We're moving the community! Starting July 7, the current community will be read-only for approx. 2 weeks. You can browse content, but posting will be temporarily unavailable. Learn more

Robots disallow list of URL's in Shopify's Robots Template

Robots disallow list of URL's in Shopify's Robots Template

Shizane
Tourist
13 0 2

Wondering if someone can help guide me on how to create a list of URL's in the Robots template that Search Console has found. I installed a #&*$# Variant app that created a bunch made up URL's that Google has now seen.

 

So we have the Robots template:

 

 

 

# we use Shopify as our ecommerce platform
{%- comment -%}
# Caution! Please read https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt before proceeding to make changes to this file.
{% endcomment %}
{% for group in robots.default_groups %}
  {{- group.user_agent -}}

  {% for rule in group.rules %}
    {{- rule -}}
  {% endfor %}

  {%- if group.sitemap != blank -%}
    {{ group.sitemap }}
  {%- endif -%}
{% endfor %}

 

 

 

 

  

but where would I place a list of URL's in the above template? I understand I'd need to add the following: 

 

User-agent: *
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 

 Just not sure where to put the list?

 

REALLY appreciate anyone that can offer some advice, thank you!

Replies 3 (3)

ES1
Shopify Partner
261 25 30

Hi,

 

Just replace the entries in the robots.txt with the entries in the 2nd screenshot. Although it is not advisable to change it yourself, if you are not well versed with it but still if you want to, you can do it. If you need help, you can always DM and our team will be glad to help you out.

 

 

Thanks

If this fixed your issue, Please Like and Accept as a Solution.
Looking for assistance? Hire an experienced Shopify Partner! Visit EcommerceStorez.us today for a quick quote.
Seeking an elegant theme designed to boost conversions? Explore our High-Converting Shopify Themes today!

Shizane
Tourist
13 0 2

Hi thanks!

 

Do you mean take this;

 

User-agent: *
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 

 

and replace the default code in the template?

 

ES1
Shopify Partner
261 25 30

Hi,

 

Yes, and the lines /products/my-product-url are just for reference. You need to replace them with the actual path of your store.

 

Please share your store url so that we can take a look at your robots.txt

 

Thanks

 

If this fixed your issue, Please Like and Accept as a Solution.
Looking for assistance? Hire an experienced Shopify Partner! Visit EcommerceStorez.us today for a quick quote.
Seeking an elegant theme designed to boost conversions? Explore our High-Converting Shopify Themes today!