Robots disallow list of URL's in Shopify's Robots Template

Shopify Discussion
1

Wondering if someone can help guide me on how to create a list of URL’s in the Robots template that Search Console has found. I installed a #&*$# Variant app that created a bunch made up URL’s that Google has now seen.

So we have the Robots template:

# we use Shopify as our ecommerce platform
{%- comment -%}
# Caution! Please read https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt before proceeding to make changes to this file.
{% endcomment %}
{% for group in robots.default_groups %}
  {{- group.user_agent -}}

  {% for rule in group.rules %}
    {{- rule -}}
  {% endfor %}

  {%- if group.sitemap != blank -%}
    {{ group.sitemap }}
  {%- endif -%}
{% endfor %}

but where would I place a list of URL’s in the above template? I understand I’d need to add the following:

User-agent: *
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 

Just not sure where to put the list?

REALLY appreciate anyone that can offer some advice, thank you!

2

Hi,

Just replace the entries in the robots.txt with the entries in the 2nd screenshot. Although it is not advisable to change it yourself, if you are not well versed with it but still if you want to, you can do it. If you need help, you can always DM and our team will be glad to help you out.

Thanks

3

Hi thanks!

Do you mean take this;

User-agent: *
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 
Disallow: /products/my-product-url 

and replace the default code in the template?

4

Hi,

Yes, and the lines /products/my-product-url are just for reference. You need to replace them with the actual path of your store.

Please share your store url so that we can take a look at your robots.txt

Thanks