All things Shopify and commerce
We're moving the community! Starting July 7, the current community will be read-only for approx. 2 weeks. You can browse content, but posting will be temporarily unavailable. Learn more
Wondering if someone can help guide me on how to create a list of URL's in the Robots template that Search Console has found. I installed a #&*$# Variant app that created a bunch made up URL's that Google has now seen.
So we have the Robots template:
# we use Shopify as our ecommerce platform
{%- comment -%}
# Caution! Please read https://help.shopify.com/en/manual/promoting-marketing/seo/editing-robots-txt before proceeding to make changes to this file.
{% endcomment %}
{% for group in robots.default_groups %}
{{- group.user_agent -}}
{% for rule in group.rules %}
{{- rule -}}
{% endfor %}
{%- if group.sitemap != blank -%}
{{ group.sitemap }}
{%- endif -%}
{% endfor %}
but where would I place a list of URL's in the above template? I understand I'd need to add the following:
User-agent: * Disallow: /products/my-product-url
Disallow: /products/my-product-url
Disallow: /products/my-product-url
Disallow: /products/my-product-url
Just not sure where to put the list?
REALLY appreciate anyone that can offer some advice, thank you!
Hi,
Just replace the entries in the robots.txt with the entries in the 2nd screenshot. Although it is not advisable to change it yourself, if you are not well versed with it but still if you want to, you can do it. If you need help, you can always DM and our team will be glad to help you out.
Thanks
Hi thanks!
Do you mean take this;
User-agent: * Disallow: /products/my-product-url
Disallow: /products/my-product-url
Disallow: /products/my-product-url
Disallow: /products/my-product-url
and replace the default code in the template?
Hi,
Yes, and the lines /products/my-product-url are just for reference. You need to replace them with the actual path of your store.
Please share your store url so that we can take a look at your robots.txt
Thanks