How can I fix a test robots.txt error in my Google ad campaign?

Shopify Discussion
1

I’m in the process of setting up a Google ad campaign and after my site was crawled I received a report that many pages are blocked because of the “test robots.txt” The theme developer indicated that it is a Shopify platform problem. How can this be fixed?

1 Like
2

That would be helpful. Thanks.

1 Like
3

I must be missing something as that flow doesn’t work. I see a “preferences” in the “sales channels” section but no preferences in the settings. I looked in that preferences section and didn’t see an “enable test mode”. What am I missing?

4

This doesn’t mean anything some pages are specifically meant to NEVER be crawled, i.e. customer accounts, the cart page , etc.

the overall general category label “pages blocked” ultimately means little, it should have given you a list of which pages are blocked and that’s what matters and has to be interpreted by an expert.

Do no muck with robots.txt if you do not understand what is meant to be blocked and what isn’t.

If you insist on messing with robots.txt, you will seriously cripple your online presence if you do not know what you are doing, you have been warned.

Hire a SEO specialist who is knowledge about shopify’s url structure.

1 Like
5

Thanks for your message. It appears that my main URL and mostly collection URLs are affected as well as one actual product. I am new and not really comfortable with the coding side as that worries me so I appreciate your advice. Should I not be concerned with these URLs not be crawled?

1 Like
6

Thanks. I’ll reach out if I get to that stage.

7

I have no idea “these URLS” doesn’t actually communicate anything without the actual URLs someone would need to look at the actual URLs.

If it’s collections generally more than likely it’s just blocking tags and sort options which should never be crawled except for very specific knowledgeable reasons. i.e.

Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*

If you need me to look over the actual report details at an hourly rate email me, contact info in signature.