Google Merchant Centre - Product Pages Cannot Be Crawled

Highlighted
New Member
1 0 0

Hi,

I have been using Google Shopping now for 2 years and have never had any issues. Last night however items were being disapproved from my site for the following reasons:

Product pages cannot be crawled with a mobile user-agent due to the robots.txt restriction

Product pages cannot be crawled because of robots.txt restriction

The solution that Google have given involves adding the following to the Robots.txt file

User-agent: Googlebot
Disallow:

User-agent: Googlebot-image
Disallow:

However I cannot amend the Robots.txt file.

Would anyone have any ideas on this?

0 Likes
Highlighted
Shopify Partner
27 0 3

Your details are a bit vague so this may be off the mark but if you can't edit the file directly on your hosting platform, you should be able to download it to your local computer via FTP. Then make the edit and reupload it back to your hosting platform. I would recommend making a backup of the file before editing.

Hope that helps.

Digital Marketing Strategist
0 Likes
Highlighted
Tourist
3 0 0

Hi mate, do you find a solution to this. I am currently having the same problem. 

0 Likes