We’ve been trying to troubleshoot some issues with Google Merchant Center over the past few days (product mobile pages and desktop pages are not crawlable by Googlebot or Googlebot-Image). This problem results in products being disapproved on Google Merchant Center, and we cannot advertise our produ…

In case anyone else runs into this issue (of your website not being crawlable by Google) - this is how we solved the issue: We created the robots.txt template in our theme. We added the following code: User-agent: Googlebot Disallow: User-agent: Googlebot-image Disallow: in line with Google’s d…

If it’s just a few random products, then this is no reason for concern. As it happens to all merchants. This is caused by failed access attempts to the page. For example, bad DNS, slow website response, Google has issues, etc. If pages are not crawlable and there are only a few, just let it be, in…

It doesn’t seem to be active again after a few days. There are a consistent ~10% of our products in a disapproved state, and this is affecting a substantial amount of volume for our shopping ads campaigns. [disapproved products over time.JPG] Because it is so consistent (and such a big part of ou…

I have never seen so many issues regarding crawling issues. I then recommend you communicate with Shopify support regarding this.

Thanks Emmanuel. I have reached out to Shopify support but after 3 emails, and 2 chat conversations, all they have been able to tell me is that the robots.txt file cannot be edited (which I already knew). I’ve just sent them an email explaining the issue of product pages not being crawlable, and a…

Hello! Just a quick update about the robot.txt file that was referenced in this post. As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit you…

Hello Shopify Community, I’m reaching out for some advice regarding an issue we’re facing with our Shopify store in the Google Merchant Center. We have been notified to update our robots.txt file to allow “Googlebot” and “Googlebot-Image” access for crawling our site. However, upon reviewing our ro…

Try adding: User-agent: Googlebot Disallow: /admin/ Allow: / User-agent: Googlebot-image Disallow: /admin/ Allow: / User-agent: Storebot-Google Disallow: /admin/ Allow: /

Hello EmmanuelFlossie, Thank you for your valuable suggestion. We are keen to implement your recommendation and will inform you about the outcomes once applied.

Hello EmmanuelFlossie, We’ve received a suggestion from Google Ads to modify our robots.txt for a full-site crawl, as follows: makefile Copy code User-agent: Googlebot Disallow: User-agent: Googlebot-image Disallow: This differs from your previous advice. Your thoughts on this change would b…

Mine blocks the admin URL. If you don’t want that, then use your own version and add Storebot-Google

Google Merchant Center Support say Shopify robots.txt has wrong format

Technical Q&A

Healthunbox November 18, 2023, 4:30am 13

Thank you for your suggestion to block the admin URL. I agree with this approach for enhanced security and will also consider adding Storebot-Google as you recommended. I’ll ensure these changes are implemented promptly.

Topic		Replies	Views
Merchant Center Error - Page not crawlable due to robots.txt Start a Business seo , apps , Paid-Ads	1	75	May 31, 2024
My google ads disapproved: "Destination not working" and google ask me to edit robot.txt Shopify Discussion troubleshooting	3	113	August 27, 2024
Google Crawler Issue Shopify Discussion troubleshooting	4	170	May 8, 2025
How can I allow a full site crawl for Google Bots on my ecommerce platform? Store Design troubleshooting	2	242	December 20, 2023
merchantcenter : many produits blocked landing pages mobile&desk -Robots.txt Shopify Discussion troubleshooting	2	65	August 31, 2024

Google Merchant Center Support say Shopify robots.txt has wrong format

Related topics