Google Crawler Issue

Topic summary

A Shopify store owner is experiencing critical Google crawling issues preventing product approval in Google Merchant Center and blocking Google Ads campaigns.

Core Problem:

  • Google Search Console reports “Failed: Robots.txt unreachable”
  • Sitemaps cannot be fetched or indexed
  • Issues began approximately 6-7 days ago after the site was functioning normally
  • Site is verified in Google Search Console

Support Loop:
Shopify support redirects to Google Search Console, which redirects to Google Merchant Center, creating a frustrating cycle without resolution.

Suggested Solution:

  • Use a dedicated Shopify app for product feeds instead of web crawlers
  • Verify robots.txt contains proper directives allowing Googlebot, Googlebot-image, and Storebot-Google access while blocking only /admin/

Status: Unresolved. The discussion remains open with no confirmed fix, and another user has asked if the issue was solved.

Summarized with AI on October 28. AI used: claude-sonnet-4-5-20250929.

My domain name is zonesyrups.com.

Since the last week, google search console is not able to crawl my website due to which my google merchant center shows that my products are not approved, and I cannot run any google ads.

Google Search Console shows “Failed: Robots.txt unreachable” and similarly sitemaps cannot be indexed. Please suggest what should be done?

Attaching some screenshots for reference

I’m neither able to submit my sitemap, status shows “could not fetch”, similarly I’m not able to submit / live test robots.txt, error shows “Failed: Robots.txt unreachable” . What do I do resolve it?

My site is already GSC verified, store was running perfectly fine just about 6-7 days ago.

How do I resolve it since shopify support tells me to reach out to GSC support, GSC support redirects me to GMC.

I am not able to send you a DM.

Sounds like you are using a webcrawler to import products into Google Merchant Center? If so I would not use this and instead use an app to submit products. For example for my clients I use: https://apps.shopify.com/multiple-google-shopping-feeds

Regarding robots.txt you should have:

User-agent: Googlebot
Disallow: /admin/
Allow: /
User-agent: Googlebot-image
Disallow: /admin/
Allow: /
User-agent: Storebot-Google
Disallow: /admin/
Allow: /

Were you able to solve this issue?