Google Crawler Issue

Google Crawler Issue

udit25197
Visitor
3 0 0

My domain name is zonesyrups.com. 

 

Since the last week, google search console is not able to crawl my website due to which my google merchant center shows that my products are not approved, and I cannot run any google ads. 

 

Google Search Console shows "Failed: Robots.txt unreachable" and similarly sitemaps cannot be indexed. Please suggest what should be done? 

 

Attaching some screenshots for reference

 

Replies 3 (3)
udit25197
Visitor
3 0 0

I'm neither able to submit my sitemap, status shows "could not fetch", similarly I'm not able to submit / live test robots.txt, error shows  "Failed: Robots.txt unreachable" . What do I do resolve it? 

 

My site is already GSC verified, store was running perfectly fine just about 6-7 days ago. 

 

How do I resolve it since shopify support tells me to reach out to GSC support, GSC support redirects me to GMC. 

udit25197
Visitor
3 0 0

I am not able to send you a DM.

EmmanuelFlossie
Shopify Partner
3295 246 790

Sounds like you are using a webcrawler to import products into Google Merchant Center? If so I would not use this and instead use an app to submit products. For example for my clients I use: https://apps.shopify.com/multiple-google-shopping-feeds

 

Regarding robots.txt you should have:

 

User-agent: Googlebot
Disallow: /admin/
Allow: /
User-agent: Googlebot-image
Disallow: /admin/
Allow: /
User-agent: Storebot-Google
Disallow: /admin/
Allow: /

Get in touch with Emmanuel: a Google Shopping Specialist, Google Ads Diamond Product Expert, and also a a Google Product Expert Education 2021 & Tailwind 2023 Award winner.
Need Google Merchant Center or Google Shopping support?.