robot.txt error

Highlighted
New Member
3 0 0

Hi I have this msg showing in google webmaster can anyone please assist

 

Crawl postponed because robots.txt was inaccessible. More info.

 

Thanks

paul

0 Likes
Highlighted
Shopify Expert
240 0 38

The robots.txt file tells Google what it is alowed to crawl. If Google can't access it, then it will stop crawling as it does not know what not to crawl.

It looks fine to me now, so I presume it was a temporary issue. 

Google should check it again soon, see it is fine, and contine on its merry crawling.

 

 

Technical SEO Consultant - Specialising in setting up Structured Data for Rich Snippets, Google Analytics for advanced reports and the Google Search Console for efficient crawling.
0 Likes
Highlighted
Shopify Expert
9933 106 1766

Hey Paul,

Is it possible your storefront was locked at the time the crawl happened? That could explain the inaccessible robots file.

Looks like there's no lock on the store at the moment so I am able to see your sitemap without issue.

★ Winning Partner of the Build a Business competition. ★ http://freakdesign.com.au
0 Likes
Highlighted
New Member
3 0 0

hi Tony/Jason,

 

Thank you for replying to my topic. I will wait a week or two to see the crawl

 

thanks

paul

0 Likes