robot.txt error

PAULO_RIBEIRO1
New Member
3 0 0

Hi I have this msg showing in google webmaster can anyone please assist

 

Crawl postponed because robots.txt was inaccessible. More info.

 

Thanks

paul

0 Likes
Tony_McCreath
Shopify Expert
240 0 38

The robots.txt file tells Google what it is alowed to crawl. If Google can't access it, then it will stop crawling as it does not know what not to crawl.

It looks fine to me now, so I presume it was a temporary issue. 

Google should check it again soon, see it is fine, and contine on its merry crawling.

 

 

Technical SEO Consultant - Specialising in setting up Structured Data for Rich Snippets, Google Analytics for advanced reports and the Google Search Console for efficient crawling.
0 Likes
Jason
Shopify Expert
10254 142 1940

Hey Paul,

Is it possible your storefront was locked at the time the crawl happened? That could explain the inaccessible robots file.

Looks like there's no lock on the store at the moment so I am able to see your sitemap without issue.

I jump on these forums to help and share some insights. Not looking to be hired, and not looking for work.

Don't hand out staff invites or give admin password to forum members unless absolutely needed. In most cases the help you need can be handled without that.


★ http://freakdesign.com.au ★
0 Likes
PAULO_RIBEIRO1
New Member
3 0 0

hi Tony/Jason,

 

Thank you for replying to my topic. I will wait a week or two to see the crawl

 

thanks

paul

0 Likes