Why is Google Search Console showing high number of blocks by robots.txt?

Why is Google Search Console showing high number of blocks by robots.txt?

RobMurphy
Tourist
7 0 0

Hello,

 

We have just been reviewing our Google Search Console and noticed an alarmingly high number of Blocked by robots.txt, 717,603 to be precise!! 

 

Does anyone know what could have caused this and more importantly, how we can fix it?

 

Thanks in advance for your assistance.

 

Best wishes,

Rob 

Replies 2 (2)

PaulNewton
Shopify Partner
7721 678 1626

Before assuming it even needs fixing for things like this hire an actual expert with SEO knowledge of shopify to interpret the data as good or bad 

Make sure they are 100% familiar with shopify's url structures and niches.

 

Unless you've recently damaged your robots txt pages being blocked doesn't mean anything.

There are many page & parameter combinations not intended for a crawler.

If you have a lot of products the block number goes up.

 

A large number is meaningless, beyond this the post is incredibly vague with NO examples or reasoning as to why it's something needing fixing.

 

Good Luck.

 

 

Contact paull.newton+shopifyforum@gmail.com for the solutions you need


Save time & money ,Ask Questions The Smart Way


Problem Solved? ✔Accept and Like solutions to help future merchants

Answers powered by coffee Thank Paul with a Coffee for more answers or donate to eff.org


RobMurphy
Tourist
7 0 0

Hi Paul,

 

Thanks for your reply. 

 

Here is a screen shot from our GSC account showing the Blocked by robots.txt we're referring to.

 

GSC Issues.png

 

Here are some example URLs that were in the export file.

 

https://opalretail.co.uk/collections/all?filter.p.product_type=Awnings&filter.v.option.colour=Black&...
White 

 

https://opalretail.co.uk/collections/all?filter.p.product_type=Awnings&filter.v.option.colour=Black&...
Back

 

https://opalretail.co.uk/collections/all?filter.p.product_type=Bedroom
Vanities&filter.v.option.colour=Gold&filter.v.option.colour=Brown&filter.v.option.colour=Ladybug

 

https://opalretail.co.uk/collections/all?filter.p.product_type=Hangers&filter.p.product_type=Air
Conditioners&filter.v.option.colour=Gold&filter.v.option.colour=Ivory&filter.v.option.colour=White/Black&filter.v.option.colour=Colour

 

Looking at the URL paths, it doesn't look like spam.

 

Many thanks

Rob