Robots.txt blocking specific vendor page

Excursionist
15 0 4

Hi, I've noticed through google search console that I have an specific page is being blocked by robots.txt. I don't know why but google is showing the following URL when someone search : Lola Palacios baby

https://www.babymacshop.com/collections/vendors?q=lola+palacios ... This URL is blocked due to the robots.txt disallow: 

Disallow: /collections/*+*

I don't know why google is showing that URL, instead: https://www.babymacshop.com/collections/vendors?q=Lola Palacios or this one: https://www.babymacshop.com/collections/vendors?q=Lola%20Palacios (both are allowed by robots.txt) due hasn't got the +.

Can anyone let me know I can fix this? .. I've tried to create a redirect but google still is showing the wrong one.

Thanks in advance

 

 

0 Likes
Shopify Staff
Shopify Staff
509 0 47

Hi Fuensanta,

https://www.babymacshop.com/collections/vendors?q=lola+palacios isn't an exising URL from your store, which seems to be why its being blocked. It wouldn't exist as part of your sitemap.

I was just wondering where had you added this, was it in the URL redirect section of your admin? Was this related to a link you had on a previous website or something like that, or what led you to add this as a search option?

Anne

0 Likes
Excursionist
15 0 4

Hi Anne, 

 

Right now that URL should be this one: https://www.babymacshop.com/collections/vendors?q=Lola%20Palacios 

 

Lola Palacios is a designer and months ago most of Designers of my store was referenced with lower case: lola palacios, then in some point I changed to use uppercase the first one: Lola Palacios …but I didn’t create any URL redirect or something similar, in fact I don’t think so I can manipulate/modify the URL in relation with vendors, I mean, for collections or products you have the option to set the URL you want but not for vendors. 

 

To be honest, not sure why this is happening, not sure why the + has been added instead set %20 (which usually is used to replace the blank space) .. Other examples: 

 

https://www.babymacshop.com/collections/vendors?q=Leon%20Shoes 

 

https://www.babymacshop.com/collections/vendors?q=Rosa%20Leon 

 

 

I’ve created the following URL redirect (see default.png screenshot) .. But still google is showing the wrong one (see fault[pMkm].png screenshot). I’m worried if this issue can have any kind of penalisation from google regarding to my ranking .. I’ve seen last week my position in google is lower than usual, but I don’t know how I can fix this (obviously because we can’t modify the robots.txt, which is blocking this url (see default[PrqS.png] screenshot). 

 

Thanks for your help, I really appreciate. 

 

Best regards 

0 Likes
Excursionist
15 0 4

by the way .. just I've requested to google to remove temporarly that URL from search results and cache .. As I told you I'm a little bit worried about for this reason my ranking in gogle could not be improve it until I fix the issue, not sure how important or impact has these kind of issues.

 

Thanks

 

0 Likes
Shopify Staff
Shopify Staff
181 0 9

Hey Fuensanta,

Nicholas here, a Shopify Guru.

The URL in question above isn't being indexed becasue it is a return URL for a search query, as such it is not a page on your site or sitemap :)

Hope this helps!

Cheers,

Nicholas

0 Likes
Highlighted

Search pages should not be indexed by Google because they essentially can be infinite in number and often are low-quality:

Use the robots.txt file on your web server to manage your crawling budget by preventing crawling of infinite spaces such as search result pages. Keep your robots.txt file up to date. Learn how to manage crawling with the robots.txt file. Test the coverage and syntax of your robots.txt file using the robots.txt testing tool

Source: https://support.google.com/webmasters/answer/35769?hl=en

Run Google Shopping ads? Get the free definitive guide to Google Shopping for Shopify (no optin required): https://www.digitaldarts.com.au/google-shopping
0 Likes