Hi, I've noticed through google search console that I have an specific page is being blocked by robots.txt. I don't know why but google is showing the following URL when someone search : Lola Palacios baby
https://www.babymacshop.com/collections/vendors?q=lola+palacios ... This URL is blocked due to the robots.txt disallow:
I don't know why google is showing that URL, instead: https://www.babymacshop.com/collections/vendors?q=Lola Palacios or this one: https://www.babymacshop.com/collections/vendors?q=Lola%20Palacios (both are allowed by robots.txt) due hasn't got the +.
Can anyone let me know I can fix this? .. I've tried to create a redirect but google still is showing the wrong one.
Thanks in advance
https://www.babymacshop.com/collections/vendors?q=lola+palacios isn't an exising URL from your store, which seems to be why its being blocked. It wouldn't exist as part of your sitemap.
I was just wondering where had you added this, was it in the URL redirect section of your admin? Was this related to a link you had on a previous website or something like that, or what led you to add this as a search option?
Right now that URL should be this one: https://www.babymacshop.com/collections/vendors?q=Lola%20Palacios
Lola Palacios is a designer and months ago most of Designers of my store was referenced with lower case: lola palacios, then in some point I changed to use uppercase the first one: Lola Palacios …but I didn’t create any URL redirect or something similar, in fact I don’t think so I can manipulate/modify the URL in relation with vendors, I mean, for collections or products you have the option to set the URL you want but not for vendors.
To be honest, not sure why this is happening, not sure why the + has been added instead set %20 (which usually is used to replace the blank space) .. Other examples:
I’ve created the following URL redirect (see default.png screenshot) .. But still google is showing the wrong one (see fault[pMkm].png screenshot). I’m worried if this issue can have any kind of penalisation from google regarding to my ranking .. I’ve seen last week my position in google is lower than usual, but I don’t know how I can fix this (obviously because we can’t modify the robots.txt, which is blocking this url (see default[PrqS.png] screenshot).
Thanks for your help, I really appreciate.
by the way .. just I've requested to google to remove temporarly that URL from search results and cache .. As I told you I'm a little bit worried about for this reason my ranking in gogle could not be improve it until I fix the issue, not sure how important or impact has these kind of issues.
Search pages should not be indexed by Google because they essentially can be infinite in number and often are low-quality:
Use the robots.txt file on your web server to manage your crawling budget by preventing crawling of infinite spaces such as search result pages. Keep your robots.txt file up to date. Learn how to manage crawling with the robots.txt file. Test the coverage and syntax of your robots.txt file using the robots.txt testing tool