Solution Required: Duplicate Content Across Vendors and Shopify Product Search Function

Nicole_Dunbar
New Member
2 0 0

Hi Guys,

I would like to know if anyone has come across some fixes for Shopify based stores when it comes to vendor URL's in Google? We are getting lot's of these URL's in google search and therefore it is creating some massive problems for our site

For eg.

http://mcleanandpage.com/collections/vendors?q=Bruuns%25252525252525252525252520Bazaar

http://mcleanandpage.com/collections/vendors?q=Dion+Lee

http://mcleanandpage.com/collections/vendors?q=Rebecca%2525252525252520Vallance

We have already applied a new canonical code which takes care of collection tags for pages such as:

http://mcleanandpage.com/collections/alexander-wang/bags

http://mcleanandpage.com/collections/alexander-wang/heels

Is there any code which can be applied in a similar fashion? Do we have to edit robots.txt? Our goal is to move these URL's out of the search results as quickly as possible. There doesn't seem to be any existing threads on this specific issue

Let me know if i can provide more information, we would especially like a response from the shopify team

Thanks and look forward to hearing responses

0 Likes
Marius_from_Sup
Shopify Partner
174 0 28

Hi Nicole,

Interesting. I see you've already put in robots.txt

Disallow: /collections/*+*

and google seems to know about it, but still showing results:

Dion Lee - McLean & Page
mcleanandpage.com/collections/vendors?q=Dion+Lee
A description for this result is not available because of this site's robots.txt – learn more.

I'm not sure that *+* is a good pattern. Could you try replacing those rules with this rule?

Disallow: /*?

And then trigger a reindex from Webmaster tools.

Streamline your shop and sell more http://www.suppleApps.com
0 Likes
Jason
Shopify Expert
10402 163 2046

 Could you try replacing those rules with this rule?

Not possible. robots.txt is auto-generated. There's existing posts on the forum about why the + syntax is used. [edited: typo]

I jump on these forums to help and share some insights. Not looking to be hired, and not looking for work.

Don't hand out staff invites or give admin password to forum members unless absolutely needed. In most cases the help you need can be handled without that.


★ http://freakdesign.com.au ★
0 Likes
Nicole_Dunbar
New Member
2 0 0

Thanks guys, are you able to recommend a possible solution then Jason?

0 Likes
Jason
Shopify Expert
10402 163 2046

are you able to recommend a possible solution then Jason?

Worth talking to shopify about. What you're seeing is a space - %20 - in the url that's been encoded a bunch of times. 

A space encoded once =  %20
encode that again = %2520
and again...= %252520 -- you get the idea, What you've got is a bunch of iterations. That does not help of course, but should explain how that url might come to be.

 

 

I jump on these forums to help and share some insights. Not looking to be hired, and not looking for work.

Don't hand out staff invites or give admin password to forum members unless absolutely needed. In most cases the help you need can be handled without that.


★ http://freakdesign.com.au ★
0 Likes
Christine_Forte
Excursionist
52 0 4

Hi.  We have noticed the *+* on our site map.  We have sub collections,   Over the last month we have seen a decline in ranking in traffic primarily generated from URL's from our sub collections.  Would this *+* prevent google from indexing these urls http://www.threehipchicks.com/collections/tech-cases/Monogram-Kindle-Folio-Cases  ?  If so is there a work around for this?  According to our webmaster tools these URL's are allowed to be indexed.  Would appreciate some help.

0 Likes
Trevor
Community Moderator
Community Moderator
2752 361 558

Hello!

As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here

Due to the age of the topic, I will be locking this thread. If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.


Trevor | Community Moderator @ Shopify 
 - Was my reply helpful? Click Like to let me know! 
 - Was your question answered? Mark it as an Accepted Solution
 - To learn more visit the Shopify Help Center or the Shopify Blog

0 Likes