Have your say in Community Polls: What was/is your greatest motivation to start your own business?

Re: Exclude product variants from crawling

How can I prevent Google from crawling product variants?

SebboJ
Tourist
13 0 3

Hi,

we are using clothes in our shop system with sizes and colors. So we get a lot of product combinations but do not want all inside Google. So how to handle that? Using robots.txt.liquid and add each single product line with disallow? Thats a lot. Is there another way by disable collections or something?

Replies 4 (4)

Ritu-N
Shopify Partner
11 1 0

Hey Sebboj, 

Try this, 

{% if handle contains 'page-handle-you-want-to-exclude' %}
<meta name="robots" content="noindex">
{% endif %}

Thanks,

Ritu

 

SebboJ
Tourist
13 0 3

I am not sure if i have explained it correctly.

Each product combination like

pants-red-xl

pants-red-l
pants-red-m

pants-blue-xl

pants-blue-l

pants-blue-m

 

...creates a full product url. Each of this created combination url is crawled by Google and kills our Ads budget for this reason i need to exclude those link combinations and allow only one of those product links.

With your code suggestion - as far as i understand it - i need to create it for each link and add it to the theme.liquid .. right? But this will blow up the code. There must be a rule to exclude this from the sitemap or block it in the robots.txt .... i can do this manually but searching for a global solution

 

 

 

 

alexeo
Visitor
1 0 0

Why are your variants not accessible via ?variant=123456789?

 

If so, you can block it via robots.txt. (after noindexing)

 

Guide: https://logeix.com/shopify-seo/robots-txt

 

Can you post the complete url path here without the domain. I may be able to find a solution.

evaracorreas
Shopify Partner
2 0 0

I have the exact same problem... any help here?