Exclude product variants from crawling

SebboJ
Tourist
13 0 1

Hi,

we are using clothes in our shop system with sizes and colors. So we get a lot of product combinations but do not want all inside Google. So how to handle that? Using robots.txt.liquid and add each single product line with disallow? Thats a lot. Is there another way by disable collections or something?

Replies 2 (2)

Ritu-N
Shopify Partner
11 1 0

Hey Sebboj, 

Try this, 

{% if handle contains 'page-handle-you-want-to-exclude' %}
<meta name="robots" content="noindex">
{% endif %}

Thanks,

Ritu

 

SebboJ
Tourist
13 0 1

I am not sure if i have explained it correctly.

Each product combination like

pants-red-xl

pants-red-l
pants-red-m

pants-blue-xl

pants-blue-l

pants-blue-m

 

...creates a full product url. Each of this created combination url is crawled by Google and kills our Ads budget for this reason i need to exclude those link combinations and allow only one of those product links.

With your code suggestion - as far as i understand it - i need to create it for each link and add it to the theme.liquid .. right? But this will blow up the code. There must be a rule to exclude this from the sitemap or block it in the robots.txt .... i can do this manually but searching for a global solution