Why is my vendors page still indexed despite using noindex meta tag?

gagah98
Visitor
3 0 0

Hello,

 

I'm having an issue with my vendors page that is still Indexed.

 

I followed the shopify instructions to hide a page from search engine. I can see now my page has the meta tag  :<meta name="robots" content="noindex">. It's been 3 weeks but the page is still indexed...

After that, I edited the robot.txt.liquid in my theme file and add this code :

{% for group in robots.default_groups %}
  {{- group.user_agent -}}

  {% for rule in group.rules %}
    {{- rule -}}
  {% endfor %}

 {%- if group.user_agent.value == '*' -%}
    {{ 'Disallow: /*?q=*' }}
  {%- endif -%}


  {%- if group.sitemap != blank -%}
    {{ group.sitemap }}
  {%- endif -%}
{% endfor %}

 But it's still not working...

 

And even when I test my URL in Google Search Console, it's said that it's not indexed...

 

gagah98_1-1646404290549.png

 

I tried without cache and with other browsers but the page is still appearing just under the home page

gagah98_2-1646404371380.png

Do you have any idea how to resolve this problem ?

 

Thanks for your help 

Replies 4 (4)

gagah98
Visitor
3 0 0

Someone has the same problem ?

Google or Shopify changed the Meta Title with flags and I have no idea why... I searched in the code and there is no sign of flags at all...

gagah98_0-1646665898420.png

 

Lychee88
Explorer
51 1 21

I'm having the same issue but when I browsed through Google docs they claimed that the disallowed page cannot be blocked via robots.txt in order for the header tag to work.

 

https://support.google.com/webmasters/answer/7440203#indexed_though_blocked_by_robots_txt

 

Indexed, though blocked by robots.txt

The page was indexed despite being blocked by your website's robots.txt file. Google always respects robots.txt, but this doesn't necessarily prevent indexing if someone else links to your page. Google won't request and crawl the page, but we can still index it, using the information from the page that links to your blocked page. Because of the robots.txt rule, any snippet shown in Google Search results for the page will probably be very limited.

Next steps:

 

 

frankymartin
Shopify Partner
30 0 17

Hi, I have the same problem. I had in theme.liquid:

 

{% if template contains 'vendors' %}
<meta name="robots" content="noindex, nofollow">
{% endif %}
 
{% if handle contains 'vendors' %}
<meta name="robots" content="noindex, nofollow">
{% endif %}
 
{%- if request.path == '/collections/vendors' and collection.all_products_count == 0 -%}
<meta name="robots" content="noindex, nofollow">
{%- endif -%}
 
{% if template contains "collection" and collection.handle == "vendors" %}
<meta name="robots" content="noindex, nofollow">
{% endif %}
 
It is working in few of my shopifys but not in all of thems.
Any idea?

Ebrahim-Talebi
Visitor
1 0 0

Hi
i tried to use this code in my website
and it's work perfect.

{% if template contains "collection" and collection.handle == "vendors" %}
<meta name="robots" content="noindex, nofollow">
{% endif %}
Use noindex and dont trust to robots.txt
if you check source code of these two links it will add to vendors noindex nofollow
one of them is collection of brand and another one is vendors link
https://www.vapezilla.com/collections/spaceman
https://www.vapezilla.com/collections/vendors?q=SPACEMAN