Google Search Console - Excluded Discovered – currently not indexed

Solved
talzy
Tourist
11 0 2

Hi All,

 

New to the forum, pardon me if the question was asked by others in the past, but the search did not give much of an answer to my problem.

 

I am new to shopify, I have added 400+ products to the store, and uploaded the sitemap to google search console for indexing. 

 

Its been a couple of weeks, my listings aren't crawled by google, I have found the following on the search console "Excluded Discovered – currently not indexed"

 

2019-07-17 14_26_10-Coverage.png

 

I am not sure if the issue is with google or shopify. I have also resubmitted the sitemap to no avail.

 

Appreciate if someone can assist me with this.


Thanks.

 

Talzy

Accepted Solution (1)

Accepted Solutions
Alexandru_Derev
Shopify Partner
86 3 22

This is an accepted solution.

Hi @talzy 

 

oh no, don't remove the entire div, just the following attributes from it:

 

itemscope itemtype="http://schema.org/Product" 

so it would look like

<div class="product-scope container type_{{ section.settings.product_view_type }}">

Item related attributes is the markup that confuses the google bot, as to the structured data.

 

 

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog

View solution in original post

Replies 42 (42)
Alexandru_Derev
Shopify Partner
86 3 22

Hey @talzy 

 

Can you please give us a link to the store? 

 

Your product pages might have a NOINDEX meta tag. 

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
Alexandru_Derev
Shopify Partner
86 3 22

Hi @talzy 

 

yeah, the NOINDEX meta tag is not the problem. 

 

Try requesting indexing explicitly from the Google Search Console under URL Inspection - "Request Indexing".

 

Here is a thread on Google Support that seems to have the same issue - https://support.google.com/webmasters/thread/4742165?hl=en, take a look. 

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
talzy
Tourist
11 0 2

@Alexandru_Derev , requested indexing via URL inspection to no avail, will check on the google forums as well.

Alexandru_Derev
Shopify Partner
86 3 22

@talzy 

 

Indexing will not be done instantaneously.

Google schedules your site for indexing and will inform you when it is done. 

It sometimes can take several days or even a few weeks.

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
talzy
Tourist
11 0 2

Thanks @Alexandru_Derev 

 

A bit more information, When I goto Live test I get the following error.


WhatsApp Image 2019-07-17 at 22.39.48.jpeg

Alexandru_Derev
Shopify Partner
86 3 22

Hi @talzy 

 

sorry for the way too delayed reply.

 

In the Google Search Console, when you go to Enhancements -> Products -> 'Either offers, review or aggregateRating should be specified' and select on of the Product Details page to the right there should be a section with the offending HTML snippet. 

 

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
talzy
Tourist
11 0 2

Hi @Alexandru_Derev ,

 

Please find the code below. I only see 27 of the products here with errors.  However, under coverage I see 462 excluded pages which are not crawled/indexed. 

 

Thanks

 

https://file.io/udyNFm

 

2019-08-08 21_56_40-Coverage.png

 

 

 

Integrity-Com
Shopify Partner
29 0 11

Hi there,

 

You'll find that most Shopify stores have a similar number. These are the pages that are blocked by default in the .robots.txt file. You'll find more information  about the standard robots.txt file in he article below. Unfortunately you can't access the robots.txt file, it's one of Shopify's biggest technical SEO flaws. Google is however starting to index 'blocked' pages if they deem them relevant to to search queries.

 

https://www.integritysearch.co.uk/blog/5-major-technical-seo-issues-with-shopify/

 

Hope this helps!

Integrity Search & Integrity Commerce® - the ONLY themes in the world fully optimized filter/tag pages. The most technically advanced Shopify themes for SEO.
Integrity-Com
Shopify Partner
29 0 11

Your product pages that are not indexed  can be seen as an example here:

https://community.shopify.com/c/Ecommerce-Marketing/Google-Search-Console-Excluded-Discovered-curren...

 

Got to your GSC and request indexing for your products - this will speed up them being indexed. Time consuming but it helps.

 

 

Integrity Search & Integrity Commerce® - the ONLY themes in the world fully optimized filter/tag pages. The most technically advanced Shopify themes for SEO.
Alexandru_Derev
Shopify Partner
86 3 22

Hi @talzy ,

 

in the example you've attached you have the following code :

 

<div itemscope="" itemtype="http://schema.org/Product" class="product-scope container type_carousel">
	<meta itemprop="url" content="https://toyroo.com.au/products/marvel-avengers-titan-hero-series-hulkbuster-12-inch-action-figure-hasbro">
	<meta itemprop="image" content="//cdn.shopify.com/s/files/1/0098/9881/9650/products/57_9b57ec41-72cb-42a3-992c-a3e2436c752d_grande.jpg?v=1561624338">
...
	</div>

This is likely related to the way the product details template in the theme you are using is built.

You need to remove the "itemscope","itemtype","itemprop" properties from the code in order to get rid of the Google Search Console error. 

 

You are already defining proper structured data for Google here :

 

<script type="application/ld+json">{"@context": "https://schema.org","@id": "https://toyroo.com.au/products/marvel-avengers-titan-hero-series-hulkbuster-12-inch-action-figure-hasbro#product","@type": "Product","brand": {"@type": "Brand","name": "Hasbro"},"sku": "132745251773","mpn": "630509423170","description": "\n\n\nMarvel Avengers TITAN Hero Series Hulkbuster 12 Inch Action Figure Hasbro\n&nbsp;\n\n&nbsp;\n\n\n\n\n\n\n\nClassic Marvel Titan Hero12-inch action figures with 5-point articulationCreate Titan-sized action figure battlesAction figure size: 12 inchesIncludes figure.\n\n\n","url": "https://toyroo.com.au/products/marvel-avengers-titan-hero-series-hulkbuster-12-inch-action-figure-hasbro","name": "Marvel Avengers TITAN Hero Series Hulkbuster 12 Inch Action Figure Hasbro","image": "https://cdn.shopify.com/s/files/1/0098/9881/9650/products/57_9b57ec41-72cb-42a3-992c-a3e2436c752d_small.jpg?v=1561624338","itemCondition": "http://schema.org/NewCondition","offers": [{"@type": "Offer","price": "29.00","priceCurrency": "AUD","itemCondition": "http://schema.org/NewCondition","url": "https://toyroo.com.au/products/marvel-avengers-titan-hero-series-hulkbuster-12-inch-action-figure-hasbro?variant=15926028238914","sku": "132745251773","mpn": "630509423170","availability": "http://schema.org/InStock","priceValidUntil": "2019-08-15","gtin12": "630509423170"}]}</script>

Let me know if this helps with the error.

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
talzy
Tourist
11 0 2

@Integrity-Com I have tried to index about 10 pages manually, to no avail, they are still seen in the excluded list. (it was only done 2 days ago), might wait for another day or two to see how its tracking.

talzy
Tourist
11 0 2

@Alexandru_Derev  Thank you, let me give it a try now.

Integrity-Com
Shopify Partner
29 0 11

Couldn't see any issue in the structured data testing tool:

 

https://search.google.com/structured-data/testing-tool/u/0/#url=https%3A%2F%2Ftoyroo.com.au%2Fproduc...

 

Try a bit of internal linkinig to your pages to help Google crawl them quicker. If it's a new site it could take a few weeks. Your site only has a domain authority of 1 so this is probably the main reason why.

Integrity Search & Integrity Commerce® - the ONLY themes in the world fully optimized filter/tag pages. The most technically advanced Shopify themes for SEO.
talzy
Tourist
11 0 2

@Integrity-Com the structured data testing tool doesn't show any errors, just warnings, I have been told the source of truth is the Search console.

 

Looks like removing the following lines have done the trick, will let you all know in the next few days how I go. Thanks @Alexandru_Derev 

 

<div itemscope itemtype="http://schema.org/Product" class="product-scope container type_{{ section.settings.product_view_type }}">
 <meta itemprop="url" content="{{ shop.url }}{{ product.url }}" />
 <meta itemprop="image" content="{{ product.featured_image.src | product_img_url: 'grande' }}" />

 

talzy
Tourist
11 0 2

@Alexandru_Derev 

 

Removing the line 

<div itemscope itemtype="http://schema.org/Product" class="product-scope container type_{{ section.settings.product_view_type }}">

has caused the images in my product listing to go out of order, but it has stopped the errors when testing the page from search console.

 

Looks like we've narrowed down the problem, but still not 100% as now the images are all over the page.  See example below.

 

https://toyroo.com.au/collections/ben-10/products/ben-10-deluxe-omnitrix-100-alien-phrases-motion-ac...

 

Any thoughts?

Alexandru_Derev
Shopify Partner
86 3 22

This is an accepted solution.

Hi @talzy 

 

oh no, don't remove the entire div, just the following attributes from it:

 

itemscope itemtype="http://schema.org/Product" 

so it would look like

<div class="product-scope container type_{{ section.settings.product_view_type }}">

Item related attributes is the markup that confuses the google bot, as to the structured data.

 

 

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog
talzy
Tourist
11 0 2

@Alexandru_Derev 

 

Thanks for the prompt reply, one more question, do I remove the following codes as well? 

 

<meta itemprop="url" content="{{ shop.url }}{{ product.url }}" />
 <meta itemprop="image" content="{{ product.featured_image.src | product_img_url: 'grande' }}" />
Appreciate your help.
 
Alexandru_Derev
Shopify Partner
86 3 22

@talzy 

 

Yes, delete these.

Alex Dereveanco | CMO @ visely.io
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution!
- To learn more about the awesome stuff we do head over to visely.io or our blog