Google Indexing - Blocked / Excluding pages

[cwardle]

Good Morning,

I have uploaded all my sitemap etc to the Google Search console and have been trying for a while to get my pages indexed but I have over 200 products pages which are being excluded from being indexed.  I have checked and tried stuff I have found online but to no avail.

Can anyone advise of possible next steps to get them listed/indexed?  

www.kwerkydesigns.com

Thanks in advance!

[DelightCart]

@cwardle May this help you. Click Here

[cwardle]

Thank you for replying, I didn't see this page before so thank you.

It seems to explain how to add pages/hide them but unless I am being dumb (very possible!) it does not explain how to check if a page is blocked/remove said block?

[flareAI]

Hello @cwardle,

Nice collection.

Up to 96% of many eCommerce sites can be hidden from your customer searches on Google, according to The Tennessian. This is called the indexing problem. Before you do on-page SEO, the page has to be Found on Google (indexed). Without getting the page indexed, doesn't matter how good the on-page SEO is, if Google does not index the page, customers cannot find the page on Google Search.

flareAI shows you, with a Found on Google (FOG) Score how much of your Shopify store is hidden from Google searches due to lack of indexing. flareAI actively grows your store presence on Google Search. Once a product is found on Google Search it is a permanent win! Once your product is found on Google, you don't need to do a thing. Customers will keep finding your product day after day and it will start generating sales and traffic.

Your customers trust Google Search more than Ads. 53% of eCommerce traffic is Search, far greater than Paid Ads & Social Media combined. flareAI works every day for you, tapping into Google Search and 20+ of world's best & biggest free sales channels.

Hope this was helpful and wish you the best with your store.

Gina
Add flareAI Shopify App today!

[Mad_Modeler]

All well and good, but this doesn't solve the problem that he and I are having with Google not indexing pages

[Mad_Modeler]

I am having this exact same problem, since January 29th 2022, Google has stopped indexing my pages and products, I have over 2600 excluded, and there is no solution that I can find.

From going to various groups on Facebook, this is widespread, but when you contact Shopify help, they just refer you back to Google.

I've even tried manually indexing five pages, but still not result, the problem has to lie in the robots.txt file

[cwardle]

Oh no, this doesn't fill me with confidence.  Any one from Shopify reading this?

[Mad_Modeler]

This is really weird, but I actually managed to get to speak to Google about this, (I know, I'm buying a lottery ticket this week).

The issue is with how Shopify structures its data and URL tree.

Long story short, it takes a lot longer for the Google bots to index a Shopify site, compared to say  a Magento site, because of this.

What may kick-start the indexing, is to actually manually submit some excluded URL's, I've done this and after 12 hrs my indexed pages has doubled from 84 yesterday, to 175 today.

When or if it slows up on the indexing, submit more manually

Hope this helps.

***Oh and check that your site is verified in the DNS settings  Admin>Settings>Domains  then look for DNS Settings at the top of the page***

[soleseriouss]

There is indexing issue, most of the website owners facing the same.

But those 200 pages which are not indexed, what error is Google Search Console giving?

Exclude but Currently not indexed

Crawled - currently not indexed

or what else?

[Mad_Modeler]

No errors on most URL's, just excluded

[cwardle]

Mine are:

The ones blocked by Robot.txt I am fine with, its the 200 pages that is the issue as these are my product pages etc.

p.s thanks for the reply!

[Mad_Modeler]

I know it's no consolation to you, but I have 2600 products on the exclusion list.

Yesterday my indexed pages went up to 178, today it's gone down to 84 again.

I don't have a clue what's going on

[Mad_Modeler]

 If you have an App that autohides out of stock products, you may want to try to disabling it.

The one I had produces a 404 error on hidden products, 404  errors means Google will blacklist your site, which means it wont index ANY URLS.

I disabled one such app I have, then I resubmitted my sitemap, the number of pages indexed nas doubled in 12hrs.

[soleseriouss]

@Mad_Modeler 
Those 200 URLs are under Crawled - currently not indexed!

So there is nothing we can do to index them quickly! It will take time to index. All you can do is resubmit the sitemap and request those pages to reindex!