Google Indexing - Blocked / Excluding pages

cwardle
Excursionist
15 1 0

Good Morning,

I have uploaded all my sitemap etc to the Google Search console and have been trying for a while to get my pages indexed but I have over 200 products pages which are being excluded from being indexed.  I have checked and tried stuff I have found online but to no avail.

 

Can anyone advise of possible next steps to get them listed/indexed?  

www.kwerkydesigns.com

 

Thanks in advance!

Replies 13 (13)

DelightCart
Shopify Partner
1221 81 154

@cwardle May this help you. Click Here

Delight Cart - It's time to turn your visitors into loyal shoppers! 

Delight Loyalty - Increase repeat sales quickly and build lifelong customers loyalty.
cwardle
Excursionist
15 1 0

Thank you for replying, I didn't see this page before so thank you.

It seems to explain how to add pages/hide them but unless I am being dumb (very possible!) it does not explain how to check if a page is blocked/remove said block?

flareAI
Shopify Partner
2405 223 534

Hello @cwardle,

 

Nice collection.


Up to 96% of many eCommerce sites can be hidden from your customer searches on Google, according to The Tennessian. This is called the indexing problem. Before you do on-page SEO, the page has to be Found on Google (indexed). Without getting the page indexed, doesn't matter how good the on-page SEO is, if Google does not index the page, customers cannot find the page on Google Search.

 

flareAI shows you, with a Found on Google (FOG) Score how much of your Shopify store is hidden from Google searches due to lack of indexing. flareAI actively grows your store presence on Google Search. Once a product is found on Google Search it is a permanent win! Once your product is found on Google, you don't need to do a thing. Customers will keep finding your product day after day and it will start generating sales and traffic.

 

Your customers trust Google Search more than Ads. 53% of eCommerce traffic is Search, far greater than Paid Ads & Social Media combined. flareAI works every day for you, tapping into Google Search and 20+ of world's best & biggest free sales channels.


Hope this was helpful and wish you the best with your store.


Gina
Add flareAI Shopify App today!

flareAI : Get Sales from Google Search, on Autopilot
$10+ billion in eCommerce on Google Search, every day. Find out how much you are missing
Mad_Modeler
Pathfinder
183 2 33

All well and good, but this doesn't solve the problem that he and I are having with Google not indexing pages

Mad_Modeler
Pathfinder
183 2 33

I am having this exact same problem, since January 29th 2022, Google has stopped indexing my pages and products, I have over 2600 excluded, and there is no solution that I can find.

From going to various groups on Facebook, this is widespread, but when you contact Shopify help, they just refer you back to Google.

I've even tried manually indexing five pages, but still not result, the problem has to lie in the robots.txt file

cwardle
Excursionist
15 1 0

Oh no, this doesn't fill me with confidence.  Any one from Shopify reading this?

Mad_Modeler
Pathfinder
183 2 33

This is really weird, but I actually managed to get to speak to Google about this, (I know, I'm buying a lottery ticket this week).

The issue is with how Shopify structures its data and URL tree.

Long story short, it takes a lot longer for the Google bots to index a Shopify site, compared to say  a Magento site, because of this.

 

What may kick-start the indexing, is to actually manually submit some excluded URL's, I've done this and after 12 hrs my indexed pages has doubled from 84 yesterday, to 175 today.

When or if it slows up on the indexing, submit more manually

Hope this helps.

***Oh and check that your site is verified in the DNS settings  Admin>Settings>Domains  then look for DNS Settings at the top of the page***

soleseriouss
Trailblazer
316 10 39

There is indexing issue, most of the website owners facing the same.


But those 200 pages which are not indexed, what error is Google Search Console giving?

 

Exclude but Currently not indexed

Crawled - currently not indexed

 

or what else?

Online Sneaker Store - Soleseriouss
Mad_Modeler
Pathfinder
183 2 33

No errors on most URL's, just excluded

cwardle
Excursionist
15 1 0

Mine are:

The ones blocked by Robot.txt I am fine with, its the 200 pages that is the issue as these are my product pages etc.

p.s thanks for the reply!

CaptureIndex.JPG

Mad_Modeler
Pathfinder
183 2 33

I know it's no consolation to you, but I have 2600 products on the exclusion list.

Yesterday my indexed pages went up to 178, today it's gone down to 84 again.

I don't have a clue what's going on

Mad_Modeler
Pathfinder
183 2 33

 If you have an App that autohides out of stock products, you may want to try to disabling it.

The one I had produces a 404 error on hidden products, 404  errors means Google will blacklist your site, which means it wont index ANY URLS.

 

I disabled one such app I have, then I resubmitted my sitemap, the number of pages indexed nas doubled in 12hrs.

soleseriouss
Trailblazer
316 10 39

@Mad_Modeler 
Those 200 URLs are under Crawled - currently not indexed!

So there is nothing we can do to index them quickly! It will take time to index. All you can do is resubmit the sitemap and request those pages to reindex!

Online Sneaker Store - Soleseriouss