Problems with Google indexing, sitemap and URLs

Le_Lapin_Blanc
Tourist
7 0 1

I tried to do SEO and found some issues withe my website at Gooogle Webmaster Tools. I believe my sitemap is not updated as Google indexes old non-existing pages and doesn't index plenty of current ones. I tried to resubmit my sitemap at Webmaster Tools but it didn't help

I also have done fetch as Google and it re-crowled my website, but it didn't help. Still it doesn't see my products. There are plenty of products that cant be found by URL.

http://le-lapin-blanc.com/collections/boho-dresses/products/vintage-uzbek-ikat-festival-dress

http://le-lapin-blanc.com/collections/boho-dresses/products/handmade-embroidered-silk-uzbek-robe-cha...

http://le-lapin-blanc.com/collections/boho-dresses/products/handmade-silk-uzbek-caftan-with-cotton-l...

http://le-lapin-blanc.com/collections/boho-dresses/products/vintage-handmade-uzbek-silk-multicoloure...

At least those existing 4 products randomly checked by me are not indexed by Goolge with error This URL could not be found in Google's index. I guess there are plenty more. 

Basically for example from the page Dresses and caftans  http://le-lapin-blanc.com/collections/boho-dresses

only 2 pages below are indexed. All other pages (products) have the error.

http://le-lapin-blanc.com/collections/boho-dresses/products/vintage-silk-festival-dress

http://le-lapin-blanc.com/collections/boho-dresses/products/peacock-silk-burnout-blue-velvet-fringe-...


I've checked everything, There is definitely a problem with my sitemap. As Google still index pages of products which were sold out a while ago and were deleted from product page (by me) long time ago. I guess they still appear at HTML files as google still can see them.For instance, http://le-lapin-blanc.com/products/boho-chic2 or http://le-lapin-blanc.com/products/turquoise-anklet-to-toe-ring and many more. Also, there are some weird pages like http://le-lapin-blanc.com/collections/frontpage/tutu indexed?! What are they doing there???? Or page http://le-lapin-blanc.com/collections/all?page=2 

The sitemap is very disorganised if sold out products show up and some of current products don't. 
So to sum up:
- there are problems with the sitemap as I guess its not updated and still shows old products and doesn't show new ones. I did resubmit it to Google, it didn't help!
- some pages are not indexed by Google (google say that the page doesn't exist)

What I would like:
- all my current product pages appear in Google search and being indexed
- all old non existing product pages not to be in a sitemap and therefore not indexed by Google
- have a clear sitemap
- don't have pages like  http://le-lapin-blanc.com/collections/frontpage/tutu. and other ones with "tags" indexed by Google
And the main goal is not to deal with those issues again and concentrate on business

Replies 15 (15)
Jason
Shopify Expert
10882 190 2178

Your sitemap will be up to date. Be aware that submitting an updated sitmap does not mean that what google shows is immediately changed. Google will decide when - or if - the index will be updated. Google does not have to index all your pages either. It will choose what ones it will include.

I searched for a single product and it showed in the index just fine:
"uzbek bohemian veil with embroidery"

 

What pages is Google saying that they don't exist?

If you're deleting products from the store you should really think about adding a redirect on that url.

★ I jump on these forums in my free time to help and share some insights. Not looking to be hired, and not looking for work. http://freakdesign.com.au ★
Jason
Shopify Expert
10882 190 2178

I checked the first one and it appears just fine. Probably not as high as you'd like but it's in the index..

Sidenote: Even though you've noted  a /collection url above the canonical url is pointing to the /product url. This is what appears in the index and is what what you want to happen. You don't want to include the /collection url along with the /product url since it will create a duplicate content issue. 

★ I jump on these forums in my free time to help and share some insights. Not looking to be hired, and not looking for work. http://freakdesign.com.au ★
Le_Lapin_Blanc
Tourist
7 0 1

Thank you, but we are talking about my sitemap submitted to Google now and a Google point of view from Webmaster Tool. The issue is that when I put each of four above URLs to Data Highlighter tool, Google gives me an error of non existing URLs. And at the same time it gives me pags of my sold out products which were deleted a while ago. 

So we are not talking about organic search, but Google Webmaster tool view based on sitemap submitted!

Jason
Shopify Expert
10882 190 2178

It probably won't work because the page is considered duplicate content. Run it on the main /product url instead. That always used to be an issue for the data highlighter so I'm assuming that's still the case. Not really my area of specialisation so I can't give you much more info than that. 

★ I jump on these forums in my free time to help and share some insights. Not looking to be hired, and not looking for work. http://freakdesign.com.au ★
Le_Lapin_Blanc
Tourist
7 0 1

I've tried. But the problem that sitemap doesn't read them as /product. It sees/gives only 9 products out of more than a hundend with URL /products, and some of them are non-existing ones. Sitemap is the issue!

thank you anyway

 

Jason
Shopify Expert
10882 190 2178

It's not the issue, but I'm ready to be wrong and will leave it with you from this point. 

You've got way more than 9 products in your sitemap. I count 92. All the links I tried in the sitemap resolved to valid and working urls.
You can easily check that yourself, but here's a link to the current one:

http://le-lapin-blanc.com/sitemap_products_1.xml?from=370972768&to=438295880

 

★ I jump on these forums in my free time to help and share some insights. Not looking to be hired, and not looking for work. http://freakdesign.com.au ★
Le_Lapin_Blanc
Tourist
7 0 1

great. Unfortunately for me, you see more than Google. As Google see only these products under /product. And again as I already said I'm taking about Google Webmaster Tools. Here is the screenshot of what Google sees as /products. 9 pages, one is not exisiting one. 

Maybe someone can help me 😞

Le_Lapin_Blanc
Tourist
7 0 1

here is another screenshot

Le_Lapin_Blanc
Tourist
7 0 1

oups, wrong one. Here is the second one

Natasha_Long
Tourist
28 0 1

Hi Jason

I have just been reading what you have said about having 'collections' in the URL.  I have no idea how I can remove this and perhaps thats why I am not being seen on search engines

All advise is appreciated as learning as I go along on how to program my website so that it does what its supposed too

This is one of my products: http://fabtasticflowers.com/collections/flower-headpieces/products/red-poppy-hair-clip

It would be nice if there was a way to remove the Collections section without effecting the website unless its in a good way

Thanks

 

CheshtaBose
Tourist
58 0 1

Thanks for sharing your comments. But, according to me, you need to take a look over the YouTube, where every step is well explained. So, it is the best way to get information about your query and can fix in an easier way.

http://nationkart.com/
Kghoshal
New Member
4 0 0

Thank you all for the answers. Though i have never experienced anything of this sort yet all the replies would be helpful in day to day work.

SEM_YELLOW
New Member
1 0 1

Hi there,

I am replying to this post because I have the same issues as Le Lapin Blanc:

Some pages of my website are still indexed, and even showing on page 1 of the SERP for some queries, whereas they should not if the canonicals were working:

www.flowershopflorist.nz/collections/thank-you-flowers?page=2
www.flowershopflorist.nz/collections/thank-you?page=2

The only page that should be indexed is :
www.flowershopflorist.nz/collections/thank-you-flowers
 

I have successfully submitted my Sitemap several times, no errors. I have done a Fetch as Google of my website also recently.

Can you please advise why Google is still indexing and showing those pages, and how to fix the issue?

Thanks

AAlmustafa
Shopify Partner
22 0 5

it seems this problem is still happening 5 years later. the thing with google is that it takes a long time to index a website (weeks or months) depending on website content and you'll find old urls still present because the update is just as slow. the problem with shopify website is that the products have 2 links one with example.com/products/xxporducturlxx/ the other is example.com/collections/xxcategoryxx/products/xxproducturlxx/  when browsing the website i get the collection version of the product url when clicking on a product link within an app like (bought together app) i get the normal first producturl above. this is very bad for search engines since its duplicate content and waste of traffic to the product url. can you kindly fix this ? so that only 1 version (the first version) is active and not the collections version ? i know google considers this duplicate content. the shopify robots.txt prevents collections version of product url from being indexed, but yet all browsing in the website is through this version of url which milks out the traffic.