FROM CACHE - en_header

Google Indexing Errors "URL is not on Google: Indexing errors" - Shopify Robots.txt

Carl11
Shopify Partner
16 0 6

I've searched the forums and can't see a solution to this particular indexing issue:

 

We've been working on SEO and were ranking top 4 out of 5 of our core keywords.

Last week core collections and some products that were ranking extremely well have now dropped from Googles index.

 

Search console informs that robot.txt is blocking these pages (we're aware that we have no access to Shopify robots.txt)

 

A google search on the offending URL's comes back with:

"No information is available for this page.
 
Checks in Search console on these live pages shows no errors
 
We're mystified - these are just standard Shopify collections
 
 

 

 

 

Replies 18 (18)
Smeelah
Navigator
292 1 79

I’m having the same problem and really need a solution!

nickjohn
New Member
1 0 0

Hi,


I am facing the same error on my site can you please also tell me the solution for google indexing errors?

 

Thank you

 

Nick

Astha
Tourist
25 0 1

Hii,

I have checked issues first I would ask you your site URL so that I can check what is exact issues and for now just have a question that how you are checking that your page is not ranking if you do not have access because without access you can not check.plzz clear it to me.

 

Thanks

MageNative | Mobile App for your Shopify Store | Native Android and iOS Apps

Digital Marketing Analyst
Skype: live:asthaupadhyay_1
E-mail: asthaupadhyay@magenative.com
Smeelah
Navigator
292 1 79

Hi Astha,

Thanks for your help. Here is a screenshot of my issue: No information is available for this page.

Screen Shot 2019-10-18 at 9.48.43 AM.png

Jacek
Excursionist
10 0 6

Have you tried to recrawl it in Google Search Console? Your robots.txt are fine.

stevelamar
Explorer
59 5 24

Smeelah -

The Shopify robots.txt file is setup correctly, so you need to request Google to recrawl your domain. First, login to Google Search Condole (GSC). If you have not verified your domain with GSC - here are instructions how to setup in Shopify. 

 

Once your site is verified, click URL Inspection in the left menu. Enter your domain name and Google will respond telling you the index status. Click the Request Indexing button and Google will put your site in queue to crawl. Since you robots.txt file is not blocking Google, within a couple days this message should go away and Google will start crawling your site again. You can check your index coverage by clicking on Coverage to see what Google has crawled but is blocking based on the robots file. 

 

Hope that helps...

 

Please click the like button if my reply was helpful 🙂
Founder of PromoPrep - Marketing Calendar Software

Find our marketing calendar app in the Shopify App Store
Smeelah
Navigator
292 1 79

Thanks so much for both the answers and instructions. I've added my site and it is queued for a crawl:)


Smeelah
Navigator
292 1 79

The issue actually remains and worse. Google indexed my site (I added the 4 options: https,http,http-www,https-www). Then I realized that my sitemap was way out of date and submitted that. But my home page is still showing:

No information is available for this page.
 

Previously Google was highlighting one of my most popular items below my unindexed home page and now it is highlighting one of the most niche items. Hopefully it's super-personalized. 

Anyway, it's really hard for me to understand why some of the best pages are excluded, why a password protected page is one of the few that are indexed and the product page of my new google ad is showing as blocked by robots.txt

 

Very frustrating that I cannot create my own sitemap or unblock my pages.

stevelamar
Explorer
59 5 24

Everything looks good in your robots.txt and sitemaps. Google may still be updating. I'd be happy to look at GSC for you to see if anything else looks off or if the reports are more telling. If so, you can add steve [at] promoprep.com 

Please click the like button if my reply was helpful 🙂
Founder of PromoPrep - Marketing Calendar Software

Find our marketing calendar app in the Shopify App Store
Jacek
Excursionist
10 0 6

Mobile test shows errors when crawling:

https://search.google.com/test/mobile-friendly?utm_source=gws&utm_medium=onebox&utm_campaign=suit&ur...

 

Pulno shows no unique content on your homepage:

https://www.pulno.com/shared/7e2bfd2e6c202f22

 

 

You have a lot of javascript.

 

Try to run a mobile test yourself and see if it works

Smeelah
Navigator
292 1 79

Yes, I suppose I do. I recently cleaned up my theme of old apps and then I guess I filled the vacuum with new bells and whistles;)

 

I was unable to get that mobile test to work after disabling some stuff but I reverted to my previous theme version and it worked. I unwisely made a few tweaks since this latest theme version but I should be able to retrace my steps. 

 

Thank you Jacek, that was super helpful. It's great to find that there is an actual problem that I can solve. And I'm learning a lot!

 

 

 

Smeelah
Navigator
292 1 79

I've actually not been able to get the mobile test to work again, even when reverting to a brand new theme so perhaps it is app related or the there is some time delay on the test having access to theme changes. 

Anyway, between the Pulno test and a Pingdom test I did this morning, I have a lot of info and lots of problems to work with;)

 

I did try to remove an app that was indicated as having a redirect issue when I was able to get the mobile test to work. Doing so removed all the body and header content from my website. Not sure if that is related to the Pulno test saying that I do not have unique content. I'm trying to sort that with the app developer. 

 

 

Smeelah
Navigator
292 1 79

Still not able to get the google tests to work but I now have a BIG CLUE. I tested my url at technicalseo.com and got a more informative error:

https://leilacools.com/ is redirecting to https://leilacools.com/cart/update which is blocked by robots.txt

 

However, I cannot find his redirect. I checked navigation section in admin, my hosts cpanel, theme code, and the easy redirect app. 

 

 

stevelamar
Explorer
59 5 24

Smeelah - 

This might be a good find. When I ran this tool I am seeing a javascript redirect. The only thing I could see in the code was the reference to the easy redirect app. https://easy-redirects.s3-eu-west-1.amazonaws.com/redirect-app.js?shop=leilacools.myshopify.com

You could try turning this app off and rerunning this test to see if the redirect clears. 

2019-11-02_1705.png

Please click the like button if my reply was helpful 🙂
Founder of PromoPrep - Marketing Calendar Software

Find our marketing calendar app in the Shopify App Store
stevelamar
Explorer
59 5 24

Smeelah -

Another thing I noticed which might be causing issues... Mail Munch has a noindex tag on it, which is showing up in your source code. Although it is in an iframe, it is possible this is being crawled and read to remove the page from the index. If turning off the redirect plugin does not work, I would look at turning off Mail Munch to see if that helps. 

 

2019-11-03_0451.png

 

Please click the like button if my reply was helpful 🙂
Founder of PromoPrep - Marketing Calendar Software

Find our marketing calendar app in the Shopify App Store
Smeelah
Navigator
292 1 79

Wow. I searched for noindex. I missed that. Thank you! Amazing how many moving parts there are. 

 

I removed the redirect app and no joy but I'm happy to have done that anyway. Thank you. I hadn't been on top of that. 

 

Also, one of the issue was that the Google error message is completely vague but I was able to get a more useful error from technicalseo.com which says my home page is redirecting to /cart/update which is blocking robots and I found code on my site from a currency switcher which includes: <form method="post" action="/cart/update" (oh I see that on the screenshot of the previous post) I'm waiting to hear back from the app. 

 

Also, by following your lead and inspecting the page elements (I had previously just looked at page source and theme code), I see another hit for /cart/update related to another app. A free one that I like but once uninstalled and reinstalled, incurs a monthly charge. But it creates a lot of code all over my site;) and may have to go. 

stevelamar
Explorer
59 5 24

Hi Smeelah -

Looks like the home page is being indexed properly now!

 

 

2019-11-06_2056.png

Please click the like button if my reply was helpful 🙂
Founder of PromoPrep - Marketing Calendar Software

Find our marketing calendar app in the Shopify App Store
Smeelah
Navigator
292 1 79

Ha ha. I knew the blocking was gone but it hasn't occurred to me to check my listing on the search page. 

 

So, it was the currency switcher. But it took a little convincing;) First they had me convinced that it wasn't the switcher and I went on to the next app that I was now convinced was the problem but they also said it was the switcher and provided me with the details that I could show the switcher developer. 

 

I don't know if the switcher will be fixed and I am currently without multiple currency capability but I am now indexed! That feels great. 

 

Thanks for all your help and also to Fera for some stellar customer service helping me figure out a problem that they did not cause:)