SEO, AdWords, affiliates, advertising, and promotions
I've searched the forums and can't see a solution to this particular indexing issue:
We've been working on SEO and were ranking top 4 out of 5 of our core keywords.
Last week core collections and some products that were ranking extremely well have now dropped from Googles index.
Search console informs that robot.txt is blocking these pages (we're aware that we have no access to Shopify robots.txt)
A google search on the offending URL's comes back with:
I’m having the same problem and really need a solution!
Hi,
I am facing the same error on my site can you please also tell me the solution for google indexing errors?
Thank you
Nick
Hii,
I have checked issues first I would ask you your site URL so that I can check what is exact issues and for now just have a question that how you are checking that your page is not ranking if you do not have access because without access you can not check.plzz clear it to me.
Thanks
Hi Astha,
Thanks for your help. Here is a screenshot of my issue: No information is available for this page.
Have you tried to recrawl it in Google Search Console? Your robots.txt are fine.
Smeelah -
The Shopify robots.txt file is setup correctly, so you need to request Google to recrawl your domain. First, login to Google Search Condole (GSC). If you have not verified your domain with GSC - here are instructions how to setup in Shopify.
Once your site is verified, click URL Inspection in the left menu. Enter your domain name and Google will respond telling you the index status. Click the Request Indexing button and Google will put your site in queue to crawl. Since you robots.txt file is not blocking Google, within a couple days this message should go away and Google will start crawling your site again. You can check your index coverage by clicking on Coverage to see what Google has crawled but is blocking based on the robots file.
Hope that helps...
Thanks so much for both the answers and instructions. I've added my site and it is queued for a crawl:)
The issue actually remains and worse. Google indexed my site (I added the 4 options: https,http,http-www,https-www). Then I realized that my sitemap was way out of date and submitted that. But my home page is still showing:
Previously Google was highlighting one of my most popular items below my unindexed home page and now it is highlighting one of the most niche items. Hopefully it's super-personalized.
Anyway, it's really hard for me to understand why some of the best pages are excluded, why a password protected page is one of the few that are indexed and the product page of my new google ad is showing as blocked by robots.txt
Very frustrating that I cannot create my own sitemap or unblock my pages.
Everything looks good in your robots.txt and sitemaps. Google may still be updating. I'd be happy to look at GSC for you to see if anything else looks off or if the reports are more telling. If so, you can add steve [at] promoprep.com
Mobile test shows errors when crawling:
Pulno shows no unique content on your homepage:
https://www.pulno.com/shared/7e2bfd2e6c202f22
You have a lot of javascript.
Try to run a mobile test yourself and see if it works
Yes, I suppose I do. I recently cleaned up my theme of old apps and then I guess I filled the vacuum with new bells and whistles;)
I was unable to get that mobile test to work after disabling some stuff but I reverted to my previous theme version and it worked. I unwisely made a few tweaks since this latest theme version but I should be able to retrace my steps.
Thank you Jacek, that was super helpful. It's great to find that there is an actual problem that I can solve. And I'm learning a lot!
I've actually not been able to get the mobile test to work again, even when reverting to a brand new theme so perhaps it is app related or the there is some time delay on the test having access to theme changes.
Anyway, between the Pulno test and a Pingdom test I did this morning, I have a lot of info and lots of problems to work with;)
I did try to remove an app that was indicated as having a redirect issue when I was able to get the mobile test to work. Doing so removed all the body and header content from my website. Not sure if that is related to the Pulno test saying that I do not have unique content. I'm trying to sort that with the app developer.
Still not able to get the google tests to work but I now have a BIG CLUE. I tested my url at technicalseo.com and got a more informative error:
https://leilacools.com/ is redirecting to https://leilacools.com/cart/update which is blocked by robots.txt
However, I cannot find his redirect. I checked navigation section in admin, my hosts cpanel, theme code, and the easy redirect app.
Smeelah -
This might be a good find. When I ran this tool I am seeing a javascript redirect. The only thing I could see in the code was the reference to the easy redirect app. https://easy-redirects.s3-eu-west-1.amazonaws.com/redirect-app.js?shop=leilacools.myshopify.com
You could try turning this app off and rerunning this test to see if the redirect clears.
Smeelah -
Another thing I noticed which might be causing issues... Mail Munch has a noindex tag on it, which is showing up in your source code. Although it is in an iframe, it is possible this is being crawled and read to remove the page from the index. If turning off the redirect plugin does not work, I would look at turning off Mail Munch to see if that helps.
Wow. I searched for noindex. I missed that. Thank you! Amazing how many moving parts there are.
I removed the redirect app and no joy but I'm happy to have done that anyway. Thank you. I hadn't been on top of that.
Also, one of the issue was that the Google error message is completely vague but I was able to get a more useful error from technicalseo.com which says my home page is redirecting to /cart/update which is blocking robots and I found code on my site from a currency switcher which includes: <form method="post" action="/cart/update" (oh I see that on the screenshot of the previous post) I'm waiting to hear back from the app.
Also, by following your lead and inspecting the page elements (I had previously just looked at page source and theme code), I see another hit for /cart/update related to another app. A free one that I like but once uninstalled and reinstalled, incurs a monthly charge. But it creates a lot of code all over my site;) and may have to go.
Hi Smeelah -
Looks like the home page is being indexed properly now!
Ha ha. I knew the blocking was gone but it hasn't occurred to me to check my listing on the search page.
So, it was the currency switcher. But it took a little convincing;) First they had me convinced that it wasn't the switcher and I went on to the next app that I was now convinced was the problem but they also said it was the switcher and provided me with the details that I could show the switcher developer.
I don't know if the switcher will be fixed and I am currently without multiple currency capability but I am now indexed! That feels great.
Thanks for all your help and also to Fera for some stellar customer service helping me figure out a problem that they did not cause:)
User | RANK |
---|---|
6 | |
6 | |
5 | |
5 | |
5 |
Connect your PayPal account to allow your customers to checkout using the PayPal gateway a...
ByYour online store speed can enhance your store’s discoverability, boost conversion rates a...
ByShopping is at our fingertips with mobile devices. Is your theme optimized to be user-frie...
By