Hi,
I’m facing 429 - Too many request error while running the Shopiy site on any SEO tools and Google crawlers. This issue is causing many pages to not get indexed and some to be deindexed, which can affect their organic traffic and visibility on Google.
I have also created the crawler access key suggested by Shopify for this issue to be added on, but it fixes only for the SEO tools and Googgle doesnt have any custom headers.
Is there any solution to fix this error and make all the pages indexable?
Shopify has rate limits on how many requests can hit your site in a short amount of time.
Tools like Screaming Frog or Ahrefs hit your site very fast, so Shopify blocks them to protect the server.
You created the crawler access key, which is good, but you’re right. Google does NOT use custom headers, so the key doesn’t help Google at all. That’s why some pages become non-indexable or deindexed.
What you can do:
Reduce Crawl Speed in SEO Tools. This won’t fix Google, but it will stop your tools from being blocked.
Make sure your site loads fast & has no big errors. If Google hits errors too often, it slows down crawling.
Tune up: image sizes, script weight, avoid unnecessary apps, reduce redirect chains
Improve internal linking & sitemap structure. Google doesn’t crawl everything at once.
Make sure all collections/products are linked, sitemap.xml is clean and updated, and there are no broken links. This helps Google crawl smarter, not harder.
You cannot completely stop 429 errors on Google with Shopify, but you can reduce how often Google triggers them by improving performance, structure, and internal linking. The 429 errors won’t stop your site from getting indexed long-term. Google will just crawl slower until your site is easier to fetch.
