Ahrefs can't crawl our site due to millions of pages

Shopify Discussion
, ,
1

Hello, I’m encountering an issue with ahrefs where it says it can’t crawl our store since we have about 90 million pages total!

This seems a little crazy especially since we prob have less than 10k products (including all variants) and not many other unique pages.

Screen Shot 2021-09-29 at 9.06.59 PM.png
Screen Shot 2021-09-29 at 9.06.59 PM.png1770×322 36.9 KB

image (42).png
image (42).png295×133 2.86 KB

Has anyone else encountered this issue and know how to solve so that we can do a full crawl on ahrefs?

Thanks for any help!

2

Hello. Did you ever hear back about this? Did you ever get an answer? We are having the same problem.