How to resolve Cloudflare errors for seamless search engine crawling?

[juliac10]

Hi! I'm work at a search engine and me and my team are having some trouble crawling shopify stores because of Clloudflare errors. There's anyway that we can get some kind of autorization? Thanks!

[Jason]

What sort of problems and errors?

[JuliaC101]

I'm so sorry for the huge delay! our crawlers don't find all the products on Shopify stores because of 403 error and no one knows how to whitelist our crawlers for these stores. We sometimes have this cloudflare issue with stores from other platforms and we managed to fix it together with the team at these other stores