[Storefront API] How to process large datasets - Timeouts

JCDY
New Member
5 0 0

I asked a previous question on Timeouts and one way I was able to reduce them was to ask for fewer transformations on the images for each product. But I have a dataset that has around 10K products that I'm accessing through the Storefront API. I'm using the cursor to fetch them, but I still get timeouts and I can't ever go through the whole dataset. What is the recommended way of going through a lot of products? Is it even possible to fetch that much data through the Storefront API and what would be the reasons for the timeouts?

Replies 2 (2)

SBD_
Shopify Staff
1829 269 406

Are you still experiencing timeouts? If so, can you please share the X-Request-Id response header?

Scott | Developer Advocate @ Shopify 

JCDY
New Member
5 0 0

No more timeouts, I reduced the limits to 100. I'm getting better results that way. Thanks