Our Partner & Developer boards on the community are moving to a brand new home: the .dev community forums! While you can still access past discussions here, for all your future app and storefront building questions, head over to the new forums.

[Storefront API] How to process large datasets - Timeouts

[Storefront API] How to process large datasets - Timeouts

JCDY
New Member
5 0 0

I asked a previous question on Timeouts and one way I was able to reduce them was to ask for fewer transformations on the images for each product. But I have a dataset that has around 10K products that I'm accessing through the Storefront API. I'm using the cursor to fetch them, but I still get timeouts and I can't ever go through the whole dataset. What is the recommended way of going through a lot of products? Is it even possible to fetch that much data through the Storefront API and what would be the reasons for the timeouts?

Replies 2 (2)

SBD_
Shopify Staff
1831 273 423

Are you still experiencing timeouts? If so, can you please share the X-Request-Id response header?

Scott | Developer Advocate @ Shopify 

JCDY
New Member
5 0 0

No more timeouts, I reduced the limits to 100. I'm getting better results that way. Thanks