hi @sd ,
I’ve run another set of tests where we don’t create 1 big request for the entire date range but split it up into multiple requests, one for each day. We then burst these requests with an initial 30 at once and then move to 3 per second to run through all the dates (and later all the next pages for some of the dates). This to make sure we stay under the API Limit (I think we could do 80/4 on this site if needed).
However: we face a similar problem here, the response on a single request can take up to 4.7 minutes, and 1% results in a number of 500 internal server errors. Have you been able to pinpoint the cause of slow responses from my earlier posts or is there someone else withing the Shopify team we can talk to?
PS. Running the same batch of requests shortly after the previous set results in much faster load times with the longest request taking 31.09s (are we hitting your cache here?)