Hello There,
I am trying to fetch the Retrieves a list of customers API with pagination because I have a +13k customer list to pull.
My script does handle the 2 request/per second rate limit and also in every request a limit of 250 rows.
The script does work for small customers like 200/300 but for some reason for the +13k customer list the API return Bad Gateway(502).
Here is an example of the header retrieved from the first request. My script strips out the and uses the link provided to make the request.
https://{MYSHOP}.myshopify.com/admin/api/2022-10/customers.json?limit=250&page_info=eyJsYXN0X2lkIjo2ODEzMzYzNzMyNzgxLCJsYXN0X3ZhbHVlIjoxNjc2OTAzOTE5MDAwLCJkaXJlY3Rpb24iOiJuZXh0In0>; rel="next"My aim is to request over and over until there is no `next` link, as the pagination doc advises.
Can I have some help understanding why work for small batches a not for a larger batch of customers?
