I run technology partnerships at Heap (Heap.io). We are a web/product analytics platform that helps our customers collect clickstream and user data from websites/applications. We have built an integration with Shopify to pull in order events (Confirmed Order, Cancelled Order, Fulfilled Order etc.) from the Shopify APIs for analysis.
Many of our eCommerce clients like us to backfill their historical order information from Shopify. We've been hitting API rate limits for backfills and these can sometimes take weeks to complete. Is there someone we can speak with on the partner integration team to discuss a solution to this problem.
Hey @zfuld ,
In order backfill a large amount of data, I would recommend you look into using the Shopify Bulk Operations functionality in the Admin API: https://shopify.dev/tutorials/perform-bulk-operations-with-admin-api
To quote from the documentation:
With the GraphQL Admin API, you can use bulk operations to asynchronously fetch data in bulk. The API is designed to reduce complexity when dealing with pagination of large volumes of data. You can bulk query any connection field that's defined by the GraphQL Admin API schema.
Instead of manually paginating results and managing a client-side throttle, you can instead run a bulk query operation. Shopify’s infrastructure does the hard work of executing your query, and then provides you with a URL where you can download all of the data.
Hassain | Developer Support Specialist @ Shopify
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Click Accept as Solution