query big shops

[Olmer]

Hi,

I have an question regarding REST API 

we have an app which create feed from products and variants by using 

GET /admin/api/2020-04/products.json

It's work very well for small shops under 1000 products despite that no option to retrieve products in several threads. It's work good one by one

In case we have more than 1000, it become very slow.

For example we have shop with ~100k products, just to get all products took around 1.5 hour.

Do you have any other option to get all products with better speed? Maybe we can increase amount of rows limit by fee (now it 250 per request). 

Any other suggestions?

Thanks

[SBD_]

Hey @Olmer 

Consider the bulk operations API.

[Olmer]

Hi @SBD_ ,

Thanks for your proposal.

Could you please elaborate why it will be quicker than REST API?

As I understand I should do paging anyway.

When I use rest api I have a loop of 400 repeats for 100000 products. How it will be different in Graph API?

[SBD_]

It may not be quicker but it would be worth testing. With the Bulk Operations API you can run an expensive job and check in on the status. This eliminates your app having to handle the pagination and you don't need to keep track of call limits.

If you do test it, please share your findings.