I found a gap in Shopify's order publication. Shopify API devs: please note.

Excursionist
33 0 3

Hi there,

 

One of our orders was created and processed at 2019-09-13T07:29:00-04:00.

It got updated at 2019-09-13T07:29:06-04:00.

 

At 2019-09-13T11:30:32.920Z (a little under a minute and a half later) we submit an hourly request for orders to Shopify's Orders API, 2019-04. This time those updated since 2019-09-13T06:15:42-04:00.

 

You'd think the response from Shopify would include that order.

 

It didn't.

 

16 Minutes later, at 2019-09-13T11:46:05.495174Z, we perform a daily audit and request orders updated since 2019-09-12T07:47:13.013-04:00.

 

That did include the order updated at 2019-09-13T07:29:06-04:00.

 

Then an hour later, at 2019-09-13T12:30:32.954Z, we submit another hourly request. This time for orders updated since 2019-09-13T07:15:38-04:00. Note that we increased the updated_at_min window with 15 minutes, just to catch orders missed previously.

 

That also included the order updated at 2019-09-13T07:29:06-04:00. 

 

Therefore the Orders API has a gap when publishing orders. It's larger than a minute and a half, and smaller than 16 minutes.

 

I advise everyone to increase their updated_at_min window with 15 minutes earlier than the last time they downloaded orders.

 

I can provide order id and web store id upon request. Hit me up.

I architect and optimize software, focusing on data integration. Currently I do this for a fashion design and manufacturing company located in midtown Manhattan, NYC.
0 Likes
Shopify Staff
Shopify Staff
618 45 84

Hi @André_Veltstra,

 

This sounds like a bug. Can you share the request-id of one of these requests so I can take a look in our logs for some insight? If you don't have the request-id value, I should be able to find the request given the timeframe and the resource id.

 

Thanks!

1 Like
Excursionist
33 0 3

Certainly!

 

The first request had id 5f417755-88ed-44fd-9825-2422e7638423.

The 2nd request had id 2feab2cf-bbb2-422b-b5fa-cb97e1ac4b48.

 

The order id is 1379100295267.

 

Thank you for your help!

I architect and optimize software, focusing on data integration. Currently I do this for a fashion design and manufacturing company located in midtown Manhattan, NYC.
0 Likes
Shopify Staff
Shopify Staff
618 45 84

Hi @André_Veltstra,

 

For some reason I'm not seeing either of those requests in our logs. I'm not sure why. Do you happen to have another example I could look into?

1 Like
Excursionist
33 0 3

Hi @Busfox,

 

Thank you for checking up on the log files. Is it normal that request IDs don't show in log files?

 

I have copies of the entire requests and responses, if that could help. Though I'm not going to share those publicly. Let me know where to send it and I'll get it done.

 

At the moment I don't have another example. I'll update this thread next time it happens.

 

Thank you,

André

I architect and optimize software, focusing on data integration. Currently I do this for a fashion design and manufacturing company located in midtown Manhattan, NYC.
0 Likes
Shopify Staff
Shopify Staff
618 45 84

Hi again,

 

No it's not common for logs to be missing. It's a very recent issue that our team is investigating, but it caused some logs to be missing. If you have the payloads for those requests, please direct message them to me through the forums. Thanks

1 Like
Excursionist
33 0 3

@BusfoxOn their way!

I architect and optimize software, focusing on data integration. Currently I do this for a fashion design and manufacturing company located in midtown Manhattan, NYC.
0 Likes
Shopify Staff
Shopify Staff
1555 80 250

Hey @André_Veltstra.

 

I'm just taking over for @Busfox on this one. We're not quite sure what the issue is yet, but we will likely end up needing more recent logs if you've happened upon this more recently (we have about a 14 day log retention time). Just in the interest of keeping this moving.

 

You can DM further examples to me.

 

Cheers.

0 Likes
Highlighted
Excursionist
33 0 3
Hi Alex,

Thank you for your assistance.

We have not yet come across another occurrence. So far, so good.
I architect and optimize software, focusing on data integration. Currently I do this for a fashion design and manufacturing company located in midtown Manhattan, NYC.
0 Likes