Updates on recent webhook instability

stephers
Shopify Staff
Shopify Staff
7 0 3

Over the past week, we’ve suffered from two incidents of service instability that have resulted in a small percentage of webhook retries being dropped on December 10 and December 15. In the process of reconciling those dropped retries, a small number of webhook subscriptions were also inadvertently deleted on December 11. 

Some updates on where we stand now: 

  • As of December 18, all deleted developer webhook subscriptions (subscriptions created via API) have since been backfilled and restored. We are in the process of reaching out to partners affected with deleted subscriptions.
  • Merchant admin webhook subscriptions (subscriptions set up via the merchant admin) unfortunately cannot be automatically restored. We are in the process of reaching out to impacted merchants about recreating their deleted subscriptions. 
  • We are actively working on reconciling dropped webhook retries from December 15. 
  • If not part of your typical workflow, you may want to re-poll to collect data that may have missed since December 11. 

We apologize for the inconvenience caused and are taking steps to ensure this can be prevented in the future. 

0 Likes