There are a few apps that allow you automate certain tasks on Shopify. Although I have not used this in particular, the app below will allow you to automate processes that you might be currently doing manually. I am sure you will be able to set an auto cancellation on orders that are unpaid for five days.
Let me know if you have any questions.
|3 hours ago|