At this time, a fulfillment created by an app cannot be cancelled through the Shopify admin. Through the admin you'll only be able to edit the tracking information or track it yourself.
With that being said, I'm not sure why this is - and I'll bring it up to see if we'd ever consider changing the behaviour.
|an hour ago|
|2 hours ago|
|4 hours ago|