It looks like handle only gets updated when you release a new version (after switching configs). I switched the handle, ran my production deployment, and the handle updated
With the Shopify CLI:
- shopify app config use
- select your production config, with the updated handle
- shopify app deploy
- updated handle now appears in the admin