When you uninstall an app it no longer has access scopes to your shop. This happens immediately. However some apps modify the theme code so when they are removed their mods still remain. A quick search for that app you're talking about brings me this page. Perhaps it will help, though ping the app devs if there's concerns.