You better turn it OFF.
Then run the below commands
npm run build
npm run deploy
This will deploy all the extensions attached to your project.
Now go to your Theme Editor of your store and add your theme extension app as an App Block and save the theme.
This will show your extension ui in the theme of your store.