Hi, @RussellH !
Thank you so much for sharing your question with our network.
To permanently and thoroughly remove a tag from your store, you must simply ensure that it is no longer attached to any customers. Otherwise, the tag will show up as an option so long as it is still associated with an existing customer past or present.
Warm regards,