I had the same thing happen in chrome. Log out of Shopify, then out of chrome, clear cache and when I logged back in the order notification was gone.