Hi all,
Just to give context on this issue. Last time, from our prior understanding, the seo.hidden will work to hide active products from the storefront search and as well as it remove the actual canonical url from the sitemap thus it’s not indexable from search engine like Google, Bing etc.
But we did have a tag-based noindex, nofollow meta tag in the header in theme.liquid. So, there certain use-case we have have that require one of them is active. For example, we usually have some products that is available to search on the storefront but the link is not indexable for storefront re-direction. Or, we have add-on products that are duplicates of our catalog but on a different tier of pricing.
Usually, having seo.hidden is enough to take it off both storefront and sitemap index, thus we have a lot of products actually didn’t have the tag-based noindex nofollow meta tag active (yes, it’s an oversight). But very recently, like early this month, we found search results that have these products available to customers, while having active seo.hidden, leading to CX problems. We didn’t have any issue of this year.
Just to gather some information if the there’s a recent change to how the seo.hidden works and there’s a new way to disable one or both storefront and sitemap index together. Or the method of checkmarking seo.hidden active and have meta tag active is the way to go forward from now on.
Thanks for reading this through and much appreciate any feedbacks.
Edit: Just to add more note on this, the products we recently found to having problems, is new products that was launched last month and we have enabled seo.hidden very early before the product is active even and this has been our SOP to onboard products. So, this is a new issue to us. Thanks.

