I have to prevent the crawl of many pages, and as you know shopify refuses to let us integrate these functions on robots.txt.
So I put this in my code, in theme.liquid :
I wonder if I put it correctly, because now on the top bar on my shop these scripts appear, and in general if it appears it's because there is a code error.
NB: I've already looked at the https://help.shopify.com/en/manual/promoting-marketing/seo/hide-a-page-from-search-engines page, but this one gives noindex codes, so to prevent the index, and I'm talking about preventing the crawl, I need Disallow.
Just a quick update about the robot.txt file that was referenced in this post. As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.
If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.