Hi
My client is asking site promotion so SEO is doing site promotion and he wants to edit robots.txt file in shopify but i can’t find this file anywhere in shopify as well as I get robots.txt file when i enter my site url / robots.txt in google. How can i add and edit robots.txt file in shopify.
Hi, @VIGNESHPRABU_C !
The robots.txt file cannot be changed - see here for more info on how robots.txt works with search engines crawling. It also explains why content is blocked and how to hide specific pages, if needed.
The robots.txt file is located at the root directory of your Shopify store’s primary domain name. For example: johns-apparel.com/robots.txt.
Although you can’t edit the content of your store’s robots.txt file, you should be aware of the content that it blocks from search engines. For example, the shopping cart page is blocked from search engines because you want customers to find your product pages before the cart page.
You can hide pages that are not included in your robots.txt file by customizing the section of your store’s theme.liquid layout file. You need to include some code to noindex particular pages.
All the best!
Hello!
Just a quick update about the robot.txt file that was referenced in this post. As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.
As this response is the answer to the question, I have marked my response as the solution. If you have any questions about the new feature, please do not hesitate to create a new post under our “Techincal QA” board.