Need help with adding and editing a robots.txt file in Shopify?

VIGNESHPRABU_C · ‎10-13-2020

Hi

My client is asking site promotion so SEO is doing site promotion and he wants to edit robots.txt file in shopify but i can't find this file anywhere in shopify as well as I get robots.txt file when i enter my site url / robots.txt in google. How can i add and edit robots.txt file in shopify.

Trevor · ‎06-21-2021

Hello!

Just a quick update about the robot.txt file that was referenced in this post. As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.

As this response is the answer to the question, I have marked my response as the solution. If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.

Trevor | Community Moderator @ Shopify
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution
- To learn more visit the Shopify Help Center or the Shopify Blog

View solution in original post

Oliver · ‎10-13-2020

Hi, @VIGNESHPRABU_C !

The robots.txt file cannot be changed - see here for more info on how robots.txt works with search engines crawling. It also explains why content is blocked and how to hide specific pages, if needed.

The robots.txt file is located at the root directory of your Shopify store's primary domain name. For example: johns-apparel.com/robots.txt.

Although you can't edit the content of your store's robots.txt file, you should be aware of the content that it blocks from search engines. For example, the shopping cart page is blocked from search engines because you want customers to find your product pages before the cart page.

You can hide pages that are not included in your robots.txt file by customizing the <head> section of your store's theme.liquid layout file. You need to include some code to noindex particular pages.

All the best!

To learn more visit the Shopify Help Center or the Community Blog.

Trevor · ‎06-21-2021

Hello!

Just a quick update about the robot.txt file that was referenced in this post. As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.

As this response is the answer to the question, I have marked my response as the solution. If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.

Trevor | Community Moderator @ Shopify
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution
- To learn more visit the Shopify Help Center or the Shopify Blog

Need help with adding and editing a robots.txt file in Shopify?

Need help with adding and editing a robots.txt file in Shopify?

Community Blog Articles