It is my understanding that it is not possible to edit the robots.txt file. The store I'm working on, uses multiple collections to sort items by price, alpha, and creation date. However, each of these pages gets indexed by google and other search engines. Example:
I'm sure someone has stumbled unto this before. How can I prevent these pages form being indexed?
Solved! Go to the solution
Use Meta Tags:
The noindex meta standard is useful if you don't have root access to your server, as it allows you to control access to your site on a page-by-page basis.
This is an accepted solution.
As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.
Due to the age of the topic, I will be locking this thread and marking it as resolved to help direct anyone that lands on this page. If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.