SEO, AdWords, affiliates, advertising, and promotions
Hi,
I have been using Google Shopping now for 2 years and have never had any issues. Last night however items were being disapproved from my site for the following reasons:
Product pages cannot be crawled with a mobile user-agent due to the robots.txt restriction
Product pages cannot be crawled because of robots.txt restriction
The solution that Google have given involves adding the following to the Robots.txt file
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:
However I cannot amend the Robots.txt file.
Would anyone have any ideas on this?
Your details are a bit vague so this may be off the mark but if you can't edit the file directly on your hosting platform, you should be able to download it to your local computer via FTP. Then make the edit and reupload it back to your hosting platform. I would recommend making a backup of the file before editing.
Hope that helps.
Hi mate, do you find a solution to this. I am currently having the same problem.
Hello!
As of today, June 21st, 2021, we have launched the ability to edit the robot.txt file to give merchants more control over the information that is crawled by search engines. You can learn more about how to edit your robot.txt file through our community post here.
Due to the age of the topic, I will be locking this thread. If you have any questions about the new feature, please do not hesitate to create a new post under our "Techincal QA" board.
Trevor | Community Moderator @ Shopify
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution
- To learn more visit the Shopify Help Center or the Shopify Blog
User | RANK |
---|---|
7 | |
5 | |
4 | |
4 | |
4 |
Photo by Marco Verch Sales channels on Shopify are various platforms where you can sell...
By Ollie May 25, 2023Summary of EventsBeginning in January of 2023, some merchants reported seeing a large amo...
By Trevor May 15, 2023With 2-Factor Authentication being required to use Shopify Payments, we’re here to help yo...
By Imogen Apr 26, 2023