Hello friends ,
I read in the forum that the collections don't indexed by google , because Shopify robots txt block it , is it true ?
Three days ago I added my sitemap to Google Webmaster and so far it's only two pages : home page and search page.
How do you index the pages with your collections on Google?
Can someone tell me a little about it? I do not understand much about it.
I have checked your website's collections. And found out they were crawled on google.
As for your query regarding the disallow & "+", plz follow this trail: https://ecommerce.shopify.com/c/ecommerce-marketing/t/am-highly-upset-shopify-s-design-does-not-allo...
Shopify does NOT block collections from being crawled. Whatever you read is wrong, or mis-interpreted.
Robots.txt is a suggestion to Google which it often obeys, not always obeys. Shopify discourages Google crawling collections that contain "+" symbols in them, which often happens with multiple tags or collections that act like filters. The Power Tools suite is one app that does this well.
Just tried again - looks like robot.txt file has been updated. Might have been a temporary issue?
# we use Shopify as our ecommerce platform User-agent: * Disallow: /admin Disallow: /cart Disallow: /orders Disallow: /checkout Disallow: /11650574/checkouts Disallow: /11650574/orders Disallow: /carts Disallow: /account Disallow: /collections/*+* Disallow: /collections/*%2B* Disallow: /collections/*%2b* Disallow: /blogs/*+* Disallow: /blogs/*%2B* Disallow: /blogs/*%2b* Disallow: /*design_theme_id* Disallow: /*preview_theme_id* Disallow: /*preview_script_id* Disallow: /discount/* Disallow: /gift_cards/* Disallow: /apple-app-site-association Sitemap: https://www.alkaviva.com.au/sitemap.xml # Google adsbot ignores robots.txt unless specifically named! User-agent: adsbot-google Disallow: /checkout Disallow: /carts Disallow: /orders Disallow: /11650574/checkouts Disallow: /11650574/orders Disallow: /discount/* Disallow: /gift_cards/* Disallow: /*design_theme_id* Disallow: /*preview_theme_id* Disallow: /*preview_script_id* User-agent: Nutch Disallow: / User-agent: MJ12bot Crawl-Delay: 10 User-agent: Pinterest Crawl-delay: 1