Is robots.txt blocking blog and collection pages from indexing?

Start a Business
9

Taken a while to respond, but they’re indexed now. Often it’s just a few simple reasons:

  1. Google takes a while to crawl & index new pages on an existing site
  2. If you have no domain authority, are a new website or have no reason for google to trust your site, then in my experience they can take a LONG time to index pages from weeeks to a couple months.
  3. There may be technical reasons like robots blocking, no internal link/crawl path to URL, not in sitemap, JS issues etc.

In Shopify, 99% of the time it’s reason 1 or 2.

2 Likes