Help Me - Non-indexed pages

[Kokoscuk]

Hello, my blog posts and products are not indexed on google. It's been too long. what could be the reason for this

Click to expand...

# we use Shopify as our ecommerce platform

User-agent: *
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

# Google adsbot ignores robots.txt unless specifically named!
User-agent: adsbot-google
Disallow: /checkout
Disallow: /carts
Disallow: /orders
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*

User-agent: Nutch
Disallow: /

User-agent: AhrefsBot
Crawl-delay: 10
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

User-agent: AhrefsSiteAudit
Crawl-delay: 10
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

User-agent: MJ12bot
Crawl-Delay: 10

User-agent: Pinterest
Crawl-delay: 1

[Tira]

Hey, @Kokoscuk. 

I’m here to help.

Thanks for these details and your screenshot. This is helpful.

I want to provide you with some insight about how Google indexes, that might help.

Google crawls a site automatically, and the first time it crawls usually takes 48-72 hours. The same is true of a re-crawl - once you update information, it should only take a couple of days for the changes to be reflected. In some cases, however, it is possible for this process to take weeks instead.

If you’re finding this is taking longer than this timeframe, you can prompt Google to index your store. Google also won't index the entirety of a site. Their documentation explicitly states that "Google doesn't crawl all the pages on the web, and we don't index all the pages we crawl." It's perfectly normal for not all the pages on a site to be indexed." You can find more information in their documentation.

Would you be able to translate the words in your screenshot for me so that I can take a further look for you?

I would also love to know, how long has it been since you’ve added products to your store? 

[Boost_Commerce]

Hi @Kokoscuk 

This is Boost Product Filter & Search - a solution that grows more sales for online stores by letting shoppers find the right products within milliseconds. As a Shopify Partner who is trusted by over 11,000 merchants, I would like to provide my recommendation.

There are many reasons why your pages are not indexed by Google. From our experience, you should TEST LIVE URL to see if the link is available to Google. If yes, go request indexing. 
In case it fails the test, you will see a detailed report on why that URL cannot be indexed. For example, it is blocked by robots.txt. According to this analysis, you will know what need to be fixed before you can request indexing. 

This all I have to say, if my answer helped you, please like and accept it as a solution ✅