Help Me - Non-indexed pages

Kokoscuk
Excursionist
24 0 20

Hello, my blog posts and products are not indexed on google. It's been too long. what could be the reason for this

 

screenshot-search.google.com-2021.09.11-23_09_44.png

 

 

Click to expand...
# we use Shopify as our ecommerce platform

User-agent: *
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

# Google adsbot ignores robots.txt unless specifically named!
User-agent: adsbot-google
Disallow: /checkout
Disallow: /carts
Disallow: /orders
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*

User-agent: Nutch
Disallow: /

User-agent: AhrefsBot
Crawl-delay: 10
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

User-agent: AhrefsSiteAudit
Crawl-delay: 10
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /59169734841/checkouts
Disallow: /59169734841/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Sitemap: https://miyalingerie.com/sitemap.xml

User-agent: MJ12bot
Crawl-Delay: 10

User-agent: Pinterest
Crawl-delay: 1

 

Replies 2 (2)
Tira
Shopify Staff (Retired)
Shopify Staff (Retired)
1260 90 212

Hey, @Kokoscuk

I’m here to help.

Thanks for these details and your screenshot. This is helpful.

I want to provide you with some insight about how Google indexes, that might help.

Google crawls a site automatically, and the first time it crawls usually takes 48-72 hours. The same is true of a re-crawl - once you update information, it should only take a couple of days for the changes to be reflected. In some cases, however, it is possible for this process to take weeks instead.

If you’re finding this is taking longer than this timeframe, you can prompt Google to index your store. Google also won't index the entirety of a site. Their documentation explicitly states that "Google doesn't crawl all the pages on the web, and we don't index all the pages we crawl." It's perfectly normal for not all the pages on a site to be indexed." You can find more information in their documentation.

Would you be able to translate the words in your screenshot for me so that I can take a further look for you?

I would also love to know, how long has it been since you’ve added products to your store? 

Tira | Social Care @ Shopify 
 - Was my reply helpful? Click Like to let me know! 
 - Was your question answered? Mark it as an Accepted Solution
 - To learn more visit the Shopify Help Center or the Shopify Blog

Boost_Commerce
Shopify Partner
31 0 21

Hi @Kokoscuk 

This is Boost Product Filter & Search - a solution that grows more sales for online stores by letting shoppers find the right products within milliseconds. As a Shopify Partner who is trusted by over 11,000 merchants, I would like to provide my recommendation.

There are many reasons why your pages are not indexed by Google. From our experience, you should TEST LIVE URL to see if the link is available to Google. If yes, go request indexing. 
Screen Shot 2021-09-15 at 09.04.00.pngIn case it fails the test, you will see a detailed report on why that URL cannot be indexed. For example, it is blocked by robots.txt. According to this analysis, you will know what need to be fixed before you can request indexing. 
Screen Shot 2021-09-15 at 09.08.08.png

 

This all I have to say, if my answer helped you, please like and accept it as a solution  

Product Filter & Search by Boost Commerce
#1 Product Filters & Search for brands of all sizes
---------------------------------------------------------------------
Insights of eCommerce Filter & Search for 2022 - Best Practices from Top Shopify Stores