Why are certain product pages disallowed in robots.txt file?

Why are certain product pages disallowed in robots.txt file?

EricApex
Visitor
2 0 1

Hello,

 

I recently noticed that the our robots.txt file is disallowing a majority of our product pages.  I found these pages in in our robots.txt.liquid file.  

 

domain - apexphotostudios.com

 

 

User-agent: *
Disallow: /a/downloads/-/*
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkouts/
Disallow: /checkout
Disallow: /63328256257/checkouts
Disallow: /63328256257/orders
Disallow: /carts
Disallow: /account
Disallow: /collections/*sort_by*
Disallow: /*/collections/*sort_by*
Disallow: /collections/*+*
Disallow: /collections/*%2B*
Disallow: /collections/*%2b*
Disallow: /*/collections/*+*
Disallow: /*/collections/*%2B*
Disallow: /*/collections/*%2b*
Disallow: /blogs/*+*
Disallow: /blogs/*%2B*
Disallow: /blogs/*%2b*
Disallow: /*/blogs/*+*
Disallow: /*/blogs/*%2B*
Disallow: /*/blogs/*%2b*
Disallow: /*?*oseid=*
Disallow: /*preview_theme_id*
Disallow: /*preview_script_id*
Disallow: /policies/
Disallow: /*/*?*ls=*&ls=*
Disallow: /*/*?*ls%3D*%3Fls%3D*
Disallow: /*/*?*ls%3d*%3fls%3d*
Disallow: /search
Disallow: /apple-app-site-association
Disallow: /.well-known/shopify/monorail
Disallow: /cdn/wpm/*.js
Disallow: /services/login_with_shop
Disallow: */collections/*filter*&*filter*
Disallow: /pages/contact
Disallow: /pages/faq
Disallow: /pages/studio-rental-agreement
Disallow: /pages/terms-and-conditions
Disallow: /pages/privacy-policy
Disallow: /collections/fashion-district-main-office-building
Disallow: /collections/flower-district
Disallow: /products/rooftop-a
Disallow: /products/rooftop-a-events
Disallow: /products/rooftop-b
Disallow: /products/rooftop-b-events
Disallow: /products/studio-a
Disallow: /products/studio-a-events
Disallow: /products/studio-b
Disallow: /products/studio-b-events
Disallow: /products/studio-d
Disallow: /products/studio-d-events
Disallow: /products/studio-e
Disallow: /products/studio-e-events
Disallow: /products/studio-f
Disallow: /products/studio-f-events

 

 

The pages in question start at /products/rooftop-a thru the bottom.

Is there a technical Shopify reason for why these are blocked?  From what I can gather they were added by the person who was previously in charge of managing but I can't find a good reason why.  I have since added a new product page which is not listed here so it doesn't seem to be trigged by Shopify itself from what I can gather.

 

Any assistance would be greatly appreciated.

Replies 0 (0)