robots.txt.liquid not applying

robots.txt.liquid not applying

Lalaloom
Not applicable
1 0 1

Hello Shopify Community,

I am trying to allow my legal pages (such as `/policies/terms`) to be indexed by customizing the robots.txt.liquid file in my published Shopify theme.

Here is the simplified version of my current file:

User-agent: *
Allow: /policies/
Allow: /checkouts/internal/preloads.js
Disallow: /checkouts/
Disallow: /checkout

Despite these settings, the live robots.txt at https://lalaloom.no/robots.txt still shows:
Disallow: /policies/
Disallow: /*/policies/

So Google continues to block those pages.
I have verified:
- The theme is published
- robots.txt.liquid is in the correct folder (templates/)
- The file saves correctly

I also spoke with Shopify Support who confirmed the file looks correct, but mentioned they could not escalate the issue as it involves code.

Can anyone from the community or staff clarify whether Shopify storefronts respect robots.txt.liquid reliably? Or is this a known limitation?

Thank you!
Ali
https://lalaloom.no

 

Replies 2 (2)

StevenT_A7
Excursionist
40 5 5

Hi, 

Even though you’ve customized your robots.txt.liquid file in your theme, Shopify overrides or appends default disallow rules—especially for /policies/ and other sensitive or legal paths like /checkout/.

This is intentional by Shopify to prevent indexing of potentially sensitive or dynamically generated content that may cause duplicate content issues or legal problems.

Steven Taylor
302-260-8345

Supermeow
Shopify Partner
13 0 0

It seems like your robots.txt is correct

Supermeow_0-1746587746941.png

 

I tested the robots.txt before to hide my product details pages. It might take time for Search Engines like Google to re-index your site. If you want to speed up, you can try Google Search Console.

Hello World