robots.txt.liquid syntax

Solved
daguy
New Member
2 1 0

Just want to know the preferred/correct syntax for listing multiple URL's to the Disallow in rorbots.txt.liquid

 

Is this correct?


{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}

 

Or is this better or even valid?


{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up',
  /products/free-sample' }}
{%- endif -%}

Accepted Solution (1)
daguy
New Member
2 1 0

This is an accepted solution.

Thanks for the reply, that is what I'm asking. So comma separated not accepted.

I'll just use:

{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}

View solution in original post

Replies 2 (2)
PaulNewton
Shopify Partner
5189 464 1125

 

When in doubt use the simplest crudest version.

 https://shopify.dev/themes/seo/robots-txt 

 

Or just simply check what the rendered output is and that it matches the expectation of the syntax used.

 

For part of your possible valid code it looks like there are missing apostrophes or your using some syntax. But note i've never seen that construct in liquid before, or comma seperated values in a robots.txt if that's the goal of the output.

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up',
  /products/free-sample' }}

vs

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up,
  /products/free-sample' }}

 

 

Finally Combinable Discounts - EARLY ACCESS ONLY - Use Free Shipping With Other Discounts

Answers powered by coffee Buy Paul a Coffee for more answers or donate to eff.org
Problem Solved? ✔Accept and Like solutions to help future merchants
Confused? Busy? Buy a custom solution paull.newton+shopifyforum@gmail.com
daguy
New Member
2 1 0

This is an accepted solution.

Thanks for the reply, that is what I'm asking. So comma separated not accepted.

I'll just use:

{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}