Solved

How to correctly list multiple URLs in robots.txt.liquid?

daguy
Visitor
2 1 0

Just want to know the preferred/correct syntax for listing multiple URL's to the Disallow in rorbots.txt.liquid

 

Is this correct?


{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}

 

Or is this better or even valid?


{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up',
  /products/free-sample' }}
{%- endif -%}

Accepted Solution (1)
daguy
Visitor
2 1 0

This is an accepted solution.

Thanks for the reply, that is what I'm asking. So comma separated not accepted.

I'll just use:

{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}

View solution in original post

Replies 2 (2)

PaulNewton
Shopify Partner
6275 573 1323

 

When in doubt use the simplest crudest version.

 https://shopify.dev/themes/seo/robots-txt 

 

Or just simply check what the rendered output is and that it matches the expectation of the syntax used.

 

For part of your possible valid code it looks like there are missing apostrophes or your using some syntax. But note i've never seen that construct in liquid before, or comma seperated values in a robots.txt if that's the goal of the output.

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up',
  /products/free-sample' }}

vs

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up,
  /products/free-sample' }}

 

 

Save time & money ,Ask Questions The Smart Way


Confused? Busy? Get the solution you need paull.newton+shopifyforum@gmail.com


Problem Solved? ✔Accept and Like solutions to help future merchants

Answers powered by coffee Buy Paul a Coffee for more answers or donate to eff.org


daguy
Visitor
2 1 0

This is an accepted solution.

Thanks for the reply, that is what I'm asking. So comma separated not accepted.

I'll just use:

{%- if group.user_agent.value == '*' -%}
{{ 'Disallow: /pages/sms-alerts' }}
{{ 'Disallow: /pages/sign-up' }}
{{ 'Disallow: /products/free-sample' }}
{%- endif -%}