How to correctly list multiple URLs in robots.txt.liquid?

Technical Q&A
1

Just want to know the preferred/correct syntax for listing multiple URL’s to the Disallow in rorbots.txt.liquid

Is this correct?

{%- if group.user_agent.value == ‘*’ -%}
{{ ‘Disallow: /pages/sms-alerts’ }}
{{ ‘Disallow: /pages/sign-up’ }}
{{ ‘Disallow: /products/free-sample’ }}
{%- endif -%}

Or is this better or even valid?

{%- if group.user_agent.value == ‘*’ -%}
{{ ‘Disallow: /pages/sms-alerts,
/pages/sign-up’,
/products/free-sample’ }}
{%- endif -%}

2

When in doubt use the simplest crudest version.

https://shopify.dev/themes/seo/robots-txt

Or just simply check what the rendered output is and that it matches the expectation of the syntax used.

For part of your possible valid code it looks like there are missing apostrophes or your using some syntax. But note i’ve never seen that construct in liquid before, or comma seperated values in a robots.txt if that’s the goal of the output.

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up',
  /products/free-sample' }}

vs

{{ 'Disallow: /pages/sms-alerts,
   /pages/sign-up,
  /products/free-sample' }}
3

Thanks for the reply, that is what I’m asking. So comma separated not accepted.

I’ll just use:

{%- if group.user_agent.value == ‘*’ -%}
{{ ‘Disallow: /pages/sms-alerts’ }}
{{ ‘Disallow: /pages/sign-up’ }}
{{ ‘Disallow: /products/free-sample’ }}
{%- endif -%}