Inability to edit robots.txt and sitemap.xml files

Highlighted
Tourist
13 0 4

I've got a really annoying problem. The first Google search result of my new site, TshirtBonus.com, shows up as "http://tshirtbonus.com/collections/all";. I would much rather have "http://tshirtbonus.com/"; be the first result to show up.

I created my own collection in order to get all my products to appear on the home page, and I think that's why the variable "collection" isn't equal to nil when trying this robots meta tag hack that the Shopify gurus said to use:

{% if collection.handle == 'all' %}
<meta name="robots" content="noindex,follow">
{% else %}
<meta name="robots" content="index,follow">
{% endif %}

In other words, this hack tells Google not to crawl my home page nor my /collections/all page.

Any ideas? Is there a way to create a redirect from /collections/all to my home page? Do you plan on letting your customers edit their own robots.txt or sitemap.xml files in the near future?

Thanks!

TshirtBonus.com: Funny, cool, offensive T-shirts. High-quality silk screen prints, low prices, and fast shipping. Men's and women's shirts. Sizes up to 5XL.
1 Like
Shopify Staff
Shopify Staff
216 0 18

Hi Matthew, 

Jamie here from Shopify. For what it's worth, your homepage is indeed being indexed by Google, and was the first result for me: 

What were your search queries? Perhaps the collections listing page had more relevant content for that particular search term? 

Cheers!

support@shopify.com | docs.shopify.com/support | 1-888-746-7439
0 Likes
Tourist
13 0 4

Yes, please forgive me; I failed to mention the search term I used to discover this dilemma: "funny offensive t-shirts"

I was showing up on page 6, but now I don't seem to show up at all. It's a brand new site with no SEO work done at all yet.

Regardless of my rank and the search terms used, I'm still troubled by this robots.txt and sitemap.xml problem. Also, I should point out that the home page and the /collections/all page have exactly the same content...

TshirtBonus.com: Funny, cool, offensive T-shirts. High-quality silk screen prints, low prices, and fast shipping. Men's and women's shirts. Sizes up to 5XL.
0 Likes
New Member
1 0 0

I've got a really annoying problem. The first Google search result of my new site, https://www.cashberryclothing.com/ ,, shows up as "https://www.cashberryclothing.com/collections";. I would much rather have "https://www.cashberryclothing.com/ ,"; be the first result to show up.

please provide me best solution

 

i am waiting to hear from you soon

0 Likes
Tourist
44 0 1

Give our app a go, it let's you remove objects from the sitemap. https://apps.shopify.com/sitemap-noindex-manager

0 Likes
Shopify Expert
379 0 41

I do not recommend you try to avoid the all collections from being indexed. It is a legimate page on your store because you are linking to it in the footer. If you want to remove pages from your sitemap, I suggest you use the meta fields method in my Shopify SEO guide. It is a big guide so search "Shopify trick" in your browser to find it.

Unless you are getting signficant traffic from organic search to a page you do not want in search results, I would not waste my time trying to shape indexing behavior. Work on other SEO, getting links to your home page, and it will naturally increase in rankings.

Google indexes and shows to users, what it thinks is best. It does get it wrong sometimes. In your case, I'd be asking the question, "Why does the big G think this page is more relevant then the homepage?" It's possible the link in your footer is a primary reason if you don't have external links pointing to it.

Run Google Shopping ads? Get the free definitive guide to Google Shopping for Shopify (no optin required): https://www.digitaldarts.com.au/google-shopping
0 Likes