Personalized checkout and custom promotions with Shopify Scripts
Top of the morning!
We are having some problems with the web crawler from google. They are telling me they couldn't see the whole website while we (and our customers) can see it clearly. Google is telling me it has something to do with the web crawler, and they told me to do the following:
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:
So I just copy/pasted the script to the robots file but now i'm wondering if have done this the right way.
If you scroll through the bottom at the following link you can see it's included now. Can somebody tell me if this is the right way to do it?
https://www.croom-sanitair.nl/robots.txt
You don't want google to crawl the _whole_ site. For example the cart page isn't something you want or need to be indexed given that only matters to a single customer. Was there a more specific warning on what it couldn't get access to? It's possible this is a warning you can ignore.
Dropshipping, a high-growth, $226 billion-dollar industry, remains a highly dynamic bus...
By JasonH Nov 27, 2024Hey Community! It’s time to share some appreciation and celebrate what we have accomplis...
By JasonH Nov 14, 2024In today’s interview, we sat down with @BSS-Commerce to discuss practical strategies f...
By JasonH Nov 13, 2024