Website is being crawled by some kind BOT out of the USA

Shopify Discussion
21

You cannot block that to enter your website other option is try to block that user with a script but that needs to be coded

22

Yes, that is the question.

  1. where i need to block it?

a) Google Search Console

b) Insert in the Theme code a prompt/script that txt.Robots blocks this ev-crawler/1.0

  1. And what kind of scriptcode / prompt do we use for that?

We are not a coding/IT company so we we don’t know.

Where and how to block this crawler BOT was actually one of one questions from the start :sweat_smile:

23

you need to block this in Robots.txt file

and

if you want the script to be added in the code so that the visits do not come that will go in your shopify theme and that script first needs to be created after researching

24

Thanks untill so far.

Yes, that is the question; which script does there need to be added in the Theme code for blocking this.

25

We have some problem in the past via Negative chinese SEO backlinks which we solved witth below coding (other Forum thread). Maybe it can be usefull… in blocking this ''ev-crawler/1.0’’

{%- if request.path == ‘/collections/vendors’ and collection.all_products_count == 0 -%}

{% elsif request.path == ‘/404’ %}
{%- endif -%}

{%- if request.path == ‘/search?q=’ == 0 -%}

{% elsif request.path == ‘/404’ %}
{%- endif -%}

26

this is different this does not have crawler name …if you are a programmer try to check a code which has crawler name as source mentioned in it

i would need to do the research and the come up with a code it will take some time for the same

27

As mentioned, we are not a programmer or IT guy that can make up this code.

The reason for this topic was that we saw a USA crawler BOT via Hotjar site recordings, crawling our Shopify website. We already saw in the name ‘ev-crawler/1.0’ in the Hotjar recordings with this USA crawler BOT, so that’s why we started the topic what this is, from whom this comes, and how to block it. In the conversation, you discovered the name was ‘ev-crawler/1.0’.

Although we still not know from whom it is or why it’s crawling, we were also looking a script html code in order to block it in our Theme code.

In all the years Shopify, assume we are not the very first with a Shopfiy website that is being crawled by some sort of BOT ??? Maybe in past threads? (we will take a look later on this as well, as we want to solve the issue, instead of re-confirming that there is indeed a problem / crawler BOT).

Seems we had a beautiful conversation, but we didn’t come much further -_-'…

Is there anyone with Programmer skills that can help us with this or that experienced this as well in the past and know how to stop this?

Your help/support is very much appreciated

28

Hi @Mark1988

I can serve you with the code but as i stated with would need to be tested first and researched too it will take 1-2 business days let me know

29

Ok, and what are the options for this?

Ps. you can also send me a PM with the procedure. Thanks

30

hi @Mark1988

My apologizes for delayed reply i was busy working for a merchant on shopify platform

As i stated JS needs to be created as custom JS which will block the robot visiting the website and that needs to be added to your theme file it is a task of 2 - 3 days as Research and testing will be involved too.

You can DM me