How can I prevent the new indexing bug from creating useless pages on Google?

The link you posted to the blog redirects to this thread. I found the direct link here: https://community.shopify.com/post/2062077

Maybe I’m just not technical enough to understand Trevor’s response but it seems like to me that there’s no information provided here about how to fix the issue or what Shopify did to fix it. Did I miss something?

You’re right! That was my mistake. I’ve updated the link

Thank you @Trevor for the upadate, Lets observe the update impact and hope it brings back our SEO traffic.

“We have created a solution to stop the crawlers from executing the JavaScript preventing pixel URLs from being crawled”

What is the solution?

So the action we should take is to do nothing and wait for all the pixel urls to disapear from the google reports?

I went ahead and temporarily removed in Google the pixel urls that were indexed by Google. Should I request cancelation or let them expire?

I want to get rid of these url’s that are indexed and I believe are impacting my SEO with Google

https://www.bunkbedking.com/wpm@0.0.242@9a764525wd403f451p960ae872m43ec93c7/sandbox/products/bunk-bed-tall-end-ladder-gray-drawers

https://www.bunkbedking.com/wpm@0.0.253@819b7641wc5b14080p284a660bm58cab6ca/sandbox/products/bunk-beds-full-full-stairway-white-full-trundle

https://www.bunkbedking.com/wpm@0.0.245@a1fcb853wff0d51fapfe890cd8ma6042ba1/sandbox/products/jackpot-princess-twin-loft-bed-blue-pink-white

https://www.bunkbedking.com/wpm@0.0.245@a1fcb853wff0d51fapfe890cd8ma6042ba1/sandbox/products/jackpot-castle-end-ladder-loft-bed-blue-blue-white

https://www.bunkbedking.com/wpm@0.0.234@1543f512w2542bf6cpa9acea22m3c2685ed/sandbox/products/all-in-one-twin-bed-rustic-gray

https://www.bunkbedking.com/wpm@0.0.233@6b2037f3wd883558dpf43ec7fem6fe2bb33/sandbox/products/jackpot-princess-twin-loft-bed-blue-pink-white

https://www.bunkbedking.com/wpm@0.0.234@1543f512w2542bf6cpa9acea22m3c2685ed/sandbox/products/bunk-beds-twin-full-stairway-dark-cherry-drawers?variant=32083837419631

https://www.bunkbedking.com/wpm@0.0.244@0efe444cwaace0ba9p2f14d49em4ffa2433/sandbox/products/jackpot-castle-twin-loft-bed-cherry-red-yellow-blue

https://www.bunkbedking.com/wpm@0.0.245@a1fcb853wff0d51fapfe890cd8ma6042ba1/sandbox/products/jackpot-castle-end-ladder-loft-bed-cherry-red-blue

https://www.bunkbedking.com/wpm@0.0.245@a1fcb853wff0d51fapfe890cd8ma6042ba1/sandbox/products/bunk-beds-tall-stairway-white-drawers

https://www.bunkbedking.com/wpm@0.0.236@dccd5d3cw10e1ada4p6b39352amee6b977d/sandbox/products/bunk-bed-tall-end-ladder-white-drawers

https://www.bunkbedking.com/wpm@0.0.237@a33a283bwbeccc2ccpdf590f4bmf0f856ad/sandbox/products/bunk-bed-twin-full-end-ladder-brushed-gray

https://www.bunkbedking.com/web-pixels-manager@0.0.186/sandbox/collections/castle-and-princess-beds

Correct me if I’m wrong. It looks like Shopify before had just hardcoded an iframe to each page, which was ok, but became a problem since Google handled it the way it did. The iframe itself seems to be the same.

But with this solution an extra step is made. The iframe is not injected directly into the code. Asynchronous JavaScript is loaded. You can find in your source code now, which injects the iframe.

Disallow: /cdn/wpm/*.js has been added to robots.txt to prevent Google crawling the JavaScript.

This might work - let’s see what our crawling logs say in the next days :slightly_smiling_face:

@Denny The previous code loaded the iframe from javascript also. The difference now is that they moved the javascript for it into it’s own js file and blocked that file in robots.txt.

The block in robots.txt will prevent Google from rendering the code that generates the iframe and since it’s a js file blocked instead of a page, Page Indexing in Search Console should be clean - though I’d expect an increase in 404 errors as the [email removed] urls now 404.

We’ve updated our Definitive SEO Guide to Shopify’s Web Pixel Manager Problem article with details of this change: https://p1commerce.com/resources/shopify-web-pixels/#attempt-4

Appreciate your guidance on dealing with his issue - a more professional approach than Shopify

D

Hi Trevor (Shopify Community Moderator),

Thanks for working on getting the solution to this issue (and Greg and the wider Shopify team).

I have been undoing a number of prior “interim fixes” (that I inserted over the last few months) over the last week - so that I can then just use your Shopify solution as the only “fix” - this way I can then monitor my website to see what is going on.

At this stage, it is too early for me to tell if your solution is working - but I have my fingers cross.

Question … P1Commerce added to your solution, with an extra step (that wasn’t in your solution) as follows:

Step 2: Use Google’s Removal Tool

Request the temporary removal of your /wpm and /web-pixels-manager URL patterns in Google Search Console.

Do you agree that we should also implement this extra step?

Thanks

A week after this solution released, seems not much improvement on my GSC. This is the latest indexing I requested last week and just updated by Google today.

Anyone has similar outcome?

Screenshot 2023-05-22 at 10.20.31 AM.png

Yes, I still see lots of nonindex pages and getting a lot of New Not Found pages. Does anyone know when we will see some improvement. Thank you!

I hope the answer from others SHOULD NOT BE: Well, you just get punished by Google’s March core update, do your stuff, know your ■■■■■ and keep moving on.

Another Google crawl and an audit in GSC shows a continued increase in “no index” pages and 404s. It’s all the wpm pages and the collections/all spam… same as before. Are any store owners seeing their indexing stats improve since this fix has been implemented?

Thanks

The amount of "noindex tag " is still rising on my store. No significant improvement can be observed from my side so far.

404’s still growing

404’s still growing!!! Why haven’t you guys solved this problem? ?

Our FAQ explains that 404 report will temporarily grow as the pixel URLs Google knows about will start to 404, but it will not discover any new URLs so the count will stop in the near future.

Hi Greg,

Please see a snapshot of my Google Search below. It appears to have stabilized. Is this what you expected to see? How should the graph change with time? Thanks.