App Performance on Storefronts - Revised Requirements and Resources

Kris_Doyle
Shopify Partner
85 0 19

Hi Shopify ,

I just got an email saying the following:

Action Required: Your app has been flagged as reducing Lighthouse performance scores by more than 10%. Improve your app(s)’ performance by March 2nd, 9am EST.

I'm confused though because my app is admin-facing and doesn't interact with storefronts or themes at all. I'm not sure how it could be affecting shop performance?

I've been running Lighthouse but it doesn't report correctly because embedded apps have to go through the oauth process which causes problems for Lighthouse. I'm wondering how the app could have been tested with Lighthouse with those limitations. When I did get it to work, it was reporting errors with the Shopify Admin, and not my actual app (since it's embedded in a frame) so I'm not sure what to do about that.

In any case, if mine is an admin-facing app, do the same rules apply, and how is the testing done? Everything I've seen is talking about theme performance, but I have no storefront interactions, no injected script or proxy, and no theme-related features, so I'm just a bit confused.

Thanks very much!
Kris

0 Likes
Jose_Samper
Shopify Partner
29 2 17

Hi Kris,

I'm not sure if anyone from Shopify is checking this thread, I would try to contact Partner Support using the form in the Shopify Partner Dashboard and send them a video showing the Lighthouse score of a shop before and after installing your app, as explained at https://shopify.dev/concepts/app-store/getting-your-app-approved/app-requirements#a-performance-scor....

The problem is that the margin of error of Lighthouse is way higher than 10% so the risk of false positives is extremely high. I will say it again: if you run Lighthouse twice on any website, it's easy to get 2 different results that differ on more than 10%.

The Online Speed Score do not apply to admin apps, this is clearly a false positive.

Good luck!

 

 

Kris_Doyle
Shopify Partner
85 0 19

Hi @Jose_Samper ,

Exactly my point (about the admin app). I can run the score and then install the app, an re-run, but all it's going to show is the theme score, which I have no impact on since the app isn't even part of the score.

But wouldn't the testing team have already done this? Is it possible that someone didn't realize it's an admin app and that it's a false positive as you said?

I really hope so because the message "fix this by March 2" is pretty ominous; especially when there's literally nothing I can do to change what the theme performance is, since my app doesn't interact with the storefront at all.

Thanks,
Kris

Jose_Samper
Shopify Partner
29 2 17

Hi,


Is it possible that someone didn't realize it's an admin app and that's it's a false positive as you said?

Definitely a false positive.

I think that Lighthouse should not be used to check apps performance but, to be fair, I understand that the guy who tested it does not need to understand how all apps works, they might think that your app, even being an admin app, could inject some storefront code to get metrics or anything else.

The misunderstanding should be easily solved but, as you said, the deadline is threatening, let's hope someone checks it before it arrives.

 

Kris_Doyle
Shopify Partner
85 0 19

Yeah good point. I guess there's no way they can know that for sure.

I think it would be better if they maybe said something like "You've been flagged! Prove your innocence by March 2 or else!" lol

Anyhow, agreed about hoping they look into it soon...starting to panic a little.

0 Likes
Kris_Doyle
Shopify Partner
85 0 19

Hi Shopify ,

Would it be possible for anyone to offer an official opinion on this?

I created a support ticket a little over a week ago with no response, and it's almost March 2.

I also sent a video showing that my app has no effect on store performance so I'm not sure what else I can do.

At this point, all I can do is wait and see what happens on March 2 but obviously I'm a little concerned here.

Help?

0 Likes