Billing complaints show up in 18.7% of one and two star Shopify app reviews, versus just 3.6% for setup complaints — that’s out of 2,797 bad reviews we read.
The timing makes it sharper. The median one star reviewer had already been paying for 90 days when they wrote the review. The median five star reviewer wrote after just 30 days, and a quarter of them left their review within a day of installing. So the reviews that show up early are happy, and the ones that show up months later, after real money has changed hands, are the angry ones about billing.
Honest caveat: this only counts complaints merchants actually put into words in a review. Silent churn and cancellations with no review attached aren’t in here at all.
For the app builders here — when you’ve dug into your own cancellations, is billing/plan confusion actually the bigger driver past the trial period, or does onboarding still show up as the main complaint for you?
The 90 day versus 30 day gap matches what I see, though I would read it as billing being where the disappointment finally becomes visible rather than where it starts.
Two Shopify specific mechanics make billing complaints land harder than they should. App charges ride on the Shopify bill rather than on a card the merchant watches, so they see one aggregated invoice weeks later and have to work backwards to figure out which app took what. Nothing in that flow puts your name in front of them at the moment the money moves. The other one is usage based pricing with a capped amount. The app stops charging silently once the cap is hit and needs the merchant to approve a new cap, and merchants read that as either the app being broken or the app sneaking a price increase, depending on which side they notice first.
Trial conversion is the third. Billing starts the day the trial ends, and as far as I know nothing goes out from Shopify at that moment, so whatever warning the merchant gets is whatever you built yourself.
On cancellations, my read is that the person writing in month three is not complaining about the price, they are saying the app never became obviously worth its line on the invoice. An onboarding failure shows up as an uninstall in week one with no review attached at all, which is exactly the silent churn in your caveat. So the two numbers may be describing two different populations rather than two competing causes.
Did you split the 18.7% by pricing model? Flat monthly versus usage based feels like it would separate a lot, and that would be a more actionable number for builders than the overall rate.
Fair, and I think you’re right that it’s more likely two different populations than one causal chain. We only coded review text, not root cause beyond the category tag, so I can’t prove disappointment starts earlier and just surfaces at billing, but nothing in what I have contradicts it either.
No, we didn’t split the 18.7% by pricing model. That’s a real gap in what I ran, not something I’m dodging, we tagged “billing” as a category but not flat versus usage-based within it. I’d want that split too, usage-cap confusion and trial-to-paid surprise sound like they’d behave pretty differently from someone just deciding a flat monthly fee isn’t worth it anymore. If I can label review volume by pricing model, I’ll rerun it.