Analytics Discrepancy (orders vs "sessions with completed checkout") caused by cookie banner?

Hi there

Since we implemented the Pandectes cookie consent banner at start of November we’ve noticed that our Shopify conversion rate has dropped dramatically (despite orders being up and sessions slightly down, which isn’t logical).

When we investigated, we found that conversion rate is defined as “sessions with completed checkout”/ sessions and not orders / sessions.

Prior to Pandectes installation the “sessions with completed checkout” metric tracked to orders at around 98% accuracy. Since Pandectes implementation it has tracked to 55-65% accuracy (about in line with % opting out of cookies).

We’re unclear what the technical difference is between “orders” and “sessions with completed checkout” and why “sessions with completed checkout” would be negatively impacted by a cookie banner but not sessions themselves (or orders).

Can anyone explain the difference and whether there’s anything we can do to reduce the discrepancy and make conversion rate tracking more accurate?

Thanks

Hi @jnellers1

I understand you’re grappling with a puzzling drop in your Shopify conversion rate after implementing the Pandectes cookie consent banner. Even though your orders have increased and sessions have slightly decreased, the conversion rate decline seems illogical at first glance.

Understanding the Metrics:

In Shopify, the conversion rate is calculated by dividing “sessions with completed checkout” by total sessions. This means it’s based on the number of sessions that lead to a completed checkout, not directly on the number of orders. Before introducing the Pandectes banner, your “sessions with completed checkout” closely matched your order count, with about 98% accuracy. However, post-implementation, this accuracy has dropped to 55-65%, which aligns with the percentage of users opting out of cookies.

Impact of the Cookie Consent Banner:

The Pandectes cookie consent banner prompts users to accept or decline cookies upon visiting your site. When users opt out, certain tracking cookies, especially those used for analytics, are disabled. This means that while the actual number of orders remains unaffected, the tracking of “sessions with completed checkout” is hindered because the analytics tools can’t record these sessions without the necessary cookies. Consequently, the conversion rate appears to drop because the denominator (total sessions) remains the same, but the numerator (“sessions with completed checkout”) decreases due to lack of tracking consent.

Difference Between “Orders” and “Sessions with Completed Checkout”:

“Orders” represent the actual number of purchases made on your store. In contrast, “sessions with completed checkout” refer to the tracked sessions where a checkout was completed. If a user opts out of cookies, their session might not be tracked, leading to a discrepancy between the two metrics. This is why you’re seeing a divergence between your order count and the “sessions with completed checkout” metric.

Reducing the Discrepancy:

To minimize this discrepancy and achieve more accurate conversion rate tracking:

  1. Implement Google Consent Mode: This feature allows your analytics tools to gather basic data even when users decline cookies. It adjusts how Google tags behave based on the user’s consent status, enabling partial data collection to maintain some level of tracking. Pandectes integrates with Google Consent Mode V2, enhancing compliance and data accuracy.
  2. Customize the Consent Banner: Design your cookie consent banner to clearly explain the benefits of enabling cookies, emphasizing how it enhances user experience. A well-informed user is more likely to opt-in, improving your tracking accuracy. Pandectes offers customizable banners to align with your store’s design and messaging.
  3. Analyze Opt-Out Rates: Regularly monitor the percentage of users opting out of cookies. If the opt-out rate is high, consider revising your banner’s messaging or design to encourage more users to consent.
  4. Review Analytics Settings: Ensure that your analytics tools are configured to handle consent management properly. This includes integrating with consent management platforms and setting up data collection preferences based on user consent.

By implementing these strategies, you can bridge the gap between your order count and the “sessions with completed checkout” metric, leading to a more accurate representation of your store’s performance.

If you need any other assistance, feel free to reply and I will try my best to help.

Best regards,

Daisy

Hello DaisyVo,

Thanks for your support—it helped me too.

So, to summarize the Shopify metrics:

Orders: → Includes all orders, regardless of their status (e.g., completed, pending, canceled).

Sessions that completed checkout: → Refers to tracked sessions where a checkout was completed. If a user opts out of cookies, uses an ad blocker, or experiences technical issues, their session might not be tracked. This can lead to a discrepancy between this metric and the total number of orders.

Correct?

However, I also found another metric that I couldn’t locate in the Shopify documentation—it’s called total_orders_placed. For a long time, this metric in our reports matched Sessions that completed checkout with 100% accuracy. However, since September 2023, the two metrics have started to diverge. Since mid-January, the difference has grown even larger. So could you explain exactly how this metric is calculated? Am I correct in assuming that it may exclude certain types of orders, such as test orders or canceled orders?

Thanks and kind regards
kivvi.studio

Hello,

We are also using GDPR Compliance since a year or so,

by optimising the GDPR banner we achieved approx 90% acceptance rate of the cookie banner.

So the difference between “Sessions converted” and “Total Orders” was very small, even when running GDPR Compliance banner.

But suddenly since around January 2025.. The difference between “Sessions converted” and “Total Orders” became much bigger ( around 50% difference ) . Even though my Cookie banner is still accepted by 90% of visitors.

So somehow Shopify has made a change that causes this bigger difference. Could it be something to do with the new “Checkout” way that shopify implemened with the new way of handling Post Purchase Conversion tracking etc?

I have no clue on how to fix this, I just know my Conversation Rate is now messed up and analyzing / optimizing that became much more difficult, unless I manually recalculate the correct Conversion Rate every time.

hi there. same here since last week. support team don’t have any clue. have you found a solution by any chance? thanks in advance