Customers Segmentation not working for orders placed in test payment mode

Shopify Discussion

Topic summary

A developer working on a Shopify loyalty app integration has encountered two testing issues on their development store:

Primary Issue - Customer Segmentation:

  • Customer segments fail to recognize test orders placed using test payment methods (both Shopify Payments and Bogus Gateway)
  • A segment filtering for “number_of_orders = 0” shows 100% of customers with zero orders
  • However, individual customer profiles clearly display multiple test orders
  • The segmentation system appears unable to count orders completed through test payment modes

Secondary Issue - Test Card Checkout:

  • Standard Shopify test card numbers (e.g., 4242…) are rejected during checkout when logged in as a customer
  • The same test cards work successfully when using “Checkout as guest” mode
  • This prevents test cards from being saved to customer accounts during testing

Store Configuration:

  • Development store with Shopify Payments enabled in test mode

The developer seeks solutions for making customer segments properly recognize test orders and enabling test card functionality for logged-in customer checkouts. Both issues appear related to how Shopify’s development environment handles test transaction data.

Summarized with AI on November 1. AI used: claude-sonnet-4-5-20250929.
1

Hey.

I’m working on a company that develops an loyalty provider that has integration with Shopify.

I currently have two issues:

  1. Customers Segments are not filtering test customers that placed test orders using test payment (I’ve tried both Shopify Payments & Bogus Gateway).
  2. Tangential: checkout page on my dev store rejects test card number (e.g. … 4242), but if I click on “Checkout as guest”, then specified card number works (albeit not stored in my test customer account I’m using for purchase).

Problem #1

  • I’ve created following customers segment to identify customers with no purchases (query “number_of_orders = 0”)

bhseletskiy_2-1737832273758.png
bhseletskiy_2-1737832273758.png695×701 49.3 KB

  • Note, that it displays “100% of your customer base” and every customer has 0 orders.
    However, if I click on “Test Testerson” customer, I see plenty of orders.
    All of them were made using test mode payment provider (both Shopify Payments and Bogus Gateway)

bhseletskiy_1-1737832200900.png
bhseletskiy_1-1737832200900.png692×573 83.5 KB

  • This is development store and I am using Shopify Payments in test mode:

bhseletskiy_3-1737832361201.png
bhseletskiy_3-1737832361201.png733×660 47.3 KB

Problem #2

  • Despite Shopify Payments is in test mode, I can not use any of provided test card numbers:

bhseletskiy_4-1737832673403.png
bhseletskiy_4-1737832673403.png618×994 66.1 KB

  • However, if I click on “Checkout as guest”, same test card works.

bhseletskiy_5-1737833124443.png
bhseletskiy_5-1737833124443.png645×966 81 KB

Therefore, my questions are:

  1. How to make customers segments match customers that placed test orders using test payment on a development shop?
  2. How to make test card number work on checkout without entering “guest” mode?