Is it possible to perform A/B test with Flow?

Solved

Is it possible to perform A/B test with Flow?

TomChuk
Tourist
9 0 2

Hi there!

Our store currently sends three abandoned checkout emails that were automated with Flow. As an email marketing specialist, I have some concerns about the performance of one of these emails, and I would like to test a hypothesis by comparing it with a slightly different version. However, I don't want to completely replace the existing email, as it has been working well so far.

So, my question is: A) is there a way to split the email flow into two equal groups (e.g., 50/50), so that each group receives a different version of the email, and then B) later combine the groups back into one flow?

 

Thank you for your help!

Accepted Solution (1)

paul_n
Shopify Staff
1188 144 279

This is an accepted solution.

There isn't a random number generator yet, although you can generate random numbers in liquid. I don't think that helps you for this use case, though. 

 

Instead, you could look for something on the customer that is random and check for that in a condition (like the presence of a letter/number in their name or email). It likely won't give you a perfect 50-50 split, but is a decent workaround until that action exists.

Paul_N | Flow Product Manager @ Shopify
- Finding Flow useful? Leave us a review
- Need Flow help? Check out our help docs.
- Building for Flow? Check out Flow's dev docs.

View solution in original post

Replies 5 (5)

paul_n
Shopify Staff
1188 144 279

This is an accepted solution.

There isn't a random number generator yet, although you can generate random numbers in liquid. I don't think that helps you for this use case, though. 

 

Instead, you could look for something on the customer that is random and check for that in a condition (like the presence of a letter/number in their name or email). It likely won't give you a perfect 50-50 split, but is a decent workaround until that action exists.

Paul_N | Flow Product Manager @ Shopify
- Finding Flow useful? Leave us a review
- Need Flow help? Check out our help docs.
- Building for Flow? Check out Flow's dev docs.
TomChuk
Tourist
9 0 2

Thanks! I used add and even numbers of {{id}} to split that flow.

What about joining splitted flow back? Is it possible?

paul_n
Shopify Staff
1188 144 279

Not currently. Right now, you'll need to duplicate the steps per branch

Paul_N | Flow Product Manager @ Shopify
- Finding Flow useful? Leave us a review
- Need Flow help? Check out our help docs.
- Building for Flow? Check out Flow's dev docs.
DannyDG
Shopify Partner
2 0 0

How did you do this exactly? I don't seem to have an odd/even option.

TomChuk
Tourist
9 0 2

To do so you need to add a condition that checks some number related to your flow. At last, I choose a customer's phone number. Even numbers lead to one thread, odd numbers - to another one. It's not a beautiful but working solution.

TomChuk_0-1695642283394.png