Split Testing Product Page Templates

New Member
1 0 0

I am looking for resources specific to how I can A/B test 2 product templates (not pages but actual templates across the site). Is this possible? Can anyone recommend best practices for doing so?

Shopify Expert
1232 109 302

You can do this with Theme Scientist, the Shopify A/B testing app.

Here's how that would work:

1) Duplicate your live theme (your live theme will be Theme A)

2) Make the changes to the product template on the new theme (this will be Theme B)

3) Start a Theme Test in the app. It will automatically swap those themes and track the stats, so you can compare which performs better.

Best practices vary depending on the store and goals, but in general I like this for Shopify sites:
- Run a test for at least 2 weeks and aim for 95%+ statistical significance (you can calculate significance with a calculator like this: https://speedboostr.com/ab-test-calculator... or the app I recommend has it built in).

- Swap themes every night at midnight to minimize the possibility of a user seeing a different theme during their browsing session. With Shopify, you don't have access to the server so doing split-traffic testing like you would on your own website is not really feasible (doable, but results in performance slowdowns because of rendering the page variation on the front end).

- Always be testing. I've been doing A/B testing for a few years and what happens is that some tests don't provide any differences, while some can provide significant improvements in conversion rate or actions taken. The key is to always be testing something, then when that test is complete, choose the winner and start the next test.

My team developed that app I mentioned, so if you need any help just contact us through the app listing: https://apps.shopify.com/theme-scientist

Founder of Speed Boostr (Shopify optimization experts, theme customization, custom app development).
Creator of Shopify Analyzer (first performance analysis tool for Shopify sites, free for the Shopify community).
Creator of Order Automator (auto tag orders and customers + auto fulfillment + more automations).
More apps: Theme Scientist (A/B testing), Tip Jar (add a tip button), File Optimizer (optimize CSS, JS, Liquid).
Shopify Partner
39 0 4

This can be quite tricky. Would recommend using an app to assist with doing this.

Would recommend Neat A/B 

If you need any support once installed on getting this successfully launched as you would like please reach out to us as we are always helping merchants run successful experiments!

CMO @ Neat A/B Testing - Price Testing, URL Split Testing, Theme Testing, and More
Founder of Shopify App Active Cart
- Was my reply helpful? Click Like to let me know!
- Was your question answered? Mark it as an Accepted Solution