AB testing homepage, product arrangement, copy

Shopify Apps

Topic summary

A merchant wants to A/B test multiple homepage elements: different images, copy variations, and product arrangement (which products appear first). They anticipate needing 5-8 test variations and are seeking app recommendations.

Suggested Solutions:

  • General A/B testing apps available in the Shopify App Store
  • Google Tag Manager as a free alternative
  • Theme Scientist (recommended for testing themes and product page attributes): Works by duplicating the live theme, making edits to the duplicate, then automatically swapping between versions at set intervals while tracking performance stats

Key Recommendations:

  • Test only one element at a time for clearer attribution of conversion rate changes
  • For product arrangement testing (#3), custom JavaScript may be needed to control sort order (e.g., “best sellers” vs “new arrivals”) based on which theme variant is active

Additional mention: SEO AB Tester app for testing page titles and meta descriptions in search results, though this addresses a different use case than the original request.

The discussion remains open with no final decision made by the original poster.

Summarized with AI on October 27. AI used: claude-sonnet-4-5-20250929.
1

I plan to test a few variations:

  1. homepage (different images)

  2. copy

  3. product alignment (e.g. first product shoppers see is X, then Y)

I assume there will be at least 5-8 variations I would need to test. Any suggestion on an app that allows to A/B test all these elements?

1 Like
2

Various options in the App Store. You could also use Google Tag Manager (example).

Would be a nice project to create a custom app for too.

3

@Toipal you can use Theme Scientist to A/B test themes or product page attributes.

You duplicate your live theme, then make the edits on the second theme, then the app swaps them at the interval you choose plus calculates the stats of each.

For #3, you might have to integrate some custom JavaScript into your theme… I think the way I would approach is to set it up by sort. For example testing “best sellers” vs “new arrivals”. Then on page load, have some code that sets the sort order based on whether it’s theme A or B.

I recommend only testing 1 element at a time for more accurate results (rather than 3 different areas, because then you can’t be sure which change affected the conversion rate).

My team built that app Theme Scientist, so we can help you get set up if you need it, just contact us through the app listing and ask for Joe: https://apps.shopify.com/theme-scientist

4

I found an app for AB testing page titles and meta descriptions (what gets shown on Google). Slightly off topic to what you are trying to test, but might be worth checking out! The app is called SEO AB Tester, it’s helped my store.