Skip to main content

How does A/B split testing work?

Learn how to use A/B test feature in app

Darius Serapinas avatar
Written by Darius Serapinas
Updated over a week ago

Want to test which bundle offers convert best? With the A/B Split Testing feature in Kaching Bundles, you can easily compare different bundle variants and see what resonates most with your audience — no third-party tools required.


Why A/B Testing Matters

A/B testing is one of the most effective ways to optimize your store’s performance. By showing different versions of a bundle deal to different visitors, you can:

  • Compare prices, layouts, or messaging

  • Improve conversion rates

  • Learn what your customers actually respond to

Over time, small tweaks based on real data can lead to significantly better results.


How It Works (Behind the Scenes)

When you enable A/B testing on a bundle:

  • All traffic to that bundle is automatically split evenly between the variants you create.

  • Each visitor sees only one variant, which is stored in their browser under a special session ID.

Specifically, we use a key called kaching_session_id in the user’s browser (via local storage) to keep track of which bundle variant they were shown.

What This Means for Returning Visitors:

  • As long as a visitor uses the same browser and device, and doesn’t clear their browsing data, they’ll always see the same variant.

  • If they switch browsers, devices, or clear local storage, they may be assigned a different variant when they return.

🧪 Advanced users can view or reset this by opening the browser Developer Tools → Application tab → Storage → Local Storage and deleting “kaching_session_id” key.


How to Set Up A/B Split Testing

Follow these steps to enable and configure A/B testing for a bundle:

  1. Open the Bundle

    Go to the Kaching Bundles app and open the bundle you want to test (or create a new one).

  2. Enable A/B Testing

    Click the “Run A/B test” button in the top-right corner of the bundle preview section.

  3. Create Variants

    You’ll see Variant A and Variant B created by default. You can also click “Add variant” to create additional versions. You can have max 4 different split test variants for each bundle block.

  4. Customize Each Variant

    Set different bundle deals, prices, titles, images, etc., for each variant. Each one will be shown to an equal portion of your visitors.

  5. Save and Publish

    Once your A/B test is ready, click “Publish” to push it live to your store.


Important Tips & Limitations

  • You can test everything in your bundle setup — including layout, discount tiers, product images, and button text.

  • ❌ The following settings cannot be split-tested:

    • Bundle visibility (Markets, main products selection)

    • Schedule (start/end dates for the bundle)

Can I Test Different Prices?

Yes, as long as you're applying a discount.

Keep in mind:

  • You can’t use the app to increase the original product price.

  • To simulate a price increase, adjust the original price on your product, then apply a smaller discount on one variant.


Need Help?

If you’re unsure how to structure your test or want help setting up variants, our support team is here to help — just reach out through the in-app live chat.

Did this answer your question?