Help Centre

In this article, we will look at how to set up split testing within your recommendations tool and where to find the results of completed split tests.

Split testing commonly referred to as A/B testing, allows a user to compare two different versions of a campaign unit with controlled strategy for each version to determine which results in a better performance or in the case of Recommendations increased conversions. 

Setting up split testing within the Recommendations tool is especially easy to set up and can be live within a few minutes.

1. Firstly, you must ensure that you have more than one unit variant set up to perform an adequate split test. 
2. To add a unit select New Unit this will create a unit for the selected strategy you would like to set for the recommendations unit. 
3. Repeat this process for a second unit for split testing with a different slot strategy. 
4. Now you have your units, within the Campaign Settings select the Split Testing Options button. This will take you to the variants you have created with the option to view and amend the weighting for the units. 
5. The weighting of each unit will determine what percentage of the unit weighted would show in the page, for example 100% would show all of the time 50% would show 50% of the time. 

We recommend that if you complete a split test of two units, weighting these to 50% so that they are delivered a fair number of times to establish true results. 

We would suggest Variant 1 has different slot strategies to Variant 2 so that the split testing results give you a defined result at the end of the test as to which type of strategy performs best on your site. 

We also recommend ensuring that when customising the variants, they are both set to appear on the same page type. For example, create a split test with 2 units to compare results on product pages. This way you can analyse what strategy drives the most conversions across 

1. Once finalised, press Save Changes to complete. Your Split testing will take place once the units have been enabled within the Activate Campaign section in the Campaigns Settings area. 

Please ensure both unit variants are live in order for your split test to run successfully. 

You may view the results of your split test at the top of the module screen underneath the Results tab.