If you’re looking for more data and more creativity, we offer the option to A/B test any of your messaging campaigns. A/B tests are great if you’re not quite sure what your users respond best to.
A/B Testing Best Practices
This might sound silly, but to make sure you have a solid understanding of exactly what your users are responding best to, you’ll want to make sure you only change 1 thing between each variant. This could be the copy, the color, or emojis.
It’s also important that you maintain a Control Group for your A/B test. Control Groups are an important part of the data process—as they can inform you as to whether you might have had better results without a message at all.
Add or Destroy Creatives
To add another in-app message to your campaign, select the green + Add Creative button. You can add up to 10 creatives.
If you need to destroy a creative, simply click the trash can icon under the preview image or copy of the creative.
Confirm that you want to delete the creative, and you’re all set.
A/B Test Setup
If you need to adjust the distribution of your variants—say you’re more confident in Control A—you can do so by selecting the A/B Test Setup button above your creatives. Here you can Enable a control group (if you haven’t already done so—which we highly recommend!), and adjust the distribution of each variant.
Drag the selectors on the bar at the top to adjust or type in new percentages.
You also have the option to adjust the size of the Control Group. Changing the number will automatically update the percent of the audience who will receive the message.
Reset to Defaults
If you make a mistake adjusting your variants, you can choose the Reset to Defaults button to set every variant back to an equal percentage (your control group will reset back to 5%). When you’re finished, just click Done.