Audaxium Blog

Perhaps you use NetSuite and have gotten into a groove. Perhaps you don’t keep on top of every little option.  Here’s one option that, in my opinion, anyone who is doing email campaigns in NetSuite should use regularly.

Here is the high level.  

First, if you have a large distribution list in NetSuite that you send emails to, you should always test different messages and formats on random group members to see what is the most effective combination.

Secondly, there is no reason to just split your group 50/50.  As long as you have 100-200 members in your second or third test group, depending on the total size,  you’ll have enough data to have statistical significance and therefore make some decisions about what works and what doesn’t.

If you have 1000 contacts in your distribution list, it’s perfectly reasonable to send out a slightly different message/call to action/format to 200 of them.  

If you want to calculate the statistical significance of a sample size check this link here

The other day, I was asked how to do A/B Testing of emails in NetSuite.   It’s fairly easy to do so here’s how.

First, go to Setup, Marketing Preferences, and click the box that says Campaign Test Cells.

Then, go and set up or edit a NetSuite Group.  Hopefully you know how to do that!

When you get into the group you’ll now see a test cells tab there.  This is where you set how many of the group you want in each test, by percentage.

NetSuite will select members for each test cell randomly each time the group is used and give you the stats in your campaign.

Next, go to a new campaign and select that group as the one to use.  You’ll then select a different email template to use for each test cell. Execute your campaign as you normally would and NetSuite will take care of the rest.

When you look at the campaign statistics you’ll see the different testcell/email template combinations as different “events” with their own different statistics.

Next, bask in the glory of admiration from your boss as you tell him/her why your instincts were right and the old messaging just isn’t working, and your brilliant idea is a smashing success!