Conversion correlation

The conversion correlation analysis on the Campaign Analytics page gives you insight into what user attributes and behaviors help or hurt the outcomes you set for campaigns.

Overview

For every campaign, Braze checks a list of attributes and user behaviors and computes whether users are statistically significantly associated with increases or decreases in each of the conversion events you’ve chosen for the campaign. We also compute how much more or less likely users with the given attribute or behavior were to convert, and if it’s significant, display that on the corresponding side of the table. Users with each attribute or behavior of interest are compared to the rates for the entire campaign audience as a whole. Behaviors and attributes that have no significant correlation with conversion are not shown in the table.

To run a conversion correlation analysis, select the conversion event of interest from the dropdown menu.

What is checked?

We check the following attributes by treating them as categorical variables. In other words, a user either does or doesn’t have each possible value of these attributes, and we test whether they affect the conversion rate.

• Country
• Language
• Gender

We also check whether the following affect the rate of conversion:

• Performing any custom events
• Campaigns and Canvases received in the last 30 days (other than the campaign currently being assessed)

Finally, we check several behavioral variables that can take on multiple values. We split the following into four buckets or quartiles and then measure the association of being in that quartile with increases or decreases in conversion:

• Age
• Total dollars spent
• Number of sessions

When can I check this analysis?

This analysis becomes available at least 24 hours after a campaign starts sending and only looks at sends that occurred in the last 30 days. If no behaviors or attributes significantly correlate with any of the campaign’s conversion events, the dropdown menu will be disabled and a message will be displayed letting you know that’s the case.

How Braze checks for significance

We check for statistical significance by using the Wilson confidence interval. We determine at 95% confidence the rate at which the entire campaign audience converted. This is called the base rate.

Then, for each of the variables, we also compute the rate at which users with that particular attribute or behavior of interest converted at 95% confidence. By dividing that by the base rate, we’re able to measure the ratio. If it’s much larger than 1, users with the attribute or behavior are more likely to convert. If it’s much less, they’re less likely. We display the value of the ratio itself in the table. The value is only displayed if it’s far enough from 1 to be significant at the 95% confidence level.