Intelligent Selection

Intelligent Selection is a feature that analyzes the performance of a recurring campaign or Canvas twice a day and automatically adjusts the percentage of users that receive each message variant.

A variant that appears to be performing better than others will get sent to more users, while underperforming variants will be targeted at fewer users. Each adjustment is made using a statistical algorithm that makes sure we are adjusting for real performance differences and not just random chance.

Intelligent Selection will:

• Repeatedly look at performance data and shift campaign traffic toward Winning Variants gradually.
• Check that more users receive your best-performing variant without sacrificing statistical confidence.
• Rule out underperforming variants and identify high-performing variants faster than a traditional A/B test.
• Test more frequently and with greater confidence that your users will see your best message.

Intelligent Selection is ideal for campaigns that are scheduled to send multiple times. Initial results are needed to begin adjusting your campaign; therefore, a campaign that sends only once will not benefit. For those campaigns, an A/B test would be more effective.

How do I add Intelligent Selection to my campaigns?

Campaign Intelligent Selection

Intelligent Selection can be added to any multi-send campaign in the Target Audiences step of the Braze campaign composer. Campaigns that send only once are unable to leverage this feature.

Canvas Intelligent Selection

When adding variants into your Canvas, click on one of the variant percentages. This allows you to edit the variant distribution and turn on Intelligent Selection.

Intelligent Selection will not be available if you haven’t yet added conversion events to your Canvas or if your campaign is composed of a solo variant.

For how long will it run?

For campaigns and Canvases, Intelligent Selection will run until it gathers enough evidence about the “true” conversion rates of the variants. “Enough” is determined by a special metric called “regret.” You can think of it as similar to confidence in that Intelligent Selection will turn itself off when there’s enough data to know which variant is best.

In most cases, Intelligent Selection will choose one of the variants as the Winning Variant. This variant will be given 100% of the audience for future sends.