experimentation
16 TopicsHow long do you run A/B or similar tests and why? Use cases?
Hi all, Curious about how long you run A/B tests, or any other tests for before making a call on the data. I imagine it varies with the use case and would be keen to hear other's thoughts and scenarios. Thanks 😊Solved504Views0likes3CommentsQuestion on testing for BlaBlaCar - Test and Learn AMA
Guendalina In the intro to this AMA session, I saw that you've been testing different "From" names in different markets. We've done this as well in multiple markets across Europe and North America. I'm curious to learn which types of names worked better than others, how many variations you tested and how long the tests lasted for.391Views1like2CommentsMeasuring Primary Conversion (A) and Conversion B in Canvas
Hi All, Hope you are all doing well. Had a query around tracking for Conversion Events A and B in the canvas. If I have my primary conversion defined as " sales form completed" and the secondary as "sales form started", would the same users appear potentially in both conversion events or only unique users are accounted for (once) across both conversion events A and B? Cheers RajSolved322Views0likes1CommentAction, personalisation, connection layers etc. - What are they in Braze?
Hello everyone! What do these different layers (connection, personalisation and action) of the Braze tech stack correspond to in terms of functions/features? And how do these layers interact with each other in different scenarios? I know this last question (on the sequence of a message through the tech stack) is one of the questions in the study guide for the admin certificate and it caught me completely off guard. Been looking throughout the documentation and have pieced together what the other layers "are" but can't find definite answers about these 3 or how they all interact in common scenarios. Would appreciate any insight!Solved309Views0likes1CommentIdeas for email open and click through rate testing
Hi all Just wondering what sort of tests others use to test open rate and click-through rate. For example: - Subject lines - Time of day - CTA wording - Localisation Would love to gather a laundry list of ideas to experiment with. 📃😁227Views0likes1CommentThe Personalized Variation Test in Campaign
We are doing our first A/B test out of Braze and the client wants to utilize the Personalized Variation test vs. the Winning Variation test. Now since we don't have many campaign history to go by since we just started deploying out of Braze, does that matter if we still run the Personalized Variation test? Does it go by past history characteristics OR solely similar characteristics on the initial test?158Views0likes0CommentsConversion Rate over 100%?
Hi, I'm struggling to understand the performance of one of our Canvases. I have both the conversion event and exit criteria as "any purchase", and users cannot re-enter the canvas. When I analyze the variants, I see more conversions than entries, leading to a conversion rate over 100%, which shouldn't be possible. Does anybody know what could be going wrong here? thanks!151Views0likes5CommentsAudience Path through event properties
Hello community! I need your help to set up a Canvas Flow: Context: In our subscription we are customising the unsubscribe flow based on the reason. We register this reason as an event property of the event that triggers the flow ( subscription cancel complete). Problem: It does not find the way to direct the users in a flow or another depending on the property of the event, since the ''audience path'' tool does not allow to split by event property. How would you do it? I could do it through conditions and liquid, but the flows are not exactly the same for all properties/reason. Thank you very much!Solved134Views1like4CommentsForge Canvas Template: Product repurchase reminder (with timing and channel testing)
Hello fellow Braze orchestrators, I didn't make it to Forge in person this year, but it was great tuning in to the keynotes and catching up on all the latest Braze innovations. 🔥 Here is a quick Canvas that we are about to launch to drive repurchase of two of our products that customers need to by on a regular basis. Entry criteria: purchase of a certain SKU Experimentation (both set up as Personalized Path): Message timing (30 days vs 45 days after the purchase) Message channel (email vs SMS, in this case) Message sequence: A user gets a reminder to repurchase the product she might be running low on; If a user engages with the message from step 1, but does not purchase, he receives a reminder 3 days later with a special offer, to incentivize the purchase. Let me know if you see any opportunities for improvement. I imagine, soon we will be able to simplify this flow by leveraging all the upcoming Braze AI tools. Cheers, Olga Baker Charlie Banana / P&G114Views5likes1CommentLiquid arrays personalization
Hello everyone I'm trying to implement this liquid code in one of my templates: {% assign combinedResults = canvas_entry_properties.${data}.results | concat: canvas_entry_properties.${data}.featuredResults %} {% assign results = combinedResults | sort: 'totalEstimatedCost.amount' | reverse %} The arrays canvas_entry_properties.${data}.results and canvas_entry_properties.${data}.featuredResults are two arrays that contain a list of offers, with each offer having a name, an ID, and a totalEstimatedCost.amount Using this Liquid code, I want to first create a third array called combinedResults that merges the offers from both canvas_entry_properties.${data}.results and canvas_entry_properties.${data}.featuredResults. Then, I want to sort this combined array so that the offers are displayed in descending order based on totalEstimatedCost.amount, from the highest to the lowest price However, the issue is that the displayed list first shows the two offers from the featuredResults array sorted in ascending order (from the smallest to the largest price), followed by the five offers from the results array sorted in descending order (from the largest to the smallest price). Do any of you know why this could happen? the structure of the original arrays is the same. Thank you in advance!98Views1like2Comments