ContributionsMost RecentMost LikesSolutionsRe: Question for Guenda on best practices for testing - Test and Learn AMA test one thing at a time (so decide one KPI to monitor for each test) make sure the results of your test are significant re-run the test periodically to confirm its validity over time Re: Question #2 on testing for BlaBlaCar - Test and Learn AMA At BlaBlaCar we have dedicated analytics resources that help us monitoring the performances of programs and campaigns (and thanks to currents we are able to export data in Tableau, the data visualization tool we use in the company). We also monitor programs performances directly in Braze thanks to conversion events (to check uplift in conversions). Re: Welcome to the Test and Learn AMA! At BlaBlaCar we keep track of all tests, results, learnings and iterations in the CRM dedicated team workspace of Confluence, the shared tool used to keep track of projects at company level. Re: Another question on testing for BlaBlaCar - Test and Learn AMA It’s the great uplift generated by our Verified Profile program: we tested this program aimed at encouraging people to verify their profile (verify their email, phone number, ID) and we kept a 20% control group that didn’t receive any message. The uplift we saw in the adoption of the VP feature was huge, +700% in treatment group vs CG. The highest uplift ever generated in CRM at BBC! The test was easy to put in place thanks to the new canva flow Experiment Path component that allowed us to add the split treatment/control group exactly where we wanted in the flow and simplified the monitoring of the performances a lot compared to the old canva flow setup. Next on our testing calendar is to try the Winning Path new feature out to save some time and automate the selection of the winning path. Re: Question on testing for BlaBlaCar - Test and Learn AMA We made several rounds of testing during 2 months, in 2 different countries (France and Russia). We tested: Common name vs. Rare Name; Masculine name vs. Feminine Name; Company name vs. Real Sender Name. The results were clear: using a first name had a big impact on open rates (up to +24%) and very popular masculine names performed better. Re: Welcome to the Test and Learn AMA! From my experience the most common overlooked factor is not considering statistical significance of a test and draw conclusions (that may be wrong) too early. As for the misconception, not reconfirming/re-checking the test results regularly is for sure quite dangerous since users' behaviour can change quite quickly and what worked one year ago may not work anymore. Re: Welcome to the Test and Learn AMA! Hello, thanks for having me here today. At BlaBlaCar we want to make sure as much as possible that everything we send to our members has a positive impact on activity and is the most engaging version we could come up with. For this reason we both test different content to maximize member's engagement towards the comms and we test the incremental impact of our programs vs a control group that does not receive anything.