Forum Discussion

megantu's avatar
megantu
Active Member
2 years ago

Canvas Testing

What's the best way to A/B test within a canvas? Since there isn't the ability to A/B test different variants like with a campaign, we set up an 'experiment' but that only shows data but conversion rate and not opens/clicks/unsub/etc. With the experiment, the data is messy in the report builder and when you try to delete a step after the test it says you'll lose all the users in that step. 

  • DavidO's avatar
    DavidO
    Strategist II

    Hi megantu 

    I often run two variants at the top of the canvas and a control. This leaves me with the option to compare variant data through each step as well as the ability to compare everything against a control group.

    It's not perfect for detecting small changes like an campaign A/B test and the reporting is 'okay' but it is still helpful to see how each variant performs against one another.

    😊

  • DanyWillis's avatar
    DanyWillis
    Practitioner III

    Pretty much what David above says, also consider the goal of the test. And importantly how long will you have to run it for in order to get significance?