As the introduction of the app could have had a fundamental impact on how customers behaved during their weekly shopping cycle, Abel and Cole were keen to understand how they could measure the impact of the app on their business metrics, such as revenue.
We first made the app accessible to staff users beforehand, which allowed fast feedback as we were developing in a pre MVP state.
A product launch plan then followed with the app released to a small subset of interested users, allowing us to collect and analyse enough data before rolling it out to the app stores.
The most critical part of the plan was segmenting customers in a fair way to ensure that the results were robust and comparable. So, we asked existing Abel & Cole customers if they were interested in testing the app.
With this in place, we could compare key metrics across Segments A and B, with the certainty that we were comparing like-for-like customer intent and loyalty to the Abel and Cole brand.