A/B Testing, Subtract the Statistics

Data collection doesn’t always require fancy spreadsheets or databases
90% confidence that the variant outperforms the default is often confidence enough to change a business practice, but the ultimate decision depends on the context.
When the default performs better than the variant, you’ll see an expected improvement close to or lower than 0.

--

--

--

Spreading the love for data, and maybe other things too. flatland.ai

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Data, AI & Government 26–09–2018| week 39

Exploring Chicago Neighborhoods

Digital Analytics MiniDegree — Week 8 of 12

Covid cases and deaths today: coronavirus Africa map

Recruit Restaurant Visitor Forecasting

Monte Carlo Tree Search: Implementing Reinforcement Learning in Real-Time Game Player

Google search queries in the times of COVID-19

Who Won Super Tuesday’s Media Coverage. Based On Data

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Logan Kopas

Logan Kopas

Spreading the love for data, and maybe other things too. flatland.ai

More from Medium

Defining terms in Analytics

Simpson’s paradox, in A/B testing

All you should know about AB testing

Don’t believe the hype: Key Takeaways from CDAO UK 2022