A/B Testing Machine Learning Models: Statistical Rigor in the Real World
A practitioner's guide to A/B testing ML models in production, covering statistical significance, sample size calculations, multi-armed bandits, the tension between model metrics and business KPIs, and the insidious novelty effect.
• Aryanto, M.Si