Robert Shepherd’s Post

View profile for Robert Shepherd

Data Science Manager at Skyscanner

Wonderful article here from Dhanush Kishore on the statistical engine we have developed at Skyscanner to evaluate A/B tests and estimate uncertainty:

WISE: Skyscanner’s Bayesian AB experimentation library and decision engine

WISE: Skyscanner’s Bayesian AB experimentation library and decision engine

medium.com

Arun C.

Senior Data Scientist

10mo

Dhanush Kishore and the Skyscanner experimentation squad have provided an outstanding overview of WISE, Skyscanner's Bayesian AB experimentation library. Here are some key points: Technical Sophistication: Using Bayesian statistics for product decision-making allows integration of prior knowledge and updating beliefs with new data. Automated Decision-Making: WISE's integration into the Dr Jekyll platform automates decision processes, reducing the cognitive load on data scientists and product managers. Standardization Across Teams: WISE standardizes AB testing across Skyscanner, ensuring consistent, reliable experimentation outcomes that facilitate easy comparison and insight sharing. Statistical Rigor: The use of Bayesian models like the beta-binomial and hurdle gamma-exponential addresses the complexities of skewed and zero-inflated data. Real-World Application: An example involving messaging about commissions illustrates WISE's practical value in enhancing user trust and improving experience. Challenges and Education: Acknowledging challenges in adopting Bayesian methods and the need for stakeholder education sets realistic expectations for transition.

Like
Reply

To view or add a comment, sign in

Explore topics