Data Science Bite: A/B Testing
I’d like to share my latest “data science bite“: A/B Testing.
New Free Mini-Lecture: Simpson’s Paradox in A/B Testing
I’d like to share a new fee mini-lecture on avoiding Simpson’s Paradox when analyzing A/B test results.
Quick Significance Calculations for A/B Tests in R
Introduction Let’s take a quick look at a very important and common experimental problem: checking if the difference in success rates of two Binomial experiments is statistically significant. This can arise in A/B testing situations such as online advertising, sales, and manufacturing. We already share a free video course on […]
Campaign Response Testing no longer published on Udemy
Our free video course Campaign Response Testing is no longer published on Udemy. It remains available for free on YouTube with all source code available from GitHub. I’ll try to correct bad links as I find them. Please read on for the reasons.
Win-Vector video courses: price/status changes
Win-Vector LLC has been offering a couple of online video courses on the topics of data science and A/B testing (both using R). These are high quality courses and well worth the money and time needed to work through them closely (with all materials distributed on GitHub). Our current distributor […]
Free video course: applied Bayesian A/B testing in R
As a “thank you” to our blog, mailing list, and Twitter followers (@WinVectorLLC) we at Win-Vector LLC have decided to re-release our formerly fee-based A/B testing video course as a free (advertisement supported) video course here on Youtube. The course emphasizes how to design A/B tests using prior “guestimates” of […]
Sequential Analysis
We here at Win-Vector LLC been working through an ad-hoc series about A/B testing combining elements of both operations research and statistical points of view. A dynamic programming solution to A/B test design Why does designing a simple A/B test seem so complicated? A clear picture of power and significance […]
Wald’s sequential analysis technique
A corrected version of this article is now here.
A dynamic programming solution to A/B test design
Our last article on A/B testing described the scope of the realistic circumstances of A/B testing in practice and gave links to different standard solutions. In this article we will be take an idealized specific situation allowing us to show a particularly beautiful solution to one very special type of […]
Why does designing a simple A/B test seem so complicated?
Why does planning something as simple as an A/B test always end up feeling so complicated? An A/B test is a very simple controlled experiment where one group is subject to a new treatment (often group “B”) and the other group (often group “A”) is considered a control group. The […]