Skip to content

tea-tasting 0.0.1

Pre-release
Pre-release
Compare
Choose a tag to compare
@e10v e10v released this 10 Dec 21:33
· 436 commits to main since this release
v0.0.1
8a151a8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

tea-tasting is a Python package for statistical analysis of A/B tests that features:

  • Student's t-test, Z-test, and Bootstrap out of the box.
  • Extensible API: Define and use statistical tests of your choice.
  • Delta method for ratio metrics.
  • Variance reduction with CUPED/CUPAC (also in combination with delta method for ratio metrics).
  • Fieller's confidence interval for percent change.
  • Sample ratio mismatch check.
  • Power analysis.
  • A/A tests.

Currently, tea-tasting is in the planning stage, and I'm starting with a README that outlines the proposed API — an approach known as Readme Driven Development (RDD).

Check out my blog post where I explain the motivation for creating this package and the benefits of the RDD approach.

Assets 2
Loading
0 Join discussion