growthbook icon indicating copy to clipboard operation
growthbook copied to clipboard

[stats] Add ability to specify effect priors

Open lukesonnet opened this issue 2 years ago • 1 comments

Summary

Adds ability to add informative priors to bayesian analysis.

Passes those priors down to the stats engine and renders them at the bottom of the results table.

Testing

WIP

Screenshots

Org settings Screenshot 2024-04-18 at 12 17 36 PM Screenshot 2024-04-18 at 12 17 41 PM

Results (flat prior, see results and text at bottom) Screenshot 2024-04-18 at 12 18 51 PM

Results (weakish informative prior, see results and text at bottom) Screenshot 2024-04-18 at 12 17 49 PM

Results (very strong prior, see results and text at bottom) Screenshot 2024-04-18 at 12 18 07 PM

TODO:

  • [ ] Add analysis settings toggle (with warning that you shouldn't really change this midflight)
  • [ ] Add custom report settings
  • [ ] Add ability to config via config.yml

lukesonnet avatar Apr 18 '24 19:04 lukesonnet

Deploy preview for docs ready!

✅ Preview https://docs-klzy4yfvb-growthbook.vercel.app

Built with commit f12ae434e2e085cc4e040478ea2a9f5b17d8ca6e. This pull request is being automatically deployed with vercel-action

github-actions[bot] avatar May 02 '24 19:05 github-actions[bot]