lifetimes icon indicating copy to clipboard operation
lifetimes copied to clipboard

Beautiful plot_calibration_purchases_vs_holdout_purchases plot! But disappointing plot_cumulative_transactions

Open invictus2010 opened this issue 4 years ago • 1 comments

I trained a BGF fitter against 30 months of customer data. I held back 1 month of data. Look how amazing this fit appears: image

Then, I ran plot_cumulative_transactions and see this image

Much bigger disparity in actual v forecasted than I hoped to see. Is this an example of overfitting my data? Or is there something else going on?

invictus2010 avatar Nov 19 '20 19:11 invictus2010

@invictus2010 if you plot from cohorts on both sides of your first month cohort, do you see the similar disparity?

ryanbonifacino avatar Mar 07 '21 17:03 ryanbonifacino