HRM icon indicating copy to clipboard operation
HRM copied to clipboard

generalization bound estimation preliminary result

Open aseok opened this issue 3 months ago • 0 comments

Hi. here are published ARC-2 weight estimated generalization bounds using paper data: [hoeffding] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=36.01% (err_upper=63.99%) [empirical_bernstein] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=34.63% (err_upper=65.37%) [wilson_one_sided] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=37.78% (err_upper=62.22%) [pac_bayes_seeger (KL≈2.85e+06, k=562741762, prior_var=1.0)] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=40.30% (err_upper=59.70%)

aseok avatar Sep 22 '25 07:09 aseok