HRM
HRM copied to clipboard
generalization bound estimation preliminary result
Hi. here are published ARC-2 weight estimated generalization bounds using paper data: [hoeffding] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=36.01% (err_upper=63.99%) [empirical_bernstein] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=34.63% (err_upper=65.37%) [wilson_one_sided] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=37.78% (err_upper=62.22%) [pac_bayes_seeger (KL≈2.85e+06, k=562741762, prior_var=1.0)] n=1000, correct=403, delta=0.05 | emp_acc=40.30% -> acc_lower=40.30% (err_upper=59.70%)