stanford_alpaca icon indicating copy to clipboard operation
stanford_alpaca copied to clipboard

BBH stats?

Open i-am-neo opened this issue 2 years ago • 0 comments

Sorry to see the demo go dark. Hope you guys are doing ok.

Wondering if you could run benchmarks with the weights you have against BIG-Bench Hard and share the results?

Results for Causal Judgment, Disambiguation QA, Formal Fallacies, Hyperbaton, and Logical Deduction (Five Objects) would be of interest.

Thanks.

i-am-neo avatar Mar 18 '23 22:03 i-am-neo