EAGLE icon indicating copy to clipboard operation
EAGLE copied to clipboard

Dataset Details Used in Eagle Speedup Tests

Open bettybaii opened this issue 1 year ago • 0 comments

The paper mentions using several datasets, including MT-bench, HumanEval, GSM8K, and Alpaca, to test Eagle’s speedup effect. Would it be possible to provide the specific paths to the complete datasets? I noticed that the eagle/data directory contains several datasets, but most of them have only about 80 samples. Was the speedup effect in the paper tested using only these subsets, or were the full datasets used as well? Thank you!

bettybaii avatar Dec 27 '24 09:12 bettybaii