lighteval icon indicating copy to clipboard operation
lighteval copied to clipboard
verified publisher icon huggingface

[FT] Add tool usage benchmarks

Open NathanHB opened this issue 1 year ago • 1 comments

Issue encountered

Lighteval does not allow evaluating models on tool usage.

Solution/Feature

Add benchmarks for tool usage

NathanHB avatar Aug 13 '24 09:08 NathanHB

Add benchmarks for tool usage Are there any? What do you suggest?

PhilipMay avatar Aug 23 '24 09:08 PhilipMay