Easy-Transformer icon indicating copy to clipboard operation
Easy-Transformer copied to clipboard

[Feature Request] Add Stopping Criteria support

Open Butanium opened this issue 1 year ago • 2 comments

Hey,

Huggingface offers a useful Stopping Criteria class that can be utilized in the .generate function to halt generation based on custom conditions.

Do you think it would be possible to integrate this functionality into HookedTransformer.generate as well?

Butanium avatar May 15 '24 10:05 Butanium

I think this could be a very useful thing to add

bryce13950 avatar May 23 '24 00:05 bryce13950

Hi @bryce13950 , if this isn't being actively worked on, I'd like to attempt this.

srishti-git1110 avatar Aug 09 '24 10:08 srishti-git1110