Natan Lifshitz
Natan Lifshitz
@sroussey Thanks, that will do. Hopefully your version will be adopted soon!
@sroussey I see there's a way to abort loading a model, but is there a way to abort text generation? I don't see something like that for `GenerationConfig`.
@Mr3zee What is the plan to change this? Is there any way I can help?