Leon Derczynski

Results 280 comments of Leon Derczynski

General refactor is upcoming in #1089 which is planned for the coming fortnight

The Turn & Conversation functionality won't hit release until end May, possibly end June. Depending on review, if we can land this earlier than that, I'm happy

This highlighted an unclear behaviour in atkgen and whether use of all_outputs or outputs is preferred when doing detection on an attempt. Atkgen expects that the detector will be run...

#1254 is going to alter the structure of `Attempt` quite a lot, as well as providing explicit abstractions for conversational turns, messages and message history within prompts, and multi-exchange conversations....

will be superseded by technique & intent, hold for now

the output from buffs is an attempt stack. can we load generator config params there and process them at execution time? worth pushing/popping state when doing this - probably only...

Huh, thanks. Can you: * try with current release version 0.13.0? * give an example of a model & invocation that lead to this, so we can try to reproduce...

Hi Emad, We haven't forgotten about these - we've been working hard on landing multilingual core support in garak, which is now in review. Once that's in place, we'll finally...

issue #833 contributed to this