Results
3
comments of
Seunghyun Ji
I think, because of attention mechanism in debertav2, it is not easy to implement debertav2 prefix based model. It is not supported in peft also, which implemented most of light...
yeah this is quite annoying. As a walkaround, you can put those in `disallowed_tools` to exclude tool 'descriptions' from the context.