lmql icon indicating copy to clipboard operation
lmql copied to clipboard

Add support for T5 family

Open paucodeici opened this issue 1 year ago • 1 comments

Hi,

I like LMQL but i would like to use other model from huggingface than the one supported from AutoModelForCausalLM. Especially model from T5 family (like LaMini T5 ).

Does it make sense? (I didn't look yet what do they expose but it should be feasible?)

I am ok to propose a PR for this.

paucodeici avatar Nov 07 '23 09:11 paucodeici

PRs are very welcome :) I think it definitely makes sense, however, you have to handle the encoder/decoder separation of the input somehow.

lbeurerkellner avatar Nov 22 '23 16:11 lbeurerkellner