davniko

Results 1 comments of davniko

Will there be support for models with custom architecture (not only mistral or gpt based)?

I've been playing around with this lib and got it to work with MoEs... Training the vectors is slow (quite slow) compared to dense models when training on the full...