tanuki.py icon indicating copy to clipboard operation
tanuki.py copied to clipboard

Add support for local open-source models

Open MartBakler opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe. We want to generalise the package by supporting local OSS models as students or teachers

Describe the solution you'd like We need to support OSS models (Zephyr, Mistral, LLama, Qwen etc) as teacher or student. Currently we are only relying on OpenAI, whereas the library should be generalised to local OSS models

MartBakler avatar Dec 04 '23 23:12 MartBakler