kani
kani copied to clipboard
kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)
I ran into a little bit of trouble trying to run `pip install kani[openai]` because I was running Python 3.7 instead of 3.10+. I received the error message "kani 0.0.0...
HuggingFace -> Hugging Face
Adds a very basic version of [autogpt](https://github.com/Significant-Gravitas/Auto-GPT) as a more complex example
I see that the API supports `.message_token_len()` for an individual ChatMessage; it would be nice to be able query total token usage over the course of a conversation for cost...
Style guidelines, organization of code, what should go in Kani main vs. ext...
I was just wondering if anyone has been able to make it work with groq?