tokencost
tokencost copied to clipboard
Easy token price estimates for 400+ LLMs. TokenOps.
Currently we have a markdown table update script, but we need to do this for the JSON also
I am getting `WARNING:root:Warning: model not found. Using cl100k_base encoding.` when using non openAI models such as claude-2. I checked the code and it seems to be a tiktoken issue....
https://www.lepton.ai/playground bunch of models provided : llama7b,13b,70b, codellama 7b,13b,34b, mixtral-8*7b, etc... For pricing: https://www.lepton.ai/pricing
We currently have error handling for when the `model` string input doesn't match our dictionary, but can eventually refactor to make it an enum that matches one of the below...
i try to replace the model name in Readme Example usage to azure_xxxx ,but get error this is the error info: KeyError: 'Model azure_xxxx is not implemented.\n Double-check your spelling,...
Currently, we do not have a capability to calculate cost for attached media (`image`) in context. Could be a great feature? Let me know if that is possible to calculate...
Hello, I noticed that the code package you wrote is very impressive. However, is it only capable of counting tokens for regular simple chats? I saw your code requires the...
Hello team! Thanks for this cool package! This is more of a suggestion than a feature request. There is this package that estimates the environmental impact of calling an Generative...