tokencost

tokencost copied to clipboard

areibman

Currently we have a markdown table update script, but we need to do this for the JSON also

areibman

WARNING:root:Warning: model not found. Using cl100k_base encoding.

1

I am getting `WARNING:root:Warning: model not found. Using cl100k_base encoding.` when using non openAI models such as claude-2. I checked the code and it seems to be a tiktoken issue....

moresearch

Add Price for Lepton AI Models

7

https://www.lepton.ai/playground bunch of models provided : llama7b,13b,70b, codellama 7b,13b,34b, mixtral-8*7b, etc... For pricing: https://www.lepton.ai/pricing

bobmayuze

We currently have error handling for when the `model` string input doesn't match our dictionary, but can eventually refactor to make it an enum that matches one of the below...

trisha