openai-tools
openai-tools copied to clipboard
dluc
A collection of tools for working with OpenAI
Given that this API uses a very explicit `GPT3Tokenizer` name ... I was just curious if this would work for GPT4. Thanks!
@dluc could you please review the PR for adding the decode method, I found the js version already have decode method, so we want it in .net also. Thanks!
Can't find documentation for decode method in the cs class.is decode not supported?
Hello, Thank you for your hard work on the project. I made some improvements to the code with help from ChatGPT, and it resulted in a 40% increase in performance....
Maybe you can add the new tokenizer of the coding model :)
It uses a different tokenizer apparently, so now this one will give me inaccurate values. It seems that at the time of writing, there is no up-to-date token counting library...
