tiktoken icon indicating copy to clipboard operation
tiktoken copied to clipboard

Published 20 hours ago • verified publisher icon openai

WIP: refactor for Java bindings

Open eisber opened this issue 2 years ago • 2 comments
trafficstars

eisber avatar Feb 28 '23 16:02 eisber

These changes looks really great and useful for making tiktoken available to many different languages and runtimes.

@eisber This PR is currently titled as WIP. What about this PR is incomplete? Can we break these changes down into more digestible PRs?

@hauntsaninja (original author). Do you have any feedback here on whether these changes can be merged in / what feedback you have?

zurawiki avatar Mar 14 '23 16:03 zurawiki

These changes looks really great and useful for making tiktoken available to many different languages and runtimes.

@eisber This PR is currently titled as WIP. What about this PR is incomplete? Can we break these changes down into more digestible PRs?

@hauntsaninja (original author). Do you have any feedback here on whether these changes can be merged in / what feedback you have?

Agree, Can we push this forward a little bit more? Tiktoken for java would be useful.

jiangying000 avatar Mar 20 '23 04:03 jiangying000