Colin Fortuner

Okay now that is cool. Didn't know about Split but definitely interested in this now! Thanks for sharing this @BLamy

Would love to see an example @yourbuddyconner @BLamy we're working on adopting this 🙇‍♂️

We adopted the lastest feedback on GitHub! Closing this for now.

hey @abhagsain, At the moment it's using some stuff that might not be compatible, but one major goal for this project is to support as much as possible in the...

Sorry about this @giulianok . I'l leave this open until we simplify this

@giulianok Yeah! want to join the discord? Plenty of ways to improve htis stuff :)

This might work -> https://www.npmjs.com/package/@dqbd/tiktoken @darknoon Let me know

Any update here? Would love to see this merged soon!

Updated the description with a slightly different approach. Will give it a go tomorrow

Adding this to the roadmap! Would love other people to chime in about their usecases here too.!