free-chat icon indicating copy to clipboard operation
free-chat copied to clipboard

Published 20 hours ago • verified publisher icon CNSeniorious000

Consider fallback to `js-tiktoken` if failing to import `tiktoken`

Open CNSeniorious000 opened this issue 1 year ago • 0 comments

To-dos:

  • [ ] Use js-tiktoken at frontend
  • [ ] Slice messages sliding window at backend: using js-tiktoken
  • [x] Cache token counting utilities
  • [ ] Standalone tiktoken page

CNSeniorious000 avatar Nov 16 '23 22:11 CNSeniorious000