chatgpt-java
chatgpt-java copied to clipboard
Bump com.knuddels:jtokkit from 0.4.0 to 1.0.0
Bumps com.knuddels:jtokkit from 0.4.0 to 1.0.0.
Release notes
Sourced from com.knuddels:jtokkit's releases.
1.0.0
Features
- Improved performance of the CL100k encoding by 5x
- Thanks
@paplorinc
for the great work!- Added
text-embedding-3-small
andtext-embedding-3-large
to theModelType
enumBreaking Changes
- Due to the performance optimization, we now return a custom
IntArrayList
instead of aList<Integer>
to prevent unnecessary boxing. TheIntArrayList
does not implementList
and therefore is a breaking change. If you are missing any critical functionality fromIntArrayList
, please raise an issue.Full Changelog: https://github.com/knuddelsgmbh/jtokkit/compare/0.6.1...1.0.0
0.6.1
Fixes
- Added a workaround to prevent issue with regex compilation on Android devices
Full Changelog: https://github.com/knuddelsgmbh/jtokkit/compare/0.6.0...0.6.1
0.6.0
Features
- Added
GPT_3_5_TURBO_16k
to theModelType
enumFull Changelog: https://github.com/knuddelsgmbh/jtokkit/compare/0.5.1...0.6.0
0.5.1
Fixes
- Fixed an issue resulting in wrong encodings for Unicode input . Thanks
@VoidIsVoid
for raising and fixing this issue :slightly_smiling_face:New Contributors
@VoidIsVoid
made their first contribution in knuddelsgmbh/jtokkit#34Full Changelog: https://github.com/knuddelsgmbh/jtokkit/compare/0.5.0...0.5.1
0.5.0
Features
- Added a new
EncodingRegistry
that loads only the requested vocabularies lazily instead of loading all vocabularies eagerly at initialization. Thanks@blackdiz
for raising this feature request and implementing it :blush:New Contributors
@blackdiz
made their first contribution in knuddelsgmbh/jtokkit#24Full Changelog: https://github.com/knuddelsgmbh/jtokkit/compare/0.4.0...0.5.0
Commits
6a54eb2
chore: bump version to 1.0.0c76b814
fix: adapt gpt-3.5-turbo maxContextLength to context sizes in the official docs2dea926
feat: add new embedding models to ModelType8c32143
chore(deps): update dependency tiktoken to v0.6.0d6a6bde
docs: add some missing JavaDoc2a8492c
chore: reduce visibility to only expose actual APIb4aa1f9
chore: move internal optimization logic from API to internal package409b3d2
chore: disable renovate for docs0d4e480
fix(deps): update junit5 monorepo to v5.10.25006a5e
fix: re-add countTokensOrdinary to keep breaking changes to a minimum- Additional commits viewable in compare view
You can trigger a rebase of this PR by commenting @dependabot rebase
.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
-
@dependabot rebase
will rebase this PR -
@dependabot recreate
will recreate this PR, overwriting any edits that have been made to it -
@dependabot merge
will merge this PR after your CI passes on it -
@dependabot squash and merge
will squash and merge this PR after your CI passes on it -
@dependabot cancel merge
will cancel a previously requested merge and block automerging -
@dependabot reopen
will reopen this PR if it is closed -
@dependabot close
will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually -
@dependabot show <dependency name> ignore conditions
will show all of the ignore conditions of the specified dependency -
@dependabot ignore this major version
will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) -
@dependabot ignore this minor version
will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) -
@dependabot ignore this dependency
will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Note Automatic rebases have been disabled on this pull request as it has been open for over 30 days.