Bump tiktoken from 0.5.1 to 0.7.0

[dependabot[bot]]

Bumps tiktoken from 0.5.1 to 0.7.0.

Changelog

Sourced from tiktoken's changelog.

[v0.7.0]

• Support for gpt-4o
• Performance improvements

[v0.6.0]

• Optimise regular expressions for a 20% performance improvement, thanks to @​paplorinc!
• Add text-embedding-3-* models to encoding_for_model
• Check content hash for downloaded files
• Allow pickling Encoding objects. Registered Encoding will be pickled by reference
• Workaround PyO3 bug for frozenset conversion

Thank you to @​paplorinc, @​mdwelsh, @​Praneet460!

[v0.5.2]

• Build wheels for Python 3.12
• Update version of PyO3 to allow multiple imports
• Avoid permission errors when using default cache logic

Commits

• bfe00ad Bump cibuildwheel
• 9d01e56 Sync codebase
• 1b9faf2 Simplify byte_pair_merge (#255)
• 6defed5 Inline custom mapping function in _byte_pair_merge
• b4c687e Avoid calling byte_pair_encode for existing tokens
• 6e4851a Add finer grained gratitude
• c2960c1 Store tokens in u32 instead of usize
• 84d88dc Allow use of gpt-2 and gpt-3.5 in encoding_for_model (#185)
• 01df436 Update cibuildwheel
• 89153d7 Sync codebase
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)