tango Remove Fairscale, move functionality to Torch FSDP

Bumps sentencepiece from 0.1.98 to 0.1.99.

Release notes

Sourced from sentencepiece's releases.

v0.1.99

Major changes

N/A

New features

N/A

Bug fixes & minor changes

[ALL] Fixes the NaN issues in unigram model training: google/sentencepiece#851

[ALL] Fixes the bug in unigram loss computation: google/sentencepiece#628

[ALL] Fixes the minor bug in BPE token extraction algorithm: google/sentencepiece#318

[ALL] Increase the number of maximum threads from 128 to 1024. google/sentencepiece#857

v0.1.99pre1

v0.1.99 pre release for testing.

Commits

3863f76 increases the max number of threads
25b64fc Fix the test error on windows
bb0b610 Fix the ULM training bugs
ba44ab1 Fix bugs in the handling of duplicated bigrams
69d34c7 prepare for v0.1.99
d9a2b21 Fix bugs the seed score computation.
See full diff in compare view

You can trigger a rebase of this PR by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

> **Note** > Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

May 02 '23 21:05 dependabot[bot]

@epwalsh, something bad happened to the cluster that Tango runs its tests against?

May 09 '23 06:05 dirkgr

Ah, Beaker removed support for cloud clusters altogether.

May 09 '23 17:05 dirkgr

A newer version of sentencepiece exists, but since this PR has been edited by someone other than Dependabot I haven't updated it. You'll get a PR for the updated version as normal once this PR is merged.

Apr 05 '24 21:04 dependabot[bot]