bert-stable-fine-tuning icon indicating copy to clipboard operation
bert-stable-fine-tuning copied to clipboard

On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines

Results 5 bert-stable-fine-tuning issues
Sort by recently updated
recently updated
newest added

Hi authors, Thank you for your excellent work! I just found a difference between Adam Epsilon that the paper state as 1e-6, while the example scripts on this repo are...

Hi Authors, Thanks for your impressive paper. I'm very interested in your implementation of the loss surfaces. I have checked the original loss surface paper Li et al., 2018. I...

I hava read the paper and It is really cool but I hava a problem, when it refers to table1, what does the std, mean and max mean? ie, the...

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.0.2 to 3.1.34. Release notes Sourced from gitpython's releases. 3.1.34 - fix resource leaking What's Changed util: close lockfile after opening successfully by @​skshetry in gitpython-developers/GitPython#1639 New...

dependencies

Bumps [scipy](https://github.com/scipy/scipy) from 1.3.1 to 1.10.0. Release notes Sourced from scipy's releases. SciPy 1.10.0 Release Notes SciPy 1.10.0 is the culmination of 6 months of hard work. It contains many...

dependencies