sparseml
sparseml copied to clipboard
Implement label smoothing for CrossEntropy Loss
CrossEntropy losses (Categorical) now can take label smoothing are as parameter. In theory, ready to be reviewed, but for clarity, I will open this PR once the PyTorch 1.10.2 upgrade gets merged to main (dependency).
@dbogunowicz looks like there's still some conflicts/unintended changes. can you take a look?
LGTM pending merge conflicts