loss_dropper icon indicating copy to clipboard operation
loss_dropper copied to clipboard

Published 20 hours ago • verified publisher icon ddkang

Adopting Loss truncation for ASR

Open Amg9794 opened this issue 1 year ago • 1 comments

Hi

can this be adopted for ASR (trained with CE loss) task ?

Amg9794 avatar Oct 28 '24 11:10 Amg9794

Our technique is fairly generic so likely will apply to any setting that uses cross-entropy. However, the specific details may differ depending on exactly how the loss is computed.

ddkang avatar Oct 28 '24 15:10 ddkang