ASL icon indicating copy to clipboard operation
ASL copied to clipboard

Some questions about the 'clamp' operation

Open Breeze-zyuhan opened this issue 1 year ago • 0 comments

Thank you for your great work.

ASL adopts 'clamp' to prevent 'inf' in the loss calculation. Actually, 'clamp' cannot back-propagate the gradients, because it is not derivable, i.e., ASL ignores the border conditions. Does it make sense?

Breeze-zyuhan avatar Mar 31 '23 03:03 Breeze-zyuhan