makemore icon indicating copy to clipboard operation
makemore copied to clipboard
verified publisher icon karpathy

Add Gradnorm to TensorBoard

Open osilkin98 opened this issue 1 year ago • 0 comments

Resolves #19

This PR adds a Gradnorm view to TensorBoard by computing the average of the L2 gradnorm across all parame

Here's how it appears in TensorBoard:

Screenshot 2024-11-23 at 10 25 13 PM ters.

Signed-off-by: Oleg [email protected]

osilkin98 avatar Nov 24 '24 03:11 osilkin98