About the gradient notes

[lzw-all-in]

Hello, I found that maybe identity(5) is mistake in gradient-notes.pdf because in there x is a column vector. x should be a transpose !
And in page 6 of gradient-notes.pdf, partial derivative of J with respect to W and partial derivative of J with respect to b1 , the first term should be partial derivative of J with respect to z .
Look forward to your reply

[yanchao0222]

Hello, I found that maybe identity(5) is mistake in gradient-notes.pdf because in there x is a column vector. x should be a transpose ! And in page 6 of gradient-notes.pdf, partial derivative of J with respect to W and partial derivative of J with respect to b1 , the first term should be partial derivative of J with respect to z . Look forward to your reply

Cannot agree more.