Grokking-Deep-Learning
Grokking-Deep-Learning copied to clipboard
iamtrask
this repository accompanies the book "Grokking Deep Learning"
NameError: name 'weight_deltas' is not defined
I believe layer_1_delta should be calculated below `layer_1_input = np.dot(layer_0,weights_0_1)` `layer_1_delta = layer_2_delta.dot(weights_1_2.T) * relu2deriv(layer_1_input)` instead of `layer_1 = relu(np.dot(layer_0,weights_0_1))` `layer_1_delta = layer_2_delta.dot(weights_1_2.T) * relu2deriv(layer_1)` even though they return the...
Hello, Andrew! Thank you very much for your book! It helps me a lot on the way to change my profession. I am having difficulty understanding the code in `Chapter...
Hello, I have finished the Chapter 4. But I have a question regarding weight_delta. It has a value of delta * input. In the book it says that weight_delta is...
There seems to be small mistake in the Predicting Movie review code. Here is the code ``` x,y = (input_dataset[i],target_dataset[i]) layer_1 = sigmoid(np.sum(weights_0_1[x],axis=0)) #embed + sigmoid layer_2 = sigmoid(np.dot(layer_1,weights_1_2)) #...
run relu2deriv() maybe not is effect,or it just demo for this case? i think it has not any assist when it run for backpropagation, any idea or suggest, thx
Notably in chapter 8, the backpropagation through activation function gradients appear off: if you target the derivative of an activation function for a given input σ'(x), shouldn't you use that...
In chap8, the code of Batch gradient descent is confusing. ```python for j in range(iterations): error, correct_cnt = (0.0, 0) for i in range(int(len(images) / batch_size)): batch_start, batch_end = ((i...
Would it be ok if I did a re-implementation in another programming language of the code in the book ? I don't see a licence, so i'm not quite sure...
