Mythereus
Mythereus
> > But the PReLu's "a" is learnable not a constant. > > That is true of `leaky_relu` as well. Oh ok
> Yeah indeed @DanisNone – it looks like this is the same as `leaky_relu`. Sorry @MythicArrow, I should have noticed that earlier. No problem sir.
Ok then I will close this pr.
I checked the LeakyReLu's proportions and I see that it has a fixed value of "a" differing from the learnable one in the PReLu so would you merge the pr...
I had checked the original paper of LeakyReLu and its "a" was a fixed constant like 0.01 and wasn't learned. But in this case the jax's LeakyReLu func is like...
Sir, I have researched the PReLu and found out that it indeed has a learnable parameter which is included in the model's weights. So if I define it as a...