Bias should be added to input layer

[ErikSchulze1796]

Hello Alex,

I am fairly new to the field of machine learning and found your awesome tool for NN visualization during my research. One thing that came to my mind when ticking the "Show bias button" is that the bias is not added to the input layer, or am I wrong? I get that the input features are no "real" layer but shouldn't be the bias added to the input of each neuron of each layer after the input layer, or am I wrong?

Greetings from Germany! Erik

[alexlenail]

Hi @ErikSchulze1796

Bias in the input layer is represented. It's less obvious which node is the bias in the input layer -- it could be any of them - since what distinguishes a bias unit in subsequent layers is the absence of inputs from the previous layer, but none of the units in the input layer get inputs from a previous layer because there isn't a previous layer.

Maybe we should be explicitly coloring the bias unit gray or something..

[ErikSchulze1796]

Oh yes, I see it now. You're completely right. It was just a bit confusing since it was not directly distinguishable from the other nodes. Thanks for the quick answer!