synaptic icon indicating copy to clipboard operation
synaptic copied to clipboard

Quick question...

Open ericlovesmath opened this issue 7 years ago • 7 comments

What would happen if the training set had too many inputs and too many outputs? Lets say it usually takes 10 inputs and 10 outputs. Would it just take the first 10 elements of the training set? @cazala

ericlovesmath avatar Oct 02 '17 00:10 ericlovesmath

There are no limits for the size of the inputs/outputs of an entry in a dataset. They just have to match the size of the network (inputs = size of the input layer, output = size of the output layer)

cazala avatar Oct 02 '17 02:10 cazala

What if inputs > size of the input layer?

ericlovesmath avatar Oct 02 '17 17:10 ericlovesmath

If using an optimized network (which is the behaviour by default) the extra inputs should be ignored, as if they didn't existed. In an unoptimized network it should throw an error.

cazala avatar Oct 02 '17 18:10 cazala

What would happen if you input words? Also, How can I prevent negative weights/inputs/both? Also, How do I do myLSTM.activate(Input) without getting the values that are activated? @cazala @wagenaartje

ericlovesmath avatar Oct 16 '17 00:10 ericlovesmath

If you input words, you have to convert them (one-hot encoding probably). Maybe this and this will help you out.

You can't prevent negative weights, and don't try, because they are necessary.

You do need to prevent negative inputs, for that I point you to the articles I just mentioned.

What do you mean with your last question? Does it matter that you're getting the values back?

wagenaartje avatar Oct 16 '17 08:10 wagenaartje

(Sorry I meant negative outputs :) ) My second question was, how can I get an output that doesn’t go through an activation function?@cazala @wagenaartje

ericlovesmath avatar Oct 17 '17 00:10 ericlovesmath

You are not supposed to get negative outputs. and I guess you can't get an output without activation.

bashz avatar Nov 05 '17 20:11 bashz