CNTK icon indicating copy to clipboard operation
CNTK copied to clipboard

how to use Logistic and CrossEntropy loss Function for C++

Open ghost opened this issue 6 years ago • 4 comments

I think there is no loss function Logistic and CrossEntropy (without softmax). how to use it?

ghost avatar Dec 18 '17 10:12 ghost

I have been searching for cross-entropy without softmax. I couldn't find yet

faruknane avatar Jan 28 '20 15:01 faruknane

Why do you need cross entropy without softmax?

delzac avatar Jan 29 '20 04:01 delzac

Why do you need cross entropy without softmax?

I just don't get it why cntk prefers not putting softmax layer into the models. Normally that's what we do. Because there is no cross entropy without softmax, we have to remove the softmax layers from our models.

faruknane avatar Jan 29 '20 17:01 faruknane

Its not just cntk. Every major deep learning framework does that.

In inference, you do not require softmax in the last layer to determine which class is the most probable.

delzac avatar Jan 31 '20 12:01 delzac