CausalELM.jl icon indicating copy to clipboard operation
CausalELM.jl copied to clipboard

Make sigmoid layer for binary classifiers

Open dscolby opened this issue 3 months ago • 1 comments

Currently, classification is done by just using the sigmoid activation function, which is basically just regression. This could potentially lead to predicted probabilities being outside of [0, 1]. Instead, for classification we should use a normal ELM with ReLU or another activation to get raw predictions and apply the sigmoid to those outputs similar to the way we use a softmax layer for multiclass classification.

dscolby avatar Mar 25 '24 19:03 dscolby