regression-prior-networks icon indicating copy to clipboard operation
regression-prior-networks copied to clipboard

Not understand why normal distributions can be used for classification

Open LinyeLi60 opened this issue 3 years ago • 2 comments
trafficstars

As in the case for classification, we can consider an ensemble of networks which parameterize multivariate normal distributions (MVN) We usually use categorical distribution for classfication, I don't known how to use normal distribution for classification, can you give some examples?

LinyeLi60 avatar Apr 12 '22 00:04 LinyeLi60

Hi, let me resolve some ambiguity of this sentence - it means that for performing uncertainty estimation in regression, we could, similarly to classification case, train an ensemble of networks which parameterize MVNs (compared to Categorical distributions in classification). The emphasis is on ensemble here, not MVNs.

At the same time, you can indeed use normal distribution for classification, e.g. by treating the outputs of your network as p(x|y) instead of p(y|x), and then performing Bayesian inference (similarly to LDA). E.g. see impostor networks.

JanRocketMan avatar Apr 19 '22 11:04 JanRocketMan

Thank you for your explanation.

------------------ Original ------------------ From: Sergey @.> Date: Tue,Apr 19,2022 7:38 PM To: JanRocketMan/regression-prior-networks @.> Cc: Linye Li @.>, Author @.> Subject: Re: [JanRocketMan/regression-prior-networks] Not understand whynormal distributions can be used for classification (Issue #2)

LinyeLi60 avatar Oct 11 '22 07:10 LinyeLi60