heat icon indicating copy to clipboard operation
heat copied to clipboard

Published 20 hours ago • verified publisher icon helmholtz-analytics

batch normalization

Open krajsek opened this issue 4 years ago • 6 comments

Implementation of a parallel version of Batch Normalisation for Model and Data parallization

krajsek avatar Jun 05 '20 21:06 krajsek

@krajsek can we break this in smaller tasks?

ClaudiaComito avatar Apr 04 '22 09:04 ClaudiaComito

we could divide it into model and data parallel BN. Ich have already started some code with data parallelism, have to check how far it is.

krajsek avatar Apr 04 '22 13:04 krajsek

@krajsek are there news within this issue?

(Review within #1109)

mrfh92 avatar Aug 17 '23 12:08 mrfh92

@mrfh92 The data-parallel version works, but still needs some more testing: https://github.com/helmholtz-analytics/heat/blob/features/589-batch-normalization-3/heat/nn/batch_norm.py

krajsek avatar Aug 17 '23 13:08 krajsek

ok sounds cool ... then we leave this definitely open :+1: (Reviewed within #1109)

mrfh92 avatar Aug 17 '23 17:08 mrfh92

Just to keep the overview: This is actually https://github.com/helmholtz-analytics/heat/pull/748?

mrfh92 avatar Aug 21 '23 07:08 mrfh92