megablocks icon indicating copy to clipboard operation
megablocks copied to clipboard

Published 20 hours ago • verified publisher icon stanford-futuredata

fix eval for moe layer

Open NeosZhang opened this issue 7 months ago • 2 comments

when I run /exp/dmoe/dmoe_46m_8gpu.sh，I encountered the following Error during evaluation. image

the func save_load_balancing_loss is bypassed during evaluation.

NeosZhang avatar Jul 24 '24 09:07 NeosZhang