nnUNet icon indicating copy to clipboard operation
nnUNet copied to clipboard

The mean validation dice is significantly lower than the pseudo dice.

Open 111678900 opened this issue 11 months ago • 5 comments

The mean validation dice is significantly lower than the pseudo dice.Please help me

111678900 avatar Mar 08 '24 10:03 111678900

I encountered the same problem and validation dice was only half of pseudo dice.

sun-wanqing avatar Mar 13 '24 03:03 sun-wanqing

您好,我查出来是数据问题

---Original--- From: @.> Date: Wed, Mar 13, 2024 11:23 AM To: @.>; Cc: @.@.>; Subject: Re: [MIC-DKFZ/nnUNet] The mean validation dice is significantly lowerthan the pseudo dice. (Issue #1995)

I encountered the same problem and validation dice was only half of pseudo dice.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

111678900 avatar Mar 13 '24 03:03 111678900

不知道您是否是相同问题

---Original--- From: @.> Date: Wed, Mar 13, 2024 11:23 AM To: @.>; Cc: @.@.>; Subject: Re: [MIC-DKFZ/nnUNet] The mean validation dice is significantly lowerthan the pseudo dice. (Issue #1995)

I encountered the same problem and validation dice was only half of pseudo dice.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

111678900 avatar Mar 13 '24 03:03 111678900

您好,我查出来是数据问题 ---Original--- From: @.> Date: Wed, Mar 13, 2024 11:23 AM To: @.>; Cc: @.@.>; Subject: Re: [MIC-DKFZ/nnUNet] The mean validation dice is significantly lowerthan the pseudo dice. (Issue #1995) I encountered the same problem and validation dice was only half of pseudo dice. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

我应该不是欸,请问您现在这两个dice差别还大吗?但两个计算方式感觉是不一样的,一个是batch算的,一个是单个样本算好求平均的。

sun-wanqing avatar Mar 13 '24 03:03 sun-wanqing

我的是数据集有几张不太好,大部分效果很好

111678900 avatar Mar 13 '24 13:03 111678900

nnU-Net is trained with patches of the images which are samples from the original images. These patches are also used to calculate the pseudo-dice metric during training.

After training, nnU-Net performs sliding window inference on the entire image. The patches obtained from this sliding window sampling may differ from the sampling strategy used during training, potentially decreasing the validation-Dice score.

You could check for the background class having a low DICE score, as nnU-Net uses an oversampling strategy for foreground classes.

sten2lu avatar May 18 '24 17:05 sten2lu