MTMT icon indicating copy to clipboard operation
MTMT copied to clipboard

test result

Open JamesZWalker opened this issue 4 years ago • 1 comments

I use the model you provide to test on your SBU test dataset, and I get the result “Test ber results: 3.75”, which is larger than the result "ber:3.15" in your paper. I think maybe something is wrong but I dont know where. Could you provide some advice.

JamesZWalker avatar Nov 01 '20 06:11 JamesZWalker

that we use the binarization operation (prediction = (prediction>90)*255) before CRF in SBU dataset. Because at that time, we observed that many pixels are positive but still under 127.5, we adjust it by binarization operation with bias. However, after the submission, we find that we can use the weighted BCE loss to achieve balance between positive and negative pixels. For restoring the setting before submission, we upload the old model.

eraserNut avatar Nov 02 '20 05:11 eraserNut