ConvCRF icon indicating copy to clipboard operation
ConvCRF copied to clipboard

About speed comparison?

Open IzouGend opened this issue 6 years ago • 6 comments

Thanks for your excellent work! I noticed convcrf is run on gpu, while fullcrf is run on cpu. Is it unfair to compare two algorithms on different platforms?

IzouGend avatar Jul 27 '18 01:07 IzouGend

The reason for this comparison is that there is simply no working fullcrf implementation on gpu available. CRFasRNN, DeepLab and other segmentation systems utilizing CRFs use the very same CPU implementation. So it is a fair comparison since it improves the state of the art.

MarvinTeichmann avatar Jul 28 '18 19:07 MarvinTeichmann

Thanks for the excellent work too! I have another question regarding the speed comparison:

you use a 4x4 average pooling before doing message passing, effectively reducing the computation 16 folds. But there isn't such a step in densecrf, right? In you arXiv draft, the only thing that seems to be relevant is the "gaussian blur" described in sec.4.2. Is that refering to this pooling operation?

suhangpro avatar Oct 02 '18 05:10 suhangpro

Yes, densecrf does bilinear downsampling internally.

MarvinTeichmann avatar Oct 03 '18 10:10 MarvinTeichmann

Thanks for the prompt reply!

I understand that there is some interpolation happening when mapping the pixels onto a permutohedral lattice. Are you referring to that? There downsampling is done in the high-dimensional lattice space. In ConvCRF, the downsampling is done on image space (XY) instead.

suhangpro avatar Oct 03 '18 17:10 suhangpro

Hi, Marvin:

I notice that in your paper, you post the speed of ConvCRF with different receptive field size from 3 to 13. Here is my question, why there's no more larger conv-size than size-13 ? And is the speed posted in table.1 indicate that the time cost for just one iteration?

hrtan avatar Sep 26 '19 07:09 hrtan

Hi Alex,

the performance does not improve past 13. Also, if you go bigger then 21 (I think it was 21) I ran into GPU memory issues (@ 11GB). The memory consumption also increases quadratically with filter size. So there is no reason why you want to go past 11.

MarvinTeichmann avatar Sep 26 '19 10:09 MarvinTeichmann