Why is the JBU upsampler so slow compared to Bilinear Interpolation?

[aniket-gupta1]

Hey, Amazing work on the paper. I have a doubt about Figure 17 from the paper where you show the timing analysis. I was checking the time taken by JBU upsampler and Bilinear interpolation and it seems to me that Bilinear interpolation is so much faster than JBU which is in contrast to what you have shown in Fig 17. I was wondering if I am doing something wrong.

My experimental setting is as follows, I have an feature vector of size 20 x 56 x 2 (H x W x C) and I am upsampling them to 320 x 896 x 2

[mhamilton723]

it depends on the patch sizes and other parameters, but one thing you might be seeing is that the learned JBU operator is actually a stack of JBUs and some small MLPs. @stephanie-fu can provide more details on precise timing experiments she ran