PSPNet icon indicating copy to clipboard operation
PSPNet copied to clipboard

Convert to Tensorflow model. How to deal with Interpolation layer? Help with the Keras imlementation

Open Vladkryvoruchko opened this issue 7 years ago • 7 comments

I want to try run this model in tensorflow, and is using caffe-tensorflow converter.

There was some minor errors which was fixed, but the main trouble is the interpolation layer. If i am right - this is the custom layer made specifically for the semantic segmentation networks, and is absent in the master branch of caffe, so its not implemented in any converters.

Has anyone tried to convert it? And how did you face this problem?

Updated:

Take a look at my repo - implementation in Keras, there are some mistakes which are leading to bad results. Help highly appreciated Vladkryvoruchko/PSPNet-Keras-tensorflow

Updated:

Now it is working Keras project with good results

Vladkryvoruchko avatar Jun 07 '17 09:06 Vladkryvoruchko

Hi @Vladkryvoruchko , I've been trying the same but haven't really got past an error telling me that "bn_param" is not a part of Caffe.

Can you possibly share your current conversion output?? I'm working on extending the interpolation layer from DeepLab to tensorflow, but the current code seems to be a bottleneck for me.

Thanks!

aneesh3108 avatar Jun 12 '17 16:06 aneesh3108

Hi @aneesh3108 . I'm fine with bn_param and caffe works well. But earlier i have made some corrections to prototxt selection_021

I'm working now with Keras and things seems to be fine, but havent finished yet

Vladkryvoruchko avatar Jun 13 '17 09:06 Vladkryvoruchko

@aneesh3108 Please take a look at my results. But results are not satisfying and i cant figure it out why Vladkryvoruchko/PSPNet-Keras-tensorflow EDIT: Now it is working Keras project with good results

Vladkryvoruchko avatar Jun 16 '17 15:06 Vladkryvoruchko

@Vladkryvoruchko On it this coming week. This is a great starter.

aneesh3108 avatar Jun 18 '17 19:06 aneesh3108

@amanjhunjhunwala Hi, thanks for sharing your code. But the link seems inaccessible. Furthermore, do you have any idea how to add an Auxillary loss layer?

wtliao avatar Aug 10 '17 15:08 wtliao

@wtliao Due to certain reasons, I needed to close-source the code ! Sorry for the inconvenience !

amanjhunjhunwala avatar Aug 10 '17 17:08 amanjhunjhunwala

@Vladkryvoruchko Hey why is frozen=true in your prototxt, is this deploy. Just checking!

jaypatravali avatar Sep 24 '17 21:09 jaypatravali