webml-polyfill icon indicating copy to clipboard operation
webml-polyfill copied to clipboard

More semantic segmentation models support

Open ibelem opened this issue 5 years ago • 2 comments

  • List models
  • Justification (in internal)

ibelem avatar Oct 08 '19 06:10 ibelem

  • FCN8 (OpenVino)
  1. Paper: Fully Convolutional Networks for Semantic Segmentation
  2. Could convert from fcn8s-heavy-pascal.caffemodel by OpenVino Model Optimizer, converted OpenVino model file size: 537.9MB
  3. This model is used by Image Segmentation C++ Demo of OpenVino ToolKit
  4. Need implement Deconvolution, Crop ops to support this model

To implement Deconvolution and Crop ops by WebGL of tensorflow, Deconvolution could map to tf.layers.TRANSPOSE_CONV_2D, and Crop map to tf.layers.CROPPING2D.

  1. ~~Paper: Understanding Convolution for Semantic Segmentation~~
  2. ~~Model file: ResNet101_DUC_HDC size: 260.7MB~~
  3. ~~mIOU: 81.92%~~
  4. ~~OnnxModelImporter could handle the ops of this model, while there's some problem on investigating and fixing.~~

DUC is based on cityscapes, it isn't OK for Video conference Scene, skip this model.

BruceDai avatar Oct 22 '19 08:10 BruceDai