openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[Bug]: OpenVINO does not support the following ONNX operations: DeformConv

Open Mitix-EPI opened this issue 1 year ago • 2 comments

OpenVINO Version

openvino==2024.1.0

Operating System

Ubuntu 18.04 (LTS)

Device used for inference

CPU

Framework

ONNX

Model used

No response

Issue description

Openvino supports ONNX opset 20. Howerver, openvino does not support DeformConv 19

image

Step-by-step reproduction

import onnx
import onnx.helper as helper
import numpy as np
import openvino as ov

if __name__ == '__main__':
    input = helper.make_tensor_value_info(name='input', elem_type=onnx.TensorProto.FLOAT, shape=[1, 64, 512, 960])
    output = helper.make_tensor_value_info(name='output', elem_type=onnx.TensorProto.FLOAT, shape=[1, 64, 512, 960])
    weight = helper.make_tensor(name='weight', data_type=onnx.TensorProto.FLOAT, dims=[64,64,3,3], vals=np.random.randn(64,64,3,3))
    offsets = helper.make_tensor_value_info(name='offsets', elem_type=onnx.TensorProto.FLOAT, shape=[1, 18, 512, 960])
    node = helper.make_node(name='dcn', op_type='DeformConv', inputs=['input', 'weight', 'offsets'], outputs=['output'], kernel_shape=[3, 3], strides=[1, 1],
                            group=1, pads=[0, 0, 0, 0])
    graph = helper.make_graph(name='graph', nodes=[node], inputs=[input, offsets], outputs=[output], initializer=[weight])
    model = helper.make_model(graph)
    onnx.checker.check_model(model)
    print(model)
    onnx.save_model(model, 'create_dcn.onnx')

    ov.compile_model("create_dcn.onnx")

Relevant log output

Trace: `OpenVINO does not support the following ONNX operations: DeformConv`

Issue submission checklist

  • [X] I'm reporting an issue. It's not a question.
  • [X] I checked the problem with the documentation, FAQ, open issues, Stack Overflow, etc., and have not found a solution.
  • [X] There is reproducer code and related data files such as images, videos, models, etc.

Mitix-EPI avatar May 22 '24 14:05 Mitix-EPI

@gkrivor, @mlukasze, GFI? We have DeformableConv in our opset.

Best regards, Roman

rkazants avatar May 22 '24 15:05 rkazants

@gkrivor, @mlukasze, GFI? We have DeformableConv in our opset.

Best regards, Roman

good idea

mlukasze avatar May 22 '24 16:05 mlukasze

GFI has been created https://github.com/openvinotoolkit/openvino/issues/24649

mlukasze avatar May 23 '24 07:05 mlukasze