mmdetection3d icon indicating copy to clipboard operation
mmdetection3d copied to clipboard

Published 20 hours ago • verified publisher icon open-mmlab

FCOS3D model conversion to onnx

Open xiaoxiongmaoxuexi opened this issue 3 years ago • 15 comments

Traceback (most recent call last): File "/home/zhanggan/mmdetection3d-master/demo/onnx-runtime.py", line 4, in sess = rt.InferenceSession('test.onnx') File "/home/zhanggan/anaconda3/envs/mmdetectiond3d1/lib/python3.7/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 324, in init self._create_inference_session(providers, provider_options, disabled_optimizers) File "/home/zhanggan/anaconda3/envs/mmdetectiond3d1/lib/python3.7/site-packages/onnxruntime/capi/onnxruntime_inference_collection.py", line 358, in _create_inference_session sess = C.InferenceSession(session_options, self._model_path, True, self._read_config_from_model) onnxruntime.capi.onnxruntime_pybind11_state.Fail: [ONNXRuntimeError] : 1 : FAIL : Load model from test.onnx failed:Fatal error: MMCVModulatedDeformConv2d is not a registered function/op

xiaoxiongmaoxuexi avatar Nov 08 '21 06:11 xiaoxiongmaoxuexi

I'm not quietly familiar with onnx, and the release of onnx conversion is currently not in our short-term plan. Maybe you can refer to this issue: https://github.com/open-mmlab/mmcv/issues/1422

ZCMax avatar Nov 08 '21 07:11 ZCMax

@ZCMax :Thank you for your reply. I try to follow #1422 operation, but there reasoning model still has this problem. Is there a relevant communication group? I want to join in and study together. Thank you.

xiaoxiongmaoxuexi avatar Nov 09 '21 01:11 xiaoxiongmaoxuexi

We do have a wechat group for mmdetection3d, but mainly talk about LiDAR based 3d object detection, I'm not sure whether someone could you help.

ZCMax avatar Nov 09 '21 07:11 ZCMax

@ZCMax ：Can I join you? I'm looking forward to joining you to discuss relevant issues. thank you.

xiaoxiongmaoxuexi avatar Nov 09 '21 07:11 xiaoxiongmaoxuexi

We have colleagues working on the deployment and model conversion for MMDet3D models. PointPillars and SECOND will have the highest priority, and then we will consider FCOS3D. So currently I will keep this issue open for community discussion, and update related changes if we make any progress.

Tai-Wang avatar Nov 10 '21 06:11 Tai-Wang

@Tai-Wang ：Thank you for your reply and look forward to the emergence of fcos3d model transform.

xiaoxiongmaoxuexi avatar Nov 10 '21 06:11 xiaoxiongmaoxuexi

@Tai-Wang Can you estimate on when the onnx conversion for PointPillars and SECOND will be finished?

Thomas-Kb avatar Nov 15 '21 10:11 Thomas-Kb

@Thomas-Kb I can not estimate the concrete time for now. We need to finish the migration of ops from mmdet3d to mmcv first. Afterward, we will continue to work on the conversion issue. I will update related information here if there is any progress.

Tai-Wang avatar Nov 23 '21 13:11 Tai-Wang

Hello, how can I convert FCOS3D to ONNX format? Hope to get your help, thank you

scuizhibin avatar Mar 31 '22 04:03 scuizhibin

Hi, is there any updates on how to convert FCOS3D to onnx model? thank you in advance.

saesaria avatar Jun 08 '22 09:06 saesaria

Hello, I also want to convert FCOS3D to ONNX, but it keeps failing. If you succeed, please leave me a message. thank you

Superyanzhuang avatar Mar 07 '23 11:03 Superyanzhuang

do you successed in convert FCOS3D to ONNX ?

perfectworld0415 avatar Jun 09 '23 05:06 perfectworld0415

Hello, I also want to convert FCOS3D++ to ONNX. If there is any progress, please leave me a message. thank you！！！

yuhanqing1996 avatar Jun 20 '23 07:06 yuhanqing1996

This error might occur because the custom ops for ONNX Runtime are not built correctly. Let's try to rebuild the custom ops by following the instructions in the link below https://github.com/open-mmlab/mmdeploy/blob/main/docs/en/01-how-to-build/linux-x86_64.md#build-model-converter

shibukazu avatar Jan 28 '24 04:01 shibukazu