open-mmlab
Support for TensorRT 10.0 [Feature]
Motivation
Thank you very much for your excellent work. MMdeploy has been very helpful to me.
Currently, TensorRT 10.0 has been released, and I found that mmdeploy_tensorrt_ops_obj cannot compile successfully in the TensorRT 10.0 environment.
The current error message is as follows: msvc: [E0144] Type 'const int64_t *' cannot be used to initialize type 'const int *' (gather_topk.cpp line81\82) -> const int * dims = &(inputDesc[0].dims.d[0]);
Related resources
No response
Additional context
No response
Have you solved this issue yet? What is your mmdeploy version and Visual Studio version?
Have you solved this issue yet? What is your mmdeploy version and Visual Studio version?
Not yet:(; tried the latest mmdeploy (V1.3.1), and using VS2022 (V17.1.0)
The breaking changes do not look too bad. I am considering whether to try patching this on a fork or to try to get torch.compile / torch_tensorrt.compile working instead
@matthost did you ever end up making the patch on a fork? Any chance you could share it if you did?
Not yet, not sure whether I’ll need to after seeing the hardware compatibility feature is as recent as 8.6. Will share if I do. Any reason you want 10?
Not a problem, I managed to get it to compile by adding a few casts. No real reason for using V10, other than avoiding future dependency problems.
