TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

GridSample 5D input support

Open Bonfireee opened this issue 1 year ago • 9 comments

Dear team, I notice currently tensorrt only supports 4D input GirdSample(see #3207), is there any chance to support 5D input in the future?

Bonfireee avatar May 23 '24 06:05 Bonfireee

My Team also need this feature to be implemented urgently . Would it be considered ?

tianlinzx avatar May 23 '24 09:05 tianlinzx

ref pytorch csrc

lix19937 avatar May 23 '24 11:05 lix19937

ref pytorch csrc

would you please elaborate more ?

tianlinzx avatar May 23 '24 14:05 tianlinzx

https://github.com/pytorch/pytorch/blob/v1.11.0/aten/src/ATen/native/cuda/GridSampler.cu
then define a trt plugin

lix19937 avatar May 24 '24 00:05 lix19937

@lix19937 Thanks, I will try your hints. But I hope this feature will be officially supported.

tianlinzx avatar May 24 '24 07:05 tianlinzx

No efforts planned for this right now.

@1059692261 @tianlinzx , can you please let us know what kind of networks you're working with that are blocked by this? Will help us prioritize.

brb-nv avatar May 24 '24 20:05 brb-nv

No efforts planned for this right now.

@1059692261 @tianlinzx , can you please let us know what kind of networks you're working with that are blocked by this? Will help us prioritize.

No efforts planned for this right now.

@1059692261 @tianlinzx , can you please let us know what kind of networks you're working with that are blocked by this? Will help us prioritize.

@brb-nv Dinet,a open source github project, Used to support talking face .

tianlinzx avatar Jun 05 '24 13:06 tianlinzx

https://github.com/SeanWangJS/grid-sample3d-trt-plugin

https://github.com/pytorch/pytorch/blob/v1.11.0/aten/src/ATen/native/cuda/GridSampler.cu then define a trt plugin

KaidDuong avatar Jul 19 '24 07:07 KaidDuong

Also commenting for more visibility. I'm creating a custom NeRF-like model. I sample multiple 3D feature grids with shape [N,C,D,H,W] given query points of shape [N,B,3]. A for loop iterating over N is a temporary solution but slows down training in PyTorch significantly (especially as N grows).

skywolf829 avatar Sep 12 '24 23:09 skywolf829