How to Transfer Data Efficiently？

[mizhitian-xiaomi]

The data types of input image and the model inferencing input data are numpy.ndarray.
I have to perform many data type conversions when using cvcuda, which is very inefficient.
How can I solve this problem?

[bhaefnerNV]

Hi @mizhitian-xiaomi, Thanks for you interest in CV-CUDA! Could you provide more information to your use-case?

Is the workflow to go from a torch tensor -> cvcuda tensor -> numpy array, and while having the cvcuda tensor, do data type conversions? Then repeat this process for multiple tensors?

[dsuthar-nvidia]

@mizhitian-xiaomi Generally CV-CUDA recommends that you use GPU accelerated data decoding libraries like nvimagecodec or pynvvideocodec. CV-CUDA samples cover a broad range of pipelines that reads videos and images and pass it on to a model for inference.

If your input data must come from Numpy and if it must be converted to Numpy before feeding into the model, then yes you would require data types conversions that you mentioned.