Pumelo comments

Repositories
Issues
Comments

Results 1 comments of


                                            Pumelo

How to build TensorRT-LLM engine on host and deploy to Jetson Orin Nano Super?

> Hi， Can you try to use Pytorch backend? And for TRT backend, the engine building will consume 4X memory of your model size. > > Thanks. How to do...