Ashish Kumar

icon company Hewlett Packard Enterprise icon location Bangalore,India icon location Data and Analytics Solutions architect at Hewlett Packard Enterprise

Results 1 issues of Ashish Kumar

V100 GPU : Facing issue with model conversion from nemo format to trt format

7 comment

### System Info I am using nemo-inferencing container to convert nemo llama-13b model to trt model using following command. python /opt/NeMo/scripts/export/export_to_trt.py --nemo_checkpoint /opt/checkpoints/results/Llama-2-13B-fp16.nemo --model_type="llama" --model_repository /opt/checkpoints/results/tmp_model_repository/ I am executing this...

bug
triaged