eduard comments

Results 5 comments of


                                            eduard

Faile to run ``gpustat --debug'': pynvml.NVMLError_LibraryNotFound: NVML Shared Library Not Found

> This was my solution hope it helps someone: > > pynvml ask for nvml.dll on "C:\Program Files\NVIDIA Corporation\NVSMI" and "C:\Windows\System32", but the new installer puts the file in "C:\Windows\System32\DriverStore\FileRepository\nv_dispi.inf_amd64_aXXXXXXXXXXXXXX",...

Format of 'flist'

Small detail here about the folder structure, maybe it helps: The code works as is, if the folder hierarchy is like this: ``` project_root/ ├─ training_data/ │ ├─ name_of_db/ │...

Transformer-like model hurts accuracy converted from onnx(opset16) when using fp16 in TensorRT-8.6, and TensorRT-8.6 cannot parse onnx(opset17) because of LayerNormalization/LayerNorm

> I found my onnx/onnx-tensorrt version is wrong, and convert engines from onnx(opset17) successfully with the right version, but the accurary is still bad: | model | trt-op17-fp32 | trt-op17-fp16...

Transformer-like model hurts accuracy converted from onnx(opset16) when using fp16 in TensorRT-8.6, and TensorRT-8.6 cannot parse onnx(opset17) because of LayerNormalization/LayerNorm

> > Does it pass with polygraphy? e.g. polygraphy run model.onnx --trt --onnxrt > > The problem of LayerNormalization in opset17 cannot be converted to engine has been solved and...

Transformer-like model hurts accuracy converted from onnx(opset16) when using fp16 in TensorRT-8.6, and TensorRT-8.6 cannot parse onnx(opset17) because of LayerNormalization/LayerNorm

> > > > Does it pass with polygraphy? e.g. polygraphy run model.onnx --trt --onnxrt > > > > > > > > > The problem of LayerNormalization in opset17...