gjm441

Problem converting ONNX model to TensorRT 7.2.1(dien.onnx)

3

when i tried convert onnx to tensorrt (trtexec --onnx=dien.onnx) , it occurs error: ---------------------------------------------------------------- Input filename: dien.onnx ONNX IR version: 0.0.7 Opset version: 13 Producer name: tf2onnx Producer version: 1.9.0...

How to use test/ls_quant_bert.py?

1

[When]([url](url)) I run the scripts, first meet a error: not has model.bin? Then, I download bert-base-uncased model (pytorch_model.bin)from huggingface: git lfs install,git clone https://huggingface.co/bert-base-uncased. I use pytorch_model.bin as ckpt_path(model_name), output...

when I run the script： CUDA_VISIBLE_DEVICES=0 python llama.py ${MODEL_DIR} c4 --wbits 4 --true-sequential --act-order --groupsize 128 --eval --save llama7b-4bit-128g.pt &>baseline.txt & I got the same ppl as readme，But when infer...

Test detection error

3

I have trained the model as instructions, and run the code for testing VOC image, but it has poor result. After I learn the darknet yolo v2 source code, I...

How to save and load fp16 pb files

1

Thanks for your code, peterneher. I have run the caffe2 code on my machine. I create float16 net. but after save it to pb, and then load blobs, I watch...