solomonmanuelraj

Results 5 comments of solomonmanuelraj

Visualizing Grounding Dino Model Predicted Bounding Box in Voxel51 Tool ( https://voxel51.com/). Bounding Box position is changing

Screenshot attached

Support bitsandbytes export to ONNX

Hi team, thanks for your quick response. I want to qunatize the model with 8 bit. in this case load_in_8bit=False will give the 8 bit quantized model ? this option...

Support bitsandbytes export to ONNX

Thanks a lot for your quick response. it was very useful. yes. i need to verify the accuracy. the quantized model will be poor in accuracy. Problem statement : my...

Support bitsandbytes export to ONNX

@fxmarty when i convert the owl-vit model into onnx file ( using optimum-cli export onnx -m google/owlvit-base-patch16 --task 'zero-shot-object-detection' --framework 'pt' owlvit_onnx) default opset is 14 it is taking (...

AIMET - Resnet18- 8 bit quantized Model - Need help regarding model memory size and inference time reduction with acceptable accuracy drop

Thanks for the update. Quantization simulation mimic the accuracy of a quantized target. It is good. Whether it will mimic the inference time and memory size, MAC of a quantized...