cnn-quantization icon indicating copy to clipboard operation
cnn-quantization copied to clipboard

Published 20 hours ago • verified publisher icon submission2019

--device cpu uses cuda and crash

Open mikeseven opened this issue 4 years ago • 0 comments

Using the example with --device cpu leads to crash: python inference/inference_sim.py -a resnet50 -b 512 -pcq_w -pcq_a -sh --qtype int4 -qw int4 --device cpu

The bug comes from calling torch.cuda.clear().

Likewise when the program finishes.

cuda device should not be called in cpu mode.

mikeseven avatar Apr 19 '20 05:04 mikeseven