Got stuck when train resnet50 with QAT

[catsled]

When I quantize a ResNet50 model and train it, it may get stuck at the first backward pass; it's normal when I train a non-quantized model..

GPU:A800 data:Cifar10

how should i do?

[dacorvo]

It is strange that you get integer output. Did you take a look at the MNIST example ? If not, maybe compare with your script and see if something is different.

[catsled]

It is strange that you get integer output. Did you take a look at the MNIST example ? If not, maybe compare with your script and see if something is different.

ok : )

[catsled]

got stuck when calibration(i did't add it before )

[dacorvo]

How long does it take to run evaluate on the float model ?

[catsled]

How long does it take to run evaluate on the float model ?

about 8s

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stalled for 5 days with no activity.