Prediction with quantized model

[indrajitsg]

Hi,

I am trying to run prediction but hitting a roadblock with CUDA not supporting Byte tensor:

d, l = next(iter(train_loader))
d, l = d.type(torch.ByteTensor), l.type(torch.ByteTensor)
d, l = Variable(d.cuda()), Variable(l.cuda())
model_q(d)

Any thoughts how can I directly use a quantized model?