WAGE.pytorch
WAGE.pytorch copied to clipboard
Reproduction of WAGE in PyTorch.
Hey, thanks for the great repo! I noticed that the bits for random are not used in QG. They dont seem to be used at all. The original paper says...
QG function takes in 4 inputs on line 47 of models.wage_quantizer.py but is given 5 in the testing function on line 128. `def QG(x, bits_G, bits_R, lr):` `quant_data = QG(test_tensor,...
Hey, @stevenygd . I recently checked your code base and the paper. - One point i do not understand is the **shifting operation in activations** seems missed in this code...