rraulison

works fine

Please, Share it on colab !

i can run inference: ``` python generate.py --compile --checkpoint_path checkpoints/$MODEL_REPO/model.pth --prompt "name 10 animals similar to duck" Loading model ... Time to load model: 75.21 seconds /home/pai/pytorch/gpt-fast/model.py:182: UserWarning: 1Torch was...

I am using iGPU from ryzen 5600g CPU. Yes, to quantize I must have more memory. Thanks.