aimet icon indicating copy to clipboard operation
aimet copied to clipboard

unable to run in google colab

Open Csaba8472 opened this issue 2 years ago • 4 comments

Following this guide: https://github.com/quic/aimet/blob/develop/packaging/google_colab/Install_AIMET_GoogleColab_torch_gpu.ipynb

requires python 3.7, but colab runs on python 3.11 so it won't find these packages: https://github.com/quic/aimet/blob/develop/packaging/google_colab/reqs_pip_torch_gpu.txt

if you install python 3.7 you'll run into another issue when it tries to install cuda-command-line-tools-11-0 https://github.com/quic/aimet/blob/develop/packaging/google_colab/reqs_deb_torch_gpu.txt

cuda-command-line-tools-11-0 isn't available.

also 1.19.1.py37 is an outdated version.

this url: image doesn't make sense, but it seems like only a formatting issue, as in the json it's there almost correctly.

Could you please help with the issues above? I was under the impression that I can run aimet in google colab.

Csaba8472 avatar Sep 28 '23 10:09 Csaba8472

@Csaba8472, these instructions might be outdated. We will take a look, in the meantime, could you try out other methods for using AIMET?

quic-mangal avatar Sep 28 '23 17:09 quic-mangal

@Csaba8472, these instructions might be outdated. We will take a look, in the meantime, could you try out other methods for using AIMET?

I have tried to install based on this: https://quic.github.io/aimet-pages/releases/1.28.0/install/install_host.html in colab but didn't work. I have amd gpu but for me it seems you only support nvidia gpu.

@quic-mangal do you have other idea what other method could I try to use AIMET?

Csaba8472 avatar Sep 28 '23 17:09 Csaba8472

You could get the repo and try building it for your environment.

quic-mangal avatar Sep 28 '23 20:09 quic-mangal

you mean to try run it on an AMD gpu?

Csaba8472 avatar Sep 28 '23 20:09 Csaba8472