Billy Cao
https://github.com/haotian-liu/LLaVA/pull/1115
cannot be 3.11. Any version from 3.8 to 3.10 works. No need to be 3.10.6 as that's outdated
are you on python 3.10?
Then thats the problem. The wheel is build for python 3.10
Get rid of conda. It is very annoying and break all thing.
You are not supposed to get rid of python...the one in venv is incomplete. It is missing a lot of libraries, it depends on the main installation to work
> pkg_resources.DistributionNotFound: The 'brotli' distribution was not found and is required by yt-dlp
this was because transformers 4.38.0 added static cache. So have to use any version below.
looking forward to this getting merged!
Gptq 8 bit doesnt work on v100, cannot compile as require sm80 and above (its marlin and quip kernels). Any plan to fix that since v100 is in the official...