AlpinDale
AlpinDale
Perhaps it would be best to pull the aphrodite package from pypi instead of building it in the docker. `pip install aphrodite-engine==0.5.1` should do it.
Ah right this reminds me, @mrseeker , we build for all GPU architectures which may take more time and use more memory. You can try getting rid of the export...
This may be kind of pointless.
Hi. At the moment, *native* windows support is still a WIP. You will need to run the engine in WSL. You need to run this command *inside* the WSL terminal...
Looks like you don't have `bzip2` installed. Please run `sudo apt update && apt install bzip2`, then run the command again. You may need to delete the `aphrodite-engine` folder. You...
> Fixed the problem, i was forced to create a username and change the directory from root to home. > > i did it again and now its giving this...
@perkel666 https://github.com/PygmalionAI/aphrodite-engine?tab=readme-ov-file#requirements
Thanks for your interest @puppetm4st3r. This PR is still a WIP, and will need a refactoring due to the changes introduced in #261. I'll get back to this PR in...
Are you on the latest release or building from source? Aphrodite now accepts direct .gguf files, so please don't convert if you're building from source.
Can confirm that I can run the same model (Q4_K_M) on the latest build by supplying the .gguf file.