Juan Calderon-Perez
Juan Calderon-Perez
@DVSProductions I will merge this soon, trying to fix a last little bug with the CI :-)
@fishscene This branch has changes that are not compatible with the migration to Redis. It's up to @DVSProductions to fix the merge conflicts
@DVSProductions Do you want to fix the conflicts or close this?
@IngwiePhoenix Can you try the latest image?
@Gyro0o Can you try the latest image and check if there's any difference? Also, does your CPU support AVX2 ?
@QBANIN This is a `llama.cpp` issue, not Serge. May wanna open an issue there
@oktaborg This is a llama.cpp and llama-cpp-python issue. Thats the libraries Serge uses to run the models. Work is being done to add GPU, once they do, we will add...
> Now gpu is supporten? Not yet
@VanHallein Did you figured out the issue?
@SavageTheUnicorn Are you running with this? ```bash docker run -d -v weights:/usr/src/app/weights -v datadb:/data/db/ -p 8008:8008 ghcr.io/nsarrazin/serge:latest ```