Jérémy de Gail

Add documentation to run on M1 chip

4

When running jina flow locally with an M1 chip, I noticed you needed to use a different version of jax to run it. See [here](https://github.com/google/jax/issues/5501). Having `jax == 0.2.10` does...

There isn't a distinction between model_name/identifier and model_path

2

Hi team, I have a LMQL server running on one machine like this: ``` python MODEL_NAME = "llama.cpp:/home/ubuntu/Desktop/models/TheBloke/Yarn-Llama-2-13B-128K-GGUF/yarn-llama-2-13b-128k.Q4_K_M.gguf" lmql.serve(model_name=MODEL_NAME, n_gqa=8, n_gpu_layers=100, n_ctx=2000) ``` and I am making request to this...

Any docker support?

7

Hi there, I have been trying to run the project in a docker container. I managed to have this screen :  However, the following errors are preventing me from...