shengkaixuan

got the same problem !

anyone tried this ?? how did it go?

> tried on my 4g gpu, oh man, it worked! thanks

` ┌───────────────────────────────────────────────────┐ │ Fiber v2.42.0 │ │ http://127.0.0.1:8080 │ │ (bound on host 0.0.0.0 and port 8080) │ │ │ │ Handlers ............ 10 Processes ........... 1 │ │ Prefork...

> I pulled the latest image, the host which runs the image suppor avx `[root@local ~]# lscpu | grep avx Flags: fpu vme de pse tsc msr pae mce cx8...

have you found a way to work around??

https://kopf.readthedocs.io/en/stable/probing/ May the health-checks be a good idea ??

> These models worked the best for me. With OpenHermes as my favorite. Based on question \ answer of 1 document with 22769 tokens length. > > * [OpenHermes-2.5-Mistral-7B-GGUF/](https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-GGUF/) >...

how to use metaflow in a locally deployed k8s cluster?