Lovepreet Singh

Results 1 issues of Lovepreet Singh

RPC Distributed Inference: Environment Variable Not Being Passed to Backend

1 comment

## Environment - **LocalAI Version**: v3.7.0 (commit 9ecfdc593827942488daa6c4027047f0ac04bd6d) - **Backend**: cuda12-llama-cpp - **OS**: Ubuntu 24.04 - **CUDA Version**: 12.6 (upgraded from 11.5) - **NVIDIA Driver**: 580.95.05 - **Hardware Setup**: -...

enhancement