DieguJota

I had the same problem, it solved it for me using --net=host: `sudo docker run --net=host --gpus all --shm-size 1g -p 8080:80 -v $volume:/data ghcr.io/huggingface/text-generation-inference:latest --model-id $model --num-shard $num_shard --quantize...