text-embeddings-inference icon indicating copy to clipboard operation
text-embeddings-inference copied to clipboard

docker -- other containers cannot connect - always defaults to 0.0.0.0

Open quantumalchemy opened this issue 11 months ago • 0 comments

System Info

docker run --name hf-embed -p 8083:80 --network AI -v /home/jec/Docker/python_AI/memgpt/hf_emb_data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.1 --model-id BAAI/bge-large-en-v1.5 --hostname AI

docker run --name hf-embed -p 8083:80 --network host -v /home/jec/Docker/python_AI/memgpt/hf_emb_data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.1 --model-id BAAI/bge-large-en-v1.5 (not working on host either) seems server defaults to 0.0.0.0 BUT 0.0.0.0 not reachable to other containers-- anyway to fix this?

Information

  • [X] Docker
  • [ ] The CLI directly

Tasks

  • [ ] An officially supported command
  • [ ] My own modifications

Reproduction

docker run --name hf-embed -p 8083:80 --network AI -v /home/jec/Docker/python_AI/memgpt/hf_emb_data:/data --pull always ghcr.io/huggingface/text-embeddings-inference:cpu-1.1 --model-id BAAI/bge-large-en-v1.5 --hostname AI

Expected behavior

curl hf-embed:8083/embed
-X POST
-d '{"inputs":"What is Deep Learning?"}'
-H 'Content-Type: application/json'

connection to : hf-embed ip (172.19.0.2 port 8083) .. embedings...

quantumalchemy avatar Mar 05 '24 17:03 quantumalchemy