Roger Meier

I just tested locally and it works: ``` $ docker compose -f xinference/deploy/docker/docker-compose-distributed.yml up [+] Running 4/4 ✔ Container docker-xinference-supervisor-1 Created 0.3s ✔ Container docker-xinference-1 Created 0.3s ✔ Container docker-xinference-worker-2-1...

Hmm, I mention the wrong file, of course I used https://github.com/xorbitsai/inference/blob/main/xinference/deploy/docker/docker-compose-distributed.yml . Please share the output of `docker compose -f xinference/deploy/docker/docker-compose-distributed.yml up`

No idea, maybe the docker environment you have is outdated or nvidia container toolkit is not installed. also the warning there could give a hint.

@insistence-essenn It's a local setup problem, as you've seen based on my example it works. Does another docker-compose file work ?

Thanks for the feedback @rgmz and @zricethezav , I just added `Entropy: 3` to all the tokens.

I agree that read all the members could make sense for some use cases. But the state will change continuously for dynamic groups especially in large companies. Therefore it becomes...

welcome to the club @stawik-mesa :smile_cat:

I agree fastapi is able to handle request but we had an out of memory issue and this is not recognized by the health endpoint. the metrics and health endpoints...

@zricethezav I suggest closing this as it is addressed by #1536

@zricethezav I suggest closing this as it is addressed by #1536