Le-yi

icon company Mahō Shōjo特別作戦班です icon location Beijing icon location Scale-up during the day, scale-out at night.

Results 2 issues of Le-yi

The model instance placement on GPU seems incorrect?

**Description** It seems that when deploying with Triton, the model execution is not correctly assigned to the specified GPU. **Triton Information** nvcr.io/nvidia/tritonserver:25.03-py3 **To Reproduce** **_config.pbtxt_** ```name: "orpheus" backend: "python" input...

[BUG] Cannot use --hostfile to start multi-node training in Docker.

5 comment

**Describe the bug** I used an overlay network to connect containers on two hosts for communication, and configured passwordless SSH along with the relevant /etc/hosts and hostfile. However, I was...

bug
training