Ruiyan Ma comments

Repositories
Issues
Comments

Results 3 comments of


                                            Ruiyan Ma

NotImplementedError: Cannot copy out of meta tensor; no data!

+1 Facing the same issue.

Request for Examples of Pipeline Parallelism with Multiple Machines in PiPPy

log in rank0: ``` Namespace(world_size=2, rank=0, master_addr='30.57.186.38', master_port='29500') rpc init success for worker0. DEBUG > WorkerInfo(id=0, name=worker0) INFO > [PiPPy] Tracing model ... DEBUG > Total model size: 1052938, per...

Incorrect GPU Assignment in MPI Inter-Node Processing with Single GPU Nodes

I will submit a suggestion for a fix soon. The Python implementation works successfully after the change, allowing for successful inference. The C++ version avoids the initial error after modification,...