Cao Zongyan comments

Repositories
Issues
Comments

Results 3 comments of


                                            Cao Zongyan

Could normal kernel and ll kernel be executed in same process?

> How many nodes and GPUs are you using? And the rank layout? Or can you ensure that every `[8k, 8k + 8)` GPUs are in the same NVLink domain?...

Could normal kernel and ll kernel be executed in same process?

> > But we got crash when we try to initiate two Buffers with different modes, like this > > Oh, sorry. NVSHMEM can not be initialized twice. If you...

Could normal kernel and ll kernel be executed in same process?

> Yes, it is possible, and you don't have to do anything, it is fully automatic. > > `NVSHMEM_IB_ENABLE_IBGDA` only initialize the IBGDA configs at setup. > > But it...