swli

icon indicating a website link http://www.hpdl.me/

icon location Member of High Performance Deep Learning(HPDL) interesting research group. My interest is Distributed Deep Learning.

Results 5 comments of swli

some fix in flops_profiler

@cli99

some fix in flops_profiler

> Hi @lucasleesw , thanks for the PR. Is there a reason you use **str** instead of **str**()? Nothing specific, just choose another attribute instead of `__name__`.

is BytePS already including Bytedance Scheduler? Or we need to use them separately?

> However, BytePS incorporates the basic idea of ByteScheduler (prioritized scheduling + tensor partition). You can manually enable/disable them if you want to check the benefits. Hi, could you share...

is BytePS already including Bytedance Scheduler? Or we need to use them separately?

> @ymjiang @lucasleesw By default it is disabled. You can enable it by exporting `BYTEPS_SCHEDULING_CREDIT` to a small value (e.g., 4). Thank you, it helps a lot! Could you share...

How to run communication scheduling with BytePS

> > Does byteps have scheduling at the worker side by default? Is there any parameter to control this feature? > > Yes, `BYTEPS_SCHEDULING_CREDIT` controls the scheduling at the worker...