IJCAI2023-OptimalShardedDataParallel icon indicating copy to clipboard operation
IJCAI2023-OptimalShardedDataParallel copied to clipboard

How do you get the number in profiler_output.py ?

Open Aegsteh-T opened this issue 1 year ago • 1 comments
trafficstars

In profiler_output.py file, there is a list named "time_map", The first dimension is about hidden_size, the second dimension is about batch size, the third dimension is a list containing 4 numbers.

What is the meaning of the 4 numbers, respectively ? How do you get the number?

Thanks.

Aegsteh-T avatar Aug 07 '24 08:08 Aegsteh-T

Actually we merged the implementation of OSDP to our framework Galvatron-2, you can check the detailed information at https://github.com/AFDWang/Hetu-Galvatron about the whole process of profiling, strategy searching, and implementing, thank you for your attention to our framework!

Youhe-Jiang avatar Aug 14 '24 10:08 Youhe-Jiang