IJCAI2023-OptimalShardedDataParallel
IJCAI2023-OptimalShardedDataParallel copied to clipboard
How do you get the number in profiler_output.py ?
In profiler_output.py file, there is a list named "time_map", The first dimension is about hidden_size, the second dimension is about batch size, the third dimension is a list containing 4 numbers.
What is the meaning of the 4 numbers, respectively ? How do you get the number?
Thanks.