Lucius

icon indicating an email [email protected]

icon company Tsinghua University icon location Beijing, China icon location Postgraduate student major in Software Engineering

Results 1 comments of Lucius

Unexpected Memory Usage and Latency with PP

Thanks for your reply! I've confirmed that latency measured with several warm up runs is normal. > On `examples/cpu_init/gpt2_cpu_init.py`, I couldn't repro the error, whether with 2 ranks or 4...