JFDuan

icon indicating a website link https://jf-d.github.io/

icon company Ph.D. Candidate@CUHK-MMLab, B.E.@ UCAS icon location HongKong icon location Interested in AI for system, efficient LLM training and serving!

Results 2 issues of JFDuan

Accelerate LLaMA model loading

1 comment

This PR is for accelerating LLaMA model weights loading with safetensors. I find current load weight implementation doubles the time cost as the tensor-model parallelism increases (refer to the belowing...

CNN benchmark cannot run

9 comment

I follow the instruction in your CNN benchamrk training resnet50 with sync data. After I exec `train.sh`, It failed with the following information. Can you offer some help? ``` ------------------------------------------------------------------...