How is the warmup function implemented?

[imhandsome]

[jiashuy]

Hi @imhandsome , the mechanism of warmup is under development. Any requirement input is encouraged, thanks!

[imhandsome]

Excuse me,1. Is the follow-up warmup plan to keep the pin memory unchanged? (or use cudaMallocManaged UVM),2. warmup Provide users with a warmup interface to pre-exchange a portion of the hot embeding to the GPU? @jiashuy

[jiashuy]

Excuse me,1. Is the follow-up warmup plan to keep the pin memory unchanged? (or use cudaMallocManaged UVM),2. warmup Provide users with a warmup interface to pre-exchange a portion of the hot embeding to the GPU? @jiashuy

For 1, pinned memory is given priority consideration as we can control the data movement more concretely; it will remain unchanged from my side.

For 2, for the mechanism of warmup, you can choose between an explicit interface and implicit exchange, for that users can hide it in application, and please refer to the next release version.

[jiafanou]

Do we have any progress on warmup implementation?

[jiashuy]

Hi @imhandsome we have just made a design about warmup, and will published soon. Thanks~

[jiafanou]

Thanks @jiashuy . Do you have rough ETA of release?

[EddieBurning]

any update on this? @jiashuy Thanks.