PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

CPU offloading?

Open Xynonners opened this issue 1 year ago • 2 comments

It seems like pipelining could possibly greatly simplify the implementation of a feature such as fairscale's OffloadModel https://fairscale.readthedocs.io/en/latest/deep_dive/offload.html

Is this something that is feasible?

Xynonners avatar Jun 11 '24 12:06 Xynonners

Can you elaborate more? Do you mean that one may offload the entire stage after its forward pass? (And meanwhile bring back another stage from CPU to do the next forward?)

kwen2501 avatar Jun 11 '24 15:06 kwen2501

Can you elaborate more? Do you mean that one may offload the entire stage after its forward pass? (And meanwhile bring back another stage from CPU to do the next forward?)

yes, that is what I was thinking

Xynonners avatar Jun 11 '24 16:06 Xynonners