codeflare
codeflare copied to clipboard
Investigate and measure zero copy for pipelines
Overview
As a CF pipelines user, I would like to understand the memory consumption when pipelines are executed. Given pipelines accept nparrays, will zero copy sharing of Ray help?
Acceptance Criteria
- [ ] Memory growth as pipelines are executed
- [ ] Clear documentation on this
- [ ] A potential story explaining this in more detail