cli icon indicating copy to clipboard operation
cli copied to clipboard

Published 20 hours ago • verified publisher icon shipwright-io

Incremental Source Upload

Open otaviof opened this issue 3 years ago • 2 comments

To improve the user experience when shp build upload for a big repository, we should support incremental uploads.

In high level, that means having a PVC mounted on /workspace/source instead of the emptyDir: {} currently employed. On the CLI side, using the incremental rsync protocol.

For the persistent volume under /workspace/source, we have SHIP-0022 covering volumes for a BuildStrategy and the issue-478 to consider.

otaviof avatar Feb 03 '22 07:02 otaviof

From grooming, keeping this one open for more discussions. There might be an interjection on this between upload and bundle for local source.

qu1queee avatar Feb 09 '22 14:02 qu1queee

Changing the upload mechanism requires coordination with the build controller and potential API changes. Therefore it requires a SHIP.

adambkaplan avatar Mar 23 '22 13:03 adambkaplan