saus icon indicating copy to clipboard operation
saus copied to clipboard

Share an http cache between build workers

Open aleclarson opened this issue 3 years ago • 2 comments

Repeating HTTP requests leads to slower builds, so workers should share them.

aleclarson avatar Feb 22 '22 22:02 aleclarson

We can use atomically to safely write to the .saus/http-cache/metadata.json file between processes. Then read the metadata on every .read call.

If we can also track pending requests somehow, avoiding the duplication would be nice.

aleclarson avatar Mar 15 '22 01:03 aleclarson

This is high priority for Parallel Rendering to be fully operational.

aleclarson avatar Mar 15 '22 01:03 aleclarson