soma icon indicating copy to clipboard operation
soma copied to clipboard

Use async streams instead of in-memory load when building image

Open KSAlpha opened this issue 6 years ago • 0 comments

#85 introduced docker API based image build using in-memory load of build context. This is not a robust behavior as a big build context may consume a lot of memory which can result in OOM exception.

Followings seem to be a good alternatives:

  • FramedRead Based on AsyncRead with blocking annotation, which requires Runtime running on thread pool. (Soma uses current_thread::Runtime)
  • futures-fs Starts additional thread pool.

Both requires 'non-current-thread` runtime (or thread pool) running, which is expected to be a big change from current implementations.

KSAlpha avatar Jan 20 '19 15:01 KSAlpha