flux-core icon indicating copy to clipboard operation
flux-core copied to clipboard

libsubprocess: support stdout flow control

Open chu11 opened this issue 1 year ago • 2 comments

Separating this from #6291 as its a different beast and different design, and at the moment not an issue hit by users

chu11 avatar Sep 24 '24 19:09 chu11

note some conversation from https://github.com/flux-framework/flux-core/pull/6281 and the overflow output callback in remote_output_buffered()

chu11 avatar Sep 24 '24 20:09 chu11

See flux-framework/rfc#427 for a proposed protocol.

garlick avatar Sep 24 '24 23:09 garlick

Was pondering this and the need.

  • with the unbuf support, it isn't needed for a large number of use cases now (but would be needed for flux-exec which doesn't use unbuf)

  • without this support, we probably gotta keep the buffer sizes large at 4 meg #6385

I think we care about #6385 a lot b/c 4 megs is a good chunk of memory or people are launching alot of processes

chu11 avatar Nov 01 '24 18:11 chu11