Mark Grondona

Related #2459 :disappointed: There's some ideas for "solutions" in that issue. I had to remind myself how this works. Even if stdin is set to a file, the file contents...

I think we can close this one after #6005 since the file input method no longer goes through the KVS. We will keep #2459 open to track the lack of...

I retried with @garlick's patch above which didn't seem to improve things. The broker is still spending a majority of its time in these three `remote_out` and `remote_in` prep/check watchers:...

I can quickly try this since I have the test environment all set up already.

That causes compilation errors: ``` $ make V=1 depbase=`echo cbuf.lo | sed 's|[^/]*$|.deps/&|;s|\.lo$||'`;\ /bin/sh ../../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../../../config -DWITH_PTHREADS -DNDEBUG -Wall -Werror -Wno-strict-aliasing -Wno-error=deprecated-declarations -Werror=missing-field-initializers -Wno-parentheses -Wno-error=parentheses...

Eh, I just ended up disabling those errors/warnings: ```diff diff --git a/src/common/liblsd/Makefile.am b/src/common/liblsd/Makefile.am index 3670604ae..009bf7aa6 100644 --- a/src/common/liblsd/Makefile.am +++ b/src/common/liblsd/Makefile.am @@ -1,13 +1,16 @@ AM_CFLAGS = \ $(WARNING_CFLAGS) \ $(CODE_COVERAGE_CFLAGS)...

Ok, that removed `cbuf_is_valid()` from the perf reprort as expected, but I think this just allows the event loop to spin faster -- the job-exec thread is still taking 100%...

The workload is multiple 128N/128p jobs on a size=1536 instance with a flat topology. When getting up to about 64 simultaneous jobs I started seeing this behavior. (That's 64*128 =...

> deal with cbuf_is_valid() slowness, we'll leave that to issue https://github.com/flux-framework/flux-core/issues/2527 FYI - the solution propose by @garlick (patch in [this comment](https://github.com/flux-framework/flux-core/issues/5919#issuecomment-2083314610)) worked well.

Could we add a new function to disable the existing callbacks and register a new one that is passed output as soon as it is ready, including the data and...