Live image output

[markuspoerschke]

Please write the output of the stages immidiately to the console.

(Maybe we want to add some options to allow different ways of outputs because of the parallel)

[jakubsacha]

I'm not entirely sure how do we want to achieve that. rumi buffers all the jobs in the single stage to the point that given job is done. Thank it outputs it. If we output it right away we would have mixed output from the different scripts in the console.

One improvement that i see is that if we have just the one job running, we could make it output directly to the console, without buffering it. Is that what you mean @markuspoerschke ?

[markuspoerschke]

This is why having an output option is great. We can prefix the output so the user can filter for the corresponding jobs. But yes the ouput might be not in order. But this is still ok if you are in a situation where you need faster feedback. Once we have a UI this functionality might be needed as well to have a live output in multiple windows. (see image)

[Fleshgrinder]

One way under Unix would be multiple file descriptors (e.g. fd/3, fd/4, fd/5, …) for each parallel matrix, stage, and job. This would allow one to write them to separate log files too. This approach does not work on Windows where the concept of multiple console handles does not exist.

Another approach would be to let the user choose, e.g. how make does it: https://www.gnu.org/software/make/manual/html_node/Parallel-Output.html#Parallel-Output

I am not sure yet how to approach this, but it is definitely doable.

PS: Removing the milestone again because this is not really for the next feature release because we do not need it anymore for Windows support.