cylc-flow
cylc-flow copied to clipboard
Improve log retrieval logging
Problem
If you set retrieve job logs max size
there is no evidence if any files get skipped
Proposed Solution
- Record the output from the log transfer in
job-activity.log
(currently you only see it in the scheduler log if you use debug mode). - Replace the rsync option
-v
with--info=skip --out-format="%o %n%L"
. Example output:
1/hello/01/job.large is over max-size
recv 1/hello/01/
recv 1/hello/01/job.err
recv 1/hello/01/job.out
recv 1/hello/01/job.status
recv 1/hello/01/job.xtrace