cylc-flow icon indicating copy to clipboard operation
cylc-flow copied to clipboard

Improve log retrieval logging

Open dpmatthews opened this issue 6 months ago • 0 comments

Problem

If you set retrieve job logs max size there is no evidence if any files get skipped

Proposed Solution

  1. Record the output from the log transfer in job-activity.log (currently you only see it in the scheduler log if you use debug mode).
  2. Replace the rsync option -v with --info=skip --out-format="%o %n%L". Example output:
1/hello/01/job.large is over max-size
recv 1/hello/01/
recv 1/hello/01/job.err
recv 1/hello/01/job.out
recv 1/hello/01/job.status
recv 1/hello/01/job.xtrace

dpmatthews avatar Aug 02 '24 06:08 dpmatthews