cylc-flow icon indicating copy to clipboard operation
cylc-flow copied to clipboard

job-submit: duplicate logging of command / output in debug mode

Open oliver-sanders opened this issue 1 year ago • 2 comments

  • If a job-submit command fails, we log it at the ERROR level.
  • We also log all commands at the DEBUG level.

This can make debugging job-submission issues rather difficult as these commands and their output gets quite long.

Example log showing an SSH failure:

DEBUG - [jobs-submit cmd] cat .../01/job | ssh myhost bash --login -c ''"'"'exec "$0" "$@"'"'"'' cylc jobs-submit --debug ...     
    [jobs-submit ret_code] 255                                                  
    [jobs-submit err]                                                                                  
    Permission denied (publickey,password,keyboard-interactive,hostbased).
WARNING - platform: myplatform - Could not connect to myhost.
    * myhost has been added to the list of unreachable hosts                    
    * jobs-submit will retry if another host is available.                      
ERROR - [jobs-submit cmd] cat .../01/job | ssh myhost2 bash --login -c ''"'"'exec "$0" "$@"'"'"'' cylc jobs-submit --debug ...     
    [jobs-submit ret_code] 255                                                  
    [jobs-submit err]                                                                                       
    Permission denied (publickey,password,keyboard-interactive,hostbased).

oliver-sanders avatar Aug 22 '24 12:08 oliver-sanders

Cannot reproduce this, must has been addressed at some point. Re-open if you disagree.

MetRonnie avatar Dec 08 '25 19:12 MetRonnie

Actually logging of jobs-submit is handled differently for the specific case of 255

MetRonnie avatar Dec 08 '25 19:12 MetRonnie