dxWDL icon indicating copy to clipboard operation
dxWDL copied to clipboard

Make it really easy to debug a single job

Open jtratner opened this issue 5 years ago • 1 comments
trafficstars

Often with dxWDL, I want to be able to easily debug some task, especially by ssh'ing on to box with everything there.

Potentially useful ways to accomplish this:

  1. Be able to specify a different docker image via secret parameter with a default (e.g., -i_image=... -iregistry_login=... or something) - this would make it easy to iterate rapidly on a prebaked image by pushing various things to external registry.
  2. Dump fully templated script to a standard location so it can be edited and rerun. Include a script to run docker with correct commands. Docker image should be fully loaded locally and not deleted afterwards. Respect --debug-on.
  3. Make it easy to do a "dxWDL clone", where you get hopped on to box with cromwell + your docker image + data downloaded + input JSON for cromwell. dxWDL debug-job -j job-123

jtratner avatar Mar 02 '20 06:03 jtratner

(1) is possible by adding a docker_image input parameter to your task with a default value, e.g.

task foo {
  input {
    String docker_image = "myimage"
  }
  ...
  runtime {
    docker: docker_image
  }
}

(2) is also supported, at least in dxCompiler. The job script is in /home/dnanexus/meta/commandScript.

jdidion avatar Feb 22 '21 21:02 jdidion