Mike Lin
Mike Lin
Refinement of the above concept: if file download cache is enabled, exclude from upfront download pass, any input URI less than a single node (outside a scatter) that's less than...
wip: https://github.com/chanzuckerberg/miniwdl/pull/417/commits/d3fd41b49f6b58ebb25ab3634767d4d5641823e3 but it's more complex than hoped for
The issue is also related to all the filename collisions. If, as a workaround, you ensure all the gvcf files have distinct basenames (and matching indexes of course), then they'll...
Actually I think this is a valid issue that miniwdl could handle better (as a lower-priority corner case). There is nothing in WDL requiring the files to have distinct basenames,...
As a workaround it will probably help to increase the setting of [[scheduler] subworkflow_concurrency](https://github.com/chanzuckerberg/miniwdl/blob/d8481a01000118eda76cbbb30df9fa5df493b86f/WDL/runtime/config_templates/default.cfg#L29). I can easily believe there's a bug in the logic that is supposed to prevent a...
Idea: lazily initialize a distinct thread pool each time we see a new subworkflow nesting level (`len(run_id_stack)`]
@rhpvorderman Yes, all basically correct. There are some heuristics right now that are supposed to have the effect of prioritize the more deeply-nested subworkflow calls, but it's hacky (and evidently...
@dinvlad we'd definitely like miniwdl to include AST serialization & pretty-printing, for use cases like this and also for style enforcement (like gofmt or python black). I don't have a...
@illusional still no timeframe for this on my end, which is regrettable (but also means the field remains wide open for community contributions). @DavyCats added some great stringification functions on...
:+1: comment retention is also needed to enable suppression of `miniwdl check` warnings on individual lines