Mike Lin

Results 159 comments of Mike Lin

Refinement of the above concept: if file download cache is enabled, exclude from upfront download pass, any input URI less than a single node (outside a scatter) that's less than...

wip: https://github.com/chanzuckerberg/miniwdl/pull/417/commits/d3fd41b49f6b58ebb25ab3634767d4d5641823e3 but it's more complex than hoped for

The issue is also related to all the filename collisions. If, as a workaround, you ensure all the gvcf files have distinct basenames (and matching indexes of course), then they'll...

Actually I think this is a valid issue that miniwdl could handle better (as a lower-priority corner case). There is nothing in WDL requiring the files to have distinct basenames,...

As a workaround it will probably help to increase the setting of [[scheduler] subworkflow_concurrency](https://github.com/chanzuckerberg/miniwdl/blob/d8481a01000118eda76cbbb30df9fa5df493b86f/WDL/runtime/config_templates/default.cfg#L29). I can easily believe there's a bug in the logic that is supposed to prevent a...

Idea: lazily initialize a distinct thread pool each time we see a new subworkflow nesting level (`len(run_id_stack)`]

@rhpvorderman Yes, all basically correct. There are some heuristics right now that are supposed to have the effect of prioritize the more deeply-nested subworkflow calls, but it's hacky (and evidently...

@dinvlad we'd definitely like miniwdl to include AST serialization & pretty-printing, for use cases like this and also for style enforcement (like gofmt or python black). I don't have a...

@illusional still no timeframe for this on my end, which is regrettable (but also means the field remains wide open for community contributions). @DavyCats added some great stringification functions on...

:+1: comment retention is also needed to enable suppression of `miniwdl check` warnings on individual lines