cwltest

cwltest copied to clipboard

`cwltest [--verbose] --test foo.yml` where `foo.yml` doesn't exist (or doesn't conform to the required schema) fails quietly, with no feedback whatsoever, skipping any valid test items. - Expected: Failed to...

martinherrerias

Needs documentation on how to write tests

5

Examples: https://github.com/common-workflow-language/common-workflow-language/blob/master/v1.0/conformance_test_v1.0.yaml https://github.com/common-workflow-language/user_guide/blob/gh-pages/_includes/cwl/conformance-test.yml

mr-c

test failed, not sure why

6

Hi, I am having problems passing test 107 with my implementation and do not understand what is wrong. The File object for file `a` should be what is expected, still...

wgerlach

"-l" should list test labels in addition to the doc string

1

mr-c

Manage log streams when runnign multiple tests in parallel

3

I'm trying to debug Toil running the CWL conformance tests; a few random tests seem to hit their timeouts. I'm running `cwltest` with `-j8` or so to run multiple tests...

adamnovak

Lets say I have a CWL tool that interacts with an ftp server that requires a username and password. It would be nice to be able to `mock` the base...

thomasyu888

If we're running CWL conformance tests and there is a 15 minutes timeout per test. there are 133 tests so this ends up in a 33 hours total timeout when...

nicocesar

logging of debug messages not possible since --quiet hardcoded in cwltest

1

Hello, This is a suggestion to help debug when running conformance tests. cwltest appends "--quiet" to the command line. https://github.com/common-workflow-language/cwltest/blob/65ec76c43095977f0c8fa0776850fd55b57a2c35/cwltest/__init__.py#L64 Also, removing "--quiet" in cwltest makes all test cases fail,...

pkp124

Examples and/or brief instructions?

2

Hi, To use this externally to test CWL an example or two and/or brief instructions would help. It looks to me as though I'd have to read the code to...

SJChacko

switch an established testing framework

3

So we don't have to maintain/add commonly found features like parallel execution, JunitXML output, et cetera. Candidates: pytest + pytest-xdist

mr-c