cylc-flow icon indicating copy to clipboard operation
cylc-flow copied to clipboard

Provenance data collection

Open hjoliver opened this issue 3 years ago • 1 comments

(From offline chat with @oliver-sanders)

For science experiments, we should provide proper provenance data collection:

Everything that goes into obtaining a result: workflow execution, system info, user interaction, captured in a standard format for scientific integrity purposes.

We already collect some of this information automatically, but users have to roll their own ways of scraping it from workflow DB and logs, and add code to collect system info (e.g. on job hosts) themselves.

hjoliver avatar Jan 25 '22 04:01 hjoliver

See also https://github.com/cylc/cylc-flow/issues/3491

oliver-sanders avatar May 06 '22 12:05 oliver-sanders