cwl-airflow

cwl-airflow copied to clipboard

run_as_user flag in default_args error

1

Hi, for security reason, I have to use Apache Airflow v2.3.3 to with cwl-airflow because I would like to use the flag "run_as_user" defined in "default_args". It is a feature...

kokleong9406

Run workflow failed with dockerPull

5

I am trying to pull a docker image within a Workflow and failed with error "Error response from daemon: invalid mount config for type "bind": bind source path does not...

kokleong9406

CWL-airflow on AWS

1

Hi cwl-airflow team, I have been running cwl-airflow locally on my laptop, it works great, thank you for such a fantastic plugin! I am looking to expand my cwl project...

stewalsh04

Bumps [apache-airflow](https://github.com/apache/airflow) from 2.1.4 to 2.2.4. Release notes Sourced from apache-airflow's releases. Apache Airflow 2.2.4 Bug Fixes Adding missing login provider related methods from Flask-Appbuilder (#21294) Fix slow DAG deletion...

dependabot[bot]

Getting standard output in airflow scheduler

3

Hi Michael, Would like to ask that currently, is there anyway to get the standard output printed on airflow scheduler? Currently, I am able to get the log files via...

kokleong9406

Conditional Workflow

1

Hi Michael, My current cwltool version is 3.1.20211107152837. Currently I have a conditional workflow. When I tried to run using cwltool in command prompt, I am able to get the...

kokleong9406

Not yet tested. Airflow 2.2.0 cwltool 3.1.20211004060744

michael-kotliar

Question: Can i use airflow operators with CWL-Airflow?

1

Can I use airflow operators with CWL-Airflow? or only cmdtools like in CWL? if so, how I am expected to push new operators or cmdtools to Airflow? Thanks! great job.

Amitg1

Use of Conditional workflows

2

With our team we are starting to use the Conditional Workflows, as descrived here https://www.commonwl.org/user_guide/24_conditional-workflow/index.html but, it works with v1.2 of CWL actually shipped into https://pypi.org/project/cwltool/3.1.20210521105815/ For your constraint reason...

francescobianco

Redirect CommandLineTool output to default task log file

1

I want collect all generated output by every task into standard Airflow task log file, generally is `./logs/{dag_id}/{task_id}/{run_stamp}/1.log` Furthermore I would get all logs for every task into single file,...

francescobianco