airflow-livy-operators
airflow-livy-operators copied to clipboard
panovvv
Lets Airflow DAGs run Spark jobs via Livy: sessions and/or batches.
Bumps [requests](https://github.com/psf/requests) from 2.26.0 to 2.31.0. Release notes Sourced from requests's releases. v2.31.0 2.31.0 (2023-05-22) Security Versions of Requests between v2.3.0 and v2.30.0 are vulnerable to potential forwarding of Proxy-Authorization...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [apache-airflow](https://github.com/apache/airflow) from 2.1.2 to 2.6.0. Release notes Sourced from apache-airflow's releases. Apache Airflow 2.6.0 Significant Changes Default permissions of file task handler log directories and files has been changed...
Bumps [pyspark](https://github.com/apache/spark) from 3.0.2 to 3.2.2. Commits 78a5825 Preparing Spark release v3.2.2-rc1 ba978b3 [SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases 001d8b0 [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to...
Hello, This is particularly not a bug but we are running livy with EMR. when batch completes , it calls the close batch API which kills the batch. as per...
