flytekit
flytekit copied to clipboard
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
Bumps [pyspark](https://github.com/apache/spark) from 3.2.1 to 3.2.2. Commits 78a5825 Preparing Spark release v3.2.2-rc1 ba978b3 [SPARK-39099][BUILD] Add dependencies to Dockerfile for building Spark releases 001d8b0 [SPARK-37554][BUILD] Add PyArrow, pandas and plotly to...
# TL;DR Enabling the Meant to open this in my fork for internal review, but will leave up as draft and wrap up tomorrow with a better test + smoke...
Signed-off-by: Ketan Umare # TL;DR _Please replace this text with a description of what this PR accomplishes._ ## Type - [ ] Bug Fix - [ ] Feature - [...
# TL;DR Implements a new `CloudPickleResolver` that should allow us to zip, pickle and ship a task for data persistence. This PR is a work in progress as of writing...
# TL;DR This PR makes passing of `SerializationSettings` for APIs like `register_task` and `register_workflow` lazy aka a user may not pass them. This is helpful in cases like: 1. Using...
Signed-off-by: Kevin Su # TL;DR We didn't set the upstream node for the branch node. Therefore, the DAG of the following example is wrong, ```python from flytekit import task, workflow,...
# TL;DR _Please replace this text with a description of what this PR accomplishes._ ## Type - [ ] Bug Fix - [ ] Feature - [ ] Plugin ##...
Signed-off-by: Prafulla Mahindrakar # TL;DR _Please replace this text with a description of what this PR accomplishes._ ## Type - [X] Bug Fix - [ ] Feature - [ ]...
Signed-off-by: Kevin Su # TL;DR Migrate ArrayJob to use TaskTemplate Config and deprecate ArrayJob proto ## Type - [ ] Bug Fix - [ ] Feature - [ ] Plugin...