flytekit

flytekit copied to clipboard

Fixes to dataclass transformer union handling

6

## Why are the changes needed? ### Motivating use case I was attempting to use the Python SDK in Python code to run tasks/workflows. When dealing with a case like...

salotz

Run command in pyflyte-fast-execute in the same process

8

## Why are the changes needed? With this PR, `pyflyte-fast-execute` does not run the command in another process, which saves ~7 seconds. ## What changes were proposed in this pull...

thomasjpfan

Fix Bug: with_overrides for cache doesn't work

2

## Tracking issue Closes flyteorg/flyte#6079 ## Why are the changes needed? I tried the with_overrides to override cache configuration for a local flyte @task, but it didn't work as expected....

hebiao064

Apply obstore as storage backend

28

## Tracking issue Related to flyteorg/flyte#4081 ## Why are the changes needed? Use a Rust/Pyo3 package - obstore - as the storage backend for cloud storages. This provides the smaller...

machichima

mosaic data streaming integration

6

## Tracking issue ## Why are the changes needed? ## What changes were proposed in this pull request? this PR adds the mosaic data streamer to flytedirectory. i have some...

samhita-alla

Add container_image at the workflow level.

3

The container_image should be propagated to all underlying levels of a task. ## Tracking issue ## Why are the changes needed? ## What changes were proposed in this pull request?...

RRap0so

[Bug] SecretsManager get function supports env_var pararmeters.

12

## Tracking issue [flyteorg/flyte#](https://github.com/flyteorg/flyte/issues/6302) ## Why are the changes needed? In flytekit secretsManager, it will check whether the secret exist in an env var "_" or in a file "/etc/secrets//"....

0yukali0

Add support cache for dynamic spec

5

## Tracking issue Related to [#5543](https://github.com/flyteorg/flyte/issues/5543) ## Why are the changes needed? We need to pass execution mode into TaskTemplate Metadata for Flyte Propeller to tell whether the node is...

popojk

Flytekit: Rename map_task to map, replace min_successes and min_success_ratio with tolerance, rename max_parallelism to concurrency

15

## Tracking issue Related to flyteorg/flyte#[6139](https://github.com/flyteorg/flyte/issues/6139) ## Why are the changes needed? The current Flytekit has several areas that could be improved for a better developer experience: 1. The `map_task`...

ChihTsungLu

Add image builder user defined

9

## Tracking issue ## Why are the changes needed? In some situations, there isn't internet to build image from pulling uv and micromamba images from the net. ## What changes...

arbaobao