Daniel Gafni

This mode allows running local code on `KubeRay` clusters without rebuilding images (by submitting files with `working_dir`). More here: https://github.com/ray-project/kuberay/pull/2364#issuecomment-2402998895

This would be different from `PipesKubeRayJobClient` because it won't be managing the Ray cluster and could run on any Ray backend.

[dagster-aws] [docs] add docs for PipesEMRClient

4

## Summary & Motivation Adding API docs & tutorial for AWS EMR Pipes ## How I Tested These Changes

[dagster-pipes] Add key param to PipesS3MessageReader

4

## Summary & Motivation This PR adds `key` parameter to `PipesS3MessageReader`. Previously, it could only be used when paired with `PipesS3MessageWriter` on the external process side. This change allows using...

[docs] add StepLauncher supersession notes

4

## Summary & Motivation `StepLauncher` is being superseded by Pipes. I added `@deprecated` to all relevant objects. Should [this](https://docs.dagster.io/integrations/spark#submitting-pyspark-jobs-on-emr) section now point to `PipesEMRClient`? It's kinda ready but not fully...

[docs] display supersession info

3

## Summary & Motivation Adding new `Supersession` helpers for docs. This is done in alignment with the new [API lifecycle](https://www.notion.so/dagster/API-Lifecycle-Refresh-f72f6e199da3409c8c5da297a109b3c8) and as requested in [this](https://github.com/dagster-io/dagster/pull/25335#discussion_r1805034325) comment by @yuhan Example screenshot...

[utils] add supersession warning and decorator

2

## Summary & Motivation Adding new Supersession Python utils. This is done in alignment with the new [API lifecycle](https://www.notion.so/dagster/API-Lifecycle-Refresh-f72f6e199da3409c8c5da297a109b3c8) and as requested in [this](https://github.com/dagster-io/dagster/pull/25335#discussion_r1805034325) comment by @yuhan The raised warning...

[core] use cli-provided job_origin when executing runs/steps

1

## Summary & Motivation Slack discussion: https://dagsterlabs.slack.com/archives/C03A0D72A6T/p1729070808476479 ## How I Tested These Changes ## Changelog > Insert changelog entry or delete this section.

[dagster-aws] add ECSExecutor

1

## Summary & Motivation This PR ads a new ECS Tasks Executor. ## How I Tested These Changes ## Changelog Insert changelog entry or "NOCHANGELOG" here. - [ ] `NEW`...