prefect icon indicating copy to clipboard operation
prefect copied to clipboard

Migrates to Kubernetes_asyncio for asynchronous support

Open jeanluciano opened this issue 8 months ago • 0 comments

Description

Migrates to use kubernetes_asynio library in order to have better handling of pod evictions and timing out jobs.

Example

No user facing changes happening. Main bulk of the changes are in _watch_jobs. It now uses timeout_async to timeout both, streaming of logs and monitor job events instead of calculating and keeping track of the timeout seconds.

Closes: #8409 #12988 #12995 #12071 #6394

Checklist

  • [x] This pull request references any related issue by including "closes <link to issue>"
    • If no issue exists and your change is not a small fix, please create an issue first.
  • [x] If this pull request adds new functionality, it includes unit tests that cover the changes
  • [x] This pull request includes a label categorizing the change e.g. maintenance, fix, feature, enhancement, docs.

For documentation changes:

  • [x] This pull request includes redirect settings in mint.json for files that are removed or renamed.

For new functions or classes in the Python SDK:

  • [x] This pull request includes helpful docstrings.
  • [x] If a new Python file was added, this pull request contains a stub page in the Python SDK docs and an entry in docs/mint.json navigation.

jeanluciano avatar Jun 10 '24 19:06 jeanluciano