prefect
prefect copied to clipboard
Migrates to Kubernetes_asyncio for asynchronous support
Description
Migrates to use kubernetes_asynio library in order to have better handling of pod evictions and timing out jobs.
Example
No user facing changes happening. Main bulk of the changes are in _watch_jobs
. It now uses timeout_async
to timeout both, streaming of logs and monitor job events instead of calculating and keeping track of the timeout seconds.
Closes: #8409 #12988 #12995 #12071 #6394
Checklist
- [x] This pull request references any related issue by including "closes
<link to issue>
"- If no issue exists and your change is not a small fix, please create an issue first.
- [x] If this pull request adds new functionality, it includes unit tests that cover the changes
- [x] This pull request includes a label categorizing the change e.g.
maintenance
,fix
,feature
,enhancement
,docs
.
For documentation changes:
- [x] This pull request includes redirect settings in
mint.json
for files that are removed or renamed.
For new functions or classes in the Python SDK:
- [x] This pull request includes helpful docstrings.
- [x] If a new Python file was added, this pull request contains a stub page in the Python SDK docs and an entry in
docs/mint.json
navigation.