DALI
DALI copied to clipboard
Add experimental support for Python 3.13t
Category:
New feature (non-breaking change which adds functionality)
Description:
This PR adds support for Python 3.13t. It also adds a test that runs two DALI pipelines at the same time within different threads. Depending on Python version, this will be true parallelism or only concurrency.
At the moment, we need to set PYTHON_GIL=0 environment variable to disable GIL. In future we can omit this by adding py::mod_gil_not_used() to DALI's pybind11 module, however it's better to make sure DALI's working in free-threaded fashion first.
Based on similar PR that adds Python 3.13 support: https://github.com/NVIDIA/DALI/pull/5692
Additional information:
Affected modules and functionalities:
Key points relevant for the review:
Tests:
- [ ] Existing tests apply
- [ ] New tests added
- [ ] Python tests
- [ ] GTests
- [ ] Benchmark
- [ ] Other
- [ ] N/A
Checklist
Documentation
- [ ] Existing documentation applies
- [ ] Documentation updated
- [ ] Docstring
- [ ] Doxygen
- [ ] RST
- [ ] Jupyter
- [ ] Other
- [ ] N/A
DALI team only
Requirements
- [ ] Implements new requirements
- [ ] Affects existing requirements
- [ ] N/A
REQ IDs: N/A
JIRA TASK: N/A
CI MESSAGE: [26991807]: BUILD STARTED
CI MESSAGE: [26992708]: BUILD STARTED
CI MESSAGE: [27039628]: BUILD STARTED
CI MESSAGE: [27039628]: BUILD FAILED
CI MESSAGE: [27049583]: BUILD STARTED
CI MESSAGE: [27049583]: BUILD FAILED
CI MESSAGE: [27060443]: BUILD STARTED
CI MESSAGE: [27060443]: BUILD FAILED
CI MESSAGE: [27073140]: BUILD STARTED
CI MESSAGE: [27073140]: BUILD FAILED
CI MESSAGE: [27105456]: BUILD STARTED
CI MESSAGE: [27105456]: BUILD FAILED
CI MESSAGE: [27155718]: BUILD STARTED
CI MESSAGE: [27155718]: BUILD FAILED
CI MESSAGE: [27159222]: BUILD STARTED
CI MESSAGE: [27159222]: BUILD FAILED
CI MESSAGE: [27948556]: BUILD STARTED
CI MESSAGE: [27948556]: BUILD FAILED
CI MESSAGE: [27951464]: BUILD STARTED
CI MESSAGE: [27951464]: BUILD PASSED
Does it work? I don't see even 3.13, let along 3.13t, being used in the tests.
CI MESSAGE: [28155725]: BUILD STARTED
CI MESSAGE: [28155725]: BUILD FAILED
CI MESSAGE: [28188506]: BUILD STARTED
CI MESSAGE: [28188506]: BUILD FAILED
CI MESSAGE: [28195678]: BUILD STARTED
CI MESSAGE: [28197582]: BUILD STARTED
CI MESSAGE: [28197780]: BUILD STARTED
CI MESSAGE: [28197780]: BUILD FAILED
CI MESSAGE: [28284986]: BUILD STARTED