Make the number of dynamic executor threads configurable via environment variables.
Category:
New feature (non-breaking change which adds functionality)
Description:
According to a request made in a review comment for #5944, this PR adds environment variables that control the number of executor threads:
DALI_EXEC2_NUM_THREADS - exact value used for the number of operator threads
DALI_EXEC2_MAX_THREADS - the number of threads is min(num_thread, $DALI_EXEC2_NUM_THREADS) where num_thread is the pipeline parameter.
DALI_EXEC2_NUM_THREADS takes precendence.
Additional information:
Affected modules and functionalities:
Key points relevant for the review:
Tests:
- [ ] Existing tests apply
- [ ] New tests added
- [ ] Python tests
- [ ] GTests
- [ ] Benchmark
- [ ] Other
- [X] N/A
Checklist
Documentation
- [ ] Existing documentation applies
- [ ] Documentation updated
- [ ] Docstring
- [ ] Doxygen
- [ ] RST
- [ ] Jupyter
- [ ] Other
- [X] N/A
DALI team only
Requirements
- [ ] Implements new requirements
- [ ] Affects existing requirements
- [X] N/A
REQ IDs: N/A
JIRA TASK: N/A
CI MESSAGE: [29892447]: BUILD STARTED
Can you please also add this to the documentation?
Can you please also add this to the documentation?
It's so internal that I'd really prefer not to... This should be exposed somehow as a first-class feature, just need to figure out how.
CI MESSAGE: [29892447]: BUILD PASSED