Improve performance of ImageDecoder

[jantonguirao]

Category:

Other Performance

Description:

• Populate the CUDA event pool with a few events per thread, to avoid creation of threads during the execution of the pipeline
• Use task priority in the thread pool used by nvimagecodec, so that tasks are executed on FIFO order
• Fix the preallocated_batch_size to take into account the hw_load. Not doing so, causes cuMemFree calls during the pipeline run.

Additional information:

Affected modules and functionalities:

ImageDecoder mostly (any operator that has a mixed backend thread pool)

• ImageDecoder

Key points relevant for the review:

Tests:

• [x] Existing tests apply
• [ ] New tests added
  • [ ] Python tests
  • [ ] GTests
  • [ ] Benchmark
  • [ ] Other
• [ ] N/A

Checklist

Documentation

• [x] Existing documentation applies
• [ ] Documentation updated
  • [ ] Docstring
  • [ ] Doxygen
  • [ ] RST
  • [ ] Jupyter
  • [ ] Other
• [ ] N/A

DALI team only

Requirements

• [ ] Implements new requirements
• [ ] Affects existing requirements
• [x] N/A

REQ IDs: N/A

JIRA TASK: N/A

[jantonguirao]

!build

[dali-automaton]

CI MESSAGE: [16808221]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16808221]: BUILD FAILED

[dali-automaton]

CI MESSAGE: [16811949]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16813241]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16813356]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16813388]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16814374]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16811949]: BUILD PASSED

[dali-automaton]

CI MESSAGE: [16814374]: BUILD PASSED

[dali-automaton]

CI MESSAGE: [16825232]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16825232]: BUILD PASSED

[dali-automaton]

CI MESSAGE: [16836552]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16836608]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16836608]: BUILD PASSED

[dali-automaton]

CI MESSAGE: [16842081]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16842081]: BUILD FAILED

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[dali-automaton]

CI MESSAGE: [16850269]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16850269]: BUILD PASSED

[dali-automaton]

CI MESSAGE: [16870107]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16870107]: BUILD FAILED

[dali-automaton]

CI MESSAGE: [16871315]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16871315]: BUILD FAILED

[dali-automaton]

CI MESSAGE: [16872794]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16872794]: BUILD FAILED

[jantonguirao]

!build

[dali-automaton]

CI MESSAGE: [16939665]: BUILD STARTED

[dali-automaton]

CI MESSAGE: [16939665]: BUILD FAILED

[dali-automaton]

CI MESSAGE: [17040647]: BUILD STARTED