openvino
openvino copied to clipboard
[CPU] Avoid extra processing of the sync nodes in scope of Infer call
Details:
- To reduce Infer overhead
- The new flow is:
- Define sync points from all the nodes perspective.
- Use sync points in scope of Allocate
- Define executable sync points from overall sync points but considering only executable nodes.
- Keep executable sync points ordered to avoid additional logic in scope of Infer call.
Tickets:
- ticket-id
@maxnick Could you please take a look?
@maxnick Comments applied, could you please take a look
Merge after 2024.2 release branch is created