openvino icon indicating copy to clipboard operation
openvino copied to clipboard

[CPU] Avoid extra processing of the sync nodes in scope of Infer call

Open EgorDuplensky opened this issue 1 year ago • 3 comments

Details:

  • To reduce Infer overhead
  • The new flow is:
    1. Define sync points from all the nodes perspective.
    2. Use sync points in scope of Allocate
    3. Define executable sync points from overall sync points but considering only executable nodes.
    4. Keep executable sync points ordered to avoid additional logic in scope of Infer call.

Tickets:

  • ticket-id

EgorDuplensky avatar Apr 24 '24 21:04 EgorDuplensky

@maxnick Could you please take a look?

EgorDuplensky avatar Apr 25 '24 12:04 EgorDuplensky

@maxnick Comments applied, could you please take a look

EgorDuplensky avatar May 21 '24 07:05 EgorDuplensky

Merge after 2024.2 release branch is created

maxnick avatar May 21 '24 11:05 maxnick