sitabulaixizawaluduo

> Hi @sitabulaixizawaluduo, did you check the latest 2024.1 release if it has the same issue? > > @dmitry-gorokhov, @mg-intel, please pay attention to performance degradation in 2024.0 release >...

> Please ensure that you're using the same benchmark parameters when comparing the performance between two different versions of benchmark_app. For example, `-nireq, -nstreams, -nthreads` > > If the scenario...

> Could you share your relevant model files? `import numpy as np import onnx from onnx import helper from onnx import AttributeProto, TensorProto, GraphProto index = [1, 1, 1, 1,...

This issue is related to #24412

I met the same case, when I use vllm to evaluate human-eval. Do you know the reason? Thanks

> @sitabulaixizawaluduo Reorder op is reponsible for memory copy in this context. In 2023 Split operation does nothing and real memory copy (from Split input to model outputs) is performed...

I found that this reorder op doesn't appear all the time, if one of the branches after split continues after the split operation, then the reorder op doesn't appear.