Add `enable_dynamic_shapes` To Model Config To Resolve CNN Memory Leaks With OpenVino EP

[narolski]

trafficstars

Is your feature request related to a problem? Please describe. For some models (most notably, CNNs), OpenVino EP for ONNX Runtime produces significant memory leaks due to issues with memory de-allocation: https://github.com/openvinotoolkit/openvino/issues/12307.

Describe the solution you'd like OpenVino team has proposed to use enable_dynamic_shapes to resolve the issue: https://github.com/openvinotoolkit/openvino/issues/12307. However, it is not currently supported by onnxruntime_backend. I'd like to be able to use this option in model config.

Describe alternatives you've considered Usage of:

parameters { key: "enable_mem_arena" value: { string_value: "0" } }
parameters { key: "enable_mem_pattern" value: { string_value: "0" } }

did not help for OpenVino EP-based inference for onnxruntime_backend.