Luis E Avitia
Luis E Avitia
Closing this, I hope previous responses were sufficient to help you proceed. Feel free to reopen and ask additional questions related to this topic.
Closing this, I hope previous responses were sufficient to help you proceed. Feel free to reopen and ask additional questions related to this topic.
@joey5678 we've done a quick test with the provided model (my-yolo-v8n-int8.zip) on MTL with NPU (Intel Core Ultra 7 155H) and the issue is not observed. Please try using the...
Closing this as it seems issue has been addressed. Feel free to reopen and ask additional questions related to this topic.
Closing this as it can't be reproduced. Feel free to reopen and ask additional questions related to this topic if issue persists and provide the stack trace crash as previously...
Closing this as it seems issue has been addressed. Feel free to reopen and ask additional questions related to this topic.
@Edward-Lin the referenced PR (not merged to master branch yet), seems to contain code changes to support LLM pipeline with static shapes out-of-the-box for NPU plugin. Feel free to try...
Hi @aoke79 if it helps you can take a look at the following PR for guidance with LLMs on NPU: https://github.com/openvinotoolkit/openvino/pull/25841. Here is the [Run LLMs with OpenVINO GenAI Flavor...