Foundry-Local icon indicating copy to clipboard operation
Foundry-Local copied to clipboard

[AMD NPU] models fail to load with "invalid unordered_map<K,T> key" on Foundry Local 0.8.113

Open MedAnd opened this issue 3 weeks ago • 4 comments

Description

On AMD Ryzen AI systems, all AMD Vitis NPU models fail during the load step in Foundry Local, even though the models download successfully and appear in the local cache. The error occurs consistently across multiple models (Phi-4-mini, Qwen2.5-Coder, etc.).

Environment

Foundry Local version: 0.8.113+70167233c5

AMD NPU Execution Provider (Windows ML): Name: MicrosoftCorporationII.WinML.AMD.NPU.EP.1.8 Version: 1.8.26.0 OS: Windows 11 24H2 (Copilot+ PC)

Repro Steps

 foundry model run qwen2.5-coder-7b-instruct-vitis-npu

Expected Behavior

Model should load successfully into Foundry Local service and be available via local OpenAI-compatible endpoint.

Actual Behavior

Fails during EP initialization with:

invalid unordered_map<K,T> key"

Additional Notes

  • CPU variants load and run fine.
  • NPU EP and Foundry Local are both latest versions.
  • This appears identical to Issue #327

MedAnd avatar Dec 04 '25 03:12 MedAnd

@MedAnd we have not been able to reproduce this error and continue to investigate as to why you are seeing this error. Can you please share your AMD NPU driver version? And also run again with Debug logging:

foundry service set --default-log-level Debug and share relevent logs from ~/.foundry/logs

natke avatar Dec 05 '25 23:12 natke

I'm not the OP but am running into the same issue on version 0.8.113+70167233c5 and windows 25H2 (Build 26200.7171) CPU is a Ryzen 7840S (not Copilot+, but has an AMD NPU)

Here's the log produced after running the relevant commands:

foundry20251206.log

OrenKohavi avatar Dec 06 '25 09:12 OrenKohavi

@natke - as requested please find logs: foundry20251208.log

AMD NPU Driver version 32.0.203.304

MedAnd avatar Dec 08 '25 04:12 MedAnd