Yauheni Vauchok

Phi-4-mini-gpu-int4-rtn-block-32 (DirectML/CUDA - Small, Standart) fails after several messages

4

2025-05-27 11:43:50.848 [info] Information: Microsoft.Neutron.OpenAI.Delegates.OpenAIApi [0] 2025-05-27T11:43:50.8481637+02:00 HandleChatCompletionAsStreamRequest -> model:Phi-4-mini-gpu-int4-rtn-block-32 MaxCompletionTokens:(null) maxTokens:256 temperature:(null) topP:(null) 2025-05-27 11:43:50.853 [info] Information: Microsoft.Neutron.OpenAI.Provider.OpenAIServiceProviderOnnx [0] 2025-05-27T11:43:50.8525922+02:00 HandleChatCompletionAsStreamRequest -> model:Phi-4-mini-gpu-int4-rtn-block-32 MaxCompletionTokens:(null) maxTokens:256 temperature:(null) topP:(null) 2025-05-27 11:43:50.856...