LLMUnity icon indicating copy to clipboard operation
LLMUnity copied to clipboard

Support UWP platform

Open zzb226zzb opened this issue 1 year ago • 4 comments

Describe the bug

I'm looking to build a RAG retrieval system on the universal windows platform, using a .gguf embedded model. The retrieval works fine in the unity editor, but when generating for deployment on a UWP platform, it doesn't work and gets stuck at the first step of the rag.Search(message, 1). I checked llmCaller.llm.model and it displays the correct model name.

Steps to reproduce

No response

LLMUnity version

No response

Operating System

None

zzb226zzb avatar Dec 19 '24 15:12 zzb226zzb

Hi! I haven't worked or tested with UWP yet. The supported platforms are: Windows, Linux, macOS, iOS and Android. I'm modifying the bug label to enhancement.

amakropoulos avatar Dec 19 '24 15:12 amakropoulos

Thank you, I'd also like to find out what .dll file was used in the search, and if it's possible that there's no corresponding format.

zzb226zzb avatar Dec 21 '24 10:12 zzb226zzb

The search DLL can be found here: LLMUnity/Resources/usearch/windows/libusearch_c.dll

amakropoulos avatar Dec 22 '24 07:12 amakropoulos

Hello, undreamai_windows-noavx.dll seems to be in Win32 format, is it possible to generate one in ARM64 format, thank you very much. Error at runtime: System.DllNotFoundException: Unable to load DLL 'undreamai_windows-noavx'. Tried the load the following dynamic libraries: Unable to load dynamic library 'undreamai_windows-noavx' because of 'Failed to open the requested Unable to load dynamic library 'undreamai_windows-noavx' because of 'Failed to open the requested dynamic library (0x06000000) - %1 is not a valid Win32 application.

zzb226zzb avatar Dec 27 '24 00:12 zzb226zzb