Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAG model not available for UWP platform #293

Open
zzb226zzb opened this issue Dec 19, 2024 · 4 comments
Open

RAG model not available for UWP platform #293

zzb226zzb opened this issue Dec 19, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@zzb226zzb
Copy link

Describe the bug

I'm looking to build a RAG retrieval system on the universal windows platform, using a .gguf embedded model. The retrieval works fine in the unity editor, but when generating for deployment on a UWP platform, it doesn't work and gets stuck at the first step of the rag.Search(message, 1). I checked llmCaller.llm.model and it displays the correct model name.

Steps to reproduce

No response

LLMUnity version

No response

Operating System

None

@zzb226zzb zzb226zzb added the bug Something isn't working label Dec 19, 2024
@amakropoulos
Copy link
Collaborator

Hi! I haven't worked or tested with UWP yet.
The supported platforms are: Windows, Linux, macOS, iOS and Android.
I'm modifying the bug label to enhancement.

@amakropoulos amakropoulos added enhancement New feature or request and removed bug Something isn't working labels Dec 19, 2024
@zzb226zzb
Copy link
Author

Thank you, I'd also like to find out what .dll file was used in the search, and if it's possible that there's no corresponding format.

@amakropoulos
Copy link
Collaborator

The search DLL can be found here:
LLMUnity/Resources/usearch/windows/libusearch_c.dll

@zzb226zzb
Copy link
Author

Hello, undreamai_windows-noavx.dll seems to be in Win32 format, is it possible to generate one in ARM64 format, thank you very much.
Error at runtime:
System.DllNotFoundException: Unable to load DLL 'undreamai_windows-noavx'. Tried the load the following dynamic libraries: Unable to load dynamic library 'undreamai_windows-noavx' because of 'Failed to open the requested Unable to load dynamic library 'undreamai_windows-noavx' because of 'Failed to open the requested dynamic library (0x06000000) - %1 is not a valid Win32 application.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants