Antonis Makropoulos comments

Results 103 comments of


                                            Antonis Makropoulos

Models not using espeak

Thank you for the quick reply! I have developed [LLM for Unity](https://github.com/undreamai/LLMUnity) that integrates LLMs into Unity. I'm looking into how to add TTS functionality and Piper is the only...

Better LLM and LLMClient workflow

I completely agree! This is work in progress for a major release coming up in the upcoming weeks :). The LLM inheritance from LLMClient grew organically but it's indeed best...

llama.cpp integration with DLL

It's progressing well, it should be done in the next 1-2 weeks

llama.cpp integration with DLL

is there something blocking you at the moment?

llama.cpp integration with DLL

I would love some testing, thank you! I'll send you when I'm at that stage.

llama.cpp integration with DLL

sorry for the delayed reply, the main advantages of the DLL-based implementation are: - it will allow to develop Android and iOS deployment. On mobile platforms it's not possible to...

llama.cpp integration with DLL

After almost 2 months of development the DLL functionality finally entered the beta phase 🚀 !! The feature is implemented in the **release/v2.0.0** branch. Since the backend is entirely rewritten,...

llama.cpp integration with DLL

@tempstudio which GPU do you have? Does llamafile use HIP for you? You can find it in the debug messages I'm trying to make it work but I don't have...

llama.cpp integration with DLL

I managed to build and add HIP support for AMD, as well as Vulkan :tada: ! It is incorporated at the new release (v2.0.1). I can't test either on AMD...

Adding New Features to LLMUnity

Sounds amazing, looking forward to seeing your work! Feel free to also create a PR at any point to add anything missing from LLMUnity. How would you envision the support...