Martin Evans comments

Results 252 comments of


                                            Martin Evans

dotnet publish issue - multiple publish output files with same relative path

Publishing `LLama.Examples` from the main project _does_ work, so this must be an issue with the way the nuget packages are set up. Unfortunately I don't know much about that...

dotnet publish issue - multiple publish output files with same relative path

Perhaps related to this? https://github.com/SciSharp/LLamaSharp/blob/master/LLama/runtimes/build/LLamaSharpBackend.props Looks like it tells it to copy all the files to the same directory.

dotnet publish issue - multiple publish output files with same relative path

Yeah to be honest I don't have any experience with the .props file either. > There is a ignore duplicates flag in the csproj that might be of use I...

dotnet publish issue - multiple publish output files with same relative path

I just encountered this issue again myself and dug into it. I think #561 should fix it.

dotnet publish issue - multiple publish output files with same relative path

Unfortunately that fix didn't work :(

Whisper support

[Example for Whisper+Llama](https://github.com/SciSharp/LLamaSharp/blob/master/LLama.Examples/Examples/SpeechChat.cs) was merged a while ago (thanks for that @Lyrcaxis!) so I'll close this issue now.

Unable to use lora in llamasharp but can use it in llama.cpp

> .gguf returns "bad file magic" The "file magic" is a very simple sanity check that the file is the right format, it just checks that the first 4 bytes...

Unable to use lora in llamasharp but can use it in llama.cpp

Are you using the same version of llama.cpp as the binaries in LLamaSharp? It's unlikely but possible there's an incompatibility in the file format.

Stateless executor doesn't work with LlamaSharp 0.10 & NET 8.0

Did you use the same model when you tested it in the Examples project and when you tested it in your own app?

Stateless executor doesn't work with LlamaSharp 0.10 & NET 8.0

Well that is bizarre! I've used the stateless executor without a spinner myself (e.g. in the unit tests). Is there any more detail on what the crash is? It looks...