Martin Evans

I'm not sure about that, ideally there probably shouldn't be any memory used, but I can easily imagine some resources getting created even when they're not technically needed. I'd recommend...

Could you try this again with the new 0.10.0 release? If it's still a problem someone will need to dig further into why it's not loading with .NET Framework.

PR with first draft: #555

I'm not familiar with nomic, but if it's based on the BERT architecture it's supported in LLamaSharp yet. BERT support was only added to llama.cpp a couple of weeks ago...

Opening a [Discussion thread](https://github.com/SciSharp/LLamaSharp/discussions) or posting something on [Discord](https://discord.gg/VvYtHCmFzr) would probably be better for something like this. Not a problem though, just a tip! A few comments on your article:...

I think that means that one of the native llama.cpp methods which LLamaSharp is not quite compatible with the .NET Framework pinvoke system. That can probably be worked around, if...

I think anyone running LLamaSharp on .NET Framework would have this issue. But framework is pretty rare to use these days.

So you think it's probably the `llama_model_default_params` method that's the issue?

Thanks for putting in the effort to narrow it down :)

> I don't know why this issue does not get the attention that it seemingly deserves Any issue only gets attention because a motivated developer contributes their spare time and...