Zoli Somogyi

I think that it would be a very useful extension of the library if you could add a function to load static extensions (usually written in C/C++). Compiling these into...

Yes, I can do this in C++/C with a dll extension (not statically linked to sqlite). It would be great if you could make this in C# with the library.

If you want to make some tests here is an extension that you can compile for testing: https://www.sqlite.org/src/file?name=ext/misc/zipfile.c or this https://www.sqlite.org/src/file?name=ext/misc/spellfix.c

@sjlombardo & @ericsink, I was able to modify my C++ code based on @sjlombardo's example and use the existing infrastructure in SQLitePCL.raw to load a module permanently for all future...

These two parameters are too high (should decrease to 512 - this is the optimal value for speed and GPU memory use: ``` BatchSize = 2048, UBatchSize = 2048 ```

It is sometimes frustrating, but if you dig deeper and learn a bit more about the code, then you will be able to adjust it to your requirements. From your...

I am using batch size 512 with KM with different models having different vector size and I have never had a problem. 512 is the optimal value for speed and...

> > @params.UBatchSize != @params.BatchSize > > This is inherited from [here](https://github.com/ggerganov/llama.cpp/blob/master/examples/embedding/embedding.cpp#L88-L89). > > Unfortunately the embedder can't split input into multiple batches at the moment, so if you are...

The new version that will come out soon works with qwen3 (updated binary). You will have to wait until the PR is merged.

I am not surprised that your code does not work. You need to reimplement it completely. It does not have any sense to work with the context in several function...