Devis Lucato

Update: SK VectorStore is almost ready and will provide this feature for free. Thanks to LINQ expressions, we'll be able to support queries such as (isTest eq false) and (tags/any(t:...

Here's our code, where the exception is thrown: ```csharp public async Task GenerateEmbeddingAsync(string text) { if (this._log.IsEnabled(LogLevel.Trace)) { this._log.LogTrace("Generating embedding, input token size: {0}", this._textTokenizer.CountTokens(text)); } // Throws `System.ArgumentException` var...

Looking at the examples, there's no code about the batch size - how is the batch size set? e.g. https://github.com/SciSharp/LLamaSharp/blob/master/LLama.Examples/Examples/GetEmbeddings.cs

trying to run https://github.com/SciSharp/LLamaSharp/blob/master/LLama.Examples/Examples/GetEmbeddings.cs and it throws the same exception: > **Unhandled exception. System.ArgumentException: Input contains more tokens than configured batch size (Parameter 'batch')** > at LLama.LLamaContext.Decode(LLamaBatch batch) in LLama/LLamaContext.cs:line...

Wouldn't it be easier if batch size was automatically set to match max tokens? is there any benefit from having a lower default? For instance, if a model supports up...

Looks like the PR got stale, with some unsolved errors and comments. We might have to archive it unless someone can kindly complete the task.

TODO: 1. when hybrid search is disabled (default) the code needs to be backward compatible, otherwise people using Postgres and upgrading KM will get a broken deployment. 2. We need...

Parking this for now, while we wait for SK Vector Store release. This feature should be available for free.

@SignalRT yup, the work is still in progress, it hasn't started for PG but you can see how it will work checking the Azure AI Search connector: https://github.com/microsoft/semantic-kernel/blob/e96c693851a2e4be14a9e7fd835c4087b063dc58/dotnet/src/Connectors/Connectors.Memory.AzureAISearch/AzureAISearchVectorStoreRecordCollection.cs#L440-L489 The work...

`DateTimeOffset` too please https://learn.microsoft.com/dotnet/standard/datetime/choosing-between-datetime https://stackoverflow.com/questions/4331189/datetime-vs-datetimeoffset https://ardalis.com/why-use-datetimeoffset/