extensions

extensions copied to clipboard

[API Proposal]: Cache Synchronization for Hybrid Caching in Multi-Node Environments

16

### Background and motivation In a multi-replica environment utilizing **hybrid caching** (in-memory and out-of-process), cache desynchronization between nodes can occur because there is no built-in mechanism to synchronize **in-memory** caches...

IbrahimMNada

Creating this as a draft to solicit some initial feedback on the design. Fix https://github.com/dotnet/extensions/issues/5546. ###### Microsoft Reviewers: [Open in CodeFlow](https://microsoft.github.io/open-pr/?codeflow=https://github.com/dotnet/extensions/pull/5557)

eiriktsarpalis

Consider alternate chaining pattern for DI/builder

1

(Written by @SteveSandersonMS; I'm copying this into the repo from an offline location...) --- ## Now Currently the API looks like: ```cs services.AddChatClient(pipeline => pipeline .UseDistributedCache() .UseFunctionCalling() .Use(new SomeConcreteClient()); //...

stephentoub

```  Microsoft.Extensions.AI.OllamaChatClientIntegrationTests.CompleteAsync_StructuredOutputEnum Message:  Assert.Equal() Failure: Values differ Expected: Arm64 Actual: Arm Stack Trace:  ChatClientIntegrationTests.CompleteAsync_StructuredOutputEnum() line 665 --- End of stack trace from previous location --- ``` cc: @SteveSandersonMS

stephentoub

HybridCache MaximumPayloadBytes not operating per documentation

2

### Is there an existing issue for this? - [X] I have searched the existing issues ### Describe the bug The documentation for HybridCache's `MaximumPayloadBytes` option indicates: ``` The maximum...

nwoolls

Header Propagation Cannot Be Used in `HybridCache`

4

### Is there an existing issue for this? - [x] I have searched the existing issues ### Describe the bug 1. Add a service depending on `HttpClient` to the DI...

chrisoverzero

[main] Update dependencies from dotnet/aspnetcore

1

Coherency update: Failed to perform coherency update for one or more dependencies. Please review the GitHub checks or run `darc update-dependencies --coherency-only` locally against darc-main-98c36d63-90aa-434d-9b3e-84f023d6b8e8 for more information.

dotnet-maestro[bot]

Add a helper for streaming `IAsyncEnumerable<T>` values as JSON formatted SSE events in Microsoft.Extensions.AI

1

eiriktsarpalis

### Background and motivation The IEmbeddingGenerator interface doesn't support streaming, which makes sense mostly with batching (for remote/cloud implementations) or with local embeddings models, that runs much slower in the...

azchohfi

Lower STJ dependency for M.E.AI to 8.0

4

Currently `Microsoft.Extensions.AI.Abstraction` requires System.Text.Json version 8.0 whereas `Microsoft.Extensions.AI` is on 9.0, primarily due to the fact that it's hosting JSON schema generation services and `AIFunctionFactory`. This implies that any leaf...

eiriktsarpalis