Arthur comments

Repositories
Issues
Comments

Results 4 comments of


                                            Arthur

Cannot configure maintenance branches to have pre-releases

Any update on this?

Is it possible to add memory context?

Hi @njalan I implemented a user-level cache using the existing MemoryCache class to store the latest N Q/A pairs per user. This cache is then appended to the prompt before...

Config for middleware parameters

+1. Please allow us to modify the parameters for default middlewares like SummarizationMiddleware.

Config for middleware parameters

We ran into this exact issue in production. Since there's no way to customize SummarizationMiddleware parameters, we ended up building our own middleware with the following features: - Configurable thresholds...