Carl Oscar Aaro comments

Results 11 comments of


                                            Carl Oscar Aaro

Changes suggestion to improve performance under production workload

@tranvietanh1991 Hi. This is an insanely late response to your suggestions I'm afraid, so I would like to apologize for that. Also – thank you for the great suggestions and...

[Request] Support for kafka

I don't have any real insights or professional experience using Kafka myself, but apparently there's a package called [aiokafka](https://github.com/aio-libs/aiokafka/) that would probably be quite easy to implement.

[Question] Can I use redis as the message queue?

I haven't built any code for it, but I think it should be doable without too much work. Added the `feature` label to the issue.

Bump aiobotocore from 1.3.3 to 1.4.2

@dependabot rebase

Bump aiobotocore from 1.3.3 to 1.4.2

@dependabot rebase

Kafka support

Hi. Kafka would be interesting, however I don't have any professional experience using Kafka myself. I suppose it should be quite easily included, if there's already an async library supporting...

how to build on local?

It should build without issues. Make sure your internet connection is stable and your machine has enough disk and RAM for the image.

zendframework/zendframework1 is abandoned

Hi. I haven't done any development on it since 2013. Since then there's been a few merged PR:s however.

'ValidationException when calling the InvokeModelWithResponseStream operation' in Open-WebUI 0.1.125 using Claude 3 on AWS Bedrock

@justinh-rahb Errors are when using the `ghcr.io/open-webui/open-webui:0.1.125` image. The older `ghcr.io/open-webui/open-webui:0.1.123` image works.

'ValidationException when calling the InvokeModelWithResponseStream operation' in Open-WebUI 0.1.125 using Claude 3 on AWS Bedrock

Same issue on `main` (hash digest `9ce6b38670a239fc575e75f1070b74e162afa318836a3af18d72d47d1a8f4f73`). I'll try out with an updated LiteLLM later on, as https://github.com/BerriAI/litellm/pull/2780 seems related.