David Manouchehri

Results 272 comments of David Manouchehri

> please add a test for this @Manouchehri - want to make sure no regressions occur. I believe you can mock bedrock calls I added a test, let me know...

```sh cd litellm/tests/ poetry run pytest test_bedrock_completion.py::test_completion_bedrock_cloudflare_ai_gateway -s -v ``` Confirmed, it passes. =)

Yeah, and returned to the client who is using LiteLLM as well.

I'm working on this now, will send a draft pull request soon. =)

Just a note, this can't go into the metadata, as streaming responses will have different `safetyRatings` values for each part of the response.

https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/gemini#response_body We should also log `citationMetadata` too while we're at it. That would be super helpful IMO.

Example request with response from AI Studio: ```sh curl -v \ -H 'Content-Type: application/json' \ -d '{ "contents": [ { "role": "user", "parts": [ { "text": "Write a fork.c that...

Shouldn't we add the `iss` (issuer) tag to the JWT to begin with? =)

For Cloudflare Workers, this was the solution: ```typescript const supabase_client = createClient(c.env.SUPABASE_URL, c.env.SUPABASE_KEY, { auth: { persistSession: false } }) ``` Thanks to https://github.com/supabase/supabase-js/issues/684#issuecomment-1376620014 for explaining it! (Just writing this...