Ali Panahi
Ali Panahi
### Is there an existing issue for the same bug? - [x] I have checked the existing issues. ### Describe the bug and reproduction steps For AWS Bedrock models setting...
### What happened? ```python import litellm response = litellm.completion( model = "azure/gpt-4o", api_base = "https://XXX.openai.azure.com/", api_version = "2024-08-01-preview", api_key = "XXX", messages = [{"role": "user", "content": "hi"}], max_completion_tokens=100, ) print(response)...
**What problem or use case are you trying to solve?** To better understand how much of the context window is used and how much is available. **Describe the UX of...