Anand Taralika
Anand Taralika
@ishaan-jaff @krrishdholakia I have a mix of PTUs and PAYG models for the exact same model variant, it'd be great if I could give a priority in the `litellm_params` so...
> in simple-shuffle we only use the rpm/tpm to define the how often they should be picked can you share a bit more about this logic? I'm open to using...
this makes sense, thank you so much for the prompt response! I'll schedule something to connect further.
@ishaan-jaff > https://github.com/BerriAI/litellm/blob/de3e642999b13ac855e4ce5d77a2af45bd9a5d39/litellm/router.py#L2958 Am I reading this code correctly that any model whose rpm is set needs to be at the beginning of the list in the `proxy-config.yaml`? otherwise it...