gateway
gateway copied to clipboard
Published
20 hours ago •
Portkey-AI
Portkey-AI
max_tokens mapping question for GROQ and Cerebras
trafficstars
What Would You Like to See with the Gateway?
I tried setting max_tokens for various providers and I found that max_completion_tokens is mapped to max_tokens for many of them such as Deepinfra and Fireworks. But I'm curious why the same isn't done for GROQ and Cerebras.
Context for your Request
No response
Your Twitter/LinkedIn
No response
