bvelker

did you use openrouter terminology for your MODEL_NAME? see https://openrouter.ai/api/v1/models for a list of supported openrouter models and their names ENDPOINT=OPENROUTER OPENAI_ENDPOINT=https://api.openai.com/v1/chat/completions OPENAI_API_KEY= AZURE_API_KEY= AZURE_ENDPOINT= OPENROUTER_API_KEY=fill_key_here # I don't know...

It might be more efficient to integrate LiteLLM https://github.com/BerriAI/litellm It already has access to basically all LLM api's, including Huggingface and Openrouter