Request to add support for additional AI providers

[aryaman-titan]

Currently, Agent-Wiz requires an OpenAI API key, limiting its usability for users who rely on other AI providers. Many users may be using alternative AI platforms such as Claude, Gemini, Azure, or even local providers like Ollama. Adding support for these providers would make Agent-Wiz more versatile and accessible to a broader audience.

Specific providers to start with:

• Claude
• Gemini
• Azure
• Local providers like Ollama

Why is it important?

• Many organizations and developers use AI providers other than OpenAI due to cost, performance, or specific requirements.

• Supporting multiple providers would align with the tool's goal of bringing visibility and security to complex LLM-based orchestration workflows.

• Local providers like Ollama are increasingly popular for on-premises or private deployments, enhancing the tool's flexibility.

[staru09]

I think adding a support for openrouter via litellm can help in this

[Aaditya-G]

@staru09 was looking for native ways to focus on this - we can utilize anthropic and vertex sdks for this

[staru09]

I can start with anthropic ones