windmill-labs
feature: custom openai base url
Now windmill supports OPENAI_AZURE_BASE_PATH to use azure instead of OpenAI.
But I may want to use other third-party solutions, like openrouter or cloudflare ai gateway.
Azure uses a different way to pass the API key compared to openai. But other providers use the same way as OpenAI. So just use their endpoint as OPENAI_AZURE_BASE_PATH doesn't work.
Just a note that the fact OPENAI_AZURE_BASE_PATH is available on community is currently an oversight considering in the UI it's marked as an ee feature. We will later refactor the ai integration to allow for more public ais but we will also restrict private and local models to enterprise and remove OPENAI_AZURE_BASE_PATH for being available in non ee.
Dear Ruben,
"we will also restrict private and local models to enterprise"
Like almost every options in Windmill ?
Don't get me wrong, your product is amazing and i'm totally ok for you to make money with it, in particular when it's used by enterprises.
But open source didn't mean "publish the code somewhere where everyone could read it and the braves would use it as some sort of freemium application if they manage to install it in a reliable way". In fact your own product is full of open source parts and you should be glad none of them has "enterprise features" because you wouldn't had the chance to launch Windmill then.
In this particular case, you want to restrict the use of custom AI to EE, thinking probably only big companies have custom models and the rest of us have nothing able to run AI models.
Guess what ? You totally wrong, many people use smaller models on high end consumer GPU, especially when they try do dev things before going on AI providers, it work enough to do amazing things.
It's ok, your product is restrictive enough regarding what is "free" and what is not, no company will ever dare to install the community edition or use it in production, risks are already to high. That's sad because i know many sysadmin that use to test the community edition to check if everything match their expectations before trying to sell it to management. And no, the one month free is not enough for them and the "contact sales" will not do because internal processes are rigids and wouldn't allow them to contact a sales without involving at least the boss of their boss and god know who.
Hope you will hear this and try to target "enterprise features" without harming the hobbyist/local lab guys that could promote the product or help you find bugs/securities issues.
@cabusar "Like almost every options in Windmill ?" really?
anyway, the custom AI provider is part of the OSS/CE edition since v1.479.0
Yeah really, in instance configuration, 22 options out of 28 are enterprise only.
In addition there is more in every corner of windmill.
So, once again don't get me wrong, Windmill is really great, you have every right to make money out of it, and i'm glad there is a free version that i can use to test the product but don't play dumb when a user tell you that's not what open source mean.
Anyway, i digress from the original topic and as OPENAI_AZURE_BASE_PATH is tagged EE and the custom AI provider will not be an EE feature, if i understand you well, i think you should close this issue as it answer the original request for feature.
Have a nice day.