langroid icon indicating copy to clipboard operation
langroid copied to clipboard

add AI/ML API as provider

Open OctavianTheI opened this issue 6 months ago • 4 comments

Hi!

I'm Sergey from the Integrations team over at AI/ML API, a startup with 150K+ users, providing over 300 AI models in one place

Your project looks dope, so we'd like a native integration. We already got integrations with Langflow, AutoGPT, and LiteLLM - so our integrations team is pretty seasoned :)

Say you're interested, and we'll test the compatibility, update the code/docs to include us, create a PR and add a tutorial on using langroid with AI/ML API to our docs

If you guys give us a green light, we could get on it 👷

OctavianTheI avatar Jun 12 '25 11:06 OctavianTheI

Thanks for the interest. Is this an LLM gateway sort of like LiteLLM, langdb, portkey etc?

pchalasani avatar Jun 12 '25 23:06 pchalasani

@OctavianTheI can you give a short outline of what such an integration might look like? I'd imagine it would be similar to openrouter, langdb or portkey.

pchalasani avatar Jun 13 '25 21:06 pchalasani

Hi @pchalasani! Yep, the plan is either to make the same native integration as openrouter, giving easy access to our collection of models We can also just add a specific ai/ml api entry to your docs, and a langroid entry to ours - but a native integration ofc would be better

OctavianTheI avatar Jun 18 '25 09:06 OctavianTheI

Ok, an integration similar to openrouter would be fine. Besides the code change, we'll need a docs page and some basic tests (in test_llm.py)

pchalasani avatar Jun 18 '25 10:06 pchalasani