Invoke API based external models

[sekhar-hari]

trafficstars

Hi -

How do I call OpenAI GPT (say gpt-4) and Google Gemini models through LoRAX? An example code snippet would really help.

Thanks, Sekhar H.

[tgaddair]

Hey @sekhar-hari, LoRAX does not support querying external models. That would be something better served by an API gateway like PortKey.