pydantic-ai icon indicating copy to clipboard operation
pydantic-ai copied to clipboard

Add SambaNova Support

Open jhpiedrahitao opened this issue 11 months ago • 3 comments

SambaNova's SambaNovaCloud offers fast inference for multiple open-source models at full precision artificial analysis providers leaderboards

jhpiedrahitao avatar Dec 11 '24 18:12 jhpiedrahitao

adding support in https://github.com/pydantic/pydantic-ai/pull/215

jhpiedrahitao avatar Dec 11 '24 22:12 jhpiedrahitao

Would love to see this working in pydantic, Sambanova is the only provider with a performant free tier offering Llama 405B! Very important to those of us building open-source first AI applications and/or concerned about ability to deploy on-prem e.g. https://github.com/OpenBB-finance

therealjkvalentine avatar Dec 12 '24 18:12 therealjkvalentine

I've written up #239 with proposed rules for when to add new models, feedback welcome.

samuelcolvin avatar Dec 13 '24 11:12 samuelcolvin

I've decided to adopt the rules set out in #239, so we won't be able to accept a SambaNova model at this time.

Sorry to disappoint.

samuelcolvin avatar Dec 14 '24 16:12 samuelcolvin