void icon indicating copy to clipboard operation
void copied to clipboard
verified publisher icon voideditor

feat: `ModelProvider` unified interface

Open zpg6 opened this issue 7 months ago • 8 comments

WIP - closes #599

  • Bridges in the current model impl's
  • adds Azure AI Foundry (a new model provider) as an example of a full use of the new interface.
  • adds Azure Databricks (a new OpenAI-compatible provider) as an example of the shortcut interface.
  • documents a Provider Development Guide for contributors
  • adds scaffolding script for quickly getting started on a new provider contribution

zpg6 avatar May 31 '25 15:05 zpg6

Added PROVIDER_DEVELOPMENT_GUIDE.md to guide contributors into the pit of success. Includes a scaffolding script for new providers to make it even easier.

zpg6 avatar Jun 01 '25 02:06 zpg6

@andrewpareles / @vrtnis any feedback on this so far? See PROVIDER_DEVELOPMENT_GUIDE.md. All that's left is to hook up to the settings and onboarding ui

zpg6 avatar Jun 16 '25 02:06 zpg6

looks neat! was yaml/json support ever intended for this pr? ( I think we are just including the TS-only path for v1 and potentially adding manifest loading later, right?... just wondering) also, thinking if there is value in a smoke test eg. a one-liner like npm run test:provider... so contributors & CI can verify a new provider actually responds before merge.

vrtnis avatar Jun 17 '25 06:06 vrtnis

looks neat! was yaml/json support ever intended for this pr? ( I think we are just including the TS-only path for v1 and potentially adding manifest loading later, right?... just wondering)

also, thinking if there is value in a smoke test eg. a one-liner like npm run test:provider... so contributors & CI can verify a new provider actually responds before merge.

@vrtnis Great ideas! Yes to both in my mind.. although this "v1" PR is getting quite large so maybe in the next PR we add

zpg6 avatar Jun 17 '25 10:06 zpg6

Any chance we can push for movement on this? This is blocking #596

aron-muon avatar Jul 07 '25 09:07 aron-muon

Any chance we can push for movement on this? This is blocking #596

I am waiting for feedback on this proposal from core maintainers before I implement the rest - it is a large PR and touches a bunch of core logic. Sorry to nudge you @andrewpareles : maybe we can connect on Discord for a code review.

zpg6 avatar Jul 07 '25 23:07 zpg6

Sorry for the delay -- will review this ASAP and provide some feedback.

andrewpareles avatar Jul 08 '25 02:07 andrewpareles

Sorry for the delay -- will review this ASAP and provide some feedback.

Hey Andrew - could we bump this?

aron-muon avatar Jul 29 '25 13:07 aron-muon