vscode-ai-toolkit icon indicating copy to clipboard operation
vscode-ai-toolkit copied to clipboard

add LLM provider replicate.com

Open xMrAli opened this issue 7 months ago • 2 comments

hi Can add new API provider.

https://replicate.com/collections/language-models

there is many models like:

https://replicate.com/deepseek-ai/deepseek-r1/api and https://replicate.com/anthropic/claude-3.7-sonnet

xMrAli avatar Apr 15 '25 11:04 xMrAli

Thank you for contacting us! Any issue or feedback from you is quite important to us. We will do our best to fully respond to your issue as soon as possible. Sometimes additional investigations may be needed, we will usually get back to you within 2 days by adding comments to this issue. Please stay tuned.

Hi @xMrAli - Does this provider produces open ai compatible endpoint? If so you should be able to add it as custom model through AI Toolkit:

  • Open model catalog
  • Select Add model
  • Select Add custom model

Image

And then you would be able to use it.

MuyangAmigo avatar May 21 '25 08:05 MuyangAmigo