continue icon indicating copy to clipboard operation
continue copied to clipboard

Published 20 hours ago • verified publisher icon continuedev

Support for Google models through Vertexai

Open arian81 opened this issue 11 months ago • 2 comments

Validations

  • [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • [X] I'm not able to find an open issue that requests the same enhancement

Problem

A lot of enterprise have access to Gemini models through Vertexai which doesn't have an api key. It would be very useful to add support for using continue with that.

Solution

Add support for Vertexai

arian81 avatar Mar 06 '24 20:03 arian81

@arian81 Is that similar to this, or something different? Would love to have this

sestinj avatar Mar 07 '24 01:03 sestinj

@arian81 Is that similar to this, or something different? Would love to have this

It should be very similar an access token from gcloud cli can be used as api key. What I don't really get is how to set a region and projectid. Because it's mentioned in the code but can't be set in config file. Also when I tried to run a Gemini model it calls a different endpoint than the one defined in this file.

arian81 avatar Mar 07 '24 01:03 arian81

I'm going to close this in favor of a more recent version that just happens to have a bit more info attached: https://github.com/continuedev/continue/issues/1573

sestinj avatar Jul 03 '24 22:07 sestinj