continue icon indicating copy to clipboard operation
continue copied to clipboard

Published 20 hours ago • verified publisher icon continuedev

fix!: change mistral api base

Open aretrace opened this issue 1 year ago • 4 comments

Description

Change the Mistrial API base to the official endpoint, replacing old and nonworking codestral endpoint.

Checklist

  • [X] The base branch of this PR is dev, rather than main
  • [X] The relevant docs, if any, have been updated or created

aretrace avatar Sep 09 '24 03:09 aretrace

@aretrace as far as I am aware Codestral is still available. Are you having trouble connecting?

sestinj avatar Sep 09 '24 05:09 sestinj

@sestinj, yes for tabAutocompleteModel, I changed apiBase per https://github.com/continuedev/continue/issues/1396#issuecomment-2142603194 and it worked (this is still using the Codestral model). I don't think "https://codestral.mistral.ai/v1/" is available (I get a 404, not a 401 or 200).

aretrace avatar Sep 10 '24 03:09 aretrace

@aretrace I think the problem here comes from Mistral having separate API keys for Codestral and Mistral, where one key won't work with the other's API base. Until this changes, we wish to keep Codestral as the default because it is free for individuals to use

sestinj avatar Sep 10 '24 03:09 sestinj

@sestinj I see, would some disambiguation in the docs be welcomed regarding this?

aretrace avatar Sep 10 '24 20:09 aretrace

Definitely! We'd done so here (https://continue.dev/walkthroughs/set-up-codestral) but are also working on a docs rewrite where we'll make it even more clear (also in product onboarding)

sestinj avatar Sep 11 '24 18:09 sestinj