continue
continue copied to clipboard
[CON-256] config.ts custom model not appearing in model selection dropdown
Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the Continue Discord for questions
- [X] I'm not able to find an open issue that reports the same bug
- [X] I've seen the troubleshooting guide on the Continue Docs
Relevant environment info
- OS:*
- Continue:0.0.192
- IDE:VS Code
- Model:
- config.json:
Description
export function modifyConfig(config: Config): Config {
config.models.push({
options: {
title: "My Custom LLM!",
model: "mistral-7b",
},
streamCompletion: async function* (
prompt: string,
options: CompletionOptions,
fetch
) {
for (let i = 0; i < 10; i++) {
yield `- ${i}\n`;
await new Promise((resolve) => setTimeout(resolve, 1000));
}
},
});
config.systemMessage = "Always respond in spanish";
return config;
}
To reproduce
export function modifyConfig(config: Config): Config {
config.models.push({
options: {
title: "My Custom LLM!",
model: "mistral-7b",
},
streamCompletion: async function* (
prompt: string,
options: CompletionOptions,
fetch
) {
for (let i = 0; i < 10; i++) {
yield `- ${i}\n`;
await new Promise((resolve) => setTimeout(resolve, 1000));
}
},
});
config.systemMessage = "Always respond in spanish";
return config;
}
Use a config.ts like above. You will notice that while the system message is respected, the model doesn't appear in the model selection dropdown
Log output
No response