prompty
prompty copied to clipboard
In `modelConfigurations` introduce a new property for configuration name
Prerequisites
- [x] I have checked the latest documentationand this feature doesn't exist
- [x] I have searched for similar feature requests and found none
- [ ] I have linked to related issues or discussions in the description (if any exist)
Type of Improvement
New Functionality
Proposed Solution
Extend modelConfigurations with a new property for the configuration name:
{
"prompty.modelConfigurations": [
{
"name": "Phi-4 (Foundry Local)",
"model": "Phi-4-mini-instruct-generic-gpu",
"type": "openai",
"api_key": "local",
"organization": "",
"base_url": "http://localhost:5272/v1"
}
]
}
Today, when you specify model configurations in the prompty.modelConfiguration, you have to use the name property to specify the model's name. Since configurations are matched by name, it makes it impossible to have different configurations for using the same model on different hosts (ie. Ollama vs. Foundry Local vs. Azure).
@sethjuarez this is a feature we would like for https://github.com/microsoft/foundry-Local/ @samuel100
Good call - I will see about adding invokers for this.