score-compose icon indicating copy to clipboard operation
score-compose copied to clipboard

[feature request] Support Compose `models`

Open mathieu-benoit opened this issue 1 month ago • 0 comments

Docker Compose now supports at the root level models: https://docs.docker.com/ai/compose/models-and-compose/.

Basic example:

services:
  chat-app:
    image: my-chat-app
    models:
      - llm

models:
  llm:
    model: ai/smollm2

It seems that the goal will be to add models support in the provisioners: https://github.com/score-spec/score-compose/blob/main/internal/provisioners/core.go#L85.

Open question: for patch-templates too? Not sure...

As a reference, today we can do that via a service's provider like illustrated below, but this will be deprecated soon: https://github.com/score-spec/community-provisioners/blob/main/llm-model/score-compose/10-dmr-llm-model-via-service-provider.provisioners.yaml

mathieu-benoit avatar Nov 06 '25 17:11 mathieu-benoit