`copilot` should not allow users to select models that are unconfigured in both enterprise and organization policies

[andyfeller]

Describe the bug

@andyfeller I've followed up my earlier tests now that my quota has reset. In summary, v0.0.354-0 displays the models as I'm expecting & I can successfully query. However, I suspect there may still be an issue with model permissions.

Below is a screenshot of my Settings->Copilot->Features screen:

Note Claude Sonnet 4.5 is enabled & Claude Haiku 4.5 is disabled.

Below are my testing steps beginning from a logged out state:

1. run npx -y @github/[email protected] --log-level all & see "Please use /login to sign in to use Copilot"
2. run /model command & see:

 Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

3. run /login command & successfully authenticate.
4. run /model command & see:

Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default) (current)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

5. submit hello world in the input field & see:

hello world

 ● Hello! I'm GitHub Copilot CLI, ready to help you with software engineering
   tasks. I can assist with:

     - Running commands and scripts
     - Reading, creating, and editing files
     - Working with git repositories
     - Searching code and repositories
     - And much more

   What would you like to do?

6. run /model command & select 3. Claude Haiku 4.5 (0.33x)
7. submit hello world in the input field & see:

hello world

 ● Hey there! I'm ready to help. What would you like me to work on? You can ask me
   to:

     - Navigate or explore code
     - Make code changes
     - Run tests or builds
     - Search repositories
     - Work with git
     - Or anything else related to software development

   What's your task?

I expected to see an error when selecting or using Claude Haiku 4.5 as it is disabled in my Copilot Features.

Logs from this session are attached. Apologies for all the MCP noise.

session-0548ef35-4d82-4567-84e8-bd22ca1907cb.log

Originally posted by @johnsockwell-tributetech in #346

Affected version

0.0.354

Steps to reproduce the behavior

1. Ensure Enterprise > AI Controls > Copilot > Models has a GitHub Copilot CLI model policy set to Let organizations decide

1. Ensure Organization > Settings > Copilot > Models has the same model set to Unconfigured

   

2. Launch copilot

3. Type /model to bring up the model selector interface

4. Verify specific model (in this example haiku) is listed

    Select Model
   
    Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.
   
    ❯ 1. Claude Sonnet 4.5 (1x) (default)
      2. Claude Sonnet 4 (1x)
      3. Claude Haiku 4.5 (0.33x) (current)
      4. GPT-5 (1x)
      5. Cancel (Esc)
   

5. Verify Copilot allows you to make requests with selected model

Expected behavior

No response

Additional context

No response