copilot-cli icon indicating copy to clipboard operation
copilot-cli copied to clipboard

Published 20 hours ago • verified publisher icon github

Cannot select models since v.0.0.330

Open johnsockwell-tributetech opened this issue 1 month ago • 30 comments
trafficstars

Describe the bug

I'm unable to select models since v0.0.330 using the /model command in the Copilot CLI. I'm accessing copilot via my organization account.

I've confirmed in my GitHub Copilot settings the following:

  • Copilot CLI is enabled
  • Anthropic Claude Sonnet 4 is enabled
  • Anthropic Claude Sonnet 4.5 is enabled
  • OpenAI GPT-5 is enabled

I've included my reproduction steps for v0.0.330, v0.0.331, v0.0.343

Affected version

0.0.343 Commit: 5847051

Steps to reproduce the behavior

v0.0.330

  1. Run copilot v0.0.330 npx -y @github/[email protected]
  2. Type /model into the input window
  3. See:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4 (default)
   2. GPT-5
   3. Claude Sonnet 4.5 (current)
   4. Cancel (Esc)

 Use ↑/↓ to navigate, Enter to select, Esc to cancel

v0.0.331

  1. Run copilot v0.0.331 npx -y @github/[email protected]
  2. Type /model into the input window
  3. See:
ERROR  No supported model available

 file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:1548:603

 - QWe (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:1548:603)
 - jEt (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:1548:1087)
 -  (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:1885:55527)
 - FG (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:138:8647)
 - VN (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:138:8831)
 - Object.useState (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:228:2823)
 - process.env.NODE_ENV.vr.useState (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:47:12332)
 - JLt (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:1885:55522)
 - react-stack-bottom-frame (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:228:12762)
 - z2 (file:///Users/[username]/.npm/_npx/8cc353b481bea4e6/node_modules/@github/copilot/index.js:138:807)

v0.0.343

  1. Run copilot v0.0.343 npx -y @github/[email protected]
  2. Type /model into the input window
  3. See:
Select Model Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 Some models are not available due to configured policy.

 ❯ 1. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

Expected behavior

I expect to see a model selector with similar functionality as in v0.0.330

Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 Some models are not available due to configured policy.

 ❯ 1. Claude Sonnet 4 (default)
   2. GPT-5
   3. Claude Sonnet 4.5 (current)
   4. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

Additional context

  • MacOS 15.6.1
  • Apple M2 chip
  • Nodejs v24.10.0
  • Terminal
  • zsh

johnsockwell-tributetech avatar Oct 17 '25 19:10 johnsockwell-tributetech

Thank you for raising this concern, @johnsockwell-tributetech! 🙇

I'm still trying to figure out what is going on here, but first I wanted to demonstrate what should be shown via the latest release:

$ npx -y @github/copilot@latest
┌──                                                                         ──┐
│                                                           ▄██████▄          │
    Welcome to GitHub                                   ▄█▀▀▀▀▀██▀▀▀▀▀█▄
    █████┐ █████┐ █████┐ ██┐██┐     █████┐ ██████┐     ▐█      ▐▌      █▌
   ██┌───┘██┌──██┐██┌─██┐██│██│    ██┌──██┐└─██┌─┘     ▐█▄    ▄██▄    ▄█▌
   ██│    ██│  ██│█████┌┘██│██│    ██│  ██│  ██│      ▄▄███████▀▀███████▄▄
   ██│    ██│  ██│██┌──┘ ██│██│    ██│  ██│  ██│     ████     ▄  ▄     ████
   └█████┐└█████┌┘██│    ██│██████┐└█████┌┘  ██│     ████     █  █     ████
    └────┘ └────┘ └─┘    └─┘└─────┘ └────┘   └─┘     ▀███▄            ▄███▀
│                              CLI Version 0.0.343      ▀▀████████████▀▀      │
└──                                                                         ──┘
 Version 0.0.343 · Commit 5847051

 Copilot can write, test and debug code right from your terminal. Describe a task to get started or enter ? for help. Copilot uses AI, check for mistakes.

 ● Logged in with gh as user: andyfeller

 ● Connected to GitHub MCP Server

 Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default) (current)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

Outside of whether you see any useful information in ~/.copilot/logs, I'm gonna see if I can reproduce this or at least figure out why all options are coming up blank 🤔

andyfeller avatar Oct 17 '25 20:10 andyfeller

@johnsockwell-tributetech : I'd like to try increasing the log level using --log-level all to see what is going on here. While I understand 3 of 4 supported models are enabled by policy, I wonder about the new Haiku model but also if there's something else going on here.

andyfeller avatar Oct 17 '25 20:10 andyfeller

I'm seeing the same thing.

My log with --log-level all enabled looks like this. I'm using Fedora 42 with node 24 installed via nvm.

2025-10-20T02:23:22.087Z [INFO] Starting Copilot CLI: 0.0.346
Commit: 74e4d22
2025-10-20T02:23:22.087Z [INFO] Node.js version: v24.10.0
2025-10-20T02:23:22.620Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T02:23:22.622Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T02:23:22.623Z [LOG] Creating MCP client for github-mcp-server...
2025-10-20T02:23:22.639Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-20T02:23:22.743Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.346 (linux v24.10.0) OpenAI/5.20.1
2025-10-20T02:23:23.301Z [LOG] MCP transport for github-mcp-server closed
2025-10-20T02:23:23.303Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-20T02:23:23.303Z [LOG] GitHub MCP server configured after authentication
2025-10-20T02:23:23.330Z [ERROR] Failed to list models: 421 : Misdirected Request

mkeesey avatar Oct 20 '25 02:10 mkeesey

Have the same issue here since v.0.0.330

jianie365 avatar Oct 20 '25 07:10 jianie365

@johnsockwell-tributetech : I'd like to try increasing the log level using --log-level all to see what is going on here. While I understand 3 of 4 supported models are enabled by policy, I wonder about the new Haiku model but also if there's something else going on here.

@andyfeller Below are logs captured using npx -y @github/[email protected] --log-level all with the three versions. I started each version & attempted the /model command then exited.

v0.0.330

2025-10-20T15:13:51.251Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:13:51.252Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:13:51.252Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-20T15:13:51.254Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-20T15:13:51.380Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Reading configuration...
  - Reading registry from registry.yaml

2025-10-20T15:13:51.380Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading catalog from [docker-mcp.yaml]

2025-10-20T15:13:51.396Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading config from config.yaml

2025-10-20T15:13:51.396Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading tools from tools.yaml

2025-10-20T15:13:51.396Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Configuration read in 16.9365ms

2025-10-20T15:13:51.396Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Using images:
  - mcp/context7@sha256:1174e6a29634a83b2be93ac1fefabf63265f498c02c72201fe3464e687dd8836

2025-10-20T15:13:51.403Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > Images pulled in 6.718ms
- Those servers are enabled: context7
- Listing MCP tools...

2025-10-20T15:13:51.403Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Running mcp/context7 with [run --rm -i --init --security-opt no-new-privileges --cpus 1 --memory 2Gb --pull never -l docker-mcp=true -l docker-mcp-tool-type=mcp -l docker-mcp-name=context7 -l docker-mcp-transport=stdio -e MCP_TRANSPORT]

2025-10-20T15:13:51.756Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   > context7: (2 tools)

2025-10-20T15:13:51.828Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > 2 tools listed in 425.090541ms

2025-10-20T15:13:51.829Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Watching for configuration updates...
> Initialized in 449.088667ms
> Start stdio server

2025-10-20T15:13:51.831Z [LOG] MCP client for Docker_MCP_Toolkit connected, took 577ms
2025-10-20T15:13:51.831Z [LOG] Started MCP client for Docker_MCP_Toolkit
2025-10-20T15:13:51.842Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Client initialized [email protected] 

2025-10-20T15:13:52.476Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:13:52.476Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:13:52.476Z [LOG] Creating MCP client for github-mcp-server...
2025-10-20T15:13:52.478Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-20T15:13:52.904Z [LOG] MCP transport for github-mcp-server closed
2025-10-20T15:13:52.906Z [ERROR] Failed to start MCP client for remote server github-mcp-server: Error: Error POSTing to endpoint (HTTP 421): Misdirected Request

2025-10-20T15:13:52.906Z [LOG] GitHub MCP server configured after authentication

v0.0.331

2025-10-20T15:15:26.224Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:15:26.224Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:15:26.225Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-20T15:15:26.227Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-20T15:15:26.417Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Reading configuration...
  - Reading registry from registry.yaml

2025-10-20T15:15:26.417Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading catalog from [docker-mcp.yaml]

2025-10-20T15:15:26.434Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading config from config.yaml

2025-10-20T15:15:26.434Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading tools from tools.yaml

2025-10-20T15:15:26.434Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Configuration read in 16.799958ms

2025-10-20T15:15:26.435Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Using images:
  - mcp/context7@sha256:1174e6a29634a83b2be93ac1fefabf63265f498c02c72201fe3464e687dd8836

2025-10-20T15:15:26.443Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > Images pulled in 8.370875ms
- Those servers are enabled: context7
- Listing MCP tools...

2025-10-20T15:15:26.444Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Running mcp/context7 with [run --rm -i --init --security-opt no-new-privileges --cpus 1 --memory 2Gb --pull never -l docker-mcp=true -l docker-mcp-tool-type=mcp -l docker-mcp-name=context7 -l docker-mcp-transport=stdio -e MCP_TRANSPORT]

2025-10-20T15:15:26.473Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.331 (darwin v24.10.0) OpenAI/4.104.0
2025-10-20T15:15:26.635Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   > context7: (2 tools)

2025-10-20T15:15:26.663Z [ERROR] Failed to list models: Misdirected Request
2025-10-20T15:15:26.704Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > 2 tools listed in 261.177541ms

2025-10-20T15:15:26.704Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Watching for configuration updates...
> Initialized in 287.327167ms
> Start stdio server

2025-10-20T15:15:26.706Z [LOG] MCP client for Docker_MCP_Toolkit connected, took 479ms
2025-10-20T15:15:26.706Z [LOG] Started MCP client for Docker_MCP_Toolkit
2025-10-20T15:15:26.713Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Client initialized [email protected] 

2025-10-20T15:15:26.811Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:15:26.811Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:15:26.811Z [LOG] Creating MCP client for github-mcp-server...
2025-10-20T15:15:26.812Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-20T15:15:26.915Z [LOG] MCP transport for github-mcp-server closed
2025-10-20T15:15:26.915Z [ERROR] Failed to start MCP client for remote server github-mcp-server: Error: Error POSTing to endpoint (HTTP 421): Misdirected Request

2025-10-20T15:15:26.915Z [LOG] GitHub MCP server configured after authentication
2025-10-20T15:15:33.607Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-20T15:15:33.607Z [LOG] MCP client for Docker_MCP_Toolkit closed
2025-10-20T15:15:33.610Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > Stop watching for updates

2025-10-20T15:15:33.613Z [LOG] [mcp server Docker_MCP_Toolkit stderr] context canceled

2025-10-20T15:15:33.615Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-20T15:15:33.615Z [LOG] MCP client for Docker_MCP_Toolkit closed

v0.0.343

2025-10-20T15:17:01.821Z [INFO] Starting Copilot CLI: 0.0.343
Commit: 5847051
2025-10-20T15:17:01.821Z [INFO] Node.js version: v24.10.0
2025-10-20T15:17:02.123Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:17:02.123Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-20T15:17:02.123Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-20T15:17:02.125Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-20T15:17:02.329Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Reading configuration...
  - Reading registry from registry.yaml

2025-10-20T15:17:02.329Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading catalog from [docker-mcp.yaml]

2025-10-20T15:17:02.346Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading config from config.yaml

2025-10-20T15:17:02.346Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Reading tools from tools.yaml

2025-10-20T15:17:02.346Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Configuration read in 17.357959ms

2025-10-20T15:17:02.347Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Using images:
  - mcp/context7@sha256:1174e6a29634a83b2be93ac1fefabf63265f498c02c72201fe3464e687dd8836

2025-10-20T15:17:02.356Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > Images pulled in 8.5475ms
- Those servers are enabled: context7
- Listing MCP tools...

2025-10-20T15:17:02.356Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   - Running mcp/context7 with [run --rm -i --init --security-opt no-new-privileges --cpus 1 --memory 2Gb --pull never -l docker-mcp=true -l docker-mcp-tool-type=mcp -l docker-mcp-name=context7 -l docker-mcp-transport=stdio -e MCP_TRANSPORT]

2025-10-20T15:17:02.378Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.343 (darwin v24.10.0) OpenAI/5.20.1
2025-10-20T15:17:02.541Z [LOG] [mcp server Docker_MCP_Toolkit stderr]   > context7: (2 tools)

2025-10-20T15:17:02.615Z [LOG] [mcp server Docker_MCP_Toolkit stderr] > 2 tools listed in 259.154375ms

2025-10-20T15:17:02.615Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Watching for configuration updates...
> Initialized in 285.979917ms
> Start stdio server

2025-10-20T15:17:02.618Z [LOG] MCP client for Docker_MCP_Toolkit connected, took 493ms
2025-10-20T15:17:02.618Z [LOG] Started MCP client for Docker_MCP_Toolkit
2025-10-20T15:17:02.629Z [LOG] [mcp server Docker_MCP_Toolkit stderr] - Client initialized [email protected] 

2025-10-20T15:17:02.729Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:17:02.729Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-20T15:17:02.729Z [LOG] Creating MCP client for github-mcp-server...
2025-10-20T15:17:02.730Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-20T15:17:02.817Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-20T15:17:02.832Z [LOG] MCP transport for github-mcp-server closed
2025-10-20T15:17:02.832Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-20T15:17:02.832Z [LOG] GitHub MCP server configured after authentication

johnsockwell-tributetech avatar Oct 20 '25 15:10 johnsockwell-tributetech

@johnsockwell-tributetech @jianie365 @mkeesey : thank you all for the follow up and additional logs; this is exactly what I needed and will help me get to the bottom of this! 🙇

I want to assure you this is my priority to get to the bottom today.

andyfeller avatar Oct 21 '25 12:10 andyfeller

My working theory is the 421 Misdirect Request response stems from copilot resolving a different subscription API endpoint than the Copilot license you have:

  • CfI: https://api.individual.githubcopilot.com
  • CfB: https://api.business.githubcopilot.com
  • CfE: https://api.enterprise.githubcopilot.com

This endpoint is resolved via GraphQL based on how you are authenticated:

query {
  viewer{
    copilotEndpoints{
      api
    }
  }
}

I'm going to continue investigating what would have changed between 0.0.330 and 0.0.331 to affect the endpoint 🤔

For more information, see Managing GitHub Copilot access to your enterprise's network

andyfeller avatar Oct 21 '25 13:10 andyfeller

@johnsockwell-tributetech : I'd like to ask you to /logout and /login to ensure you are authenticated against the GitHub Copilot CLI OAuth app and your business account.

andyfeller avatar Oct 21 '25 15:10 andyfeller

@johnsockwell-tributetech : I'd like to ask you to /logout and /login to ensure you are authenticated against the GitHub Copilot CLI OAuth app and your business account.

@andyfeller : below are the steps I performed & associated log.

  1. npx -y @github/[email protected] --log-level all
  2. ran the /logout command
  3. ran the /login command & authenticated with GitHub.com
  4. ran the /model command
  5. Did not see any models listed.

Below are the logs from this session:

2025-10-21T18:10:29.024Z [INFO] Starting Copilot CLI: 0.0.343
Commit: 5847051
2025-10-21T18:10:29.024Z [INFO] Node.js version: v24.10.0
2025-10-21T18:10:29.112Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-21T18:10:29.112Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-21T18:10:29.112Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-21T18:10:29.114Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-21T18:10:29.117Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT
2025-10-21T18:10:29.143Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-21T18:10:29.332Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.343 (darwin v24.10.0) OpenAI/5.20.1
2025-10-21T18:10:29.696Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-21T18:10:29.829Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-21T18:10:29.830Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-21T18:10:29.830Z [LOG] Creating MCP client for github-mcp-server...
2025-10-21T18:10:29.831Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-21T18:10:29.892Z [LOG] MCP transport for github-mcp-server closed
2025-10-21T18:10:29.892Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-21T18:10:29.892Z [LOG] GitHub MCP server configured after authentication
2025-10-21T18:11:17.253Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-21T18:11:17.253Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-21T18:11:17.253Z [LOG] Creating MCP client for github-mcp-server...
2025-10-21T18:11:17.255Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-21T18:11:17.364Z [LOG] MCP transport for github-mcp-server closed
2025-10-21T18:11:17.364Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-21T18:11:17.364Z [LOG] GitHub MCP server configured after authentication
2025-10-21T18:11:17.512Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.343 (darwin v24.10.0) OpenAI/5.20.1
2025-10-21T18:11:17.635Z [ERROR] Failed to list models: 421 : Misdirected Request

johnsockwell-tributetech avatar Oct 21 '25 18:10 johnsockwell-tributetech

Thanks, @johnsockwell-tributetech. I have a suspicion that copilot is picking up on multiple authentication tokens while trying to resolve the Copilot API to talk with. This information is currently only displayed in the console and not the logs, so I'm working on a hotfix to capture more information about what is going on and provide better guidance to resolve.

andyfeller avatar Oct 21 '25 20:10 andyfeller

The hotfix @andyfeller alluded to is now available in 0.0.348!

RyanHecht avatar Oct 22 '25 00:10 RyanHecht

With 0.0.348, the log looks like the following after starting and running /model

2025-10-22T12:47:25.839Z [INFO] Starting Copilot CLI: 0.0.348 Commit: 946b5dc 2025-10-22T12:47:25.839Z [INFO] Node.js version: v24.10.0 2025-10-22T12:47:25.891Z [INFO] Login status unknown 2025-10-22T12:47:26.024Z [INFO] Logged in as user: mkeesey 2025-10-22T12:47:26.331Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.348 (linux v24.10.0) OpenAI/5.20.1 2025-10-22T12:47:26.362Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly 2025-10-22T12:47:26.362Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly 2025-10-22T12:47:26.362Z [LOG] Creating MCP client for github-mcp-server... 2025-10-22T12:47:26.367Z [LOG] Connecting MCP client for github-mcp-server... 2025-10-22T12:47:27.238Z [LOG] MCP transport for github-mcp-server closed 2025-10-22T12:47:27.240Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed 2025-10-22T12:47:27.240Z [LOG] GitHub MCP server configured after authentication 2025-10-22T12:47:27.424Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-22T12:47:27.424Z [ERROR] Verify the authenticated user against subscription-based Copilot API endpoint used: https://api.individual.githubcopilot.com

mkeesey avatar Oct 22 '25 12:10 mkeesey

@andyfeller I've tested the new release, below are my testing steps:

  1. ran npx -y @github/[email protected] --log-level all
  2. ran the /model command -- didn't see any models listed
  3. ran the /logout command
  4. ran the /login command & authenticated with GitHub.com
  5. ran the /model command
  6. Did not see any models listed

Logs from the session:

2025-10-22T12:52:08.594Z [INFO] Starting Copilot CLI: 0.0.348
Commit: 946b5dc
2025-10-22T12:52:08.594Z [INFO] Node.js version: v24.10.0
2025-10-22T12:52:08.627Z [INFO] Login status unknown
2025-10-22T12:52:08.910Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-22T12:52:08.910Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-22T12:52:08.910Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-22T12:52:08.913Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-22T12:52:08.915Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT
2025-10-22T12:52:08.936Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-22T12:52:08.947Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-22T12:52:09.115Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-22T12:52:09.115Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-22T12:52:09.115Z [LOG] Creating MCP client for github-mcp-server...
2025-10-22T12:52:09.116Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-22T12:52:09.158Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.348 (darwin v24.10.0) OpenAI/5.20.1
2025-10-22T12:52:09.461Z [LOG] MCP transport for github-mcp-server closed
2025-10-22T12:52:09.461Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-22T12:52:09.461Z [LOG] GitHub MCP server configured after authentication
2025-10-22T12:52:09.518Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-22T12:52:09.518Z [ERROR] Verify the authenticated user against subscription-based Copilot API endpoint used: https://api.individual.githubcopilot.com
2025-10-22T12:52:23.412Z [INFO] Logged out
2025-10-22T12:53:12.489Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-22T12:53:12.490Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-22T12:53:12.490Z [LOG] Creating MCP client for github-mcp-server...
2025-10-22T12:53:12.491Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-22T12:53:12.557Z [LOG] MCP transport for github-mcp-server closed
2025-10-22T12:53:12.557Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-22T12:53:12.557Z [LOG] GitHub MCP server configured after authentication
2025-10-22T12:53:12.566Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-22T12:53:12.698Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.348 (darwin v24.10.0) OpenAI/5.20.1
2025-10-22T12:53:12.838Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-22T12:53:12.838Z [ERROR] Verify the authenticated user against subscription-based Copilot API endpoint used: https://api.individual.githubcopilot.com

johnsockwell-tributetech avatar Oct 22 '25 13:10 johnsockwell-tributetech

I've had similar issue (https://github.com/github/copilot-cli/issues/173), what helped - logout in Copilot, login using 'gh auth login'.

jburyk avatar Oct 22 '25 14:10 jburyk

@johnsockwell-tributetech : thank you for your continued patience helping me get to the root of this 🙇

looking at your recent logs and @jburyk comment, I would like to try his idea as an experiment.

Currently, you are authenticated with the GitHub Copilot CLI OAuth app, however copilot can leverage gh authentication using the GitHub CLI OAuth app by logging out, exiting, and relaunching while authenticated with gh.

andyfeller avatar Oct 23 '25 12:10 andyfeller

@johnsockwell-tributetech : thank you for your continued patience helping me get to the root of this 🙇

looking at your recent logs and @jburyk comment, I would like to try his idea as an experiment.

Currently, you are authenticated with the GitHub Copilot CLI OAuth app, however copilot can leverage gh authentication using the GitHub CLI OAuth app by logging out, exiting, and relaunching while authenticated with gh.

I have try this Open copilot -> /login -> Choose github.com After that using "gh auth login" with github also have token ( access grant for copilot ) But my copilot latest version still trying invidiual github api not bussiness api

0kuromi avatar Oct 23 '25 15:10 0kuromi

@johnsockwell-tributetech : thank you for your continued patience helping me get to the root of this 🙇

looking at your recent logs and @jburyk comment, I would like to try his idea as an experiment.

Currently, you are authenticated with the GitHub Copilot CLI OAuth app, however copilot can leverage gh authentication using the GitHub CLI OAuth app by logging out, exiting, and relaunching while authenticated with gh.

@andyfeller below are my steps & resulting log files:

  1. run npx -y @github/[email protected] --log-level all
  2. run /logout & /exit commands
  3. run gh auth login & successfully authenticate
  4. run npx -y @github/[email protected] --log-level all
  5. See instruction to login
  6. run /model command
  7. See models listed (Sonnets, Hauku, GPT)
  8. run hello world & get prompt to login
  9. run /login command & successfully authenticate
  10. run /model command
  11. No longer see models listed

Logs from the session @ step 4 below:

2025-10-23T16:19:15.986Z [INFO] Starting Copilot CLI: 0.0.349
Commit: 3469b3e
2025-10-23T16:19:15.986Z [INFO] Node.js version: v24.10.0
2025-10-23T16:19:16.007Z [INFO] Login status unknown
2025-10-23T16:19:16.056Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-23T16:19:16.056Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-23T16:19:16.056Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-23T16:19:16.058Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-23T16:19:16.060Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT
2025-10-23T16:19:16.060Z [START-GROUP] gh auth token --hostname github.com
2025-10-23T16:19:16.061Z [ERROR] Error: spawn gh ENOENT
2025-10-23T16:19:16.061Z [END-GROUP] 
2025-10-23T16:19:16.061Z [DEBUG] Error checking GitHub CLI: Error: spawn gh ENOENT (stderr: )
2025-10-23T16:19:16.065Z [INFO] Logged out
2025-10-23T16:19:16.079Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-23T16:19:16.079Z [START-GROUP] gh auth token --hostname github.com
2025-10-23T16:19:16.081Z [ERROR] Error: spawn gh ENOENT
2025-10-23T16:19:16.081Z [END-GROUP] 
2025-10-23T16:19:16.081Z [DEBUG] Error checking GitHub CLI: Error: spawn gh ENOENT (stderr: )
2025-10-23T16:21:43.160Z [LOG] Using Copilot API endpoint: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-23T16:21:43.161Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-23T16:21:43.161Z [LOG] Creating MCP client for github-mcp-server...
2025-10-23T16:21:43.163Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-23T16:21:43.681Z [LOG] MCP transport for github-mcp-server closed
2025-10-23T16:21:43.682Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-23T16:21:43.682Z [LOG] GitHub MCP server configured after authentication
2025-10-23T16:21:43.695Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-23T16:21:43.840Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.349 (darwin v24.10.0) OpenAI/5.20.1
2025-10-23T16:21:44.070Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-23T16:21:44.070Z [ERROR] Verify the authenticated user against subscription-based Copilot API endpoint used: https://api.individual.githubcopilot.com

johnsockwell-tributetech avatar Oct 23 '25 17:10 johnsockwell-tributetech

@johnsockwell-tributetech : in the latest release being cut tonight, I've got a little more debug logging I'd like your help with. We think there are inconsistencies with the Copilot API URL being resolved, allowing you to use the chat loop because it fell back to https://api.githubcopilot.com

I'm hoping this confirms the theory that we can the work with our sibling teams to address 🙇

andyfeller avatar Oct 23 '25 22:10 andyfeller

@johnsockwell-tributetech : When it is convenient, I would appreciate your help testing out the logging changes in 0.0.350. Meanwhile, I'm working to put more logging in place and investigating how copilot is being told to hit api.individual.githubcopilot.com. 🙇

andyfeller avatar Oct 24 '25 14:10 andyfeller

@johnsockwell-tributetech : Outside of copilot, I would like to enable a feature flag that affects how we resolve Copilot information around your account if you are okay with it.

andyfeller avatar Oct 24 '25 21:10 andyfeller

@johnsockwell-tributetech : When it is convenient, I would appreciate your help testing out the logging changes in 0.0.350. Meanwhile, I'm working to put more logging in place and investigating how copilot is being told to hit api.individual.githubcopilot.com. 🙇

@andyfeller I took a pass at my tests using the latest copilot version. Steps & logs are below:

  1. run npx -y @github/copilot@latest --log-level all
  2. run /logout command & exit
  3. run npx -y @github/copilot@latest --log-level all
  4. run /model command See:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. run /login command & successfully authenticate (use Github.com account.)
  2. run /model command See:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 Some models are not available due to configured policy.

 ❯ 1. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

Logs from the session:

2025-10-27T17:33:15.236Z [INFO] Starting Copilot CLI: 0.0.351 Commit: 90770bc 2025-10-27T17:33:15.236Z [INFO] Node.js version: v24.10.0 2025-10-27T17:33:15.274Z [INFO] Login status unknown 2025-10-27T17:33:15.291Z [ERROR] Error checking for updates: TypeError: Cannot read properties of undefined (reading 'paths') 2025-10-27T17:33:15.313Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run 2025-10-27T17:33:15.313Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run 2025-10-27T17:33:15.314Z [LOG] Creating MCP client for Docker_MCP_Toolkit... 2025-10-27T17:33:15.317Z [LOG] Connecting MCP client for Docker_MCP_Toolkit... 2025-10-27T17:33:15.320Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT 2025-10-27T17:33:15.321Z [START-GROUP] gh auth token --hostname github.com 2025-10-27T17:33:15.323Z [ERROR] Error: spawn gh ENOENT 2025-10-27T17:33:15.323Z [END-GROUP] 2025-10-27T17:33:15.324Z [DEBUG] Error checking GitHub CLI: Error: spawn gh ENOENT (stderr: ) 2025-10-27T17:33:15.328Z [INFO] Logged out 2025-10-27T17:33:15.350Z [LOG] MCP transport for Docker_MCP_Toolkit closed 2025-10-27T17:33:15.351Z [START-GROUP] gh auth token --hostname github.com 2025-10-27T17:33:15.353Z [ERROR] Error: spawn gh ENOENT 2025-10-27T17:33:15.353Z [END-GROUP] 2025-10-27T17:33:15.353Z [DEBUG] Error checking GitHub CLI: Error: spawn gh ENOENT (stderr: ) 2025-10-27T17:40:04.917Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com 2025-10-27T17:40:04.918Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly 2025-10-27T17:40:04.919Z [LOG] Creating MCP client for github-mcp-server... 2025-10-27T17:40:04.922Z [LOG] Connecting MCP client for github-mcp-server... 2025-10-27T17:40:05.322Z [LOG] MCP transport for github-mcp-server closed 2025-10-27T17:40:05.322Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed 2025-10-27T17:40:05.322Z [LOG] GitHub MCP server configured after authentication 2025-10-27T17:40:05.336Z [INFO] Logged in as user: johnsockwell-tributetech 2025-10-27T17:40:05.500Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com 2025-10-27T17:40:05.501Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.351 (darwin v24.10.0) OpenAI/5.20.1 2025-10-27T17:40:06.867Z [ERROR] Failed to list models: 421 : Misdirected Request

2025-10-27T17:40:06.867Z [ERROR] Verify the authenticated user against subscription-based Copilot API endpoint used: https://api.individual.githubcopilot.com

johnsockwell-tributetech avatar Oct 27 '25 17:10 johnsockwell-tributetech

@johnsockwell-tributetech : Outside of copilot, I would like to enable a feature flag that affects how we resolve Copilot information around your account if you are okay with it.

I approve.

johnsockwell-tributetech avatar Oct 27 '25 17:10 johnsockwell-tributetech

@johnsockwell-tributetech : I've toggled the feature flag and appreciate if you let me know if that has made any change here. 🙇

andyfeller avatar Oct 28 '25 18:10 andyfeller

3. npx -y @github/copilot@latest --log-level all

thanks, this working for me

MarsonShine avatar Oct 29 '25 10:10 MarsonShine

@johnsockwell-tributetech : I've toggled the feature flag and appreciate if you let me know if that has made any change here. 🙇

@andyfeller : I've encountered some conflicting results:

  • Yesterday, when I ran the /model command I saw the expected list of models including Haiku-4.5.
    • I was able to successfully change my model to Haiku.
    • I sent "hello world" through the input & received an expected over quota message.
    • Unfortunately, I don't have logs from this session.
  • Today, when I run /model command I encounter the behavior described below.
    • I've attempted logging out of both gh & copilot & logging in with each individually with no change.
    • I've attempted using both v0.0.352 & v0.0.353 with no change.

I'm unable to identify what changed between my attempts yesterday & today.

Below are the steps I performed & logs:

  1. run npx -y @github/copilot@latest --log-level all
  2. run /logout command
  3. run /login command & authenticate
  4. run /model command & see:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 Some models are not available due to configured policy.

 ❯ 1. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc

Below are the logs from this session:

2025-10-29T13:19:31.851Z [INFO] Starting Copilot CLI: 0.0.353
Commit: f8fd3e3
2025-10-29T13:19:31.851Z [INFO] Node.js version: v24.10.0
2025-10-29T13:19:31.885Z [INFO] Login status unknown
2025-10-29T13:19:31.902Z [ERROR] Error checking for updates: TypeError: Cannot read properties of undefined (reading 'paths')
2025-10-29T13:19:31.921Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-29T13:19:31.921Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-29T13:19:31.921Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-29T13:19:31.924Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-29T13:19:31.927Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT
2025-10-29T13:19:31.945Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-29T13:19:31.984Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-29T13:19:32.151Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com
2025-10-29T13:19:32.152Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-29T13:19:32.152Z [LOG] Creating MCP client for github-mcp-server...
2025-10-29T13:19:32.152Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-29T13:19:32.223Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com
2025-10-29T13:19:32.223Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.353 (darwin v24.10.0) OpenAI/5.20.1
2025-10-29T13:19:32.331Z [ERROR] Failed to list models: 403 : unauthorized: not authorized to use this Copilot feature

2025-10-29T13:19:32.348Z [LOG] MCP transport for github-mcp-server closed
2025-10-29T13:19:32.348Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-29T13:19:32.348Z [LOG] GitHub MCP server configured after authentication
2025-10-29T13:19:39.230Z [INFO] Logged out
2025-10-29T13:20:02.184Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com
2025-10-29T13:20:02.184Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.individual.githubcopilot.com/mcp/readonly
2025-10-29T13:20:02.185Z [LOG] Creating MCP client for github-mcp-server...
2025-10-29T13:20:02.185Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-29T13:20:02.471Z [LOG] MCP transport for github-mcp-server closed
2025-10-29T13:20:02.472Z [ERROR] Failed to start MCP client for remote server github-mcp-server: TypeError: fetch failed
2025-10-29T13:20:02.472Z [LOG] GitHub MCP server configured after authentication
2025-10-29T13:20:02.481Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-29T13:20:02.709Z [DEBUG] Fetched Copilot URL: 200 https://api.individual.githubcopilot.com
2025-10-29T13:20:02.710Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.353 (darwin v24.10.0) OpenAI/5.20.1
2025-10-29T13:20:02.761Z [ERROR] Failed to list models: 403 : unauthorized: not authorized to use this Copilot feature

johnsockwell-tributetech avatar Oct 29 '25 13:10 johnsockwell-tributetech

I finally resolved this for myself by generating a fine-grained access token on my business account, selecting all of the copilot-related permissions. Once this was set in my .zshrc file, the Copilot CLI correctly detected my business settings and loaded all the models. When trying to sign in using gh auth login and copilot /login it would always attempt to use https://api.individual.githubcopilot.com/ and failed with the 421 misdirected error.

gridsandspaces avatar Oct 29 '25 14:10 gridsandspaces

Providing an update:

  • we are investigating some of the server-side logic used in assessing the various Copilot licenses associated with a user account and whether timeouts could be a factor in events
  • this evening once GitHub Universe deployment freezes are unlocked, I've got a few more additional client logging changes I'll be releasing to verify the authentication information being used to resolve the Copilot API endpoint

I'm hopeful tomorrow that we will have a more concrete update of what is going on and what we need to resolve. 🙇

UPDATE: There is a prerelease with some final client-side logging changes I'd love for you to test out in 0.0.354-0

andyfeller avatar Oct 29 '25 20:10 andyfeller

Providing an update:

  • we are investigating some of the server-side logic used in assessing the various Copilot licenses associated with a user account and whether timeouts could be a factor in events
  • this evening once GitHub Universe deployment freezes are unlocked, I've got a few more additional client logging changes I'll be releasing to verify the authentication information being used to resolve the Copilot API endpoint

I'm hopeful tomorrow that we will have a more concrete update of what is going on and what we need to resolve. 🙇

UPDATE: There is a prerelease with some final client-side logging changes I'd love for you to test out in 0.0.354-0

@andyfeller : With the prerelease version 0.0.354-0, I'm now seeing the expected model list. Notably, I see Claude Haiku 4.5 (0.33x) listed in the model selector when Anthropic Claude Haiku 4.5 is disabled in my GitHub>settings>copilot>features. Is this expected?

I'm unable to test conversations with the models until my quota resets, but I've included my test steps & logs starting from a logged out state:

  1. run npx -y @github/[email protected] --log-level all
  2. run /model command & see:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. run /login command & authenticate
  2. run /model command & see:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default) (current)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. select Claude Sonnet 4.5 (1x) (default) (current)

Logs from this session below:

2025-10-30T15:25:14.095Z [INFO] Starting Copilot CLI: 0.0.354-0
Commit: d0c91e7
2025-10-30T15:25:14.095Z [INFO] Node.js version: v24.10.0
2025-10-30T15:25:14.115Z [INFO] Login status unknown
2025-10-30T15:25:14.130Z [ERROR] Error checking for updates: TypeError: Cannot read properties of undefined (reading 'paths')
2025-10-30T15:25:14.143Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-30T15:25:14.143Z [LOG] Starting MCP client for Docker_MCP_Toolkit with command: docker and args: mcp,gateway,run
2025-10-30T15:25:14.143Z [LOG] Creating MCP client for Docker_MCP_Toolkit...
2025-10-30T15:25:14.145Z [LOG] Connecting MCP client for Docker_MCP_Toolkit...
2025-10-30T15:25:14.147Z [ERROR] Failed to start MCP client for Docker_MCP_Toolkit: Error: spawn docker ENOENT
2025-10-30T15:25:14.147Z [START-GROUP] gh auth token --hostname github.com
2025-10-30T15:25:14.166Z [LOG] MCP transport for Docker_MCP_Toolkit closed
2025-10-30T15:25:14.166Z [START-GROUP] gh auth token --hostname github.com
2025-10-30T15:25:14.363Z [ERROR] no oauth token found for github.com

2025-10-30T15:25:14.363Z [END-GROUP] 
2025-10-30T15:25:14.363Z [DEBUG] Failed to retrieve GitHub token from CLI (exit code: 1): no oauth token found for github.com
2025-10-30T15:25:14.368Z [INFO] Logged out
2025-10-30T15:25:14.368Z [ERROR] no oauth token found for github.com

2025-10-30T15:25:14.368Z [END-GROUP] 
2025-10-30T15:25:14.368Z [DEBUG] Failed to retrieve GitHub token from CLI (exit code: 1): no oauth token found for github.com
2025-10-30T15:26:43.510Z [DEBUG] Fetched Copilot URL for johnsockwell-tributetech from https://api.github.com/graphql: 200 https://api.business.githubcopilot.com
2025-10-30T15:26:43.512Z [LOG] Starting remote MCP client for github-mcp-server with url: https://api.business.githubcopilot.com/mcp/readonly
2025-10-30T15:26:43.512Z [LOG] Creating MCP client for github-mcp-server...
2025-10-30T15:26:43.514Z [LOG] Connecting MCP client for github-mcp-server...
2025-10-30T15:26:43.776Z [LOG] MCP client for github-mcp-server connected, took 262ms
2025-10-30T15:26:43.776Z [LOG] Started MCP client for remote server github-mcp-server
2025-10-30T15:26:43.776Z [LOG] GitHub MCP server configured after authentication
2025-10-30T15:26:43.794Z [INFO] Logged in as user: johnsockwell-tributetech
2025-10-30T15:26:43.926Z [DEBUG] Fetched Copilot URL for johnsockwell-tributetech from https://api.github.com/graphql: 200 https://api.business.githubcopilot.com
2025-10-30T15:26:43.926Z [DEBUG] Creating copilot-client for integration ID copilot-developer-cli with token authentication. User-agent: copilot/0.0.354-0 (darwin v24.10.0) OpenAI/5.20.1
2025-10-30T15:26:43.988Z [DEBUG] Successfully listed 31 models

johnsockwell-tributetech avatar Oct 30 '25 16:10 johnsockwell-tributetech

@andyfeller I've followed up my earlier tests now that my quota has reset. In summary, v0.0.354-0 displays the models as I'm expecting & I can successfully query. However, I suspect there may still be an issue with model permissions.

Below is a screenshot of my Settings->Copilot->Features screen:

Image Note Claude Sonnet 4.5 is enabled & Claude Haiku 4.5 is disabled.

Below are my testing steps beginning from a logged out state:

  1. run npx -y @github/[email protected] --log-level all & see "Please use /login to sign in to use Copilot"
  2. run /model command & see:
 Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. run /login command & successfully authenticate.
  2. run /model command & see:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default) (current)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. submit hello world in the input field & see:
> hello world

 ● Hello! I'm GitHub Copilot CLI, ready to help you with software engineering
   tasks. I can assist with:

     - Running commands and scripts
     - Reading, creating, and editing files
     - Working with git repositories
     - Searching code and repositories
     - And much more

   What would you like to do?
  1. run /model command & select 3. Claude Haiku 4.5 (0.33x)
  2. submit hello world in the input field & see:
> hello world

 ● Hey there! I'm ready to help. What would you like me to work on? You can ask me
   to:

     - Navigate or explore code
     - Make code changes
     - Run tests or builds
     - Search repositories
     - Work with git
     - Or anything else related to software development

   What's your task?

I expected to see an error when selecting or using Claude Haiku 4.5 as it is disabled in my Copilot Features.

Logs from this session are attached. Apologies for all the MCP noise.

session-0548ef35-4d82-4567-84e8-bd22ca1907cb.log

johnsockwell-tributetech avatar Nov 03 '25 18:11 johnsockwell-tributetech

@andyfeller I've followed up my earlier tests now that my quota has reset. In summary, v0.0.354-0 displays the models as I'm expecting & I can successfully query. However, I suspect there may still be an issue with model permissions.

Below is a screenshot of my Settings->Copilot->Features screen:

Image Note Claude Sonnet 4.5 is enabled & Claude Haiku 4.5 is disabled. Below are my testing steps beginning from a logged out state:

  1. run npx -y @github/[email protected] --log-level all & see "Please use /login to sign in to use Copilot"
  2. run /model command & see:
 Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. run /login command & successfully authenticate.
  2. run /model command & see:
Select Model

 Choose the AI model to use for Copilot CLI. The selected model will be persisted and used for future sessions.

 ❯ 1. Claude Sonnet 4.5 (1x) (default) (current)
   2. Claude Sonnet 4 (1x)
   3. Claude Haiku 4.5 (0.33x)
   4. GPT-5 (1x)
   5. Cancel (Esc)

 Confirm with number keys or ↑↓ keys and Enter, Cancel with Esc
  1. submit hello world in the input field & see:
> hello world

 ● Hello! I'm GitHub Copilot CLI, ready to help you with software engineering
   tasks. I can assist with:

     - Running commands and scripts
     - Reading, creating, and editing files
     - Working with git repositories
     - Searching code and repositories
     - And much more

   What would you like to do?
  1. run /model command & select 3. Claude Haiku 4.5 (0.33x)
  2. submit hello world in the input field & see:
> hello world

 ● Hey there! I'm ready to help. What would you like me to work on? You can ask me
   to:

     - Navigate or explore code
     - Make code changes
     - Run tests or builds
     - Search repositories
     - Work with git
     - Or anything else related to software development

   What's your task?

I expected to see an error when selecting or using Claude Haiku 4.5 as it is disabled in my Copilot Features.

Logs from this session are attached. Apologies for all the MCP noise.

session-0548ef35-4d82-4567-84e8-bd22ca1907cb.log

@johnsockwell-tributetech : Nice work! I would like to pull this into a separate issue as I believe you found a legitimate issue where a model that is unconfigured at both the enterprise and organization levels is not being removed as an option in copilot.

Yesterday evening, we shipped some enhancements to GitHub Copilot API resolution that I have opted you into. I think you were fortunate yesterday with the current behavior completing at a reasonable time to move things along, so I'd like your help vetting these enhancements. 🙇

If there's anyone else still having issues retrieving /model listing, please mention me and I'll be happy to work with you to enable this and verify it addresses the concern.

UPDATE: Created https://github.com/github/copilot-cli/issues/473 for this follow up

andyfeller avatar Nov 04 '25 17:11 andyfeller