vscode-remote-release icon indicating copy to clipboard operation
vscode-remote-release copied to clipboard

[devcontainers] chained devcontainer resolver does not reconnect

Open jeanp413 opened this issue 1 year ago • 17 comments

Chained ssh + devcontainer resolver does not reconnect, using latest vscode and ssh, devcontainer extension

Steps to Reproduce:

  1. SSH into remote machine that has a docker container running
  2. Attach to remote container using devcontainer extension
  3. Put machine to sleep running pmset sleepnow (macos)
  4. Wait a few minutes
  5. Awake machine
  6. 🐛 vscode never manages to reconnect, from remote-ssh logs, ssh connection successfully reconnects but devcontainer does not
Dev container logs
[751 ms] Dev Containers 0.348.0 over Remote - SSH 0.109.0 in VS Code 1.87.2 (863d2581ecda6849923a2118d93a088b0745d9d6).
[750 ms] Start: Resolving Remote
[752 ms] Setting up container: /confident_brattain
[752 ms] Host authority: ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[934 ms] Host OS: linux 6.1.81-060181-generic
[934 ms] Host CWD: undefined
[934 ms] Start: Run: /bin/sh 
[1293 ms] Start: Run in host: echo ~
[1474 ms] /home/gitpod
[1474 ms] 
[1475 ms] Start: Run in host: id -un
[1655 ms] gitpod
[1656 ms] 
[1656 ms] Start: Run in host:  (command -v getent >/dev/null 2>&1 && getent passwd 'gitpod' || grep -E '^gitpod|^[^:]*:[^:]*:gitpod:' /etc/passwd || true)
[1838 ms] userEnvProbe: loginInteractiveShell (default)
[1839 ms] userEnvProbe: not found in cache
[1839 ms] userEnvProbe shell: /bin/bash
[2393 ms] userEnvProbe PATHs:
Probe:     '/home/gitpod/.nix-profile/bin:/home/gitpod/.local/bin:/home/gitpod/.sdkman/candidates/maven/current/bin:/home/gitpod/.sdkman/candidates/java/current/bin:/home/gitpod/.sdkman/candidates/gradle/current/bin:/workspace/.cargo/bin:/home/gitpod/.pyenv/shims:/workspace/go/bin:/home/gitpod/.nix-profile/bin:/home/gitpod/.rvm/gems/ruby-3.2.3/bin:/home/gitpod/.rvm/gems/ruby-3.2.3@global/bin:/home/gitpod/.rvm/rubies/ruby-3.2.3/bin:/home/gitpod/.nix-profile/bin:/home/gitpod/.local/bin:/ide/bin/remote-cli:/home/gitpod/go/bin:/home/gitpod/go-packages/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.yarn/bin:/home/gitpod/.pnpm:/home/gitpod/.pyenv/bin:/home/gitpod/.rvm/bin:/home/gitpod/.cargo/bin:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin/:/home/gitpod/.local/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.rvm/bin'
Container: None
[2931 ms] Start: Run: docker inspect --type container /confident_brattain
[3362 ms] Start: Check Docker is running
[3362 ms] Start: Run: docker version
[3744 ms] Client: Docker Engine - Community
[3744 ms]  Version:           25.0.3
 API version:       1.44
 Go version:        go1.21.6
 Git commit:        4debf41
 Built:             Tue Feb  6 21:13:09 2024
 OS/Arch:           linux/amd64
[3744 ms]  Context:           default

[3744 ms] Server: Docker Engine - Community
[3744 ms]  Engine:
[3744 ms]   Version:          25.0.3
  API version:      1.44 (minimum version 1.24)
  Go version:       go1.21.6
[3744 ms]   Git commit:       f417435
  Built:            Tue Feb  6 21:13:09 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
[3744 ms]   Version:          1.6.28
  GitCommit:        ae07eda36dd25f8a1b98dfbf587313b99c0190bb
 gitpod:
[3744 ms]   Version:          1.1.9
  GitCommit:        v1.1.9-0-gccaecfcb
 docker-init:
[3744 ms]   Version:          0.19.0
  GitCommit:
[3744 ms]         de40ad0
[4472 ms] Start: Run: /home/gitpod/.vscode-server/cli/servers/Stable-863d2581ecda6849923a2118d93a088b0745d9d6/server/node /home/gitpod/.vscode-remote-containers/dist/dev-containers-cli-0.348.0/dist/spec-node/devContainersSpecCLI.js set-up --container-id 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae --container-session-data-folder /tmp/devcontainers-2db529fa-4af7-4f06-a0cf-0a12f2cfef3d1710917954493 --log-level debug --log-format json --config /tmp/devcontainer-config-51407b02-f1fb-41eb-8b24-5589665ece4b.json --default-user-env-probe loginInteractiveShell --skip-post-create
[5095 ms] @devcontainers/cli 0.56.2. Node.js v18.17.1. linux 6.1.81-060181-generic x64.
[5095 ms] Start: Run: docker buildx version
[5145 ms] github.com/docker/buildx v0.12.1 30feaa1
[5145 ms] 
[5148 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[5163 ms] Start: Inspecting container
[5163 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[5178 ms] Start: Run in container: /bin/sh
[5181 ms] Start: Run in container: uname -m
[5256 ms] x86_64
[5256 ms] 
[5256 ms] Start: Run in container: (cat /etc/os-release || cat /usr/lib/os-release) 2>/dev/null
[5257 ms] PRETTY_NAME="Ubuntu 22.04.4 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.4 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy
[5257 ms] 
[5258 ms] Start: Run in container:  (command -v getent >/dev/null 2>&1 && getent passwd 'gitpod' || grep -E '^gitpod|^[^:]*:[^:]*:gitpod:' /etc/passwd || true)
[5259 ms] Start: Run in container: test -f '/var/devcontainer/.patchEtcEnvironmentMarker'
[5260 ms] 
[5260 ms] 
[5260 ms] Exit code 1
[5260 ms] Start: Run in container: /bin/sh
[5264 ms] Start: Run in container: test ! -f '/var/devcontainer/.patchEtcEnvironmentMarker' && set -o noclobber && mkdir -p '/var/devcontainer' && { > '/var/devcontainer/.patchEtcEnvironmentMarker' ; } 2> /dev/null
[5356 ms] 
[5356 ms] 
[5356 ms] Start: Run in container: cat >> /etc/environment <<'etcEnvrionmentEOF'
[5358 ms] 
[5358 ms] 
[5358 ms] Start: Run in container: test -f '/var/devcontainer/.patchEtcProfileMarker'
[5359 ms] 
[5359 ms] 
[5359 ms] Exit code 1
[5359 ms] Start: Run in container: test ! -f '/var/devcontainer/.patchEtcProfileMarker' && set -o noclobber && mkdir -p '/var/devcontainer' && { > '/var/devcontainer/.patchEtcProfileMarker' ; } 2> /dev/null
[5360 ms] 
[5360 ms] 
[5360 ms] Start: Run in container: sed -i -E 's/((^|\s)PATH=)([^\$]*)$/\1${PATH:-\3}/g' /etc/profile || true
[5361 ms] 
[5361 ms] 
[5467 ms] Start: Run: /home/gitpod/.vscode-server/cli/servers/Stable-863d2581ecda6849923a2118d93a088b0745d9d6/server/node /home/gitpod/.vscode-remote-containers/dist/dev-containers-cli-0.348.0/dist/spec-node/devContainersSpecCLI.js read-configuration --container-id 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae --log-level debug --log-format json --config /tmp/devcontainer-config-51407b02-f1fb-41eb-8b24-5589665ece4b.json --include-merged-configuration --mount-workspace-git-root
[6091 ms] @devcontainers/cli 0.56.2. Node.js v18.17.1. linux 6.1.81-060181-generic x64.
[6091 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[6038 ms] Start: Inspecting container
[6038 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[6423 ms] Start: Run in container: /bin/sh
[6788 ms] Start: Run in container: uname -m
[6966 ms] x86_64
[6966 ms] 
[6966 ms] Start: Run in container: (cat /etc/os-release || cat /usr/lib/os-release) 2>/dev/null
[7148 ms] PRETTY_NAME="Ubuntu 22.04.4 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.4 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy
[7148 ms] 
[7149 ms] Start: Run in container:  (command -v getent >/dev/null 2>&1 && getent passwd 'gitpod' || grep -E '^gitpod|^[^:]*:[^:]*:gitpod:' /etc/passwd || true)
[7329 ms] Start: Run in container: test -d '/home/gitpod/.vscode-server'
[7509 ms] 
[7509 ms] 
[7509 ms] Exit code 1
[7510 ms] Start: Run in container: test -d '/home/gitpod/.vscode-remote'
[7691 ms] 
[7691 ms] 
[7692 ms] Exit code 1
[7693 ms] Start: Run in container: test ! -f '/home/gitpod/.vscode-server/data/Machine/.writeMachineSettingsMarker' && set -o noclobber && mkdir -p '/home/gitpod/.vscode-server/data/Machine' && { > '/home/gitpod/.vscode-server/data/Machine/.writeMachineSettingsMarker' ; } 2> /dev/null
[7878 ms] 
[7878 ms] 
[7878 ms] Start: Run in container: cat /home/gitpod/.vscode-server/data/Machine/settings.json
[8059 ms] 
[8060 ms] cat: /home/gitpod/.vscode-server/data/Machine/settings.json: No such file or directory
[8060 ms] Exit code 1
[8060 ms] Start: Run in container: test -d '/home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6'
[8239 ms] 
[8239 ms] 
[8239 ms] Exit code 1
[8240 ms] Installing VS Code Server for commit 863d2581ecda6849923a2118d93a088b0745d9d6
[8240 ms] Start: Installing VS Code Server
[8240 ms] Start: Run in container: mkdir -p /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6_1710917963046
[8419 ms] 
[8419 ms] 
[8441 ms] Start: Run in container: (dd iflag=fullblock bs=8192 count=7014 2>/dev/null; dd iflag=fullblock bs=6039 count=1 2>/dev/null) | tar --no-same-owner -xz -C /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6_1710917963046
[23813 ms] 
[23813 ms] 
[23813 ms] Start: Run in container: mv -n /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6_1710917963046/* /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6 && rmdir /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6_1710917963046
[23995 ms] 
[23995 ms] 
[23995 ms] Start: Run in container: test -x '/home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/bin/helpers/check-requirements.sh'
[24177 ms] 
[24178 ms] 
[24178 ms] Start: Run in container: '/home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/bin/helpers/check-requirements.sh'
[24392 ms] 
[24393 ms] 
[24394 ms] Start: Launching Dev Containers helper.
[24395 ms] ssh-agent: SSH_AUTH_SOCK in container (/tmp/vscode-ssh-auth-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.sock) forwarded to remote host (/tmp/ssh-XXXXMAoJpc/agent.1607).
[24395 ms] X11 forwarding: DISPLAY not set on remote host.
[24395 ms] X11 forwarding: DISPLAY not set on local host.
[24395 ms] Start: Run in container: gpgconf --list-dir agent-socket
[24576 ms] /home/gitpod/.gnupg/S.gpg-agent
[24577 ms] 
[24577 ms] Start: Run in container: gpgconf --list-dir homedir
[24756 ms] /home/gitpod/.gnupg
[24756 ms] 
[24756 ms] Start: Run in container: ls '/home/gitpod/.gnupg/private-keys-v1.d' 2>/dev/null
[24934 ms] 
[24935 ms] 
[24935 ms] Start: Run: gpgconf --list-dir agent-extra-socket
[25305 ms] /home/gitpod/.gnupg/S.gpg-agent.extra
[25305 ms] 
[25305 ms] Start: Run in container: mkdir -p -m 700 '/home/gitpod/.gnupg'
[25306 ms] gpg-agent: Socket in container (/home/gitpod/.gnupg/S.gpg-agent) forwarded to remote host (/home/gitpod/.gnupg/S.gpg-agent.extra).
[25485 ms] 
[25485 ms] 
[25485 ms] Start: Run in container: command -v docker >/dev/null 2>&1
[25486 ms] Start: Run: gpgconf --list-dir homedir
[25670 ms] 
[25670 ms] 
[25672 ms] Start: Run in container: /bin/sh
[25674 ms] userEnvProbe: loginInteractiveShell (default)
[25674 ms] Start: Run in container: test -f '/tmp/devcontainers-2db529fa-4af7-4f06-a0cf-0a12f2cfef3d1710917954493/env-loginInteractiveShell.json'
[25857 ms] 
[25857 ms] 
[25857 ms] Exit code 1
[25857 ms] userEnvProbe: not found in cache
[25857 ms] userEnvProbe shell: /bin/bash
[25858 ms] Start: Run in container: # Test for /home/gitpod/.ssh/known_hosts and ssh
[25858 ms] /home/gitpod/.gnupg
[25859 ms] 
[26039 ms] 
[26039 ms] 
[26039 ms] Start: Run in container: echo ~
[26040 ms] Start: Run in container: gpgconf --list-dir homedir
[26220 ms] /home/gitpod
[26221 ms] 
[26222 ms] Start: Run in container: cat <<'EOF-/tmp/vscode-remote-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js' >/tmp/vscode-remote-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js
[26270 ms] /home/gitpod/.gnupg
[26271 ms] 
[26271 ms] Start: Run in container: # Copy /Users/jeanpierre/.ssh/known_hosts to /home/gitpod/.ssh/known_hosts
[26409 ms] 
[26409 ms] 
[26411 ms] Start: Run in container: cat ~/.docker/config.json || echo "{
[26629 ms] {
}
[26629 ms] cat: /home/gitpod/.docker/config.json: No such file or directory
[26629 ms] Start: Run in container: /bin/sh
[26772 ms] 
[26772 ms] 
[26772 ms] Start: Run in container: # Test for /home/gitpod/.gnupg/pubring.kbx and gpg
[26954 ms] /home/gitpod/.gnupg/pubring.kbx exists
[26954 ms] 
[26954 ms] Exit code 1
[26987 ms] Start: Run in container: mkdir -p /usr/local/bin && cat <<'EOF-/usr/local/bin/docker-credential-dev-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb' >/usr/local/bin/docker-credential-dev-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb
[27140 ms] Start: Run in container: # Test for /home/gitpod/.gnupg/pubring.gpg and gpg
[27207 ms] 
[27207 ms] 
[27207 ms] Start: Run in container: command -v git >/dev/null 2>&1 && git config --system --replace-all credential.helper '!f() { /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node /tmp/vscode-remote-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js git-credential-helper $*; }; f' || true
[27320 ms] 
[27320 ms] 
[27321 ms] Start: Run in container: # Copy /home/gitpod/.gnupg/pubring.gpg to /home/gitpod/.gnupg/pubring.gpg
[27387 ms] 
[27387 ms] 
[27387 ms] Start: Run in container: chmod +x /usr/local/bin/docker-credential-dev-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb
[27505 ms] 
[27505 ms] 
[27505 ms] Exit code 1
[27505 ms] Start: Run in container: for pid in `cd /proc && ls -d [0-9]*`; do { echo $pid ; readlink /proc/$pid/cwd || echo ; readlink /proc/$pid/ns/mnt || echo ; cat /proc/$pid/stat | tr "
[27571 ms] 
[27572 ms] 
[27574 ms] Start: Run in container: mkdir -p ~/.docker && cat <<'EOF-/usr/local/bin/docker-credential-dev-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb' >~/.docker/config.json
[27746 ms] Start: Run in container: # Test for /home/gitpod/.gnupg/trustdb.gpg and gpg
[27753 ms] 
[27754 ms] 
[27754 ms] Start: Run in container: cat <<'EOF-/tmp/vscode-remote-containers-server-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js' >/tmp/vscode-remote-containers-server-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js_1710917982560
[27925 ms] /home/gitpod/.gnupg/trustdb.gpg exists
[27925 ms] 
[27926 ms] Exit code 1
[27926 ms] Start: Run in container: cat '/home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/product.json'
[27926 ms] Start: Run: gpg-connect-agent updatestartuptty /bye
[27978 ms] 
[27978 ms] 
[28115 ms] Start: Run in container: cat '/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6' 2>/dev/null || (umask 377 && echo '63bf9b4f-69e9-4db9-a1bb-db8932faca80' >'/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6-eaf259a9-3e40-429e-bcf0-9be214ebf592' && mv -n '/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6-eaf259a9-3e40-429e-bcf0-9be214ebf592' '/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6' && rm -f '/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6-eaf259a9-3e40-429e-bcf0-9be214ebf592' && cat '/home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6')
[28335 ms] 63bf9b4f-69e9-4db9-a1bb-db8932faca80
[28335 ms] 
[28336 ms] Start: Starting VS Code Server
[28337 ms] Start: Preparing Extensions
[28337 ms] Start: Run in container: test ! -f '/home/gitpod/.vscode-server/data/Machine/.installExtensionsMarker' && set -o noclobber && mkdir -p '/home/gitpod/.vscode-server/data/Machine' && { > '/home/gitpod/.vscode-server/data/Machine/.installExtensionsMarker' ; } 2> /dev/null
[28561 ms] 
[28562 ms] 
[28564 ms] Extensions cache, install extensions: github.copilot, github.copilot-chat, GitHub.copilot, GitHub.copilot-chat
[28564 ms] Start: Run in container: test -d /home/gitpod/.vscode-server/extensionsCache && ls /home/gitpod/.vscode-server/extensionsCache || true
[28612 ms] userEnvProbe PATHs:
Probe:     '/home/gitpod/.nix-profile/bin:/home/gitpod/.local/bin:/home/gitpod/.sdkman/candidates/maven/current/bin:/home/gitpod/.sdkman/candidates/java/current/bin:/home/gitpod/.sdkman/candidates/gradle/current/bin:/workspace/.cargo/bin:/home/gitpod/.rvm/gems/ruby-3.2.3/bin:/home/gitpod/.rvm/gems/ruby-3.2.3@global/bin:/home/gitpod/.rvm/rubies/ruby-3.2.3/bin:/home/gitpod/.pyenv/shims:/workspace/go/bin:/home/gitpod/.nix-profile/bin:/home/gitpod/go/bin:/home/gitpod/go-packages/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.yarn/bin:/home/gitpod/.pnpm:/home/gitpod/.pyenv/bin:/home/gitpod/.rvm/bin:/home/gitpod/.cargo/bin:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin/:/home/gitpod/.local/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.rvm/bin'
Container: '/home/gitpod/go/bin:/home/gitpod/go-packages/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.yarn/bin:/home/gitpod/.pnpm:/home/gitpod/.pyenv/bin:/home/gitpod/.pyenv/shims:/home/gitpod/.rvm/bin:/home/gitpod/.cargo/bin:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin/:/home/gitpod/.local/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin'
Merged:    '/home/gitpod/.nix-profile/bin:/home/gitpod/.local/bin:/home/gitpod/.sdkman/candidates/maven/current/bin:/home/gitpod/.sdkman/candidates/java/current/bin:/home/gitpod/.sdkman/candidates/gradle/current/bin:/workspace/.cargo/bin:/home/gitpod/.rvm/gems/ruby-3.2.3/bin:/home/gitpod/.rvm/gems/ruby-3.2.3@global/bin:/home/gitpod/.rvm/rubies/ruby-3.2.3/bin:/home/gitpod/.pyenv/shims:/workspace/go/bin:/home/gitpod/.nix-profile/bin:/home/gitpod/go/bin:/home/gitpod/go-packages/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.yarn/bin:/home/gitpod/.pnpm:/home/gitpod/.pyenv/bin:/home/gitpod/.rvm/bin:/home/gitpod/.cargo/bin:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin/:/home/gitpod/.local/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/gitpod/.nvm/versions/node/v20.11.1/bin:/home/gitpod/.rvm/bin'
[28744 ms] 
[28744 ms] 
[28744 ms] Start: Run in container: mkdir -p '/tmp/devcontainers-2db529fa-4af7-4f06-a0cf-0a12f2cfef3d1710917954493' && cat > '/tmp/devcontainers-2db529fa-4af7-4f06-a0cf-0a12f2cfef3d1710917954493/env-loginInteractiveShell.json' << 'envJSON'
[28746 ms] Extensions cache, copy to remote: github.copilot-1.175.0, github.copilot-chat-0.13.1
[28925 ms] 
[28925 ms] 
[28925 ms] Start: Run in container: # Copy extensions to remote
[32385 ms] 
[32386 ms] 
[32387 ms] Optimizing extensions for quality: stable
[32388 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/bin/code-server --log debug --force-disable-user-env --server-data-dir /home/gitpod/.vscode-server --telemetry-level off --accept-server-license-terms --host 127.0.0.1 --port 0 --connection-token-file /home/gitpod/.vscode-server/data/Machine/.connection-token-863d2581ecda6849923a2118d93a088b0745d9d6 --extensions-download-dir /home/gitpod/.vscode-server/extensionsCache --install-extension github.copilot --install-extension github.copilot-chat --install-extension GitHub.copilot --install-extension GitHub.copilot-chat --start-server  --skip-requirements-check
[32869 ms] *
* Visual Studio Code Server
*
* By using the software, you agree to
* the Visual Studio Code Server License Terms (https://aka.ms/vscode-server-license) and
* the Microsoft Privacy Statement (https://privacy.microsoft.com/en-US/privacystatement).
*
[32870 ms] Server bound to 127.0.0.1:44131 (IPv4)
Extension host agent listening on 44131

[32870 ms] Start: Run in container: echo 44131 >'/home/gitpod/.vscode-server/data/Machine/.devport-863d2581ecda6849923a2118d93a088b0745d9d6'
[32961 ms] [06:59:47] 




[32976 ms] [06:59:47] Installing extensions...
[32978 ms] [06:59:47] Extension host agent started.
[32989 ms] [06:59:47] Started initializing default profile extensions in extensions installation folder. file:///home/gitpod/.vscode-server/extensions
[32992 ms] [06:59:47] ComputeTargetPlatform: linux-x64
[32995 ms] [06:59:47] Completed initializing default profile extensions in extensions installation folder. file:///home/gitpod/.vscode-server/extensions
[32998 ms] [06:59:47] ComputeTargetPlatform: linux-x64
[33048 ms] 
[33049 ms] 
[33049 ms] Port forwarding for container port 44131 starts listening on local port.
[33050 ms] Port forwarding local port 44131 to container port 44131
[33051 ms] Start: Run in container: /bin/sh -c # Watch installed extensions
[33051 ms] Start: Run in container: /bin/sh -c # Watch machine settings
[33057 ms] Port forwarding connection from 49640 > 44131 > 44131 in the container.
[33057 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[33430 ms] Start: Run in container: # Test for /home/gitpod/.gitconfig and git
[33519 ms] [06:59:48] Installing extension 'github.copilot-chat'...
[33522 ms] [06:59:48] Installing extension 'github.copilot-chat'...
[33524 ms] [06:59:48] Installing extension 'github.copilot'...
[33525 ms] [06:59:48] Installing extension 'github.copilot'...
[33538 ms] Port forwarding 49640 > 44131 > 44131 stderr: Connection established
[33544 ms] [06:59:48] Getting Manifest... github.copilot-chat
[33544 ms] [06:59:48] Getting Manifest... github.copilot-chat
[06:59:48] Getting Manifest... github.copilot
[06:59:48] Getting Manifest... github.copilot
[33568 ms] [06:59:48] Installing extension: github.copilot
[33568 ms] [06:59:48] Extension is already requested to install github.copilot
[33568 ms] [06:59:48] Installing extension: github.copilot-chat
[33568 ms] [06:59:48] Extension is already requested to install github.copilot-chat
[33613 ms] 
[33614 ms] 
[33615 ms] Start: Run in container: # Copy /home/gitpod/.gitconfig to /home/gitpod/.gitconfig
[33690 ms] Port forwarding connection from 49641 > 44131 > 44131 in the container.
[33691 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[33973 ms] 
[33973 ms] 
[34023 ms] [06:59:48] Getting Manifest... github.copilot
[34090 ms] [06:59:48] [127.0.0.1][65efb178][ManagementConnection] New connection established.
[34090 ms] [06:59:48] Getting Manifest... github.copilot-chat
[34157 ms] Start: Run in container: # Cleaning up git config
[34164 ms] Port forwarding 49641 > 44131 > 44131 stderr: Connection established
[34344 ms] 
[34344 ms] 
[34345 ms] Start: Run in container: command -v git >/dev/null 2>&1 && git config --global --replace-all credential.helper '!f() { /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node /tmp/vscode-remote-containers-87c92cf8-e04d-4ebb-9c0e-d0e992ad5ffb.js git-credential-helper $*; }; f' || true
[34457 ms] [06:59:49] Log level changed to info
[34553 ms] 
[34553 ms] 
[34652 ms] [06:59:49] [127.0.0.1][92aae1cc][ExtensionHostConnection] New connection established.
[34652 ms] [06:59:49] [127.0.0.1][92aae1cc][ExtensionHostConnection] <842> Launched Extension Host Process.
[35340 ms] [06:59:50] Extension signature is verified: github.copilot-chat
[35341 ms] [06:59:50] Extension signature is verified: github.copilot
[35450 ms] [06:59:50] Extracted extension to file:///home/gitpod/.vscode-server/extensions/github.copilot-chat-0.13.1: github.copilot-chat
[35451 ms] [06:59:50] Renamed to /home/gitpod/.vscode-server/extensions/github.copilot-chat-0.13.1
[35452 ms] [06:59:50] Extracting extension completed. github.copilot-chat
[35523 ms] Start: Run in container: cat '/home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/product.json'
[35574 ms] [06:59:50] Extracted extension to file:///home/gitpod/.vscode-server/extensions/github.copilot-1.175.0: github.copilot
[35575 ms] [06:59:50] Renamed to /home/gitpod/.vscode-server/extensions/github.copilot-1.175.0
[35575 ms] [06:59:50] Extracting extension completed. github.copilot
[35575 ms] [06:59:50] Extension installed successfully: github.copilot-chat
[06:59:50] Extension installed successfully: github.copilot
[35575 ms] [06:59:50] Extension 'github.copilot-chat' v0.13.1 was successfully installed.
[06:59:50] Extension 'github.copilot' v1.175.0 was successfully installed.
[35715 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/bin/code-server --server-data-dir /home/gitpod/.vscode-server --telemetry-level off --list-extensions
[36102 ms] Port forwarding connection from 49644 > 44131 > 44131 in the container.
[36102 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[36435 ms] github.copilot
github.copilot-chat
[36435 ms] 
[36436 ms] Start: Run in container: /bin/sh -c # Watch installed extensions
[36568 ms] Port forwarding 49644 > 44131 > 44131 stderr: Connection established
[42271 ms] Port forwarding 49644 > 44131 > 44131 stderr: Remote close
[42280 ms] Port forwarding 49644 > 44131 > 44131 terminated with code 0 and signal null.
[42610 ms] Extensions cache, remote removals: None
[82094 ms] Start: Run in container: cat /proc/1620/environ
[93703 ms] Start: Run in container: /bin/sh -c # Watch machine settings
[97042 ms] Start: Run in container: /bin/sh -c # Watch installed extensions
[102796 ms] Extensions cache, remote removals: None
[151494 ms] Port forwarding 49641 > 44131 > 44131: Local close
[151495 ms] Port forwarding 49640 > 44131 > 44131: Local close
[151495 ms] Port forwarding 49644 > 44131 > 44131: Local close
[151496 ms] Port forwarding connection from 49658 > 44131 > 44131 in the container.
[151497 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[151829 ms] Port forwarding 49641 > 44131 > 44131 stderr: Remote stdin close
[151831 ms] Port forwarding 49640 > 44131 > 44131 stderr: Remote stdin close
[151859 ms] Port forwarding 49641 > 44131 > 44131 terminated by extension (closed) with code 0 and signal null.
[151859 ms] Port forwarding 49640 > 44131 > 44131 terminated by extension (closed) with code 0 and signal null.
[151859 ms] Start: Reconnection attempt 1
[151859 ms] Start: Container: Reconnecting exec server
[151859 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[151860 ms] Start: Run in container: /bin/sh
[152213 ms] Port forwarding 49658 > 44131 > 44131 stderr: Connection established
[152506 ms] Port forwarding connection from 49667 > 44131 > 44131 in the container.
[152507 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[152741 ms] [07:01:47] [127.0.0.1][92aae1cc][ExtensionHostConnection] The client has reconnected.
[153091 ms] Port forwarding 49667 > 44131 > 44131 stderr: Connection established
[153630 ms] [07:01:48] [127.0.0.1][65efb178][ManagementConnection] The client has reconnected.
[154332 ms] Start: Run in container: /bin/sh -c # Watch machine settings
[157631 ms] Start: Run in container: /bin/sh -c # Watch installed extensions
[35033495 ms] Port forwarding connection from 51642 > 44131 > 44131 in the container.
[35033495 ms] Start: Run in container: /home/gitpod/.vscode-server/bin/863d2581ecda6849923a2118d93a088b0745d9d6/node -e 
[35040874 ms] Start: Reconnection attempt 2
[35040874 ms] Start: Container: Reconnecting exec server
[35040875 ms] Start: Run: docker inspect --type container 4eb33c5f369e8b39f53a6947c6c56bbfd5d88f4db886f2c0669490ab6bf604ae
[35040875 ms] Start: Run in container: /bin/sh

SSH logs
[01:59:14.872] Log Level: 1
[01:59:14.879] Opening exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[01:59:14.897] VS Code version: 1.87.2
[01:59:14.897] Remote-SSH version: [email protected]
[01:59:14.897] darwin arm64
[01:59:14.910] Initizing new exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[01:59:14.912] Acquiring local install lock: /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-remote-ssh-28703a77-install.lock
[01:59:14.912] Looking for existing server data file at /Users/jeanpierre/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-28703a77-863d2581ecda6849923a2118d93a088b0745d9d6-0.109.0-es/data.json
[01:59:14.912] Found local server running: {"remoteListeningOn":{"port":42761},"osReleaseId":"ubuntu","arch":"x86_64","sshAuthSock":"/tmp/ssh-XXXXMAoJpc/agent.1607","display":"","tmpDir":"/tmp","platform":"linux","execServerToken":"9af99b1a-e23c-45ab-b723-2a3b6ebfaea7","pid":86724,"ipcHandlePath":"/var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock","socksPort":49616,"startupTime":1710917915513}
[01:59:14.915] Found running server - short-circuiting install
[01:59:14.917] Starting forwarding server. local port 49630 -> socksPort 49616 -> remotePort 42761
[01:59:14.917] Forwarding server listening on port 49630
[01:59:14.917] Waiting for ssh tunnel to be ready
[01:59:14.918] Tunneled port 42761 to local port 49630
[01:59:14.918] Resolved "ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d" to "port 49630"
[01:59:14.918] Resolving exec server at port 49630
[01:59:14.918] [Forwarding server port 49630] Got connection 0
[01:59:14.918] [Forwarding server port 49630] Got connection 1
[01:59:15.555] Exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d created and cached
[02:01:46.308] Opening exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[02:01:46.665] Verified and reusing cached exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[02:17:18.216] Server delay-shutdown request failed: socket hang up
[02:17:20.216] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[02:17:22.227] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock

...

[11:42:32.876] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:42:34.890] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:42:58.973] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:00.978] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:02.983] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:04.990] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:06.998] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:08.300] Opening exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[11:43:09.003] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:11.006] Server delay-shutdown request failed: connect ECONNREFUSED /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-5c04323948bec5ffaa4a6b99b3f61e5750899312.sock
[11:43:11.310] Existing exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d timed out
[11:43:11.311] Initizing new exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d
[11:43:11.312] Acquiring local install lock: /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-remote-ssh-28703a77-install.lock
[11:43:11.313] Looking for existing server data file at /Users/jeanpierre/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-28703a77-863d2581ecda6849923a2118d93a088b0745d9d6-0.109.0-es/data.json
[11:43:11.314] Using commit id "863d2581ecda6849923a2118d93a088b0745d9d6" and quality "stable" for server
[11:43:11.318] Install and start server if needed
[11:43:11.323] PATH: /Users/jeanpierre/go/bin:/opt/homebrew/opt/coreutils/libexec/gnubin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/usr/local/go/bin:/Users/jeanpierre/.cargo/bin
[11:43:11.323] Checking ssh with "ssh -V"
[11:43:11.329] > OpenSSH_9.6p1, LibreSSL 3.3.6

[11:43:11.332] askpass server listening on /var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-c06a25647b41cc4159e33bc4a93aee14409ba250.sock
[11:43:11.333] Spawning local server with {"serverId":1,"ipcHandlePath":"/var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-267e1bd884a7ecbc6ec03e047dd487812dc48596.sock","sshCommand":"ssh","sshArgs":["-v","-T","-D","51643","-o","ConnectTimeout=15","jeanp413-devtunnelsssh-tmhyo65bpe2@jeanp413-devtunnelsssh-tmhyo65bpe2.ssh.ws.dogfood.gitpod.cloud"],"serverDataFolderName":".vscode-server","dataFilePath":"/Users/jeanpierre/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-28703a77-863d2581ecda6849923a2118d93a088b0745d9d6-0.109.0-es/data.json"}
[11:43:11.333] Local server env: {"SSH_AUTH_SOCK":"/private/tmp/com.apple.launchd.F0nvUz1t6W/Listeners","SHELL":"/bin/zsh","DISPLAY":"1","ELECTRON_RUN_AS_NODE":"1","SSH_ASKPASS":"/Users/jeanpierre/.vscode/extensions/ms-vscode-remote.remote-ssh-0.109.0/out/local-server/askpass.sh","VSCODE_SSH_ASKPASS_NODE":"/Applications/Visual Studio Code.app/Contents/Frameworks/Code Helper (Plugin).app/Contents/MacOS/Code Helper (Plugin)","VSCODE_SSH_ASKPASS_EXTRA_ARGS":"","VSCODE_SSH_ASKPASS_MAIN":"/Users/jeanpierre/.vscode/extensions/ms-vscode-remote.remote-ssh-0.109.0/out/askpass-main.js","VSCODE_SSH_ASKPASS_HANDLE":"/var/folders/n6/9v45vmg54jjc_mtklc1x79l00000gn/T/vscode-ssh-askpass-c06a25647b41cc4159e33bc4a93aee14409ba250.sock"}
[11:43:11.333] Spawned 98562
[11:43:11.828] > local-server-1> Running ssh connection command: ssh -v -T -D 51643 -o ConnectTimeout=15 jeanp413-devtunnelsssh-tmhyo65bpe2@jeanp413-devtunnelsssh-tmhyo65bpe2.ssh.ws.dogfood.gitpod.cloud
[11:43:11.829] > local-server-1> Spawned ssh, pid=98575
[11:43:11.832] stderr> OpenSSH_9.6p1, LibreSSL 3.3.6
[11:43:14.315] > ready: f3fa731d6e1b
[11:43:14.501] > Linux 6.1.81-060181-generic #202403070032 SMP PREEMPT_DYNAMIC Thu Mar  7 00:50:03 UTC 2024
[11:43:14.501] Platform: linux
[11:43:14.683] > /bin/bash
[11:43:14.684] Shell: bash
[11:43:14.684] Creating bash subshell inside "bash"
[11:43:14.868] > bash version:  5.1.16(1)-release
[11:43:14.919] > bash version:  5.1.16(1)-release
[11:43:14.974] > bash version:  5.1.16(1)-release
[11:43:15.034] > bash version:  5.1.16(1)-release
[11:43:15.057] > f3fa731d6e1b: running
[11:43:15.067] > Found existing installation at /home/gitpod/.vscode-server...
> Starting VS Code CLI... "/home/gitpod/.vscode-server/code-863d2581ecda6849923a2118d93a088b0745d9d6" command-shell --cli-data-dir "/home/gitpod/.vscode-server/cli" --on-port --parent-process-id 48538 &> "/home/gitpod/.vscode-server/.cli.863d2581ecda6849923a2118d93a088b0745d9d6.log" < /dev/null
> Removing old logfile at /home/gitpod/.vscode-server/.cli.863d2581ecda6849923a2118d93a088b0745d9d6.log
> Spawned remote CLI: 48558
> Waiting for server log...
[11:43:15.109] > f3fa731d6e1b: start
> SSH_AUTH_SOCK==/tmp/ssh-XXXXDikhMj/agent.48467==
> DISPLAY====
> listeningOn==127.0.0.1:33557==
> osReleaseId==ubuntu==
> arch==x86_64==
> vscodeArch==x64==
> bitness==64==
> tmpDir==/tmp==
> platform==linux==
> unpackResult====
> didLocalDownload==0==
> downloadTime====
> installTime====
> serverStartTime==39==
> execServerToken==111111a1-1a11-1111-1aaa-1aa11aa1a11a==
> f3fa731d6e1b: end
[11:43:15.110] Received install output: 
SSH_AUTH_SOCK==/tmp/ssh-XXXXDikhMj/agent.48467==
DISPLAY====
listeningOn==127.0.0.1:33557==
osReleaseId==ubuntu==
arch==x86_64==
vscodeArch==x64==
bitness==64==
tmpDir==/tmp==
platform==linux==
unpackResult====
didLocalDownload==0==
downloadTime====
installTime====
serverStartTime==39==
execServerToken==111111a1-1a11-1111-1aaa-1aa11aa1a11a==

[11:43:15.112] Remote server is listening on port 33557
[11:43:15.113] Parsed server configuration: {"serverConfiguration":{"remoteListeningOn":{"port":33557},"osReleaseId":"ubuntu","arch":"x86_64","sshAuthSock":"/tmp/ssh-XXXXDikhMj/agent.48467","display":"","tmpDir":"/tmp","platform":"linux","execServerToken":"111111a1-1a11-1111-1aaa-1aa11aa1a11a"},"serverStartTime":39,"installUnpackCode":""}
[11:43:15.114] Persisting server connection details to /Users/jeanpierre/Library/Application Support/Code/User/globalStorage/ms-vscode-remote.remote-ssh/vscode-ssh-host-28703a77-863d2581ecda6849923a2118d93a088b0745d9d6-0.109.0-es/data.json
[11:43:15.119] Starting forwarding server. local port 51646 -> socksPort 51643 -> remotePort 33557
[11:43:15.119] Forwarding server listening on port 51646
[11:43:15.120] Waiting for ssh tunnel to be ready
[11:43:15.121] Tunneled port 33557 to local port 51646
[11:43:15.121] Resolved "ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d" to "port 51646"
[11:43:15.121] Resolving exec server at port 51646
[11:43:15.122] [Forwarding server port 51646] Got connection 0
[11:43:15.123] [Forwarding server port 51646] Got connection 1
[11:43:15.124] stderr> debug1: Connection to port 51643 forwarding to socks port 0 requested.
[11:43:15.125] stderr> debug1: channel 3: new dynamic-tcpip [dynamic-tcpip] (inactive timeout: 0)
[11:43:15.125] stderr> debug1: Connection to port 51643 forwarding to socks port 0 requested.
[11:43:15.125] stderr> debug1: channel 4: new dynamic-tcpip [dynamic-tcpip] (inactive timeout: 0)
[11:43:15.494] stderr> debug1: channel 3: free: direct-tcpip: listening port 51643 for 127.0.0.1 port 33557, connect from 127.0.0.1 port 51649 to 127.0.0.1 port 51643, nchannels 5
[11:43:15.679] Exec server for ssh-remote+7b22686f73744e616d65223a226a65616e703431332d64657674756e6e656c737373682d746d68796f3635627065322e7373682e77732e646f67666f6f642e676974706f642e636c6f7564222c2275736572223a226a65616e703431332d64657674756e6e656c737373682d746d68796f363562706532227d created and cached


jeanp413 avatar Mar 27 '24 17:03 jeanp413

@connor4312 @roblourens Does Remote-SSH support reconnection when it is used as an ExecServer?

chrmarti avatar Mar 28 '24 10:03 chrmarti

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.

Happy Coding!

vscodenpa avatar Apr 04 '24 12:04 vscodenpa

@chrmarti can you reopen this please :pray:, there's no response from @connor4312 or @roblourens yet

jeanp413 avatar Apr 04 '24 13:04 jeanp413

Sorry for the delay. Yes, we do reconnect in exec server mode. I'll give this a look and see if I repro any issues...

connor4312 avatar Apr 04 '24 15:04 connor4312

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.

Happy Coding!

vscodenpa avatar Apr 12 '24 12:04 vscodenpa

This issue has been closed automatically because it needs more information and has not had recent activity. See also our issue reporting guidelines.

Happy Coding!

vscodenpa avatar Apr 20 '24 12:04 vscodenpa

@chrmarti @connor4312 could you reopen this pls 🙏

jeanp413 avatar Apr 20 '24 19:04 jeanp413

Tentatively reopening and removing info-needed so that the bot doesn't get to this one too eagerly.

bamurtaugh avatar Apr 29 '24 21:04 bamurtaugh

@connor4312 Fixing an issue in Dev Container (publishing as 0.363.0-pre-release).

With that fix in I see two cases testing with pmset sleepnow on macOS with an SSH server running Docker:

  1. Short sleep with the Remote-SSH log showing that a cached ExecServer is used actually works.
  2. Longer sleep (15 seconds or more) with the Remote-SSH log showing that a new ExecServer was created still does not work.

In the second case I see the new ExecServer being pass in to the Dev Container resolver and the resolver finishes successfully, but I don't see any connection attempt on the local port that the Dev Container extension forwards to the VS Code Server in the container.

The window log shows that WebSocket connection attempts on that port are made, but they don't seem to reach the listening port. When I use curl to connect to the local port, I see the connection attempt in the Dev Containers log.

Just noticed it now successfully reconnected on attempt 18. This looks like an issue on the VS Code core side since I can connect to the port with curl and don't see connection attempts from VS Code.

/cc @alexdima

chrmarti avatar Apr 30 '24 11:04 chrmarti

Window log while reconnection fails:

2024-04-30 13:13:51.835 [info] [remote-connection][ExtensionHost][6a229…][reconnect] resolving connection...
2024-04-30 13:13:51.836 [info] [remote-connection][ExtensionHost][6a229…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:13:51.837 [trace] [remote-connection][ExtensionHost][6a229…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:13:51.838 [info] Creating a socket (renderer-ExtensionHost-6a229c58-1db5-4e16-a511-a6d27afdfaff)...
2024-04-30 13:13:52.053 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:52.556 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:53.066 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:53.162 [trace] CommandService#executeCommand workbench.output.action.toggleAutoScroll
2024-04-30 13:13:53.564 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:54.075 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:54.296 [info] [remote-connection][Management   ][643a5…][reconnect] resolving connection...
2024-04-30 13:13:54.297 [info] Invoking resolveAuthority(dev-container)...
2024-04-30 13:13:54.297 [info] [LocalProcess0][resolveAuthority(dev-container,22)][0ms] obtaining proxy...
2024-04-30 13:13:54.297 [info] [LocalProcess0][resolveAuthority(dev-container,22)][0ms] invoking...
2024-04-30 13:13:54.332 [trace] CommandService#executeCommand _setContext
2024-04-30 13:13:54.407 [info] [LocalProcess0][resolveAuthority(dev-container,22)][111ms] returned WebSocket(127.0.0.1:33853)
2024-04-30 13:13:54.407 [info] resolveAuthority(dev-container) returned 'WebSocket(127.0.0.1:33853)' after 111 ms
2024-04-30 13:13:54.407 [info] [remote-connection][Management   ][643a5…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:13:54.408 [trace] [remote-connection][Management   ][643a5…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:13:54.408 [info] Creating a socket (renderer-Management-643a5b2f-10d8-4577-893d-435691bcaec8)...
2024-04-30 13:13:54.560 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:55.088 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:55.584 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:56.102 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:56.423 [trace] writeTextAreaState(reason: focusgain)
2024-04-30 13:13:56.568 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:57.077 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:57.515 [info] [remote-connection][ExtensionHost][6a229…][reconnect] received socket timeout event (unacknowledgedMsgCount: 153, timeSinceOldestUnacknowledgedMsg: 40004, timeSinceLastReceivedSomeData: 54361).
2024-04-30 13:13:57.582 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:58.083 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:58.589 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:59.100 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:13:59.618 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:00.117 [debug] Comments: URIs of continue on comments to add to storage .
2024-04-30 13:14:00.132 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:00.594 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:01.286 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:01.624 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:02.109 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:02.629 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:03.133 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:03.648 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:04.151 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:04.659 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:05.157 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:05.672 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:06.167 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:06.669 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:07.172 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:07.679 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:08.188 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:08.685 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:09.201 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:09.701 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:10.192 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:10.512 [info] [remote-connection][Management   ][643a5…][reconnect] received socket timeout event (unacknowledgedMsgCount: 4, timeSinceOldestUnacknowledgedMsg: 40830, timeSinceLastReceivedSomeData: 65754).
2024-04-30 13:14:10.710 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:11.203 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:11.714 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:12.216 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:12.720 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:13.204 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:13.711 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:14.209 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:14.724 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:15.222 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:15.720 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:16.251 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:16.529 [trace] CommandService#executeCommand workbench.getCodeExchangeProxyEndpoints
2024-04-30 13:14:16.752 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:17.130 [trace] [mainThreadSecretState] Setting password for vscode.microsoft-authentication extension:  72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f
2024-04-30 13:14:17.131 [trace] [secrets] encrypting secret for key: {"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.131 [info] Settings Sync: Updating due to change in sessions
2024-04-30 13:14:17.132 [trace] [secrets] storing encrypted secret for key: secret://{"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.132 [trace] [SecretStorageService] Notifying change in value for secret: {"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.133 [trace] [secrets] stored encrypted secret for key: secret://{"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.133 [trace] [mainThreadSecretState] Password set for:  vscode.microsoft-authentication 72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f
2024-04-30 13:14:17.133 [trace] Settings Sync: Updating the token for the account chrmarti
2024-04-30 13:14:17.133 [trace] Settings Sync: Token updated for the account chrmarti
2024-04-30 13:14:17.134 [trace] [mainThreadSecretState] Getting password for vscode.microsoft-authentication extension:  72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f
2024-04-30 13:14:17.134 [trace] [secrets] getting secret for key: secret://{"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.134 [trace] [secrets] decrypting gotten secret for key: secret://{"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.135 [trace] [secrets] decrypted secret for key: secret://{"extensionId":"vscode.microsoft-authentication","key":"72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f"}
2024-04-30 13:14:17.135 [trace] [mainThreadSecretState] Password found for:  vscode.microsoft-authentication 72f988bf-86f1-41af-91ab-2d7cd011db47/aa503e33-a5cd-473a-a0b3-06f2449cdeac/ec575c63-cb58-4ac4-885b-c7b46a26fe6f
2024-04-30 13:14:17.231 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:17.515 [info] [remote-connection][ExtensionHost][6a229…][reconnect] received socket timeout event (unacknowledgedMsgCount: 301, timeSinceOldestUnacknowledgedMsg: 60004, timeSinceLastReceivedSomeData: 74361).
2024-04-30 13:14:17.731 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:18.274 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:18.778 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:19.253 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:19.782 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:20.278 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:20.785 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:21.297 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:21.794 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:21.835 [error] [remote-connection][ExtensionHost][6a229…][reconnect][WebSocket(127.0.0.1:33853)] socketFactory.connect() failed or timed out. Error:
2024-04-30 13:14:21.835 [error] Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:21.835 [info] [remote-connection][ExtensionHost][6a229…][reconnect] A network error occurred while trying to reconnect, will try again...
2024-04-30 13:14:21.835 [trace] Time limit reached: Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:21.835 [info] [remote-connection][ExtensionHost][6a229…][reconnect] waiting for 5 seconds before reconnecting...
2024-04-30 13:14:22.290 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:22.808 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:23.297 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:23.816 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:24.323 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:24.410 [error] [remote-connection][Management   ][643a5…][reconnect][WebSocket(127.0.0.1:33853)] socketFactory.connect() failed or timed out. Error:
2024-04-30 13:14:24.410 [error] Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:24.410 [info] [remote-connection][Management   ][643a5…][reconnect] A network error occurred while trying to reconnect, will try again...
2024-04-30 13:14:24.410 [trace] Time limit reached: Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:24.410 [info] [remote-connection][Management   ][643a5…][reconnect] waiting for 5 seconds before reconnecting...
2024-04-30 13:14:24.821 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:25.323 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:25.830 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:26.148 [trace] writeTextAreaState(reason: focusgain)
2024-04-30 13:14:26.327 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:26.822 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:26.837 [info] [remote-connection][ExtensionHost][6a229…][reconnect] resolving connection...
2024-04-30 13:14:26.837 [info] [remote-connection][ExtensionHost][6a229…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:14:26.837 [trace] [remote-connection][ExtensionHost][6a229…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:14:26.837 [info] Creating a socket (renderer-ExtensionHost-6a229c58-1db5-4e16-a511-a6d27afdfaff)...
2024-04-30 13:14:27.310 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:27.819 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:28.339 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:28.844 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:29.348 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:29.411 [info] [remote-connection][Management   ][643a5…][reconnect] resolving connection...
2024-04-30 13:14:29.412 [info] Invoking resolveAuthority(dev-container)...
2024-04-30 13:14:29.412 [info] [LocalProcess0][resolveAuthority(dev-container,23)][0ms] obtaining proxy...
2024-04-30 13:14:29.412 [info] [LocalProcess0][resolveAuthority(dev-container,23)][0ms] invoking...
2024-04-30 13:14:29.437 [trace] CommandService#executeCommand _setContext
2024-04-30 13:14:29.509 [info] [LocalProcess0][resolveAuthority(dev-container,23)][98ms] returned WebSocket(127.0.0.1:33853)
2024-04-30 13:14:29.509 [info] resolveAuthority(dev-container) returned 'WebSocket(127.0.0.1:33853)' after 98 ms
2024-04-30 13:14:29.509 [info] [remote-connection][Management   ][643a5…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:14:29.510 [trace] [remote-connection][Management   ][643a5…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:14:29.510 [info] Creating a socket (renderer-Management-643a5b2f-10d8-4577-893d-435691bcaec8)...
2024-04-30 13:14:29.845 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:30.361 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:30.820 [trace] writeTextAreaState(reason: focusgain)
2024-04-30 13:14:30.846 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:31.374 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:31.851 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:32.344 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:32.855 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:33.358 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:33.854 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:34.361 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:34.890 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:35.401 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:35.877 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:36.047 [info] [remote-connection][Management   ][643a5…][reconnect] received socket timeout event (unacknowledgedMsgCount: 5, timeSinceOldestUnacknowledgedMsg: 66367, timeSinceLastReceivedSomeData: 91291).
2024-04-30 13:14:36.377 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:36.900 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:37.401 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:37.516 [info] [remote-connection][ExtensionHost][6a229…][reconnect] received socket timeout event (unacknowledgedMsgCount: 484, timeSinceOldestUnacknowledgedMsg: 80005, timeSinceLastReceivedSomeData: 94362).
2024-04-30 13:14:37.904 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.369 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.879 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.908 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.927 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.943 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.959 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:38.977 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:50.156 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:50.328 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:50.480 [trace] writeTextAreaState(reason: selection changed)
2024-04-30 13:14:56.839 [error] [remote-connection][ExtensionHost][6a229…][reconnect][WebSocket(127.0.0.1:33853)] socketFactory.connect() failed or timed out. Error:
2024-04-30 13:14:56.864 [error] Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:56.864 [info] [remote-connection][ExtensionHost][6a229…][reconnect] A network error occurred while trying to reconnect, will try again...
2024-04-30 13:14:56.864 [trace] Time limit reached: Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:56.864 [info] [remote-connection][ExtensionHost][6a229…][reconnect] waiting for 10 seconds before reconnecting...
2024-04-30 13:14:57.516 [info] [remote-connection][ExtensionHost][6a229…][reconnect] received socket timeout event (unacknowledgedMsgCount: 560, timeSinceOldestUnacknowledgedMsg: 100005, timeSinceLastReceivedSomeData: 114362).
2024-04-30 13:14:59.511 [error] [remote-connection][Management   ][643a5…][reconnect][WebSocket(127.0.0.1:33853)] socketFactory.connect() failed or timed out. Error:
2024-04-30 13:14:59.511 [error] Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:59.511 [info] [remote-connection][Management   ][643a5…][reconnect] A network error occurred while trying to reconnect, will try again...
2024-04-30 13:14:59.512 [trace] Time limit reached: Error: Time limit reached
    at l.i (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6826)
    at l.h (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6808)
    at d.value (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6663)
    at n.y (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:659)
    at n.fire (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:876)
    at L.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8258)
    at I.cancel (vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:89:8668)
    at vscode-file://vscode-app/Applications/Visual%20Studio%20Code%20-%20Insiders.app/Contents/Resources/app/out/vs/workbench/workbench.desktop.main.js:689:6163
2024-04-30 13:14:59.512 [info] [remote-connection][Management   ][643a5…][reconnect] waiting for 10 seconds before reconnecting...
2024-04-30 13:15:00.129 [debug] Comments: URIs of continue on comments to add to storage .
2024-04-30 13:15:02.208 [trace] writeTextAreaState(reason: focusgain)
2024-04-30 13:15:06.866 [info] [remote-connection][ExtensionHost][6a229…][reconnect] resolving connection...
2024-04-30 13:15:06.867 [info] [remote-connection][ExtensionHost][6a229…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:15:06.867 [trace] [remote-connection][ExtensionHost][6a229…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:15:06.867 [info] Creating a socket (renderer-ExtensionHost-6a229c58-1db5-4e16-a511-a6d27afdfaff)...
2024-04-30 13:15:09.513 [info] [remote-connection][Management   ][643a5…][reconnect] resolving connection...
2024-04-30 13:15:09.513 [info] Invoking resolveAuthority(dev-container)...
2024-04-30 13:15:09.513 [info] [LocalProcess0][resolveAuthority(dev-container,24)][0ms] obtaining proxy...
2024-04-30 13:15:09.513 [info] [LocalProcess0][resolveAuthority(dev-container,24)][0ms] invoking...
2024-04-30 13:15:09.533 [trace] CommandService#executeCommand _setContext
2024-04-30 13:15:09.607 [info] [LocalProcess0][resolveAuthority(dev-container,24)][94ms] returned WebSocket(127.0.0.1:33853)
2024-04-30 13:15:09.607 [info] resolveAuthority(dev-container) returned 'WebSocket(127.0.0.1:33853)' after 94 ms
2024-04-30 13:15:09.607 [info] [remote-connection][Management   ][643a5…][reconnect] connecting to WebSocket(127.0.0.1:33853)...
2024-04-30 13:15:09.607 [trace] [remote-connection][Management   ][643a5…][reconnect][WebSocket(127.0.0.1:33853)] 1/6. invoking socketFactory.connect().
2024-04-30 13:15:09.607 [info] Creating a socket (renderer-Management-643a5b2f-10d8-4577-893d-435691bcaec8)...
2024-04-30 13:15:11.869 [trace] writeTextAreaState(reason: focusgain)
2024-04-30 13:15:17.516 [info] [remote-connection][ExtensionHost][6a229…][reconnect] received socket timeout event (unacknowledgedMsgCount: 606, timeSinceOldestUnacknowledgedMsg: 120005, timeSinceLastReceivedSomeData: 134362).

chrmarti avatar Apr 30 '24 11:04 chrmarti

I think the WebSocket might be using an old underlying connection (hence the missing connection attempt on the Dev Containers side) and because the doesn't do anything the WebSocket connection attempt eventually times out.

Part of the reason the old connection is still around might be that Dev Containers doesn't get the onExit, stdout.onEnd and stderr.onEnd promises resolved for the command in spawned using the old ExecServer for forwarding the connection.

When I terminate the leftover connection in Dev Containers during reconnection everything starts working. I can add that as a fix to Dev Containers, but would recommend looking into the above mentioned behavior:

  1. Remote Core should not reuse old connections when reconnecting the WebSocket.
  2. Commands spawned by with the ExecServer should get their onExit, stdout.onEnd and stderr.onEnd promises resolved also when the connection is lost and the old ExecServer needs to be replaced.

chrmarti avatar Apr 30 '24 14:04 chrmarti

Do you have useLocalServer on in your remote SSH settings (I think the default is true on macOS). If so this likely duplicates the existing https://github.com/microsoft/vscode-remote-release/issues/9602

connor4312 avatar Apr 30 '24 15:04 connor4312

Yes, useLocalServer is on.

chrmarti avatar Apr 30 '24 17:04 chrmarti

Thanks for your investigation, I'll continue to track that in the linked issue

connor4312 avatar Apr 30 '24 17:04 connor4312

Using this issue to track the changes in Dev Containers. Thanks.

chrmarti avatar Apr 30 '24 18:04 chrmarti

The mentioned improvement (terminating leftover connections during reconnection) is published with Dev Containers 0.364.0-pre-release. Could everyone seeing this issue give that a try and let us know if it fixes it? Thanks!

chrmarti avatar Apr 30 '24 20:04 chrmarti

It seems to be better with pre-release extension on our side now.

akosyakov avatar May 10 '24 12:05 akosyakov

Closing as fixed, thanks. If there are specific scenarios that still don't work, please open new issues.

Note that for the reconnection to work, the VS Code Server must keep running, so the session state is still available when the client reconnects. If the VS Code Server process had to restart, the session state is gone and reconnection will fail.

chrmarti avatar May 13 '24 07:05 chrmarti