Unable to attach to container on remote host over Remote-SSH

[tgrosinger]

• VSCode Version: 1.71.2
• Local OS Version: Windows 11 - 10.0.22000
• Remote OS Version: Ubuntu 18.04
• Remote Extension/Connection Type: SSH and Container

I am trying to open a workspace on remote machine in a container on the remote machine. I am attempting to follow these instructions which claim that Docker Desktop is not required on the local machine. However, when running "Remote-Containers: Reopen in Container" or "Attach Visual Studio Code" in the Docker extension I receive an error that Docker must be installed.

Steps to Reproduce:

1. Open VS Code locally on Windows without Docker Desktop installed.
2. Connect to remote workspace using Remote SSH extension. Key-based auth is being used.
3. Run "Remote-Containers: Reopen in Container"

Please let me know if I can provide additional details. If I understand correctly the instruction in that doc linked above is exactly what I am looking for, it just does not seem to behave as described. Thank you.