sys.path is incorrect on W10 store installations

[Trolldemorted]

Issue

Virtualenv folders are not added to sys.path in activate.bat (and activate.ps1):

C:\Users\Benni>.venv\Scripts\activate.bat

(.venv) C:\Users\Benni>python3
Python 3.10.2 (tags/v3.10.2:a58ebcc, Jan 17 2022, 14:12:15) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.path
['', 'C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\python310.zip', 'C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\DLLs', 'C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\lib', 'C:\\Users\\Benni\\AppData\\Local\\Microsoft\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0', 'C:\\Users\\Benni\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python310\\site-packages', 'C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0', 'C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\lib\\site-packages']

As you can see, a path to the venv's /lib/python3.8/site-packages was not added. pip3 manages to install packages into it, but python3 can't import them. Am I missing something obvious?

Environment

Provide at least:

• OS: W10 21H1
• pip list of the host python where virtualenv is installed:

C:\Users\Benni>pip3 list
Package      Version
------------ -------
distlib      0.3.4
filelock     3.4.2
platformdirs 2.4.1
six          1.16.0
virtualenv   20.13.0

Output of the virtual environment creation

Make sure to run the creation with -vvv --with-traceback:

C:\Users\Benni>python3 -m virtualenv .venv -vvv --with-traceback
119 setup logging to NOTSET [DEBUG report:39]
124 find interpreter for spec PythonSpec(path=C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\python.exe) [INFO builtin:62]
125 proposed PythonInfo(spec=CPython3.10.2.final.0-64, exe=C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\python.exe, platform=win32, version='3.10.2 (tags/v3.10.2:a58ebcc, Jan 17 2022, 14:12:15) [MSC v.1929 64 bit (AMD64)]', encoding_fs_io=utf-8-utf-8) [INFO builtin:69]
125 accepted PythonInfo(spec=CPython3.10.2.final.0-64, exe=C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\python.exe, platform=win32, version='3.10.2 (tags/v3.10.2:a58ebcc, Jan 17 2022, 14:12:15) [MSC v.1929 64 bit (AMD64)]', encoding_fs_io=utf-8-utf-8) [DEBUG builtin:71]
128 symlink on filesystem does work [DEBUG info:48]
128 filesystem is not case-sensitive [DEBUG info:29]
177 create virtual environment via Venv(dest=C:\Users\Benni\.venv, clear=False, no_vcs_ignore=False, global=False, describe=CPython3Windows) [INFO session:52]
185 create virtualenv import hook file C:\Users\Benni\.venv\Lib\site-packages\_virtualenv.pth [DEBUG api:95]
185 create C:\Users\Benni\.venv\Lib\site-packages\_virtualenv.py [DEBUG api:98]
187 ============================== target debug ============================== [DEBUG session:54]
188 debug via 'C:\Users\Benni\.venv\Scripts\python.exe' 'C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\virtualenv\create\debug.py' [DEBUG creator:224]
188 {
  "sys": {
    "executable": "C:\\Users\\Benni\\.venv\\Scripts\\python.exe",
    "_base_executable": "C:\\Users\\Benni\\AppData\\Local\\Microsoft\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\\python.exe",
    "prefix": "C:\\Users\\Benni\\.venv",
    "base_prefix": "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0",
    "real_prefix": null,
    "exec_prefix": "C:\\Users\\Benni\\.venv",
    "base_exec_prefix": "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0",
    "path": [
      "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\python310.zip",
      "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\DLLs",
      "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\lib",
      "C:\\Users\\Benni\\AppData\\Local\\Microsoft\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0",
      "C:\\Users\\Benni\\.venv",
      "C:\\Users\\Benni\\.venv\\lib\\site-packages"
    ],
    "meta_path": [
      "<class '_virtualenv._Finder'>",
      "<class '_frozen_importlib.BuiltinImporter'>",
      "<class '_frozen_importlib.FrozenImporter'>",
      "<class '_frozen_importlib_external.PathFinder'>"
    ],
    "fs_encoding": "utf-8",
    "io_encoding": "cp1252"
  },
  "version": "3.10.2 (tags/v3.10.2:a58ebcc, Jan 17 2022, 14:12:15) [MSC v.1929 64 bit (AMD64)]",
  "makefile_filename": "C:\\Program Files\\WindowsApps\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\Lib\\config\\Makefile",
  "os": "<module 'os' from 'C:\\\\Program Files\\\\WindowsApps\\\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\\\lib\\\\os.py'>",
  "site": "<module 'site' from 'C:\\\\Program Files\\\\WindowsApps\\\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\\\lib\\\\site.py'>",
  "datetime": "<module 'datetime' from 'C:\\\\Program Files\\\\WindowsApps\\\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\\\lib\\\\datetime.py'>",
  "math": "<module 'math' (built-in)>",
  "json": "<module 'json' from 'C:\\\\Program Files\\\\WindowsApps\\\\PythonSoftwareFoundation.Python.3.10_3.10.752.0_x64__qbz5n2kfra8p0\\\\lib\\\\json\\\\__init__.py'>"
} [DEBUG session:55]
346 add seed packages via FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv) [INFO session:59]
352 got embed update of distribution pip from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\pip.json [DEBUG via_disk_folder:135]
355 got embed update of distribution pip from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\pip.json [DEBUG via_disk_folder:135]
356 got embed update of distribution setuptools from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\setuptools.json [DEBUG via_disk_folder:135]
357 got embed update of distribution wheel from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\wheel.json [DEBUG via_disk_folder:135]
359 got embed update of distribution setuptools from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\setuptools.json [DEBUG via_disk_folder:135]
360 got embed update of distribution wheel from C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\embed\3\wheel.json [DEBUG via_disk_folder:135]
360 install pip from wheel C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\virtualenv\seed\wheels\embed\pip-21.3.1-py3-none-any.whl via CopyPipInstall [DEBUG via_app_data:49]
361 install setuptools from wheel C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\virtualenv\seed\wheels\embed\setuptools-60.2.0-py3-none-any.whl via CopyPipInstall [DEBUG via_app_data:49]
361 Attempting to acquire lock 2874775016864 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any.lock [DEBUG _api:168]
361 install wheel from wheel C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\virtualenv\seed\wheels\embed\wheel-0.37.1-py2.py3-none-any.whl via CopyPipInstall [DEBUG via_app_data:49]
362 Attempting to acquire lock 2874775017584 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any.lock [DEBUG _api:168]
362 Lock 2874775016864 acquired on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any.lock [DEBUG _api:172]
363 Attempting to acquire lock 2874775017824 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any.lock [DEBUG _api:168]
363 Lock 2874775017584 acquired on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any.lock [DEBUG _api:172]
363 Attempting to release lock 2874775016864 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any.lock [DEBUG _api:202]
363 Lock 2874775017824 acquired on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any.lock [DEBUG _api:172]
364 Attempting to release lock 2874775017584 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any.lock [DEBUG _api:202]
364 Lock 2874775016864 released on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any.lock [DEBUG _api:205]
365 Attempting to release lock 2874775017824 on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any.lock [DEBUG _api:202]
365 Lock 2874775017584 released on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any.lock [DEBUG _api:205]
366 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any\pip to C:\Users\Benni\.venv\Lib\site-packages\pip [DEBUG _sync:51]
366 Lock 2874775017824 released on C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any.lock [DEBUG _api:205]
367 copy C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\distutils-precedence.pth to C:\Users\Benni\.venv\Lib\site-packages\distutils-precedence.pth [DEBUG _sync:51]
367 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any\wheel to C:\Users\Benni\.venv\Lib\site-packages\wheel [DEBUG _sync:51]
368 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\pkg_resources to C:\Users\Benni\.venv\Lib\site-packages\pkg_resources [DEBUG _sync:51]
386 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any\wheel-0.37.1.dist-info to C:\Users\Benni\.venv\Lib\site-packages\wheel-0.37.1.dist-info [DEBUG _sync:51]
392 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\setuptools to C:\Users\Benni\.venv\Lib\site-packages\setuptools [DEBUG _sync:51]
394 copy C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\wheel-0.37.1-py2.py3-none-any\wheel-0.37.1.virtualenv to C:\Users\Benni\.venv\Lib\site-packages\wheel-0.37.1.virtualenv [DEBUG _sync:51]
399 generated console scripts wheel3.exe wheel-3.10.exe wheel.exe wheel3.10.exe [DEBUG base:45]
514 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\setuptools-60.2.0.dist-info to C:\Users\Benni\.venv\Lib\site-packages\setuptools-60.2.0.dist-info [DEBUG _sync:51]
521 copy C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\setuptools-60.2.0.virtualenv to C:\Users\Benni\.venv\Lib\site-packages\setuptools-60.2.0.virtualenv [DEBUG _sync:51]
523 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\setuptools-60.2.0-py3-none-any\_distutils_hack to C:\Users\Benni\.venv\Lib\site-packages\_distutils_hack [DEBUG _sync:51]
526 generated console scripts  [DEBUG base:45]
712 copy directory C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any\pip-21.3.1.dist-info to C:\Users\Benni\.venv\Lib\site-packages\pip-21.3.1.dist-info [DEBUG _sync:51]
717 copy C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv\wheel\3.10\image\1\CopyPipInstall\pip-21.3.1-py3-none-any\pip-21.3.1.virtualenv to C:\Users\Benni\.venv\Lib\site-packages\pip-21.3.1.virtualenv [DEBUG _sync:51]
722 generated console scripts pip3.10.exe pip.exe pip3.exe pip-3.10.exe [DEBUG base:45]
722 add activators for Bash, Batch, Fish, Nushell, PowerShell, Python [INFO session:64]
728 write C:\Users\Benni\.venv\pyvenv.cfg [DEBUG pyenv_cfg:34]
728     home = C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0 [DEBUG pyenv_cfg:38]
728     implementation = CPython [DEBUG pyenv_cfg:38]
729     version_info = 3.10.2.final.0 [DEBUG pyenv_cfg:38]
729     virtualenv = 20.13.0 [DEBUG pyenv_cfg:38]
729     include-system-site-packages = false [DEBUG pyenv_cfg:38]
729     version = 3.10.2 [DEBUG pyenv_cfg:38]
730 created virtual environment CPython3.10.2.final.0-64 in 612ms
  creator Venv(dest=C:\Users\Benni\.venv, clear=False, no_vcs_ignore=False, global=False, describe=CPython3Windows)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\Benni\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\Local\pypa\virtualenv)
    added seed packages: pip==21.3.1, setuptools==60.2.0, wheel==0.37.1
  activators BashActivator,BatchActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator [WARNING __main__:19]

[OmerFI]

Could you share the activate.bat file?

[Trolldemorted]

@echo off

rem This file is UTF-8 encoded, so we need to update the current code page while executing it
for /f "tokens=2 delims=:." %%a in ('"%SystemRoot%\System32\chcp.com"') do (
    set _OLD_CODEPAGE=%%a
)
if defined _OLD_CODEPAGE (
    "%SystemRoot%\System32\chcp.com" 65001 > nul
)

set VIRTUAL_ENV=C:\Users\Benni\test2\.venv

if not defined PROMPT set PROMPT=$P$G

if defined _OLD_VIRTUAL_PROMPT set PROMPT=%_OLD_VIRTUAL_PROMPT%
if defined _OLD_VIRTUAL_PYTHONHOME set PYTHONHOME=%_OLD_VIRTUAL_PYTHONHOME%

set _OLD_VIRTUAL_PROMPT=%PROMPT%
set PROMPT=(.venv) %PROMPT%

if defined PYTHONHOME set _OLD_VIRTUAL_PYTHONHOME=%PYTHONHOME%
set PYTHONHOME=

if defined _OLD_VIRTUAL_PATH set PATH=%_OLD_VIRTUAL_PATH%
if not defined _OLD_VIRTUAL_PATH set _OLD_VIRTUAL_PATH=%PATH%

set PATH=%VIRTUAL_ENV%\Scripts;%PATH%
set VIRTUAL_ENV_PROMPT=(.venv) 

:END
if defined _OLD_CODEPAGE (
    "%SystemRoot%\System32\chcp.com" %_OLD_CODEPAGE% > nul
    set _OLD_CODEPAGE=
)

In the meanwhile I have narrowed down the issue: The venv only adds a new python.exe to the path, but not a python3.exe:

C:\Users\Benni\test2>.venv\Scripts\activate.bat

(.venv) C:\Users\Benni\test2>where python
C:\Users\Benni\test2\.venv\Scripts\python.exe
C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\python.exe

(.venv) C:\Users\Benni\test2>where python3
C:\Users\Benni\AppData\Local\Microsoft\WindowsApps\python3.exe

So if you type python3 it'll be the default interpreter, and not the one in the venv.

[gaborbernat]

Perhaps this is no longer valid.

[Trolldemorted]

which version of what should have fixed this?

[gaborbernat]

Did someone test with latest and see if still issue? Perhaps was upstream issue.