executorch icon indicating copy to clipboard operation
executorch copied to clipboard
verified publisher icon pytorch

./install_requirements.sh --pybind xnnpack Error

Open MisssssXie opened this issue 1 year ago β€’ 5 comments

πŸ› Describe the bug

I followed the steps from https://github.com/pytorch/executorch/blob/main/examples/models/llama2/README.md.

The installation steps are as follows:

git clone https://github.com/pytorch/executorch.git cd executorch git submodule sync git submodule update --init --recursive python3 -m venv .llama && source .llama/bin/activate pip install torch torchvision torchaudio ./install_requirements.sh --pybind xnnpack

Output:

File "/myPath/executorch/codegen/tools/gen_oplist.py", line 240, in gen_oplist
      assert os.path.isfile(
             ^^^^^^^^^^^^^^^
  AssertionError: The value for --ops_schema_yaml_path needs to be a valid file.
  make[3]: *** [kernels/portable/portable_ops_lib/selected_operators.yaml] Error 1
  make[2]: *** [kernels/portable/CMakeFiles/portable_ops_lib.dir/all] Error 2
  make[1]: *** [CMakeFiles/portable_lib.dir/rule] Error 2
  make: *** [portable_lib] Error 2
  error: command '/opt/anaconda3/bin/cmake' failed with exit code 2
  error: subprocess-exited-with-error
  
  Γ— Building wheel for executorch (pyproject.toml) did not run successfully.
  β”‚ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /opt/anaconda3/bin/python /opt/anaconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/tmpk2z94u0o
  cwd: /myPath/executorch
  Building wheel for executorch (pyproject.toml) ... error
  ERROR: Failed building wheel for executorch
Failed to build executorch
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (executorch)

env: M1 MacBook Pro MacOS: 14.5 python: 3.12 torch:2.4.0 cmake: 3.30.0

MisssssXie avatar Aug 09 '24 10:08 MisssssXie

Could you please paste full log?

You can check something like

  Command - /home/hsz/.conda/envs/executorch/bin/python;-m;codegen.tools.gen_oplist;--output_path=/home/hsz/e3/executorch/pip-out/temp.linux-x86_64-cpython-310/cmake-out/kernels/optimized/optimized_ops_lib/selected_operators.yaml;--ops_schema_yaml_path="/home/hsz/e3/executorch/kernels/optimized/optimized-oss.yaml"

I'm not sure why ops_schema_yaml_path is not valid

kirklandsign avatar Aug 09 '24 18:08 kirklandsign

cc @dbort

kirklandsign avatar Aug 09 '24 18:08 kirklandsign

I wonder if this might be an interaction between anaconda and the venv. The repro instructions set up a venv (python3 -m venv .llama && source .llama/bin/activate) but the logs show that it's running under an anaconda environment (/opt/anaconda3/bin/python etc.).

I don't know why that would be a problem here, but it could be a factor.

dbort avatar Aug 09 '24 19:08 dbort

I noticed an issue with /opt/anaconda3/bin/python, so I re-ran the command source .llama/bin/activate and then used ./install_requirements.sh --pybind xnnpack. but still error.

The full log is here:

Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/nightly/cpu
Requirement already satisfied: torch==2.5.0.dev20240716 in ./.llama/lib/python3.12/site-packages (2.5.0.dev20240716)
Requirement already satisfied: torchvision==0.20.0.dev20240716 in ./.llama/lib/python3.12/site-packages (0.20.0.dev20240716)
Requirement already satisfied: cmake in ./.llama/lib/python3.12/site-packages (3.30.2)
Requirement already satisfied: pip>=23 in ./.llama/lib/python3.12/site-packages (24.0)
Requirement already satisfied: pyyaml in ./.llama/lib/python3.12/site-packages (6.0.2)
Requirement already satisfied: setuptools>=63 in ./.llama/lib/python3.12/site-packages (72.1.0)
Requirement already satisfied: tomli in ./.llama/lib/python3.12/site-packages (2.0.1)
Requirement already satisfied: wheel in ./.llama/lib/python3.12/site-packages (0.44.0)
Requirement already satisfied: zstd in ./.llama/lib/python3.12/site-packages (1.5.5.1)
Requirement already satisfied: timm==1.0.7 in ./.llama/lib/python3.12/site-packages (1.0.7)
Requirement already satisfied: torchaudio==2.4.0.dev20240716 in ./.llama/lib/python3.12/site-packages (2.4.0.dev20240716)
Requirement already satisfied: torchsr==1.0.4 in ./.llama/lib/python3.12/site-packages (1.0.4)
Requirement already satisfied: transformers==4.42.4 in ./.llama/lib/python3.12/site-packages (4.42.4)
Requirement already satisfied: filelock in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (3.15.4)
Requirement already satisfied: typing-extensions>=4.8.0 in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (4.12.2)
Requirement already satisfied: sympy in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (1.13.1)
Requirement already satisfied: networkx in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (3.3)
Requirement already satisfied: jinja2 in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (3.1.4)
Requirement already satisfied: fsspec in ./.llama/lib/python3.12/site-packages (from torch==2.5.0.dev20240716) (2024.6.1)
Requirement already satisfied: numpy in ./.llama/lib/python3.12/site-packages (from torchvision==0.20.0.dev20240716) (1.26.4)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in ./.llama/lib/python3.12/site-packages (from torchvision==0.20.0.dev20240716) (10.4.0)
Requirement already satisfied: huggingface_hub in ./.llama/lib/python3.12/site-packages (from timm==1.0.7) (0.24.5)
Requirement already satisfied: safetensors in ./.llama/lib/python3.12/site-packages (from timm==1.0.7) (0.4.4)
Requirement already satisfied: packaging>=20.0 in ./.llama/lib/python3.12/site-packages (from transformers==4.42.4) (24.1)
Requirement already satisfied: regex!=2019.12.17 in ./.llama/lib/python3.12/site-packages (from transformers==4.42.4) (2024.7.24)
Requirement already satisfied: requests in ./.llama/lib/python3.12/site-packages (from transformers==4.42.4) (2.32.3)
Requirement already satisfied: tokenizers<0.20,>=0.19 in ./.llama/lib/python3.12/site-packages (from transformers==4.42.4) (0.19.1)
Requirement already satisfied: tqdm>=4.27 in ./.llama/lib/python3.12/site-packages (from transformers==4.42.4) (4.66.5)
Requirement already satisfied: MarkupSafe>=2.0 in ./.llama/lib/python3.12/site-packages (from jinja2->torch==2.5.0.dev20240716) (2.1.5)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.llama/lib/python3.12/site-packages (from requests->transformers==4.42.4) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in ./.llama/lib/python3.12/site-packages (from requests->transformers==4.42.4) (3.7)
Requirement already satisfied: urllib3<3,>=1.21.1 in ./.llama/lib/python3.12/site-packages (from requests->transformers==4.42.4) (2.2.2)
Requirement already satisfied: certifi>=2017.4.17 in ./.llama/lib/python3.12/site-packages (from requests->transformers==4.42.4) (2024.7.4)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./.llama/lib/python3.12/site-packages (from sympy->torch==2.5.0.dev20240716) (1.3.0)

[notice] A new release of pip is available: 24.0 -> 24.2
[notice] To update, run: pip install --upgrade pip
Using pip 24.0 from /myPath/executorch/.llama/lib/python3.12/site-packages/pip (python 3.12)
WARNING: The index url "" seems invalid, please provide a scheme.
Looking in indexes: https://pypi.org/simple, 
Processing /myPath/executorch
  Running command Preparing metadata (pyproject.toml)
  running dist_info
  creating /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info
  writing /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/PKG-INFO
  writing dependency_links to /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/dependency_links.txt
  writing entry points to /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/entry_points.txt
  writing requirements to /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/requires.txt
  writing top-level names to /private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/top_level.txt
  writing manifest file '/private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/SOURCES.txt'
  reading manifest file '/private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file '/private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch.egg-info/SOURCES.txt'
  creating '/private/var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/pip-modern-metadata-b8w3tiey/executorch-0.4.0a0+bf477e4.dist-info'
  Preparing metadata (pyproject.toml) ... done
WARNING: Location 'expecttest/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting expecttest (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for expecttest from https://files.pythonhosted.org/packages/73/a8/9427813686fe043eaf817b99444d4d321ce14f9434e3ffb6bbd1a182a8df/expecttest-0.2.1-py3-none-any.whl.metadata
  Using cached expecttest-0.2.1-py3-none-any.whl.metadata (2.5 kB)
WARNING: Location 'flatbuffers/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting flatbuffers (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for flatbuffers from https://files.pythonhosted.org/packages/41/f0/7e988a019bc54b2dbd0ad4182ef2d53488bb02e58694cd79d61369e85900/flatbuffers-24.3.25-py2.py3-none-any.whl.metadata
  Using cached flatbuffers-24.3.25-py2.py3-none-any.whl.metadata (850 bytes)
WARNING: Location 'hypothesis/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting hypothesis (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for hypothesis from https://files.pythonhosted.org/packages/0b/79/06dfd9c9413a19cc0a5a2828706a2629ed74506c29486b5ca456d4d96aff/hypothesis-6.110.1-py3-none-any.whl.metadata
  Downloading hypothesis-6.110.1-py3-none-any.whl.metadata (6.2 kB)
Requirement already satisfied: mpmath==1.3.0 in ./.llama/lib/python3.12/site-packages (from executorch==0.4.0a0+bf477e4) (1.3.0)
Requirement already satisfied: packaging in ./.llama/lib/python3.12/site-packages (from executorch==0.4.0a0+bf477e4) (24.1)
WARNING: Location 'parameterized/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting parameterized (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for parameterized from https://files.pythonhosted.org/packages/00/2f/804f58f0b856ab3bf21617cccf5b39206e6c4c94c2cd227bde125ea6105f/parameterized-0.9.0-py2.py3-none-any.whl.metadata
  Using cached parameterized-0.9.0-py2.py3-none-any.whl.metadata (18 kB)
WARNING: Location 'pytest/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting pytest (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for pytest from https://files.pythonhosted.org/packages/0f/f9/cf155cf32ca7d6fa3601bc4c5dd19086af4b320b706919d48a4c79081cf9/pytest-8.3.2-py3-none-any.whl.metadata
  Using cached pytest-8.3.2-py3-none-any.whl.metadata (7.5 kB)
WARNING: Location 'pytest-xdist/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting pytest-xdist (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for pytest-xdist from https://files.pythonhosted.org/packages/6d/82/1d96bf03ee4c0fdc3c0cbe61470070e659ca78dc0086fb88b66c185e2449/pytest_xdist-3.6.1-py3-none-any.whl.metadata
  Using cached pytest_xdist-3.6.1-py3-none-any.whl.metadata (4.3 kB)
Requirement already satisfied: pyyaml in ./.llama/lib/python3.12/site-packages (from executorch==0.4.0a0+bf477e4) (6.0.2)
WARNING: Location 'ruamel-yaml/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting ruamel.yaml (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for ruamel.yaml from https://files.pythonhosted.org/packages/73/67/8ece580cc363331d9a53055130f86b096bf16e38156e33b1d3014fffda6b/ruamel.yaml-0.18.6-py3-none-any.whl.metadata
  Using cached ruamel.yaml-0.18.6-py3-none-any.whl.metadata (23 kB)
Requirement already satisfied: sympy in ./.llama/lib/python3.12/site-packages (from executorch==0.4.0a0+bf477e4) (1.13.1)
WARNING: Location 'tabulate/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting tabulate (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for tabulate from https://files.pythonhosted.org/packages/40/44/4a5f08c96eb108af5cb50b41f76142f0afa346dfa99d5296fe7202a11854/tabulate-0.9.0-py3-none-any.whl.metadata
  Using cached tabulate-0.9.0-py3-none-any.whl.metadata (34 kB)
WARNING: Location 'pandas/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting pandas (from executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for pandas from https://files.pythonhosted.org/packages/db/7c/9a60add21b96140e22465d9adf09832feade45235cd22f4cb1668a25e443/pandas-2.2.2-cp312-cp312-macosx_11_0_arm64.whl.metadata
  Using cached pandas-2.2.2-cp312-cp312-macosx_11_0_arm64.whl.metadata (19 kB)
Requirement already satisfied: numpy in ./.llama/lib/python3.12/site-packages (from executorch==0.4.0a0+bf477e4) (1.26.4)
WARNING: Location 'attrs/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting attrs>=22.2.0 (from hypothesis->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for attrs>=22.2.0 from https://files.pythonhosted.org/packages/6a/21/5b6702a7f963e95456c0de2d495f67bf5fd62840ac655dc451586d23d39a/attrs-24.2.0-py3-none-any.whl.metadata
  Using cached attrs-24.2.0-py3-none-any.whl.metadata (11 kB)
WARNING: Location 'sortedcontainers/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting sortedcontainers<3.0.0,>=2.1.0 (from hypothesis->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for sortedcontainers<3.0.0,>=2.1.0 from https://files.pythonhosted.org/packages/32/46/9cb0e58b2deb7f82b84065f37f3bffeb12413f947f9388e4cac22c4621ce/sortedcontainers-2.4.0-py2.py3-none-any.whl.metadata
  Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl.metadata (10 kB)
WARNING: Location 'python-dateutil/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting python-dateutil>=2.8.2 (from pandas->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for python-dateutil>=2.8.2 from https://files.pythonhosted.org/packages/ec/57/56b9bcc3c9c6a792fcbaf139543cee77261f3651ca9da0c93f5c1221264b/python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
WARNING: Location 'pytz/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting pytz>=2020.1 (from pandas->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for pytz>=2020.1 from https://files.pythonhosted.org/packages/9c/3d/a121f284241f08268b21359bd425f7d4825cffc5ac5cd0e1b3d82ffd2b10/pytz-2024.1-py2.py3-none-any.whl.metadata
  Using cached pytz-2024.1-py2.py3-none-any.whl.metadata (22 kB)
WARNING: Location 'tzdata/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting tzdata>=2022.7 (from pandas->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for tzdata>=2022.7 from https://files.pythonhosted.org/packages/65/58/f9c9e6be752e9fcb8b6a0ee9fb87e6e7a1f6bcab2cdc73f02bb7ba91ada0/tzdata-2024.1-py2.py3-none-any.whl.metadata
  Using cached tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB)
WARNING: Location 'iniconfig/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting iniconfig (from pytest->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for iniconfig from https://files.pythonhosted.org/packages/ef/a6/62565a6e1cf69e10f5727360368e451d4b7f58beeac6173dc9db836a5b46/iniconfig-2.0.0-py3-none-any.whl.metadata
  Using cached iniconfig-2.0.0-py3-none-any.whl.metadata (2.6 kB)
WARNING: Location 'pluggy/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting pluggy<2,>=1.5 (from pytest->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for pluggy<2,>=1.5 from https://files.pythonhosted.org/packages/88/5f/e351af9a41f866ac3f1fac4ca0613908d9a41741cfcf2228f4ad853b697d/pluggy-1.5.0-py3-none-any.whl.metadata
  Using cached pluggy-1.5.0-py3-none-any.whl.metadata (4.8 kB)
WARNING: Location 'execnet/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting execnet>=2.1 (from pytest-xdist->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for execnet>=2.1 from https://files.pythonhosted.org/packages/43/09/2aea36ff60d16dd8879bdb2f5b3ee0ba8d08cbbdcdfe870e695ce3784385/execnet-2.1.1-py3-none-any.whl.metadata
  Using cached execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
WARNING: Location 'ruamel-yaml-clib/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting ruamel.yaml.clib>=0.2.7 (from ruamel.yaml->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for ruamel.yaml.clib>=0.2.7 from https://files.pythonhosted.org/packages/66/98/8de4f22bbfd9135deb3422e96d450c4bc0a57d38c25976119307d2efe0aa/ruamel.yaml.clib-0.2.8-cp312-cp312-macosx_13_0_arm64.whl.metadata
  Using cached ruamel.yaml.clib-0.2.8-cp312-cp312-macosx_13_0_arm64.whl.metadata (2.2 kB)
WARNING: Location 'six/' is ignored: it is either a non-existing path or lacks a specific scheme.
Collecting six>=1.5 (from python-dateutil>=2.8.2->pandas->executorch==0.4.0a0+bf477e4)
  Obtaining dependency information for six>=1.5 from https://files.pythonhosted.org/packages/d9/5a/e7c31adbe875f2abbb91bd84cf2dc52d792b5a01506781dbcf25c91daf11/six-1.16.0-py2.py3-none-any.whl.metadata
  Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Using cached expecttest-0.2.1-py3-none-any.whl (7.4 kB)
Using cached flatbuffers-24.3.25-py2.py3-none-any.whl (26 kB)
Downloading hypothesis-6.110.1-py3-none-any.whl (467 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 467.6/467.6 kB 1.2 MB/s eta 0:00:00
Using cached pandas-2.2.2-cp312-cp312-macosx_11_0_arm64.whl (11.3 MB)
Using cached parameterized-0.9.0-py2.py3-none-any.whl (20 kB)
Using cached pytest-8.3.2-py3-none-any.whl (341 kB)
Using cached pytest_xdist-3.6.1-py3-none-any.whl (46 kB)
Using cached ruamel.yaml-0.18.6-py3-none-any.whl (117 kB)
Using cached tabulate-0.9.0-py3-none-any.whl (35 kB)
Using cached attrs-24.2.0-py3-none-any.whl (63 kB)
Using cached execnet-2.1.1-py3-none-any.whl (40 kB)
Using cached pluggy-1.5.0-py3-none-any.whl (20 kB)
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)
Using cached ruamel.yaml.clib-0.2.8-cp312-cp312-macosx_13_0_arm64.whl (135 kB)
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB)
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Building wheels for collected packages: executorch
  Running command Building wheel for executorch (pyproject.toml)
  running bdist_wheel
  running build
  command options for 'CustomBuild':
    build_base = pip-out
    build_purelib = pip-out/lib
    build_platlib = pip-out/lib.macosx-11.1-arm64-cpython-312
    build_lib = pip-out/lib.macosx-11.1-arm64-cpython-312
    build_scripts = pip-out/scripts-3.12
    build_temp = pip-out/temp.macosx-11.1-arm64-cpython-312
    plat_name = macosx-11.1-arm64
    compiler = None
    parallel = 9
    debug = None
    force = None
    executable = /myPath/executorch/.llama/bin/python3
  deleting /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/CMakeCache.txt
  cmake -S "/myPath/executorch" -B "/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out" -DBUCK2= "-DPYTHON_EXECUTABLE=/myPath/executorch/.llama/bin/python3" "-DCMAKE_PREFIX_PATH=/myPath/executorch/.llama/lib/python3.12/site-packages" -DCMAKE_BUILD_TYPE=Release -DEXECUTORCH_ENABLE_LOGGING=ON -DEXECUTORCH_LOG_LEVEL=Info -DCMAKE_OSX_DEPLOYMENT_TARGET=10.15 -DEXECUTORCH_SEPARATE_FLATCC_HOST_PROJECT=OFF -DEXECUTORCH_BUILD_PYBIND=ON -DEXECUTORCH_BUILD_KERNELS_QUANTIZED=ON -DEXECUTORCH_BUILD_KERNELS_QUANTIZED_AOT=ON -DEXECUTORCH_BUILD_KERNELS_CUSTOM=ON -DEXECUTORCH_BUILD_KERNELS_CUSTOM_AOT=ON -DEXECUTORCH_BUILD_KERNELS_QUANTIZED=ON -DEXECUTORCH_BUILD_KERNELS_QUANTIZED_AOT=ON -DEXECUTORCH_BUILD_XNNPACK=ON
  -- The C compiler identification is AppleClang 15.0.0.15000309
  -- The CXX compiler identification is AppleClang 15.0.0.15000309
  -- Detecting C compiler ABI info
  -- Detecting C compiler ABI info - done
  -- Check for working C compiler: /Applications/Xcode-15.3.0.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc - skipped
  -- Detecting C compile features
  -- Detecting C compile features - done
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /Applications/Xcode-15.3.0.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Downloading FXdiv to /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FXdiv-source (define FXDIV_SOURCE_DIR to avoid it)
  -- Configuring done (0.0s)
  -- Generating done (0.0s)
  -- Build files have been written to: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FXdiv-download
  [ 11%] Creating directories for 'fxdiv'
  [ 22%] Performing download step (git clone) for 'fxdiv'
  ζ­£θ€‡θ£½εˆ° 'FXdiv-source'...
  已碓位於 β€œmaster”
  ζ‚¨ηš„εˆ†ζ”―θˆ‡δΈŠζΈΈεˆ†ζ”― 'origin/master' 一致。
  [ 33%] Performing update step for 'fxdiv'
  -- Fetching latest from the remote origin
  [ 44%] No patch step for 'fxdiv'
  [ 55%] No configure step for 'fxdiv'
  [ 66%] No build step for 'fxdiv'
  [ 77%] No install step for 'fxdiv'
  [ 88%] No test step for 'fxdiv'
  [100%] Completed 'fxdiv'
  [100%] Built target fxdiv
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
  -- Found Threads: TRUE
  -- Using python executable '/myPath/executorch/.llama/bin/python3'
  -- Resolved buck2 as /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/buck2-bin/buck2-99773fe6f7963a72ae5f7b737c02836e.
  -- Killing buck2 daemon
  -- executorch: Generating source lists
  -- executorch: Using source file list /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/executorch_srcs.cmake
  -- executorch: Using sources file /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/executorch_srcs.cmake
  -- Proceeding with version: 24.3.25.0
  -- Looking for strtof_l
  -- Looking for strtof_l - not found
  -- Looking for strtoull_l
  -- Looking for strtoull_l - not found
  -- Looking for realpath
  -- Looking for realpath - found
  -- CMAKE_CXX_FLAGS:
  -- executorch: Using PAL default 'posix'
  -- Generating operator lib:
  --   LIB_NAME: portable_ops_lib
  --   OPS_SCHEMA_YAML: /myPath/executorch/kernels/portable/functions.yaml
  --   ROOT_OPS:
  --   INCLUDE_ALL_OPS:
  Command - /myPath/executorch/.llama/bin/python3;-m;codegen.tools.gen_oplist;--output_path=/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/portable/portable_ops_lib/selected_operators.yaml;--ops_schema_yaml_path="/myPath/executorch/kernels/portable/functions.yaml"
  -- Generating kernel bindings:
  --   LIB_NAME: portable_ops_lib
  --   FUNCTIONS_YAML: /myPath/executorch/kernels/portable/functions.yaml
  --   CUSTOM_OPS_YAML:
  Generated files /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/portable/portable_ops_lib/RegisterCodegenUnboxedKernelsEverything.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/portable/portable_ops_lib/Functions.h;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/portable/portable_ops_lib/NativeFunctions.h
  -- Generating operator lib:
  --   LIB_NAME: portable_ops_lib
  --   KERNEL_LIBS: portable_kernels
  --   DEPS: executorch
  -- Generating operator lib:
  --   LIB_NAME: optimized_ops_lib
  --   OPS_SCHEMA_YAML: /myPath/executorch/kernels/optimized/optimized-oss.yaml
  --   ROOT_OPS:
  --   INCLUDE_ALL_OPS:
  Command - /myPath/executorch/.llama/bin/python3;-m;codegen.tools.gen_oplist;--output_path=/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/optimized/optimized_ops_lib/selected_operators.yaml;--ops_schema_yaml_path="/myPath/executorch/kernels/optimized/optimized-oss.yaml"
  -- Generating kernel bindings:
  --   LIB_NAME: optimized_ops_lib
  --   FUNCTIONS_YAML: /myPath/executorch/kernels/optimized/optimized-oss.yaml
  --   CUSTOM_OPS_YAML:
  Generated files /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/optimized/optimized_ops_lib/RegisterCodegenUnboxedKernelsEverything.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/optimized/optimized_ops_lib/Functions.h;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/optimized/optimized_ops_lib/NativeFunctions.h
  -- Generating operator lib:
  --   LIB_NAME: optimized_ops_lib
  --   KERNEL_LIBS: optimized_kernels
  --   DEPS: executorch
  -- Generating operator lib:
  --   LIB_NAME: quantized_ops_lib
  --   OPS_SCHEMA_YAML: /myPath/executorch/kernels/quantized/quantized.yaml
  --   ROOT_OPS:
  --   INCLUDE_ALL_OPS:
  Command - /myPath/executorch/.llama/bin/python3;-m;codegen.tools.gen_oplist;--output_path=/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/selected_operators.yaml;--ops_schema_yaml_path="/myPath/executorch/kernels/quantized/quantized.yaml"
  -- Generating kernel bindings:
  --   LIB_NAME: quantized_ops_lib
  --   FUNCTIONS_YAML:
  --   CUSTOM_OPS_YAML: /myPath/executorch/kernels/quantized/quantized.yaml
  Generated files /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/RegisterCodegenUnboxedKernelsEverything.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/Functions.h;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/NativeFunctions.h;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/RegisterCPUCustomOps.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/RegisterSchema.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_lib/CustomOpsNativeFunctions.h
  -- Generating operator lib:
  --   LIB_NAME: quantized_ops_aot_lib
  --   OPS_SCHEMA_YAML:
  --   ROOT_OPS: quantized_decomposed::add.out;quantized_decomposed::choose_qparams.Tensor_out;quantized_decomposed::dequantize_per_channel.out;quantized_decomposed::dequantize_per_tensor.out;quantized_decomposed::dequantize_per_tensor.Tensor_out;quantized_decomposed::mixed_linear.out;quantized_decomposed::mixed_mm.out;quantized_decomposed::quantize_per_channel.out;quantized_decomposed::quantize_per_tensor.out;quantized_decomposed::quantize_per_tensor.Tensor_out
  --   INCLUDE_ALL_OPS:
  Command - /myPath/executorch/.llama/bin/python3;-m;codegen.tools.gen_oplist;--output_path=/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/kernels/quantized/quantized_ops_aot_lib/selected_operators.yaml;--root_ops="quantized_decomposed::add.out;quantized_decomposed::choose_qparams.Tensor_out;quantized_decomposed::dequantize_per_channel.out;quantized_decomposed::dequantize_per_tensor.out;quantized_decomposed::dequantize_per_tensor.Tensor_out;quantized_decomposed::mixed_linear.out;quantized_decomposed::mixed_mm.out;quantized_decomposed::quantize_per_channel.out;quantized_decomposed::quantize_per_tensor.out;quantized_decomposed::quantize_per_tensor.Tensor_out"
  -- Generating kernel bindings:
  --   LIB_NAME: quantized_ops_aot_lib
  --   FUNCTIONS_YAML:
  --   CUSTOM_OPS_YAML: /myPath/executorch/kernels/quantized/quantized.yaml
  -- Generating custom ops aot lib:
  --   LIB_NAME: quantized_ops_aot_lib
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_add.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_choose_qparams.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_dequantize.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_embedding.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_embedding4b.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_mixed_linear.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_mixed_mm.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/quantized/cpu/op_quantize.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../kernels/portable/cpu/util/reduce_util.cpp
  --   KERNEL_SOURCE: /myPath/executorch/kernels/quantized/../../runtime/core/exec_aten/util/tensor_util_aten.cpp
  CMake Warning at .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
    static library kineto_LIBRARY-NOTFOUND not found.
  Call Stack (most recent call first):
    .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:120 (append_torchlib_if_found)
    build/Codegen.cmake:143 (find_package)
    kernels/quantized/CMakeLists.txt:87 (gen_custom_ops_aot_lib)


  -- Found Torch: /myPath/executorch/.llama/lib/python3.12/site-packages/torch/lib/libtorch.dylib
  -- Generating operator lib:
  --   LIB_NAME: quantized_ops_lib
  --   KERNEL_LIBS: quantized_kernels
  --   DEPS: executorch
  -- Merging kernel yaml files:
  --   FUNCTIONS_YAML: /myPath/executorch/configurations/../kernels/optimized/optimized-oss.yaml
  --   FALLBACK_YAML: /myPath/executorch/configurations/../kernels/portable/functions.yaml
  --   OUTPUT_DIR: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations
  -- Generating operator lib:
  --   LIB_NAME: optimized_native_cpu_ops_lib
  --   OPS_SCHEMA_YAML: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/merged.yaml
  --   ROOT_OPS:
  --   INCLUDE_ALL_OPS:
  Command - /myPath/executorch/.llama/bin/python3;-m;codegen.tools.gen_oplist;--output_path=/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/optimized_native_cpu_ops_lib/selected_operators.yaml;--ops_schema_yaml_path="/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/merged.yaml"
  -- Generating kernel bindings:
  --   LIB_NAME: optimized_native_cpu_ops_lib
  --   FUNCTIONS_YAML: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/merged.yaml
  --   CUSTOM_OPS_YAML:
  Generated files /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/optimized_native_cpu_ops_lib/RegisterCodegenUnboxedKernelsEverything.cpp;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/optimized_native_cpu_ops_lib/Functions.h;/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/configurations/optimized_native_cpu_ops_lib/NativeFunctions.h
  -- Generating operator lib:
  --   LIB_NAME: optimized_native_cpu_ops_lib
  --   KERNEL_LIBS: portable_kernels;optimized_kernels
  --   DEPS: executorch
  CMake Deprecation Warning at third-party/gflags/CMakeLists.txt:73 (cmake_minimum_required):
    Compatibility with CMake < 3.5 will be removed from a future version of
    CMake.

    Update the VERSION argument <min> value or use a ...<max> suffix to tell
    CMake that the project does not need compatibility with older versions.


  -- Looking for C++ include unistd.h
  -- Looking for C++ include unistd.h - found
  -- Looking for C++ include stdint.h
  -- Looking for C++ include stdint.h - found
  -- Looking for C++ include inttypes.h
  -- Looking for C++ include inttypes.h - found
  -- Looking for C++ include sys/types.h
  -- Looking for C++ include sys/types.h - found
  -- Looking for C++ include sys/stat.h
  -- Looking for C++ include sys/stat.h - found
  -- Looking for C++ include fnmatch.h
  -- Looking for C++ include fnmatch.h - found
  -- Looking for C++ include stddef.h
  -- Looking for C++ include stddef.h - found
  -- Check size of uint32_t
  -- Check size of uint32_t - done
  -- Looking for strtoll
  -- Looking for strtoll - found
  -- The ASM compiler identification is AppleClang
  -- Found assembler: /Applications/Xcode-15.3.0.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc
  -- Downloading FP16 to /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-source (define FP16_SOURCE_DIR to avoid it)
  -- Configuring done (0.0s)
  -- Generating done (0.0s)
  -- Build files have been written to: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-download
  [ 11%] Creating directories for 'fp16'
  [ 22%] Performing download step (download, verify and extract) for 'fp16'
  -- verifying file...
         file='/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-download/fp16-prefix/src/0a92994d729ff76a58f692d3028ca1b64b145d91.zip'
  -- File already exists and hash match (skip download):
    file='/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-download/fp16-prefix/src/0a92994d729ff76a58f692d3028ca1b64b145d91.zip'
    SHA256='e66e65515fa09927b348d3d584c68be4215cfe664100d01c9dbc7655a5716d70'
  -- extracting...
       src='/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-download/fp16-prefix/src/0a92994d729ff76a58f692d3028ca1b64b145d91.zip'
       dst='/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-source'
  -- extracting... [tar xfz]
  -- extracting... [analysis]
  -- extracting... [rename]
  -- extracting... [clean up]
  -- extracting... done
  [ 33%] No update step for 'fp16'
  [ 44%] No patch step for 'fp16'
  [ 55%] No configure step for 'fp16'
  [ 66%] No build step for 'fp16'
  [ 77%] No install step for 'fp16'
  [ 88%] No test step for 'fp16'
  [100%] Completed 'fp16'
  [100%] Built target fp16
  CMake Deprecation Warning at pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/FP16-source/CMakeLists.txt:1 (CMAKE_MINIMUM_REQUIRED):
    Compatibility with CMake < 3.5 will be removed from a future version of
    CMake.

    Update the VERSION argument <min> value or use a ...<max> suffix to tell
    CMake that the project does not need compatibility with older versions.


  -- Downloading PSimd to /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/psimd-source (define PSIMD_SOURCE_DIR to avoid it)
  CMake Deprecation Warning at CMakeLists.txt:1 (CMAKE_MINIMUM_REQUIRED):
    Compatibility with CMake < 3.5 will be removed from a future version of
    CMake.

    Update the VERSION argument <min> value or use a ...<max> suffix to tell
    CMake that the project does not need compatibility with older versions.


  -- Configuring done (0.0s)
  -- Generating done (0.0s)
  -- Build files have been written to: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/psimd-download
  [ 11%] Creating directories for 'psimd'
  [ 22%] Performing download step (git clone) for 'psimd'
  ζ­£θ€‡θ£½εˆ° 'psimd-source'...
  已碓位於 β€œmaster”
  ζ‚¨ηš„εˆ†ζ”―θˆ‡δΈŠζΈΈεˆ†ζ”― 'origin/master' 一致。
  [ 33%] Performing update step for 'psimd'
  -- Fetching latest from the remote origin
  [ 44%] No patch step for 'psimd'
  [ 55%] No configure step for 'psimd'
  [ 66%] No build step for 'psimd'
  [ 77%] No install step for 'psimd'
  [ 88%] No test step for 'psimd'
  [100%] Completed 'psimd'
  [100%] Built target psimd
  CMake Deprecation Warning at pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/psimd-source/CMakeLists.txt:1 (CMAKE_MINIMUM_REQUIRED):
    Compatibility with CMake < 3.5 will be removed from a future version of
    CMake.

    Update the VERSION argument <min> value or use a ...<max> suffix to tell
    CMake that the project does not need compatibility with older versions.


  -- pybind11 v2.12.0 dev1
  CMake Warning (dev) at third-party/pybind11/tools/FindPythonLibsNew.cmake:98 (find_package):
    Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules
    are removed.  Run "cmake --help-policy CMP0148" for policy details.  Use
    the cmake_policy command to set the policy and suppress this warning.

  Call Stack (most recent call first):
    third-party/pybind11/tools/pybind11Tools.cmake:50 (find_package)
    third-party/pybind11/tools/pybind11Common.cmake:188 (include)
    third-party/pybind11/CMakeLists.txt:211 (include)
  This warning is for project developers.  Use -Wno-dev to suppress it.

  -- Found PythonInterp: /myPath/executorch/.llama/bin/python3 (found suitable version "3.12.4", minimum required is "3.6")
  -- Found PythonLibs: /opt/anaconda3/lib/libpython3.12.dylib
  -- Performing Test HAS_FLTO
  -- Performing Test HAS_FLTO - Success
  -- Performing Test HAS_FLTO_THIN
  -- Performing Test HAS_FLTO_THIN - Success
  CMake Deprecation Warning at third-party/flatcc/CMakeLists.txt:2 (cmake_minimum_required):
    Compatibility with CMake < 3.5 will be removed from a future version of
    CMake.

    Update the VERSION argument <min> value or use a ...<max> suffix to tell
    CMake that the project does not need compatibility with older versions.


  -- dist install dir /myPath/executorch/third-party/flatcc
  -- lib install dir /myPath/executorch/third-party/flatcc/lib
  -- Setting Clang compiler options
  -- Configured C_FLAGS:  -DFLATCC_REFLECTION=0 -Wstrict-prototypes -Wsign-conversion -Wconversion -std=c11 -pedantic -Wall -Wextra -Werror
  CMake Warning at .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
    static library kineto_LIBRARY-NOTFOUND not found.
  Call Stack (most recent call first):
    .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:120 (append_torchlib_if_found)
    CMakeLists.txt:671 (find_package)


  -- executorch: Using source file list /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/extension/llm/custom_ops/../../../executorch_srcs.cmake
  CMake Warning at .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
    static library kineto_LIBRARY-NOTFOUND not found.
  Call Stack (most recent call first):
    .llama/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:120 (append_torchlib_if_found)
    extension/llm/custom_ops/CMakeLists.txt:81 (find_package)


  --
  -- ******** Summary ********
  --   CMAKE_BUILD_TYPE              : Release
  --   CMAKE_CXX_STANDARD            : 17
  --   CMAKE_CXX_COMPILER_ID         : AppleClang
  --   CMAKE_TOOLCHAIN_FILE          :
  --   BUCK2                         : /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out/buck2-bin/buck2-99773fe6f7963a72ae5f7b737c02836e
  --   PYTHON_EXECUTABLE             : /myPath/executorch/.llama/bin/python3
  --   FLATC_EXECUTABLE              : flatc
  --   EXECUTORCH_ENABLE_LOGGING              : ON
  --   EXECUTORCH_ENABLE_PROGRAM_VERIFICATION : OFF
  --   EXECUTORCH_LOG_LEVEL                   : Info
  --   EXECUTORCH_BUILD_ANDROID_JNI           : OFF
  --   EXECUTORCH_BUILD_ARM_BAREMETAL         : OFF
  --   EXECUTORCH_BUILD_COREML                : OFF
  --   EXECUTORCH_BUILD_KERNELS_CUSTOM        : ON
  --   EXECUTORCH_BUILD_EXECUTOR_RUNNER       : ON
  --   EXECUTORCH_BUILD_EXTENSION_DATA_LOADER : OFF
  --   EXECUTORCH_BUILD_EXTENSION_MODULE      : OFF
  --   EXECUTORCH_BUILD_EXTENSION_RUNNER_UTIL : OFF
  --   EXECUTORCH_BUILD_FLATC                 : ON
  --   EXECUTORCH_BUILD_GFLAGS                : ON
  --   EXECUTORCH_BUILD_GTESTS                : OFF
  --   EXECUTORCH_BUILD_HOST_TARGETS          : ON
  --   EXECUTORCH_BUILD_MPS                   : OFF
  --   EXECUTORCH_BUILD_PYBIND                : ON
  --   EXECUTORCH_BUILD_QNN                   : OFF
  --   EXECUTORCH_BUILD_KERNELS_OPTIMIZED     : ON
  --   EXECUTORCH_BUILD_KERNELS_QUANTIZED     : ON
  --   EXECUTORCH_BUILD_SDK                   : OFF
  --   EXECUTORCH_BUILD_SIZE_TEST             : OFF
  --   EXECUTORCH_BUILD_XNNPACK               : ON
  --   EXECUTORCH_BUILD_VULKAN                : OFF
  --   EXECUTORCH_BUILD_PTHREADPOOL           : ON
  --   EXECUTORCH_BUILD_CPUINFO               : ON
  -- Configuring done (13.8s)
  -- Generating done (1.6s)
  -- Build files have been written to: /myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out
  cmake --build "/myPath/executorch/pip-out/temp.macosx-11.1-arm64-cpython-312/cmake-out" -j9 --target flatc --target portable_lib --target custom_ops_aot_lib --target quantized_ops_aot_lib
  [  0%] Linking CXX executable flatc
  [100%] Built target flatc
  [  0%] Built target microkernel-utils
  [  0%] Building C object backends/xnnpack/third-party/pthreadpool/CMakeFiles/pthreadpool.dir/src/legacy-api.c.o
  [  0%] Building C object backends/xnnpack/third-party/pthreadpool/CMakeFiles/pthreadpool.dir/src/portable-api.c.o
  [  0%] Building C object backends/xnnpack/third-party/pthreadpool/CMakeFiles/pthreadpool.dir/src/pthreads.c.o
  [  0%] Building C object backends/xnnpack/third-party/pthreadpool/CMakeFiles/pthreadpool.dir/src/memory.c.o
  [  0%] Linking C static library "/myPath/executorch/third-party/flatcc/lib/libflatccrt.a"
  [  0%] Linking C static library libcpuinfo.a
  [  0%] Linking C static library "/myPath/executorch/third-party/flatcc/lib/libflatcc.a"
  [  0%] Built target flatccrt
  [  6%] Built target cpuinfo
  [ 13%] Built target flatcc
  [ 20%] Built target flatc
  [ 20%] Linking C executable "/myPath/executorch/third-party/flatcc/bin/flatcc"
  [ 20%] Generating common_schema headers
  [ 20%] Generating bundled_program headers
  [ 26%] Built target xnnpack_schema
  [ 26%] Built target flatcc_cli
  [ 26%] Generating etdump headers
  [ 26%] Built target common_schema
  [ 26%] Built target bundled_program_schema
  [ 26%] Generating program_schema headers
  [ 26%] Built target program_schema
  [ 26%] Linking C static library libpthreadpool.a
  [ 26%] Built target pthreadpool
  [ 26%] Built target allocator
  [ 26%] Built target normalization
  [ 26%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/indirection.dir/src/indirection.c.o
  [ 26%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/microparams-init.dir/src/microparams-init.c.o
  [ 26%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/packing.dir/src/packing.c.o
  [ 26%] Built target logging
  [ 26%] Built target hardware-config
  [ 26%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/microkernels-prod.dir/src/amalgam/gen/scalar.c.o
  [ 26%] Built target post-operation
  [ 26%] Building CXX object CMakeFiles/executorch_no_prim_ops.dir/runtime/executor/method.cpp.o
  [ 26%] Built target mutex
  [ 26%] Built target memory
  [ 26%] Built target etdump_schema
  [ 26%] Built target operator-utils
  [ 26%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operator-run.dir/src/operator-run.c.o
  [ 26%] Building CXX object CMakeFiles/executorch_no_prim_ops.dir/runtime/executor/method_meta.cpp.o
  [ 26%] Built target microparams-init
  [ 26%] Building CXX object CMakeFiles/executorch_no_prim_ops.dir/runtime/executor/program.cpp.o
  [ 26%] Built target cache
  [ 26%] Building CXX object CMakeFiles/executorch_no_prim_ops.dir/runtime/executor/tensor_parser_exec_aten.cpp.o
  [ 26%] Built target indirection
  [ 26%] Building CXX object CMakeFiles/executorch_no_prim_ops.dir/runtime/executor/tensor_parser_portable.cpp.o
  [ 33%] Built target jit
  [ 33%] Built target operator-run
  [ 33%] Built target packing
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/average-pooling-nhwc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/fully-connected-nc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/dynamic-fully-connected-nc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/convolution-nhwc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/deconvolution-nhwc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/binary-elementwise-nd.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/convolution-nchw.c.o
  [ 33%] Linking CXX static library libexecutorch_no_prim_ops.a
  [ 33%] Built target executorch_no_prim_ops
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/global-average-pooling-ncw.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/global-average-pooling-nwc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/max-pooling-nhwc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/reduce-nd.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/scaled-dot-product-attention-nhtc.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/softmax-nc.c.o
  [ 33%] Linking CXX static library libexecutorch.a
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/operators.dir/src/operators/unary-elementwise-nc.c.o
  [ 33%] Built target executorch
  [ 33%] Linking CXX static library libextension_data_loader.a
  [ 33%] Building CXX object sdk/CMakeFiles/bundled_program.dir/bundled_program/bundled_program.cpp.o
  [ 33%] Building CXX object sdk/CMakeFiles/etdump.dir/etdump/etdump_flatcc.cpp.o
  [ 33%] Building CXX object CMakeFiles/util.dir/extension/evalue_util/print_evalue.cpp.o
  [ 33%] Built target extension_data_loader
  [ 33%] Built target operators
  [ 33%] Building CXX object CMakeFiles/util.dir/util/read_file.cpp.o
  [ 33%] Building CXX object CMakeFiles/util.dir/extension/aten_util/aten_bridge.cpp.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/subgraph.dir/src/subgraph/static-constant-pad.c.o
  [ 33%] Building C object backends/xnnpack/third-party/XNNPACK/CMakeFiles/subgraph.dir/src/subgraph.c.o
  [ 40%] Built target subgraph
  [ 40%] Linking CXX static library libbundled_program.a
  [ 40%] Linking CXX static library libetdump.a
  [ 40%] Built target bundled_program
  [ 40%] Built target etdump
  [ 40%] Linking CXX static library libportable_kernels.a
  [ 60%] Built target portable_kernels
  [ 60%] Generating selected_operators.yaml for portable_ops_lib
  Traceback (most recent call last):
    File "<frozen runpy>", line 198, in _run_module_as_main
    File "<frozen runpy>", line 88, in _run_code
    File "/myPath/executorch/codegen/tools/gen_oplist.py", line 314, in <module>
      main(sys.argv[1:])
    File "/myPath/executorch/codegen/tools/gen_oplist.py", line 303, in main
      gen_oplist(
    File "/myPath/executorch/codegen/tools/gen_oplist.py", line 240, in gen_oplist
      assert os.path.isfile(
             ^^^^^^^^^^^^^^^
  AssertionError: The value for --ops_schema_yaml_path needs to be a valid file.
  make[3]: *** [kernels/portable/portable_ops_lib/selected_operators.yaml] Error 1
  make[2]: *** [kernels/portable/CMakeFiles/portable_ops_lib.dir/all] Error 2
  make[2]: *** Waiting for unfinished jobs....
  [100%] Built target microkernels-prod
  [100%] Linking CXX static library libutil.a
  [100%] Built target util
  make[1]: *** [CMakeFiles/portable_lib.dir/rule] Error 2
  make: *** [portable_lib] Error 2
  error: command '/myPath/executorch/.llama/bin/cmake' failed with exit code 2
  error: subprocess-exited-with-error
  
  Γ— Building wheel for executorch (pyproject.toml) did not run successfully.
  β”‚ exit code: 1
  ╰─> See above for output.
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: '/myPath/executorch/.llama/bin/python3' '/myPath/executorch/.llama/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py' build_wheel /var/folders/_x/ygx005857cs139l0ymy429rh0000gq/T/tmpg1h9gh4b
  cwd: /myPath/executorch
  Building wheel for executorch (pyproject.toml) ... error
  ERROR: Failed building wheel for executorch
Failed to build executorch
ERROR: Could not build wheels for executorch, which is required to install pyproject.toml-based projects

[notice] A new release of pip is available: 24.0 -> 24.2
[notice] To update, run: pip install --upgrade pip

MisssssXie avatar Aug 10 '24 01:08 MisssssXie

I completely reinstalled everything and tried switching to the command ./install_requirements.sh --pybind mps, but it still failed.

MisssssXie avatar Aug 12 '24 02:08 MisssssXie

Thanks for adding the details, and reproducing it in a clean environment. Seems like it may be related to the cmake codegen rules. @larryliu0820

dbort avatar Aug 19 '24 21:08 dbort

Hi, is there a solution for the follow-up?

MisssssXie avatar Aug 28 '24 23:08 MisssssXie

Hi @MisssssXie, sorry for the delay. We're super swamped preparing for the PyTorch conference, and it's taking longer than we'd like to get back to these issues.

dbort avatar Aug 28 '24 23:08 dbort

hi, are you empolying the llm into the arm devices? I also met the problem.

yoookoso avatar Aug 30 '24 13:08 yoookoso

Hi @MisssssXie @udrs it seems the error happens in these two lines: https://github.com/pytorch/executorch/blob/main/kernels/portable/CMakeLists.txt#L42-L47

The gen_selected_ops supposed to generate a selected_operators.yaml from the functions.yaml under kernels/portable, but it seems the path to functions.yaml is invalid.

I noticed this line above:

set(_yaml "${CMAKE_CURRENT_LIST_DIR}/functions.yaml")

I'm suspecting CMAKE_CURRENT_LIST_DIR doesn't work in your build environment and we probably should use CMAKE_CURRENT_SOURCE_DIR instead.

In https://github.com/pytorch/executorch/pull/5005 I'm going to change that and add more logging.

larryliu0820 avatar Aug 30 '24 17:08 larryliu0820

Hi @MisssssXie @udrs #5005 is merged can you please checkout main and see if your issue is still there?

larryliu0820 avatar Sep 01 '24 17:09 larryliu0820

Awesome! The code is running. Thank you all, and have a wonderful day!

MisssssXie avatar Sep 03 '24 00:09 MisssssXie