torchchat
torchchat copied to clipboard
pytorch
`scripts/build_native.sh et` errors out
🐛 Describe the bug
I am trying to build the llama runner natively on a rasperry pi following the torchchat description, and the post at https://dev-discuss.pytorch.org/t/run-llama3-8b-on-a-raspberry-pi-5-with-executorch/2048
I was able to build executorch and torchchat so far (I can build a pte and run it with the python driver), but ran into an error with scripts/build_native et:
[ 22%] Performing download step (git clone) for 'fxdiv' Cloning into 'FXdiv-source'... Already on 'master' Your branch is up to date with 'origin/master'. [ 33%] Performing update step for 'fxdiv' -- Fetching latest from the remote origin [ 44%] No patch step for 'fxdiv' [ 55%] No configure step for 'fxdiv' [ 66%] No build step for 'fxdiv' [ 77%] No install step for 'fxdiv' [ 88%] No test step for 'fxdiv' [100%] Completed 'fxdiv' [100%] Built target fxdiv -- Using python executable '/home/sunshine/pt2/bin/python3' -- Resolved buck2 as /home/sunshine/torchchat/et-build/src/executorch/pip-out/temp.linux-aarch64-cpython-311/cmake-out/buck2-bin/buck2-49670bee56a7d8a7696409ca6fbf7551d2469787. -- Killing buck2 daemon -- executorch: Generating source lists -- executorch: Generating source file list /home/sunshine/torchchat/et-build/src/executorch/pip-out/temp.linux-aarch64-cpython-311/cmake-out/executorch_srcs.cmake Error while generating /home/sunshine/torchchat/et-build/src/executorch/pip-out/temp.linux-aarch64-cpython-311/cmake-out/executorch_srcs.cmake. Exit code: 1 Output:
Error: Traceback (most recent call last): File "/home/sunshine/torchchat/et-build/src/executorch/build/buck_util.py", line 26, in run cp: subprocess.CompletedProcess = subprocess.run( ^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['/home/sunshine/torchchat/et-build/src/executorch/pip-out/temp.linux-aarch64-cpython-311/cmake-out/buck2-bin/buck2-49670bee56a7d8a7696409ca6fbf7551d2469787', 'cquery', "inputs(deps('//runtime/executor:program'))"]' returned non-zero exit status 2.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/sunshine/torchchat/et-build/src/executorch/build/extract_sources.py", line 218, in
Caused by:
0: Failed to stat /home/sunshine/torchchat/et-build/src/executorch/buck-out/v2
1: ENOENT: No such file or directory
CMake Error at build/Utils.cmake:191 (message): executorch: source list generation failed Call Stack (most recent call first): CMakeLists.txt:327 (extract_sources)
-- Configuring incomplete, errors occurred! error: command '/home/sunshine/pt2/bin/cmake' failed with exit code 1 error: subprocess-exited-with-error
Building wheel for executorch (pyproject.toml) did not run successfully. exit code: 1
See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/sunshine/pt2/bin/python3 /home/sunshine/pt2/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpvxjhev2t cwd: /home/sunshine/torchchat/et-build/src/executorch Building wheel for executorch (pyproject.toml) ... error ERROR: Failed building wheel for executorch Failed to build executorch ERROR: Could not build wheels for executorch, which is required to install pyproject.toml-based projects
Versions
Collecting environment information... PyTorch version: 2.5.0.dev20240716 Is debug build: False CUDA used to build PyTorch: None ROCM used to build PyTorch: N/A
OS: Debian GNU/Linux trixie/sid (aarch64) GCC version: (Debian 13.3.0-2) 13.3.0 Clang version: 16.0.6 (27+b1) CMake version: version 3.30.0 Libc version: glibc-2.38
Python version: 3.11.2 (main, May 2 2024, 11:59:08) [GCC 12.2.0] (64-bit runtime) Python platform: Linux-6.6.31+rpt-rpi-v8-aarch64-with-glibc2.38 Is CUDA available: False CUDA runtime version: No CUDA CUDA_MODULE_LOADING set to: N/A GPU models and configuration: No CUDA Nvidia driver version: No CUDA cuDNN version: No CUDA HIP runtime version: N/A MIOpen runtime version: N/A Is XNNPACK available: True
CPU: Architecture: aarch64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: ARM Model name: Cortex-A76 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 4 Socket(s): - Cluster(s): 1 Stepping: r4p1 CPU(s) scaling MHz: 100% CPU max MHz: 2400.0000 CPU min MHz: 1500.0000 BogoMIPS: 108.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp L1d cache: 256 KiB (4 instances) L1i cache: 256 KiB (4 instances) L2 cache: 2 MiB (4 instances) L3 cache: 2 MiB (1 instance) Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected
Versions of relevant libraries: [pip3] executorch==0.4.0a0+c757499 [pip3] numpy==1.26.3 [pip3] torch==2.5.0.dev20240716 [pip3] torchao==0.3.1 [pip3] torchaudio==2.4.0.dev20240716 [pip3] torchsr==1.0.4 [pip3] torchvision==0.20.0.dev20240716 [conda] Could not collect
