Llama-Chinese
Llama-Chinese copied to clipboard
LlamaFamily
Docker部署有成功的吗？
用文档里的Docker部署了多次，都在编译的时候就出错了，是我的方法不对了。下面是一部分报错信息 docker build -f docker/Dockerfile -t flagalpha/llama2-chinese-7b:gradio . （我的环境是 Ubuntu 20.04.6 LTS ）
Looking in links: /tmp/tmpapy16eg4 Processing /tmp/tmpapy16eg4/setuptools-65.5.0-py3-none-any.whl Processing /tmp/tmpapy16eg4/pip-23.0.1-py3-none-any.whl Installing collected packages: setuptools, pip Successfully installed pip-23.0.1 setuptools-65.5.0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv update-alternatives: using /usr/local/bin/python3.10 to provide /usr/bin/python (python) in auto mode update-alternatives: using /usr/local/bin/pip3.10 to provide /usr/bin/pip (pip) in auto mode Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: git-man less libcbor0.8 libcurl3-gnutls libedit2 liberror-perl libfido2-1 libnghttp2-14 librtmp1 libssh-4 libxext6 libxmuu1 openssh-client xauth Suggested packages: gettext-base git-daemon-run | git-daemon-sysvinit git-doc git-email git-gui gitk gitweb git-cvs git-mediawiki git-svn keychain libpam-ssh monkeysphere ssh-askpass The following NEW packages will be installed: git git-man less libcbor0.8 libcurl3-gnutls libedit2 liberror-perl libfido2-1 libnghttp2-14 librtmp1 libssh-4 libxext6 libxmuu1 openssh-client xauth 0 upgraded, 15 newly installed, 0 to remove and 9 not upgraded. Need to get 6077 kB of archives. After this operation, 26.9 MB of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 less amd64 590-1ubuntu0.22.04.1 [143 kB] Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcbor0.8 amd64 0.8.0-2ubuntu1 [24.6 kB] Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit2 amd64 3.1-20210910-1build1 [96.8 kB] Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfido2-1 amd64 1.10.0-1 [82.8 kB] Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libnghttp2-14 amd64 1.43.0-1build3 [76.3 kB] Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libxext6 amd64 2:1.3.4-1build1 [31.8 kB] Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libxmuu1 amd64 2:1.1.3-3 [10.2 kB] Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 openssh-client amd64 1:8.9p1-3ubuntu0.3 [910 kB] Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 xauth amd64 1:1.1-1build2 [27.5 kB] Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB] Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.1 [185 kB] Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.13 [284 kB] Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB] Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.10 [954 kB] Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.10 [3166 kB] sh: 0: getcwd() failed: No such file or directory debconf: delaying package configuration, since apt-utils is not installed Fetched 6077 kB in 6s (1041 kB/s) Selecting previously unselected package less. (Reading database ... 14555 files and directories currently installed.) Preparing to unpack .../00-less_590-1ubuntu0.22.04.1_amd64.deb ... Unpacking less (590-1ubuntu0.22.04.1) ... Selecting previously unselected package libcbor0.8:amd64. Preparing to unpack .../01-libcbor0.8_0.8.0-2ubuntu1_amd64.deb ... Unpacking libcbor0.8:amd64 (0.8.0-2ubuntu1) ... Selecting previously unselected package libedit2:amd64. Preparing to unpack .../02-libedit2_3.1-20210910-1build1_amd64.deb ... Unpacking libedit2:amd64 (3.1-20210910-1build1) ... Selecting previously unselected package libfido2-1:amd64. Preparing to unpack .../03-libfido2-1_1.10.0-1_amd64.deb ... Unpacking libfido2-1:amd64 (1.10.0-1) ... Selecting previously unselected package libnghttp2-14:amd64. Preparing to unpack .../04-libnghttp2-14_1.43.0-1build3_amd64.deb ... Unpacking libnghttp2-14:amd64 (1.43.0-1build3) ... Selecting previously unselected package libxext6:amd64. Preparing to unpack .../05-libxext6_2%3a1.3.4-1build1_amd64.deb ... Unpacking libxext6:amd64 (2:1.3.4-1build1) ... Selecting previously unselected package libxmuu1:amd64. Preparing to unpack .../06-libxmuu1_2%3a1.1.3-3_amd64.deb ... Unpacking libxmuu1:amd64 (2:1.1.3-3) ... Selecting previously unselected package openssh-client. Preparing to unpack .../07-openssh-client_1%3a8.9p1-3ubuntu0.3_amd64.deb ... Unpacking openssh-client (1:8.9p1-3ubuntu0.3) ... Selecting previously unselected package xauth. Preparing to unpack .../08-xauth_1%3a1.1-1build2_amd64.deb ... Unpacking xauth (1:1.1-1build2) ... Selecting previously unselected package librtmp1:amd64. Preparing to unpack .../09-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ... Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... Selecting previously unselected package libssh-4:amd64. Preparing to unpack .../10-libssh-4_0.9.6-2ubuntu0.22.04.1_amd64.deb ... Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.1) ... Selecting previously unselected package libcurl3-gnutls:amd64. Preparing to unpack .../11-libcurl3-gnutls_7.81.0-1ubuntu1.13_amd64.deb ... Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.13) ... Selecting previously unselected package liberror-perl. Preparing to unpack .../12-liberror-perl_0.17029-1_all.deb ... Unpacking liberror-perl (0.17029-1) ... Selecting previously unselected package git-man. Preparing to unpack .../13-git-man_1%3a2.34.1-1ubuntu1.10_all.deb ... Unpacking git-man (1:2.34.1-1ubuntu1.10) ... Selecting previously unselected package git. Preparing to unpack .../14-git_1%3a2.34.1-1ubuntu1.10_amd64.deb ... Unpacking git (1:2.34.1-1ubuntu1.10) ... Setting up libcbor0.8:amd64 (0.8.0-2ubuntu1) ... Setting up libedit2:amd64 (3.1-20210910-1build1) ... Setting up libnghttp2-14:amd64 (1.43.0-1build3) ... Setting up less (590-1ubuntu0.22.04.1) ... Setting up libxext6:amd64 (2:1.3.4-1build1) ... Setting up liberror-perl (0.17029-1) ... Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.1) ... Setting up git-man (1:2.34.1-1ubuntu1.10) ... Setting up libfido2-1:amd64 (1.10.0-1) ... Setting up libxmuu1:amd64 (2:1.1.3-3) ... Setting up openssh-client (1:8.9p1-3ubuntu0.3) ... update-alternatives: using /usr/bin/ssh to provide /usr/bin/rsh (rsh) in auto mode update-alternatives: warning: skip creation of /usr/share/man/man1/rsh.1.gz because associated file /usr/share/man/man1/ssh.1.gz (of link group rsh) doesn't exist update-alternatives: using /usr/bin/slogin to provide /usr/bin/rlogin (rlogin) in auto mode update-alternatives: warning: skip creation of /usr/share/man/man1/rlogin.1.gz because associated file /usr/share/man/man1/slogin.1.gz (of link group rlogin) doesn't exist update-alternatives: using /usr/bin/scp to provide /usr/bin/rcp (rcp) in auto mode update-alternatives: warning: skip creation of /usr/share/man/man1/rcp.1.gz because associated file /usr/share/man/man1/scp.1.gz (of link group rcp) doesn't exist Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.13) ... Setting up git (1:2.34.1-1ubuntu1.10) ... Setting up xauth (1:1.1-1build2) ... Processing triggers for libc-bin (2.35-0ubuntu3.1) ... /bin/sh: 1: curl: not found shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory Reading package lists... Building dependency tree... Reading state information... The following NEW packages will be installed: git-lfs 0 upgraded, 1 newly installed, 0 to remove and 9 not upgraded. Need to get 3503 kB of archives. After this operation, 10.4 MB of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 git-lfs amd64 3.0.2-1ubuntu0.2 [3503 kB] sh: 0: getcwd() failed: No such file or directory debconf: delaying package configuration, since apt-utils is not installed Fetched 3503 kB in 3s (1274 kB/s) Selecting previously unselected package git-lfs. (Reading database ... 15666 files and directories currently installed.) Preparing to unpack .../git-lfs_3.0.2-1ubuntu0.2_amd64.deb ... Unpacking git-lfs (3.0.2-1ubuntu0.2) ... Setting up git-lfs (3.0.2-1ubuntu0.2) ... The folder you are executing pip from can no longer be found. The command '/bin/sh -c apt-get update && apt-get install -y wget build-essential libssl-dev zlib1g-dev libncurses5-dev libncursesw5-dev libreadline-dev libsqlite3-dev libgdbm-dev libdb5.3-dev libbz2-dev libexpat1-dev liblzma-dev libffi-dev libgdbm-compat-dev && wget https://www.python.org/ftp/python/3.10.12/Python-3.10.12.tar.xz -O /tmp/Python-3.10.12.tar.xz && tar xvf /tmp/Python-3.10.12.tar.xz -C /tmp && cd /tmp/Python-3.10.12 && ./configure --enable-optimizations --with-ensurepip=install && make -j $(nproc) && make altinstall && update-alternatives --install /usr/bin/python python /usr/local/bin/python3.10 1 && update-alternatives --install /usr/bin/pip pip /usr/local/bin/pip3.10 1 && rm -rf /tmp/Python-3.10.12.tar.xz /tmp/Python-3.10.12 && apt-get install -y git && curl -s https://packagecloud.io/install/repositories/github/git-lfs/script.deb.sh | bash && apt-get install -y git-lfs && pip install --upgrade pip' returned a non-zero code: 1
错误是这一句：The folder you are executing pip from can no longer be found.
原因是：docker/Dockerfile文件中有这句“&& rm -rf /tmp/Python-3.10.12.tar.xz /tmp/Python-3.10.12 \”把“/tmp/Python-3.10.12”给删除了。修改下docker/Dockerfile，让它不要删除这个目录，或者删除前增加“&& cd /root \”
亲测可用，不过后边还会碰到别的问题。等我安装成功后来分享。
错误是这一句：The folder you are executing pip from can no longer be found.
原因是：docker/Dockerfile文件中有这句“&& rm -rf /tmp/Python-3.10.12.tar.xz /tmp/Python-3.10.12 \”把“/tmp/Python-3.10.12”给删除了。修改下docker/Dockerfile，让它不要删除这个目录，或者删除前增加“&& cd /root \”
亲测可用，不过后边还会碰到别的问题。等我安装成功后来分享。
这句话不会影响后面的执行的。
目前进度：修改了pyton3.10的安装。可以通过了。但是requirement.txt 安装的部分出错，找不到nvcc，我开始怀疑这个镜像nvidia/cuda:11.7.1-cudnn8-runtime-ubuntu22.04 不匹配
Building wheels for collected packages: auto-gptq, peft, ffmpy Building wheel for auto-gptq (setup.py): started Building wheel for auto-gptq (setup.py): finished with status 'error' error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [71 lines of output] No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda' conda_cuda_include_dir /opt/conda/lib/python3.10/site-packages/nvidia/cuda_runtime/include appending conda cuda include dir /opt/conda/lib/python3.10/site-packages/nvidia/cuda_runtime/include running bdist_wheel /opt/conda/lib/python3.10/site-packages/torch/utils/cpp_extension.py:476: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend. warnings.warn(msg.format('we could not find ninja.')) running build running build_py creating build creating build/lib.linux-x86_64-cpython-310 creating build/lib.linux-x86_64-cpython-310/auto_gptq copying auto_gptq/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq creating build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt2.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/auto.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/bloom.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt_neox.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gptj.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/moss.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt_bigcode.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_const.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/qwen.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/codegen.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/llama.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/rw.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/internlm.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/opt.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/baichuan.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling creating build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/perplexity_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/data_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/exllama_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/import_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/peft_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils creating build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/language_modeling_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/sequence_classification_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/text_summarization_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks creating build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/gptq.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/quantizer.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization creating build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_llama_attn.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/_fused_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_gptj_attn.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_llama_mlp.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules creating build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/generation_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/classification_utils.py -> bu·ild/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utilsa creating build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules/triton_utils copying auto_gptq/nn_modules/triton_utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules/triton_utils
错误是这一句：The folder you are executing pip from can no longer be found. 原因是：docker/Dockerfile文件中有这句“&& rm -rf /tmp/Python-3.10.12.tar.xz /tmp/Python-3.10.12 \”把“/tmp/Python-3.10.12”给删除了。修改下docker/Dockerfile，让它不要删除这个目录，或者删除前增加“&& cd /root \” 亲测可用，不过后边还会碰到别的问题。等我安装成功后来分享。
这句话不会影响后面的执行的。
请问你是怎么搞定之前的报错的？
错误是这一句：The folder you are executing pip from can no longer be found. 原因是：docker/Dockerfile文件中有这句“&& rm -rf /tmp/Python-3.10.12.tar.xz /tmp/Python-3.10.12 \”把“/tmp/Python-3.10.12”给删除了。修改下docker/Dockerfile，让它不要删除这个目录，或者删除前增加“&& cd /root \” 亲测可用，不过后边还会碰到别的问题。等我安装成功后来分享。
这句话不会影响后面的执行的。
请问你是怎么搞定之前的报错的？
python3.10的安装替换成下面的 RUN wget https://mirrors.tuna.tsinghua.edu.cn/anaconda/miniconda/Miniconda3-py310_23.5.2-0-Linux-x86_64.sh -O miniconda.sh RUN bash miniconda.sh -b -p /opt/conda ENV PATH="/opt/conda/bin:${PATH}" RUN pip install --upgrade pip
目前进度：修改了pyton3.10的安装。可以通过了。但是requirement.txt 安装的部分出错，找不到nvcc，我开始怀疑这个镜像nvidia/cuda:11.7.1-cudnn8-runtime-ubuntu22.04 不匹配
Building wheels for collected packages: auto-gptq, peft, ffmpy Building wheel for auto-gptq (setup.py): started Building wheel for auto-gptq (setup.py): finished with status 'error' error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [71 lines of output] No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda' conda_cuda_include_dir /opt/conda/lib/python3.10/site-packages/nvidia/cuda_runtime/include appending conda cuda include dir /opt/conda/lib/python3.10/site-packages/nvidia/cuda_runtime/include running bdist_wheel /opt/conda/lib/python3.10/site-packages/torch/utils/cpp_extension.py:476: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend. warnings.warn(msg.format('we could not find ninja.')) running build running build_py creating build creating build/lib.linux-x86_64-cpython-310 creating build/lib.linux-x86_64-cpython-310/auto_gptq copying auto_gptq/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq creating build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt2.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/auto.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/bloom.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt_neox.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gptj.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/moss.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/gpt_bigcode.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/_const.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/qwen.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/codegen.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/llama.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/rw.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/internlm.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/opt.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling copying auto_gptq/modeling/baichuan.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/modeling creating build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/perplexity_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/data_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/exllama_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/import_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils copying auto_gptq/utils/peft_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/utils creating build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/language_modeling_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/sequence_classification_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks copying auto_gptq/eval_tasks/text_summarization_task.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks creating build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/gptq.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization copying auto_gptq/quantization/quantizer.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/quantization creating build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_llama_attn.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/_fused_base.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_gptj_attn.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules copying auto_gptq/nn_modules/fused_llama_mlp.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules creating build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/generation_utils.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utils copying auto_gptq/eval_tasks/_utils/classification_utils.py -> bu·ild/lib.linux-x86_64-cpython-310/auto_gptq/eval_tasks/_utilsa creating build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules/triton_utils copying auto_gptq/nn_modules/triton_utils/init.py -> build/lib.linux-x86_64-cpython-310/auto_gptq/nn_modules/triton_utils
我也碰到了这两句错误，正在尝试解决中：
No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda' error: [Errno 2] No such file or directory: '/usr/local/cuda/bin/nvcc'
- 使用我修改的docker文件
- 使用命令直接构建（目前我没有gpu的服务器，还没有验证，不过准备在aws上按小时买一台来跑跑试试）
$ git clone [email protected]:kongh/Llama2-Chinese.git
$ git checkout kh
$ docker build -f docker/Dockerfile -t flagalpha/llama2-chinese-7b:gradio .
- 使用我修改的docker文件
- 使用命令直接构建（目前我没有gpu的服务器，还没有验证，不过准备在aws上按小时买一台来跑跑试试）
$ git clone [email protected]:kongh/Llama2-Chinese.git $ git checkout kh $ docker build -f docker/Dockerfile -t flagalpha/llama2-chinese-7b:gradio .
- 使用我修改的docker文件
- 使用命令直接构建（目前我没有gpu的服务器，还没有验证，不过准备在aws上按小时买一台来跑跑试试）
$ git clone [email protected]:kongh/Llama2-Chinese.git $ git checkout kh $ docker build -f docker/Dockerfile -t flagalpha/llama2-chinese-7b:gradio .
最近国内huggingface访问不了了，哥们国内服务器安装你试过设置代理吗。（麻了）
- 使用我修改的docker文件
- 使用命令直接构建（目前我没有gpu的服务器，还没有验证，不过准备在aws上按小时买一台来跑跑试试）
$ git clone [email protected]:kongh/Llama2-Chinese.git $ git checkout kh $ docker build -f docker/Dockerfile -t flagalpha/llama2-chinese-7b:gradio .最近国内huggingface访问不了了，哥们国内服务器安装你试过设置代理吗。（麻了）
没有尝试过