ktransformers
ktransformers copied to clipboard
Published
2 weeks ago
•
kvcache-ai
kvcache-ai
安装ktransformers出错
安装依赖完成，在安装ktransformers时出错。报错信息如下：
running build_ext
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/gemini/data-1/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/root/miniconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.0+cu121torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/envs/ktransformers/bin/ninja']
Traceback (most recent call last):
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
如果是源码安装，git submodule init，git submodule update，并检查third party目录下的内容是否正确
gcc 11.2 cuda 12.1 已经执行过git submodule init，git submodule update，内容没问题。
完整报错如下：
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.assistants' is absent from the packages configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.api.openai.assistants' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.api.openai.assistants' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.api.openai.assistants' to be distributed and are
already explicitly excluding 'ktransformers.server.api.openai.assistants' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.endpoints' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.api.openai.endpoints' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.api.openai.endpoints' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.api.openai.endpoints' to be distributed and are
already explicitly excluding 'ktransformers.server.api.openai.endpoints' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.legacy' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.api.openai.legacy' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.api.openai.legacy' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.api.openai.legacy' to be distributed and are
already explicitly excluding 'ktransformers.server.api.openai.legacy' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.web' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.api.web' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.api.web' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.api.web' to be distributed and are
already explicitly excluding 'ktransformers.server.api.web' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.backend' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.backend' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.backend' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.backend' to be distributed and are
already explicitly excluding 'ktransformers.server.backend' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.backend.interfaces' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.backend.interfaces' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.backend.interfaces' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.backend.interfaces' to be distributed and are
already explicitly excluding 'ktransformers.server.backend.interfaces' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.config' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.config' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.config' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.config' to be distributed and are
already explicitly excluding 'ktransformers.server.config' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.crud' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.crud' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.crud' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.crud' to be distributed and are
already explicitly excluding 'ktransformers.server.crud' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.crud.assistants' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.crud.assistants' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.crud.assistants' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.crud.assistants' to be distributed and are
already explicitly excluding 'ktransformers.server.crud.assistants' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.models' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.models' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.models' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.models' to be distributed and are
already explicitly excluding 'ktransformers.server.models' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.models.assistants' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.models.assistants' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.models.assistants' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.models.assistants' to be distributed and are
already explicitly excluding 'ktransformers.server.models.assistants' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.schemas' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.schemas' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.schemas' to be distributed and are
already explicitly excluding 'ktransformers.server.schemas' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.assistants' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.schemas.assistants' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.schemas.assistants' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.schemas.assistants' to be distributed and are
already explicitly excluding 'ktransformers.server.schemas.assistants' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.endpoints' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.schemas.endpoints' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.schemas.endpoints' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.schemas.endpoints' to be distributed and are
already explicitly excluding 'ktransformers.server.schemas.endpoints' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.legacy' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.schemas.legacy' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.schemas.legacy' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.schemas.legacy' to be distributed and are
already explicitly excluding 'ktransformers.server.schemas.legacy' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.utils' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.server.utils' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.server.utils' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.server.utils' to be distributed and are
already explicitly excluding 'ktransformers.server.utils' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.tests' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.tests' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.tests' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.tests' to be distributed and are
already explicitly excluding 'ktransformers.tests' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.util' is absent from the `packages` configuration.
!!
********************************************************************************
############################
# Package would be ignored #
############################
Python recognizes 'ktransformers.util' as an importable package[^1],
but it is absent from setuptools' `packages` configuration.
This leads to an ambiguous overall configuration. If you want to distribute this
package, please make sure that 'ktransformers.util' is explicitly added
to the `packages` configuration field.
Alternatively, you can also rely on setuptools' discovery methods
(for example by using `find_namespace_packages(...)`/`find_namespace:`
instead of `find_packages(...)`/`find:`).
You can read more about "package discovery" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
If you don't want 'ktransformers.util' to be distributed and are
already explicitly excluding 'ktransformers.util' via
`find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
you can try to use `exclude_package_data`, or `include-package-data=False` in
combination with a more fine grained `package-data` configuration.
You can read more about "package data files" on setuptools documentation page:
- https://setuptools.pypa.io/en/latest/userguide/datafiles.html
[^1]: For Python, any directory (with suitable naming) can be imported,
even if it does not contain any `.py` files.
On the other hand, currently there is no concept of package data
directory, all directories are treated like packages.
********************************************************************************
!!
check.warn(importable)
creating build/lib.linux-x86_64-cpython-311/ktransformers/configs
copying ktransformers/configs/config.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/configs
copying ktransformers/configs/log_config.ini -> build/lib.linux-x86_64-cpython-311/ktransformers/configs
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext
copying ktransformers/ktransformers_ext/CMakeLists.txt -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext
copying ktransformers/ktransformers_ext/ext_bindings.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_attention_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_linear_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_mlp.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_mlp_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
copying ktransformers/ktransformers_ext/bench/bench_moe_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cmake
copying ktransformers/ktransformers_ext/cmake/FindSIMD.cmake -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cmake
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
copying ktransformers/ktransformers_ext/cpu_backend/backend.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
copying ktransformers/ktransformers_ext/cpu_backend/backend.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
copying ktransformers/ktransformers_ext/cpu_backend/cpuinfer.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
copying ktransformers/ktransformers_ext/cpu_backend/task_queue.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
copying ktransformers/ktransformers_ext/cpu_backend/task_queue.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda
copying ktransformers/ktransformers_ext/cuda/binding.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda
copying ktransformers/ktransformers_ext/cuda/setup.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf
copying ktransformers/ktransformers_ext/cuda/custom_gguf/binding.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf
copying ktransformers/ktransformers_ext/cuda/custom_gguf/dequant.cu -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf
copying ktransformers/ktransformers_ext/cuda/custom_gguf/ops.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin
copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cu -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin
copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cuh -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin
copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin_dtypes.cuh -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin
copying ktransformers/ktransformers_ext/cuda/gptq_marlin/ops.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples
copying ktransformers/ktransformers_ext/examples/test_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples
copying ktransformers/ktransformers_ext/examples/test_linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples
copying ktransformers/ktransformers_ext/examples/test_mlp.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples
copying ktransformers/ktransformers_ext/examples/test_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/format_24.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_24_perms.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_perms.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/quant_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
copying ktransformers/ktransformers_ext/operators/kvcache/kvcache.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_attn.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_load_dump.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_read_write.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_utils.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache
creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/conversion.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/linear.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/linear.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/mlp.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/moe.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/moe.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile
creating build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/configuration_deepseek.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/configuration_deepseek_v3.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/configuration_llama.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/custom_cache.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/modeling_deepseek.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/modeling_deepseek_v3.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/modeling_llama.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/modeling_mixtral.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
copying ktransformers/models/modeling_qwen2_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models
creating build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/RoPE.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/base_operator.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/cpuinfer.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/dynamic_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/experts.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/gate.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/models.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
copying ktransformers/operators/triton_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators
creating build/lib.linux-x86_64-cpython-311/ktransformers/optimize
copying ktransformers/optimize/optimize.py -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize
creating build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat-multi-gpu-4.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Lite-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Lite-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-4.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-8.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-marlin.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/Internlm2_5-7b-Chat-1m.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/Mixtral.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/Qwen2-57B-A14B-Instruct-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
copying ktransformers/optimize/optimize_rules/Qwen2-57B-A14B-Instruct.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules
creating build/lib.linux-x86_64-cpython-311/ktransformers/server
copying ktransformers/server/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server
copying ktransformers/server/args.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server
copying ktransformers/server/exceptions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server
copying ktransformers/server/main.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server
copying ktransformers/server/requirements.txt -> build/lib.linux-x86_64-cpython-311/ktransformers/server
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api
copying ktransformers/server/api/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama
copying ktransformers/server/api/ollama/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama
copying ktransformers/server/api/ollama/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai
copying ktransformers/server/api/openai/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
copying ktransformers/server/api/openai/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
copying ktransformers/server/api/openai/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
copying ktransformers/server/api/openai/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
copying ktransformers/server/api/openai/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
copying ktransformers/server/api/openai/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints
copying ktransformers/server/api/openai/endpoints/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints
copying ktransformers/server/api/openai/endpoints/chat.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy
copying ktransformers/server/api/openai/legacy/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy
copying ktransformers/server/api/openai/legacy/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web
copying ktransformers/server/api/web/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web
copying ktransformers/server/api/web/system.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/backend
copying ktransformers/server/backend/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend
copying ktransformers/server/backend/args.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend
copying ktransformers/server/backend/base.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend
copying ktransformers/server/backend/context_manager.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces
copying ktransformers/server/backend/interfaces/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces
copying ktransformers/server/backend/interfaces/exllamav2.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces
copying ktransformers/server/backend/interfaces/ktransformers.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces
copying ktransformers/server/backend/interfaces/transformers.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/config
copying ktransformers/server/config/config.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config
copying ktransformers/server/config/log.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config
copying ktransformers/server/config/singleton.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/crud
copying ktransformers/server/crud/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
copying ktransformers/server/crud/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
copying ktransformers/server/crud/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
copying ktransformers/server/crud/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
copying ktransformers/server/crud/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
copying ktransformers/server/crud/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/models
copying ktransformers/server/models/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/run_steps.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
copying ktransformers/server/models/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas
copying ktransformers/server/schemas/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas
copying ktransformers/server/schemas/base.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas
copying ktransformers/server/schemas/conversation.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/streaming.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
copying ktransformers/server/schemas/assistants/tool.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/endpoints
copying ktransformers/server/schemas/endpoints/chat.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/endpoints
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy
copying ktransformers/server/schemas/legacy/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy
copying ktransformers/server/schemas/legacy/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy
creating build/lib.linux-x86_64-cpython-311/ktransformers/server/utils
copying ktransformers/server/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils
copying ktransformers/server/utils/create_interface.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils
copying ktransformers/server/utils/multi_timer.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils
copying ktransformers/server/utils/sql_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils
creating build/lib.linux-x86_64-cpython-311/ktransformers/tests
copying ktransformers/tests/dequant_gpu.py -> build/lib.linux-x86_64-cpython-311/ktransformers/tests
copying ktransformers/tests/dequant_gpu_t.py -> build/lib.linux-x86_64-cpython-311/ktransformers/tests
creating build/lib.linux-x86_64-cpython-311/ktransformers/util
copying ktransformers/util/cuda_graph_runner.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util
copying ktransformers/util/custom_gguf.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util
copying ktransformers/util/modeling_rope_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util
copying ktransformers/util/textstream.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util
copying ktransformers/util/utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util
running build_ext
/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/gemini/data-1/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/root/miniconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu121torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/envs/ktransformers/bin/ninja']
Traceback (most recent call last):
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
main()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
return _build_backend().build_wheel(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 438, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 426, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
self.run_setup()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
File "<string>", line 295, in <module>
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 983, in run_commands
self.run_command(cmd)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "<string>", line 153, in run
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 379, in run
self.run_command("build")
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 136, in run
self.run_command(cmd_name)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command
super().run_command(command)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
cmd_obj.run()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 99, in run
_build_ext.run(self)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
self.build_extensions()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions
self._build_extensions_serial()
File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial
self.build_extension(ext)
File "<string>", line 285, in build_extension
File "/root/miniconda3/envs/ktransformers/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '/gemini/data-1/ktransformers/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/gemini/data-1/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/root/miniconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu121torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/envs/ktransformers/bin/ninja']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
如果是源码安装，git submodule init，git submodule update，并检查third party目录下的内容是否正确
gcc 11.2 cuda 12.1 已经执行过git submodule init，git submodule update，内容没问题。
完整报错如下： check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.assistants' is absent from the
packagesconfiguration. !!******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.api.openai.assistants' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.api.openai.assistants' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.api.openai.assistants' to be distributed and are already explicitly excluding 'ktransformers.server.api.openai.assistants' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.endpoints' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.api.openai.endpoints' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.api.openai.endpoints' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.api.openai.endpoints' to be distributed and are already explicitly excluding 'ktransformers.server.api.openai.endpoints' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.openai.legacy' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.api.openai.legacy' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.api.openai.legacy' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.api.openai.legacy' to be distributed and are already explicitly excluding 'ktransformers.server.api.openai.legacy' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.api.web' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.api.web' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.api.web' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.api.web' to be distributed and are already explicitly excluding 'ktransformers.server.api.web' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.backend' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.backend' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.backend' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.backend' to be distributed and are already explicitly excluding 'ktransformers.server.backend' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.backend.interfaces' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.backend.interfaces' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.backend.interfaces' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.backend.interfaces' to be distributed and are already explicitly excluding 'ktransformers.server.backend.interfaces' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.config' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.config' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.config' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.config' to be distributed and are already explicitly excluding 'ktransformers.server.config' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.crud' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.crud' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.crud' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.crud' to be distributed and are already explicitly excluding 'ktransformers.server.crud' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.crud.assistants' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.crud.assistants' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.crud.assistants' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.crud.assistants' to be distributed and are already explicitly excluding 'ktransformers.server.crud.assistants' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.models' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.models' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.models' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.models' to be distributed and are already explicitly excluding 'ktransformers.server.models' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.models.assistants' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.models.assistants' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.models.assistants' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.models.assistants' to be distributed and are already explicitly excluding 'ktransformers.server.models.assistants' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.schemas' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.schemas' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.schemas' to be distributed and are already explicitly excluding 'ktransformers.server.schemas' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.assistants' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.schemas.assistants' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.schemas.assistants' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.schemas.assistants' to be distributed and are already explicitly excluding 'ktransformers.server.schemas.assistants' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.endpoints' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.schemas.endpoints' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.schemas.endpoints' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.schemas.endpoints' to be distributed and are already explicitly excluding 'ktransformers.server.schemas.endpoints' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.schemas.legacy' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.schemas.legacy' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.schemas.legacy' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.schemas.legacy' to be distributed and are already explicitly excluding 'ktransformers.server.schemas.legacy' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.utils' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.utils' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.utils' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.utils' to be distributed and are already explicitly excluding 'ktransformers.server.utils' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.tests' to be distributed and are already explicitly excluding 'ktransformers.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.util' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.util' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.util' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.util' to be distributed and are already explicitly excluding 'ktransformers.util' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) creating build/lib.linux-x86_64-cpython-311/ktransformers/configs copying ktransformers/configs/config.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/configs copying ktransformers/configs/log_config.ini -> build/lib.linux-x86_64-cpython-311/ktransformers/configs creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext copying ktransformers/ktransformers_ext/CMakeLists.txt -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext copying ktransformers/ktransformers_ext/ext_bindings.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_attention_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_linear_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_mlp.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_mlp_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_moe_torch.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/bench creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cmake copying ktransformers/ktransformers_ext/cmake/FindSIMD.cmake -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cmake creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/backend.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/backend.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/cpuinfer.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/task_queue.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/task_queue.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cpu_backend creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda copying ktransformers/ktransformers_ext/cuda/binding.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda copying ktransformers/ktransformers_ext/cuda/setup.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf copying ktransformers/ktransformers_ext/cuda/custom_gguf/binding.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf copying ktransformers/ktransformers_ext/cuda/custom_gguf/dequant.cu -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf copying ktransformers/ktransformers_ext/cuda/custom_gguf/ops.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/custom_gguf creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cu -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin.cuh -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin copying ktransformers/ktransformers_ext/cuda/gptq_marlin/gptq_marlin_dtypes.cuh -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin copying ktransformers/ktransformers_ext/cuda/gptq_marlin/ops.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/cuda/gptq_marlin creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples copying ktransformers/ktransformers_ext/examples/test_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples copying ktransformers/ktransformers_ext/examples/test_linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples copying ktransformers/ktransformers_ext/examples/test_mlp.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples copying ktransformers/ktransformers_ext/examples/test_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/examples creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/format_24.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_24_perms.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_perms.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/marlin_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils copying ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils/quant_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/custom_marlin/quantize/utils creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache copying ktransformers/ktransformers_ext/operators/kvcache/kvcache.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_attn.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_load_dump.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_read_write.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache copying ktransformers/ktransformers_ext/operators/kvcache/kvcache_utils.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/kvcache creating build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/conversion.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/linear.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/linear.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/mlp.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/moe.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/moe.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.h -> build/lib.linux-x86_64-cpython-311/ktransformers/ktransformers_ext/operators/llamafile creating build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/configuration_deepseek.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/configuration_deepseek_v3.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/configuration_llama.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/custom_cache.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/modeling_deepseek.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/modeling_deepseek_v3.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/modeling_llama.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/modeling_mixtral.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models copying ktransformers/models/modeling_qwen2_moe.py -> build/lib.linux-x86_64-cpython-311/ktransformers/models creating build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/RoPE.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/base_operator.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/cpuinfer.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/dynamic_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/experts.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/gate.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/linear.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/models.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators copying ktransformers/operators/triton_attention.py -> build/lib.linux-x86_64-cpython-311/ktransformers/operators creating build/lib.linux-x86_64-cpython-311/ktransformers/optimize copying ktransformers/optimize/optimize.py -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize creating build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat-multi-gpu-4.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Lite-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V2-Lite-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-4.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-8.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu-marlin.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/Internlm2_5-7b-Chat-1m.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/Mixtral.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/Qwen2-57B-A14B-Instruct-multi-gpu.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules copying ktransformers/optimize/optimize_rules/Qwen2-57B-A14B-Instruct.yaml -> build/lib.linux-x86_64-cpython-311/ktransformers/optimize/optimize_rules creating build/lib.linux-x86_64-cpython-311/ktransformers/server copying ktransformers/server/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server copying ktransformers/server/args.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server copying ktransformers/server/exceptions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server copying ktransformers/server/main.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server copying ktransformers/server/requirements.txt -> build/lib.linux-x86_64-cpython-311/ktransformers/server creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api copying ktransformers/server/api/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama copying ktransformers/server/api/ollama/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama copying ktransformers/server/api/ollama/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/ollama creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai copying ktransformers/server/api/openai/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants copying ktransformers/server/api/openai/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants copying ktransformers/server/api/openai/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants copying ktransformers/server/api/openai/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants copying ktransformers/server/api/openai/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants copying ktransformers/server/api/openai/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/assistants creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints copying ktransformers/server/api/openai/endpoints/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints copying ktransformers/server/api/openai/endpoints/chat.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/endpoints creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy copying ktransformers/server/api/openai/legacy/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy copying ktransformers/server/api/openai/legacy/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/openai/legacy creating build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web copying ktransformers/server/api/web/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web copying ktransformers/server/api/web/system.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/api/web creating build/lib.linux-x86_64-cpython-311/ktransformers/server/backend copying ktransformers/server/backend/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend copying ktransformers/server/backend/args.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend copying ktransformers/server/backend/base.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend copying ktransformers/server/backend/context_manager.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend creating build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces copying ktransformers/server/backend/interfaces/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces copying ktransformers/server/backend/interfaces/exllamav2.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces copying ktransformers/server/backend/interfaces/ktransformers.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces copying ktransformers/server/backend/interfaces/transformers.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/backend/interfaces creating build/lib.linux-x86_64-cpython-311/ktransformers/server/config copying ktransformers/server/config/config.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config copying ktransformers/server/config/log.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config copying ktransformers/server/config/singleton.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/config creating build/lib.linux-x86_64-cpython-311/ktransformers/server/crud copying ktransformers/server/crud/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud creating build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants copying ktransformers/server/crud/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants copying ktransformers/server/crud/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants copying ktransformers/server/crud/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants copying ktransformers/server/crud/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants copying ktransformers/server/crud/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/crud/assistants creating build/lib.linux-x86_64-cpython-311/ktransformers/server/models copying ktransformers/server/models/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models creating build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/run_steps.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants copying ktransformers/server/models/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/models/assistants creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas copying ktransformers/server/schemas/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas copying ktransformers/server/schemas/base.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas copying ktransformers/server/schemas/conversation.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/assistants.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/messages.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/runs.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/streaming.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/threads.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants copying ktransformers/server/schemas/assistants/tool.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/assistants creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/endpoints copying ktransformers/server/schemas/endpoints/chat.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/endpoints creating build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy copying ktransformers/server/schemas/legacy/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy copying ktransformers/server/schemas/legacy/completions.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/schemas/legacy creating build/lib.linux-x86_64-cpython-311/ktransformers/server/utils copying ktransformers/server/utils/__init__.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils copying ktransformers/server/utils/create_interface.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils copying ktransformers/server/utils/multi_timer.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils copying ktransformers/server/utils/sql_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/server/utils creating build/lib.linux-x86_64-cpython-311/ktransformers/tests copying ktransformers/tests/dequant_gpu.py -> build/lib.linux-x86_64-cpython-311/ktransformers/tests copying ktransformers/tests/dequant_gpu_t.py -> build/lib.linux-x86_64-cpython-311/ktransformers/tests creating build/lib.linux-x86_64-cpython-311/ktransformers/util copying ktransformers/util/cuda_graph_runner.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util copying ktransformers/util/custom_gguf.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util copying ktransformers/util/modeling_rope_utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util copying ktransformers/util/textstream.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util copying ktransformers/util/utils.py -> build/lib.linux-x86_64-cpython-311/ktransformers/util running build_ext /root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no g++ version bounds defined for CUDA version 12.1 warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}') CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/gemini/data-1/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/root/miniconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu121torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/envs/ktransformers/bin/ninja'] Traceback (most recent call last): File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module> main() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main json_out["return_val"] = hook(**hook_input["kwargs"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel return _build_backend().build_wheel( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 438, in build_wheel return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 426, in _build return self._build_with_temp_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir self.run_setup() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/build_meta.py", line 320, in run_setup exec(code, locals()) File "<string>", line 295, in <module> File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup return distutils.core.setup(**attrs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup return run_commands(dist) ^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands dist.run_commands() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 983, in run_commands self.run_command(cmd) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "<string>", line 153, in run File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 379, in run self.run_command("build") File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command self.distribution.run_command(command) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 136, in run self.run_command(cmd_name) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command self.distribution.run_command(command) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 99, in run _build_ext.run(self) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 365, in run self.build_extensions() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions build_ext.build_extensions(self) File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions self._build_extensions_serial() File "/root/miniconda3/envs/ktransformers/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial self.build_extension(ext) File "<string>", line 285, in build_extension File "/root/miniconda3/envs/ktransformers/lib/python3.11/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '/gemini/data-1/ktransformers/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/gemini/data-1/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/root/miniconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu121torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/envs/ktransformers/bin/ninja']' returned non-zero exit status 1. [end of output]note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
same problem
同样的问题
我安装成功了，我是cmake版本升级到最新版本就好了
我是cmake版本最新版本都不行： File "/opt/conda/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2079, in _get_cuda_arch_flags arch_list[-1] += '+PTX' ~~~~~~~~~^^^^ IndexError: list index out of range [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
同样的问题
我安装成功了，我是cmake版本升级到最新版本就好了
我是cmake版本最新版本都不行： File "/opt/conda/envs/ktransformers/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2079, in _get_cuda_arch_flags arch_list[-1] += '+PTX' ~~~~~~~~~^^^^ IndexError: list index out of range [end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers) 这个当时我也遇到了，可能是需要执行一下这个，pip install torch==2.4.1 torchvision==0.19.1 torchaudio==2.4.1 --index-url https://download.pytorch.org/whl/cu124，我的cmake是3.31.5，cuda >=12.4,，我是12.8，triton 3.1.0
我遇到同样的问题，确实是升级cmake到3.31.6就解决了。 我的环境：ubuntu20.04, python3.11, nvidia 570.85, cuda 12.8, torch 2.6
求求了 大家帮我看看这是什么问题 /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avxintrin.h: In function 'void {anonymous}::tinyBLAS<KN, D, V, TA, TB, TC>::gemm(int64_t, int64_t, int64_t) [with int RM = 4; int RN = 1; int BM = 1; int KN = 16; D = __vector(16) float; V = __vector(16) float; TA = ggml_bf16_t; TB = ggml_bf16_t; TC = float]': /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avxintrin.h:1210:11: note: '__Y' was declared here 1210 | __m256d __Y = __Y; | ^~~ In function '__m256d _mm512_extractf64x4_pd(__m512d, int)', inlined from 'float _mm512_reduce_add_ps(__m512)' at /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avx512fintrin.h:16169:3, inlined from 'float {anonymous}::hsum(__m512)' at /home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp:207:32, inlined from 'void {anonymous}::tinyBLAS<KN, D, V, TA, TB, TC>::gemm_bloc(int64_t, int64_t) [with int RM = 4; int RN = 1; int KN = 16; D = __vector(16) float; V = __vector(16) float; TA = ggml_bf16_t; TB = ggml_bf16_t; TC = float]' at /home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp:392:52, inlined from 'void {anonymous}::tinyBLAS<KN, D, V, TA, TB, TC>::gemm(int64_t, int64_t, int64_t) [with int RM = 4; int RN = 1; int BM = 1; int KN = 16; D = __vector(16) float; V = __vector(16) float; TA = ggml_bf16_t; TB = ggml_bf16_t; TC = float]' at /home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/ggml-cpu/llamafile/sgemm.cpp:432:38: /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avx512fintrin.h:5946:10: warning: '__Y' may be used uninitialized [-Wmaybe-uninitialized] 5946 | return (__m256d) __builtin_ia32_extractf64x4_mask ((__v8df) __A, | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 5947 | __imm, | ~~~~~~ 5948 | (__v4df) | ~~~~~~~~ 5949 | _mm256_undefined_pd (), | ~~~~~~~~~~~~~~~~~~~~~~~ 5950 | (__mmask8) -1); | ~~~~~~~~~~~~~~ /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avxintrin.h: In function 'void {anonymous}::tinyBLAS<KN, D, V, TA, TB, TC>::gemm(int64_t, int64_t, int64_t) [with int RM = 4; int RN = 1; int BM = 1; int KN = 16; D = __vector(16) float; V = __vector(16) float; TA = ggml_bf16_t; TB = ggml_bf16_t; TC = float]': /mnt/share/yhc/conda_envs/hybrimoe/lib/gcc/x86_64-conda-linux-gnu/12.2.0/include/avxintrin.h:1210:11: note: '__Y' was declared here 1210 | __m256d __Y = __Y; | ^~~ [46/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/src/../include -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -ffast-math -O3 -DNDEBUG -std=gnu++17 -fPIC -march=native -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-quant.cpp.o -MF third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-quant.cpp.o.d -o third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-quant.cpp.o -c /home/yhc/HybriMoE/third_party/llama.cpp/src/llama-quant.cpp [47/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-cc -DGGML_BUILD -DGGML_SCHED_MAX_COPIES=4 -DGGML_SHARED -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Dggml_base_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -DNDEBUG -std=gnu11 -fPIC -march=native -Wshadow -Wstrict-prototypes -Wpointer-arith -Wmissing-prototypes -Werror=implicit-int -Werror=implicit-function-declaration -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wdouble-promotion -MD -MT third_party/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o -MF third_party/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o.d -o third_party/llama.cpp/ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o -c /home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/ggml-quants.c [48/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/src/../include -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -ffast-math -O3 -DNDEBUG -std=gnu++17 -fPIC -march=native -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o -MF third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o.d -o third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-grammar.cpp.o -c /home/yhc/HybriMoE/third_party/llama.cpp/src/llama-grammar.cpp [49/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/src/../include -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -ffast-math -O3 -DNDEBUG -std=gnu++17 -fPIC -march=native -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o -MF third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o.d -o third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-sampling.cpp.o -c /home/yhc/HybriMoE/third_party/llama.cpp/src/llama-sampling.cpp [50/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/src/../include -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -ffast-math -O3 -DNDEBUG -std=gnu++17 -fPIC -march=native -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT third_party/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o -MF third_party/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o.d -o third_party/llama.cpp/src/CMakeFiles/llama.dir/unicode.cpp.o -c /home/yhc/HybriMoE/third_party/llama.cpp/src/unicode.cpp [51/80] /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ -DGGML_BACKEND_SHARED -DGGML_SHARED -DGGML_USE_CPU -DLLAMA_BUILD -DLLAMA_SHARED -Dllama_EXPORTS -I/home/yhc/HybriMoE/third_party/llama.cpp/src/. -I/home/yhc/HybriMoE/third_party/llama.cpp/src/../include -I/home/yhc/HybriMoE/third_party/llama.cpp/ggml/src/../include -fvisibility-inlines-hidden -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /mnt/share/yhc/conda_envs/hybrimoe/include -I/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/include -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib -L/mnt/share/yhc/conda_envs/hybrimoe/targets/x86_64-linux/lib/stubs -O3 -ffast-math -O3 -DNDEBUG -std=gnu++17 -fPIC -march=native -Wmissing-declarations -Wmissing-noreturn -Wall -Wextra -Wpedantic -Wcast-qual -Wno-unused-function -Wno-array-bounds -Wextra-semi -MD -MT third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-model.cpp.o -MF third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-model.cpp.o.d -o third_party/llama.cpp/src/CMakeFiles/llama.dir/llama-model.cpp.o -c /home/yhc/HybriMoE/third_party/llama.cpp/src/llama-model.cpp ninja: build stopped: subcommand failed.
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/yhc/HybriMoE/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/yhc/.conda/envs/hybrimoe/bin/python3.11', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON']
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/yhc/HybriMoE/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/yhc/.conda/envs/hybrimoe/bin/python3.11', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DCMAKE_AR=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-ar', '-DCMAKE_CXX_COMPILER_AR=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-gcc-ar', '-DCMAKE_C_COMPILER_AR=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-gcc-ar', '-DCMAKE_RANLIB=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-ranlib', '-DCMAKE_CXX_COMPILER_RANLIB=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-gcc-ranlib', '-DCMAKE_C_COMPILER_RANLIB=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-gcc-ranlib', '-DCMAKE_LINKER=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-strip', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.3.post2+torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/home/yhc/.conda/envs/hybrimoe/bin/ninja']
Standard output: b'-- The C compiler identification is GNU 12.2.0\n-- The CXX compiler identification is GNU 12.2.0\n-- Detecting C compiler ABI info\n-- Detecting C compiler ABI info - done\n-- Check for working C compiler: /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-cc - skipped\n-- Detecting C compile features\n-- Detecting C compile features - done\n-- Detecting CXX compiler ABI info\n-- Detecting CXX compiler ABI info - done\n-- Check for working CXX compiler: /mnt/share/yhc/conda_envs/hybrimoe/bin/x86_64-conda-linux-gnu-c++ - skipped\n-- Detecting CXX compile features\n-- Detecting CXX compile features - done\n-- CMAKE_SYSTEM_PROCESSOR: x86_64\n-- x86 detected\n-- pybind11 v3.0.0 dev1\n-- Found Python: /mnt/share/yhc/conda_envs/hybrimoe/bin/python3.11 (found suitable version "3.11.13", minimum required is "3.8") found components: Interpreter Development.Module Development.Embed\n-- Performing Test HAS_FLTO\n-- Performing Test HAS_FLTO - Success\n-- Found Git: /usr/bin/git (found version "2.34.1")\n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD\n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success\n-- Found Threads: TRUE\n-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF\n-- CMAKE_SYSTEM_PROCESSOR: x86_64\n-- Including CPU backend\n-- Found OpenMP_C: -fopenmp (found version "4.5")\n-- Found OpenMP_CXX: -fopenmp (found version "4.5")\n-- Found OpenMP: TRUE (found version "4.5")\n-- x86 detected\n-- Adding CPU backend variant ggml-cpu: -march=native;-march=native \n-- LLAMA_BUILD_COMMON is OFF, disabling LLAMA_CURL\n-- Found CUDA: /usr (found version "11.5")\n-- ALL_SOURCES: /home/yhc/HybriMoE/ktransformers/ktransformers_ext/ext_bindings.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/cpu_backend/backend.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/cpu_backend/task_queue.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/llamafile/linear.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/llamafile/moe.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/flags.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_avx2.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_zen4.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_arm82.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/sgemm.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx2.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx512f.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avxvnni.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_fma.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_zen4.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm80.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm82.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx2.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx512f.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avxvnni.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_fma.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_zen4.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm80.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm82.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_unsupported.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/kvcache/kvcache_attn.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/kvcache/kvcache_load_dump.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/kvcache/kvcache_read_write.cpp;/home/yhc/HybriMoE/ktransformers/ktransformers_ext/operators/kvcache/kvcache_utils.cpp\n-- NUMA support is disabled\n-- NUMA library not found or user not set USE_NUMA - disabling NUMA support\n-- Configuring done (1.6s)\n-- Generating done (0.0s)\n-- Build files have been written to: /home/yhc/HybriMoE/ktransformers/ktransformers_ext/build\n'
Standard error: b'Using compatibility mode for Python, set PYBIND11_FINDPYTHON to NEW/OLD to silence this message\nCMake Warning at /home/yhc/HybriMoE/third_party/llama.cpp/CMakeLists.txt:108 (message):\n LLAMA_NATIVE is deprecated and will be removed in the future.\n\n Use GGML_NATIVE instead\n\nCall Stack (most recent call first):\n /home/yhc/HybriMoE/third_party/llama.cpp/CMakeLists.txt:118 (llama_option_depr)\n\n\nCMake Warning (dev) at CMakeLists.txt:242 (find_package):\n Policy CMP0146 is not set: The FindCUDA module is removed. Run "cmake\n --help-policy CMP0146" for policy details. Use the cmake_policy command to\n set the policy and suppress this warning.\n\nThis warning is for project developers. Use -Wno-dev to suppress it.\n\nCMake Warning:\n Manually-specified variables were not used by the project:\n\n EXAMPLE_VERSION_INFO\n\n\n'
Traceback (most recent call last):
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
main()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
return _build_backend().build_wheel(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/build_meta.py", line 435, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/build_meta.py", line 423, in _build
return self._build_with_temp_dir(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/build_meta.py", line 404, in _build_with_temp_dir
self.run_setup()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/build_meta.py", line 317, in run_setup
exec(code, locals())
File "<string>", line 443, in <module>
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/__init__.py", line 115, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 186, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
dist.run_commands()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
self.run_command(cmd)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
super().run_command(command)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "<string>", line 243, in run
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
self.run_command("build")
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
super().run_command(command)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
self.distribution.run_command(command)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/dist.py", line 1102, in run_command
super().run_command(command)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
cmd_obj.run()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 96, in run
_build_ext.run(self)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
self.build_extensions()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
build_ext.build_extensions(self)
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
self._build_extensions_serial()
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
self.build_extension(ext)
File "<string>", line 397, in build_extension
File "/home/yhc/.conda/envs/hybrimoe/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--verbose', '--parallel=48']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers error: failed-wheel-build-for-install
× Failed to build installable wheels for some pyproject.toml based projects ╰─> ktransformers (/mnt/share/yhc/conda_envs/hybrimoe) ➜ HybriMoE git:(main) ✗ 求求了 大家帮我看看这是什么问题 我需要帮助
