open-compass
[Bug] 运行example/eval_api_demo.py出错
先决条件
问题类型
我正在使用官方支持的任务/模型/数据集进行评估。
环境
{'CUDA available': False, 'GCC': 'Apple clang version 16.0.0 (clang-1600.0.26.6)', 'MMEngine': '0.10.7', 'MUSA available': False, 'OpenCV': '4.11.0', 'PyTorch': '2.7.0', 'PyTorch compiling details': 'PyTorch built with:\n' ' - GCC 4.2\n' ' - C++ Version: 201703\n' ' - clang 15.0.0\n' ' - OpenMP 201811\n' ' - LAPACK is enabled (usually provided by ' 'MKL)\n' ' - NNPACK is enabled\n' ' - CPU capability usage: NO AVX\n' ' - Build settings: BLAS_INFO=accelerate, ' 'BUILD_TYPE=Release, ' 'COMMIT_SHA=134179474539648ba7dee1317959529fbd0e7f89, ' 'CXX_COMPILER=/usr/bin/c++, CXX_FLAGS= ' '-fvisibility-inlines-hidden -DUSE_PTHREADPOOL ' '-DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI ' '-DLIBKINETO_NOROCTRACER -DLIBKINETO_NOXPUPTI=ON ' '-DUSE_PYTORCH_QNNPACK ' '-DAT_BUILD_ARM_VEC256_WITH_SLEEF -DUSE_XNNPACK ' '-DUSE_PYTORCH_METAL_EXPORT ' '-DSYMBOLICATE_MOBILE_DEBUG_HANDLE ' '-DUSE_COREML_DELEGATE -O2 -fPIC -Wall -Wextra ' '-Werror=return-type -Werror=non-virtual-dtor ' '-Werror=braced-scalar-init ' '-Werror=range-loop-construct ' '-Werror=bool-operation -Wnarrowing ' '-Wno-missing-field-initializers ' '-Wno-unknown-pragmas -Wno-unused-parameter ' '-Wno-strict-overflow -Wno-strict-aliasing ' '-Wvla-extension -Wsuggest-override ' '-Wnewline-eof -Winconsistent-missing-override ' '-Winconsistent-missing-destructor-override ' '-Wno-pass-failed -Wno-error=old-style-cast ' '-Wconstant-conversion -Qunused-arguments ' '-fcolor-diagnostics -faligned-new ' '-fno-math-errno -fno-trapping-math ' '-Werror=format -DUSE_MPS -Wno-missing-braces, ' 'LAPACK_INFO=accelerate, TORCH_VERSION=2.7.0, ' 'USE_CUDA=OFF, USE_CUDNN=OFF, ' 'USE_CUSPARSELT=OFF, USE_EIGEN_FOR_BLAS=ON, ' 'USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, ' 'USE_MKL=OFF, USE_MKLDNN=OFF, USE_MPI=OFF, ' 'USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, ' 'USE_ROCM=OFF, USE_ROCM_KERNEL_ASSERT=OFF, \n', 'Python': '3.10.17 | packaged by conda-forge | (main, Apr 10 2025, 22:23:34) ' '[Clang 18.1.8 ]', 'lmdeploy': "not installed:No module named 'lmdeploy'", 'numpy_random_seed': 2147483648, 'opencompass': '0.4.2+d572761', 'sys.platform': 'darwin', 'transformers': '4.52.4'}
重现问题 - 代码/配置示例
源码，没做改动。
通过“pip install -e .”安装
重现问题 - 命令或脚本
opencompass examples/eval_api_demo.py
重现问题 - 错误信息
其他信息
我想通过api跑评测，似乎只有这一个脚本，在没有配API_KEY的情况下，尝试跑了example，出现上述错误，想请问这该如何解决。以及有几个问题想请教下：
- 使用"opencompass examples/eval_api_demo.py“能不能通过"python run.py xxx"方式运行，这样会方便debug
- 如果我想用dou_bao/qwen_api，应该做哪些工作
