opencompass
opencompass copied to clipboard
Published
20 hours ago •
open-compass
open-compass
Process failed
Prerequisite
- [X] I have searched Issues and Discussions but cannot get the expected help.
- [X] The bug has not been fixed in the latest version.
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
'CUDA_HOME': 'C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.3',
'GCC': 'n/a',
'GPU 0': 'NVIDIA GeForce RTX 2070 SUPER',
'MMEngine': '0.10.4',
'MSVC': 'Microsoft (R) C/C++ Optimizing Compiler Version 19.37.32824 for x64',
'MUSA available': False,
'NVCC': 'Cuda compilation tools, release 12.3, V12.3.107',
'OpenCV': '4.10.0',
'PyTorch': '2.4.0',
'PyTorch compiling details': 'PyTorch built with:\n'
' - C++ Version: 201703\n'
' - MSVC 192930154\n'
' - Intel(R) oneAPI Math Kernel Library Version '
'2023.1-Product Build 20230303 for Intel(R) 64 '
'architecture applications\n'
' - Intel(R) MKL-DNN v3.4.2 (Git Hash '
'1137e04ec0b5251ca2b4400a4fd3c667ce843d67)\n'
' - OpenMP 2019\n'
' - LAPACK is enabled (usually provided by '
'MKL)\n'
' - CPU capability usage: NO AVX\n'
' - CUDA Runtime 12.4\n'
' - NVCC architecture flags: '
'-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute_80,code=sm_80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_90,code=sm_90\n'
' - CuDNN 90.1\n'
' - Magma 2.5.4\n'
' - Build settings: BLAS_INFO=mkl, '
'BUILD_TYPE=Release, CUDA_VERSION=12.4, '
'CUDNN_VERSION=9.1.0, '
'CXX_COMPILER=C:/cb/pytorch_1000000000000/work/tmp_bin/sccache-cl.exe, '
'CXX_FLAGS=/DWIN32 /D_WINDOWS /GR /EHsc '
'/Zc:__cplusplus /bigobj /FS /utf-8 '
'-DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO '
'-DLIBKINETO_NOCUPTI -DLIBKINETO_NOROCTRACER '
'-DUSE_FBGEMM -DUSE_XNNPACK '
'-DSYMBOLICATE_MOBILE_DEBUG_HANDLE /wd4624 '
'/wd4068 /wd4067 /wd4267 /wd4661 /wd4717 /wd4244 '
'/wd4804 /wd4273, LAPACK_INFO=mkl, '
'PERF_WITH_AVX=1, PERF_WITH_AVX2=1, '
'PERF_WITH_AVX512=1, TORCH_VERSION=2.4.0, '
'USE_CUDA=ON, USE_CUDNN=ON, USE_CUSPARSELT=OFF, '
'USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, '
'USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, '
'USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, '
'USE_NNPACK=OFF, USE_OPENMP=ON, USE_ROCM=OFF, '
'USE_ROCM_KERNEL_ASSERT=OFF, \n',
'Python': '3.10.14 | packaged by conda-forge | (main, Mar 20 2024, 12:40:08) '
'[MSC v.1938 64 bit (AMD64)]',
'TorchVision': '0.19.0',
'numpy_random_seed': 2147483648,
'opencompass': '0.2.6+12b84ae',
'sys.platform': 'win32'```
### Reproduces the problem - code/configuration sample
```python run.py --datasets winogrande_gen --hf-type chat --hf-path internlm/internlm2_5-7b-chat```
### Reproduces the problem - command or script
see above
### Reproduces the problem - error message
```signal.SIGALRM is not available on this platform
signal.SIGALRM is not available on this platform
07/27 20:10:02 - OpenCompass - INFO - Loading winogrande_gen: configs\datasets\winogrande\winogrande_gen.py
07/27 20:10:02 - OpenCompass - INFO - Loading example: configs\summarizers\example.py
07/27 20:10:03 - OpenCompass - INFO - Current exp folder: outputs\default\20240727_201003
07/27 20:10:03 - OpenCompass - WARNING - SlurmRunner is not used, so the partition argument is ignored.
07/27 20:10:03 - OpenCompass - INFO - Partitioned into 1 tasks.
launch OpenICLInfer[internlm2_5-7b-chat_hf/winogrande] on GPU 0
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02<00:00, 2.78s/it]
07/27 20:10:06 - OpenCompass - INFO - Partitioned into 1 tasks.
launch OpenICLEval[internlm2_5-7b-chat_hf/winogrande] on CPU
0%| | 0/1 [00:00<?, ?it/s0
7/27 20:10:25 - OpenCompass - ERROR - C:\code\LLMs\opencompass\opencompass\runners\local.py - _launch - 220 - task OpenICLEval[internlm2_5-7b-chat_hf/winogrande] fail, see
outputs\default\20240727_201003\logs/eval\internlm2_5-7b-chat_hf\winogrande.out
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:18<00:00, 18.97s/it]
07/27 20:10:25 - OpenCompass - ERROR - C:\code\LLMs\opencompass\opencompass\runners\base.py - summarize - 64 - OpenICLEval[internlm2_5-7b-chat_hf/winogrande] failed with code 3221225477
dataset version metric mode internlm2_5-7b-chat_hf
---------- --------- -------- ------ ------------------------
winogrande - - - -
07/27 20:10:25 - OpenCompass - INFO - write summary to C:\code\LLMs\opencompass\outputs\default\20240727_201003\summary\summary_20240727_201003.txt
07/27 20:10:25 - OpenCompass - INFO - write csv to C:\code\LLMs\opencompass\outputs\default\20240727_201003\summary\summary_20240727_201003.csv```
### Other information
Log files are empty except for "failed to create process."
