JittorLLMs
JittorLLMs copied to clipboard
Jittor
计图大模型推理库，具有高性能、配置要求低、中文支持好、可移植等特点
环境： win11，python 3.10，笔记本电脑，rtx 3050 4G 以下是报错情况： Failed reason:[f 0702 17:51:16.026000 80 parallel_compiler.cc:331] Error happend during compilation: [Error] source file location:F:\work\win\wf\py\gpt\JittorLLMs\model_cach\.cache\jittor\jt1.3.8\cl\py3.10.11\Windows-10-10.x04\13thGenIntelRCxf6\default\cu11.2.67\jit\getitem__Ti_float16__IDIM_1__ODIM_1__IV0_0__IO0_0__VS0_1__JIT_1__JIT_cpu_1__index_t_int32_hash_eaf0bc6f85e36896_op.cc Compile operator(0/2)failed:Op(5933:0:1:1:i1:o1:s0,getitem.bool->5934) Reason: [f 0702 17:51:16.026000 80 log.cc:608] Check failed...
Failed reason:[f 0503 13:12:22.563000 04 py_var_tracer.cc:90] python3.11 not supported yet
环境：python=3.8，jittor=1.3.7.10，jtorch=0.1.7，在按照readme安装完后运行下列命令： export JT_SYNC=1 export trace_py_var=3 export JT_SAVE_MEM=1 export cpu_mem_limit=10000000000 export device_mem_limit=8000000000 conda activate jittorllm cd JittorLLMs/ python cli_demo.py chatglm 然后出现如下问题： [i 1015 22:19:39.834705 92 __init__.py:227] Total mem: 12.35GB, using 4...
[i 0518 10:10:26.348652 20 cuda_flags.cc:39] CUDA enabled. 用户输入:1+1 Traceback (most recent call last): File "cli_demo.py", line 9, in model.chat() File "/root/chatglm/JittorLLMs/models/chatglm/__init__.py", line 36, in chat for response, history in self.model.stream_chat(self.tokenizer,...
```bash >>> pip install -r requirements.txt -i https://pypi.jittor.org/simple -I --break-system-packages Defaulting to user installation because normal site-packages is not writeable Looking in indexes: https://pypi.jittor.org/simple WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None,...
Centos7环境信息： gcc 6.1.0 cuda 11.7 python 3.9 [i 0523 18:12:43.006756 44 jit_compiler.cc:28] Load cc_path: /home/aaa/anaconda3/envs/jjitor/bin/g++ terminate called after throwing an instance of 'std::runtime_error' what(): [f 0523 18:12:43.149831 44 helper_cuda.h:128] CUDA...
