hopeforus

[BUG] 运行的时候报错ImportError: libcudnn.so.8: cannot open shared object file: No such file or directory

3

**问题描述 / Problem Description**raceback (most recent call last): File "webui.py", line 4, in from chains.local_doc_qa import LocalDocQA File "/home/hope/work/langchain-ChatGLM/chains/local_doc_qa.py", line 4, in from configs.model_config import * File "/home/hope/work/langchain-ChatGLM/configs/model_config.py", line 1,...

按照说明推理的时候报错

4

>>> model = AutoModelForCausalLM.from_pretrained("/home/hope/work/models/internlm-chat-7b-8k", trust_remote_code=True).to(torch.bfloat16).cuda() Loading checkpoint shards: 100%|███████████████████████████████| 2/2 [00:11>> import torch >>> tokenizer = AutoTokenizer.from_pretrained("/home/hope/work/models/internlm-chat-7b-8k", trust_remote_code=True) >>> model = model.eval()Traceback (most recent call last): File "", line 1,...

### Describe the bug from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("internlm/internlm-7b", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("internlm/internlm-7b", trust_remote_code=True).cuda() model = model.eval() inputs = tokenizer(["A beautiful flower"], return_tensors="pt") for k,v in inputs.items():...

训练到这一步报错 build.ninja...

4

mitting ninja build file /home/hope/.cache/torch_extensions/py310_cu117/wkv_1024/build.ninja... Building extension module wkv_1024... Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N) [1/2] /usr/bin/nvcc -DTORCH_EXTENSION_NAME=wkv_1024 -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\"...

如何运行推理？

1

基础模型下载了，lora也下载了，怎么运行推理呢？

训练qwen -14B-base 报错，chat 正常

1

2023-12-30 09:32:35.529 | INFO | component.dataset:__init__:317 - there are 1074551 data in dataset 2023-12-30 09:32:35.545 | INFO | __main__:main:221 - *** starting training *** 0%| | 0/89546 [00:00

RWKV 模型没有config.josn 文件吗？用text-generation-webui 报错

5

EnvironmentError( OSError: models/rwkv-4-raven does not appear to have a file named config.json. Checkout ‘https://huggingface.co/models/rwkv-4-raven/None’ for available files.

按照教程微调训练，出现这个fine tune loop early stopped

1

完全按照教程操作的，麻烦看看什么原因？ 

构建知识库报错python plugins/gen_data_st.py时候ModuleNotFoundError: No module named 'exceptions'

1

python plugins/gen_data_st.py Traceback (most recent call last): File "/home/hope/work/wenda/plugins/gen_data_st.py", line 12, in import docx File "/home/hope/miniconda3/envs/wenda/lib/python3.10/site-packages/docx.py", line 30, in from exceptions import PendingDeprecationWarning ModuleNotFoundError: No module named 'exceptions'