LMFlow

LMFlow copied to clipboard

CUDA cannot be found

1

   

ShiXiangXiang123

Error in fine-tuning llama

4

报错日志如下，请问是因为网络原因？ 05/28/2023 17:18:09 - WARNING - datasets.builder - Found cached dataset json (/home/lmw22/.cache/huggingface/datasets/json/default-356c98baf89317c6/0.0.0/0f7e3662623656454fcd2b650f34e886a7db4b9104504885bd462096cc7a9f51) 'HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /gpt2/resolve/main/tokenizer_config.json (Caused by ConnectTimeoutError(, 'Connection to huggingface.co timed out. (connect...

LiuMingwu

Unable to resolve any data

2

deepspeed ${deepspeed_args} \ examples/finetune.py \ --deepspeed configs/ds_config_zero3.json \ --bf16 \ --run_name finetune_with_lora \ --model_name_or_path /output_models/llama7b-lora-170k \ --num_train_epochs 0.01 \ --learning_rate 2e-5 \ --dataset_path /data/converted_data.json \ --per_device_train_batch_size 1 \ --per_device_eval_batch_size 1...

ShiXiangXiang123

CUDA cannot be found

5

CUDA exception! Error code: no CUDA-capable device is detected CUDA exception! Error code: initialization error CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Detected CUDA version 118

ShiXiangXiang123

repeat the question

2

使用的模型是llama7b，数据集是用的hugging face上的finance_alpaca（68.9K），制作成了下面的格式： { "type": "text2text", "instances": [ { "input": "###Instruction: If you are a financial adviser, customer will ask you some questions. ###Human: For a car, what scams can be...

Shelton1013

model forgetting

10

我使用一个医学问答数据集（[chatdoctor](https://github.com/Kent0n-Li/ChatDoctor)）来微调robin-7b-v2，即使只训练0.01个epoch，也会导致完全失去对话能力。 数据集形式如下： { "type": "text2text", "instances": [ { "input": "###Human: Hi, I have what feels like a lump in my hip felxor, pretty much in the crease between lower abdominals...

snake-head

prediction model on industrial data

7

[New Feature]能否用自己的数据训练一个预测模型，我的数据是工业上的数据，有很多特征值，想用它来训练从而帮我预测工业参数。

ShiXiangXiang123

No config.json

1

我的训练输出目录如下：  里面没有config.json文件，导致我融合模型的时候报如下的错误： 

huizhilei

strange response

3

模型权重是在 https://huggingface.co/LMFlow/Robin-7b-v2/tree/main 下载的，应该不需要再合并了。 启动命令使用的是： CUDA_VISIBLE_DEVICES=0 python examples/chatbot.py --model_name_or_path /home/gpt/weights/Robin-7b-v2 --deepspeed configs/ds_config_chatbot.json --use_ram_optimized_load False 

klykq111

[BUG] ImportError: cannot import name 'UnencryptedCookieSessionFactoryConfig' from 'pyramid.session'

1

**Describe the bug** ```bash python service/app.py CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths... CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so CUDA SETUP: Highest compute...

kulame