LMFlow

LMFlow copied to clipboard

It add RAG ability to original lmflow inference and evaluation on some dataset, but it still contains memory issue.

cheng-wang2002

[BUG]使用远程服务器运行chatbot_gradio.py时意外中断连接

2

您好，在使用实验室远程服务器（3张3090卡）运行chatbot_gradio.py文件时会发生服务器中断连接情况，直接退出原本正常运行界面，或者是直接卡住，想请问一下这是什么原因呢？是远程服务器无法带动该程序吗？ 所运行的具体命令为python ./examples/chatbot_gradio.py --deepspeed configs/ds_config_chatbot.json --model_name_or_path YOUR-LLAMA --lora_model_path ./robin-7b --prompt_structure "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to...

11whitewater

[BUG] EvaluatorArguments,

1

Description: I encountered an issue while running the script feedback_training_raft_t2t.py. The script fails with the following traceback: Traceback (most recent call last): File "/hdd/harshit-space/Feedbacknmt/train_scripts/../src/feedback_training_raft_t2t.py", line 15, in from lmflow.args import...

Harshit-tech9

HALIS-sh

[Roadmap] LMFlow Roadmap

2

This document includes the features in LMFlow's roadmap. We welcome any discuss or contribute to the specific features at related Issues/PRs. 🤗 ### Main Features * Data * [x] DPO...

wheresmyhair

- Modified the code structure to fit the structure of `src`. - Fixed some bugs. - Aligned code with previous code.

Aziily

[New Feature] Is Mixtral supported?

1

Can you confirm if Mixtral is currently supported, e.g., `mistralai/Mixtral-8x7B-Instruct-v0.1?` I saw in another issue that Mistral is supported, but I'm not sure about Mixtral-8x7B since it's a different architecture.

markusdr

Today, while processing `ultrachat` data, I encountered an error with lmflow’s `load_data` as follows: > Generating train split: 0 examples [02:27, ? examples/s] > [rank7]: Traceback (most recent call last):...

shizhediao

DPO+ZeRO train error

2

I would like to ask for your advice on the following two questions. 1. DPO train does not seem to support DeepSpeed ZeRO. After manually integrating `DPOAlignerArguments` with the `FinetunerArguments`...

tankeui

RAFT Issues

2

Hello, I am trying to replicate RAFT, but am running into several issues when running ./scripts/run_raft_align.sh. I've tried both the main LMFlow branch and the LMFlow_RAFT_Dev subbranch, but both seem...

jujipotle