zhangfan-algo

可以支持一下RoPE外推不

1

对于比较长的长下文微调帮助挺大的

**Describe the bug** 2024-05-16 14:19:20 [W socket.cpp:697] [c10d] The IPv6 network addresses of (zf-yi1-5-34b-sft-0516-02-master-0, 23456) cannot be retrieved (gai error: -2 - Name or service not known). 2024-05-16 14:19:35 Traceback...

训练日志记录不完整

3

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction torchrun --nproc_per_node ${num_gpu_per_node} --master_port $MASTER_PORT --master_addr $MASTER_ADDR --node_rank $RANK --nnodes $WORLD_SIZE src/train.py \ --stage...

Can other models be supported?

1

like llama Series and qwen Series

qwen1.5-32b-chat 使用vllm推理很慢

3

已经运行了5分钟,一条数据也没有跑出来 

可以支持一下InternLM2-Math-Plus-Mixtral8x22B的微调吗

1

这个模型效果非常不错,数学上面接近gpt4o了

qwen2 7B 单机8卡 dpo报错

4

**Describe the bug** Traceback (most recent call last): File "/apps1/zhangfan/anaconda3/envs/new_swift/lib/python3.10/site-packages/swift/cli/rlhf.py", line 5, in rlhf_main() File "/apps1/zhangfan/anaconda3/envs/new_swift/lib/python3.10/site-packages/swift/utils/run_utils.py", line 22, in x_main args, remaining_argv = parse_args(args_class, argv) File "/apps1/zhangfan/anaconda3/envs/new_swift/lib/python3.10/site-packages/swift/utils/utils.py", line 131, in...

[Bug]: Model architectures ['Qwen2AudioForConditionalGeneration'] are not supported for now.

2

### Your current environment pip install+https://github.com/vllm-project/vllm.git ### Model Input Dumps _No response_ ### 🐛 Describe the bug (VllmWorkerProcess pid=544861) ERROR 09-13 18:22:53 multiproc_worker_utils.py:226] File "/apps1/zhangfan/anaconda3/envs/new_swift/lib/python3.10/site-packages/vllm/executor/multiproc_worker_utils.py", line 223, in _run_worker_process (VllmWorkerProcess...

qwen2 audio dpo微调报错

1

**Describe the bug**  **Additional context** SIZE_FACTOR=8 MAX_PIXELS=602112 torchrun --nproc_per_node ${num_gpu_per_node} --master_port $MASTER_PORT --master_addr $MASTER_ADDR --node_rank $RANK --nnodes $WORLD_SIZE examples/pytorch/llm/llm_rlhf.py \ --model_cache_dir Qwen2-Audio-7B-Instruct \ --model_type qwen2-audio-7b-instruct \ --rlhf_type dpo \...