Smilefish1

[BUG/Help] <title>ValueError: expected sequence of length 613 at dim 1 (got 612)

2

### Is there an existing issue for this? - [X] I have searched the existing issues ### Current Behavior 代码拉的是最新的 用pt的方式微调出现这种bug,数据格式是alpaca格式， [ { "instruction": "用JavaScript实现队列；", "input": "这是关于JavaScript的问题", "output": "```javascript\nclass Queue...

[BUG] <title> 72B模型导入报错，救命，急！！！！

2

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...

拜托大佬们帮我看下，用6张A800-80G预训练百川7B内存消耗问题

5

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction deepspeed --num_gpus 6 --master_port=9901 src/train_bash.py \ --deepspeed ds_config.json \ --train_id testetstets \ --stage pt...