Baichuan2 icon indicating copy to clipboard operation
Baichuan2 copied to clipboard

Published 20 hours ago • verified publisher icon baichuan-inc

Baichuan2-13b-chat-v2版本训练无法进行

Open Taskii-Lei opened this issue 11 months ago • 0 comments

我想用数据微调baichuan2-13b-chat-v2版本，但是一直报错：

 line 331, in get_alibi_mask
    alibi = slopes.unsqueeze(1).unsqueeze(1) * position_point
RuntimeError: [enforce fail at alloc_cpu.cpp:75] err == 0. DefaultCPUAllocator: can't allocate memory: you tried to allocate 671088640 bytes. Error code 12 (Cannot allocate memory)

不知道是什么问题...

Taskii-Lei avatar Feb 29 '24 11:02 Taskii-Lei