jonnyhe

Results 3 comments of jonnyhe

RuntimeError: split_with_sizes expects split_sizes to sum exactly to 185 (input tensor's size at dimension 0), but got split_sizes=[83, 84]

Nope, i have just followed the default settings.

open-source

Hi @julianyulu, Any plan to release the code? Thanks in advance

DeepSpeed ZeRO-3预训练

咨询下，这个一般需要多少内存，我这边100多G，一直报内存不足。 RuntimeError: [enforce fail at CPUAllocator.cpp:71] . DefaultCPUAllocator: can't allocate memory: you tried to allocate 4052879360 bytes. Error code 12 (Cannot allocate memory)