Faye issues

Repositories
Issues
Comments

Results 1 issues of


                                            Faye

RuntimeError: CUDA error: CUBLAS_STATUS_INVALID_VALUE when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)

在模型lora微调时编写shell脚本如下，出现图中错误，错误的原因是什么，如何修改？ python train.py \ --load_model "/home/intern/workspace/LLM/RWKV-LM-LoRA/weight/RWKV-4-Pile-3B-Chn-testNovel-done-ctx2048-20230312.pth" \ --proj_dir "/home/intern/workspace/LLM/RWKV-LM-LoRA/weight/lora" \ --data_file "/home/intern/workspace/LLM/RWKV-LM-LoRA/RWKV-v4neo/data/firefly-text_text_document" \ --data_type "binidx" \ --vocab_size 50277 \ --ctx_len 2048 \ --epoch_steps 1000 --epoch_count 1000 \ --epoch_begin 0 --epoch_save...