Julylmm

CUBLAS_STATUS_EXECUTION_FAILED when calling `cublasGemmEx( handle, opa, opb, m, n, k, &falpha, a, CUDA_R_16F, lda, b, CUDA_R_16F, ldb, &fbeta, c, CUDA_R_16F, ldc, CUDA_R_32F, CUBLAS_GEMM_DFALT_TENSOR_OP)

3

When i loaded ernie-1.0 model to do fine-tune task, i came across runtime error. what's wrong?

qwen1.5_7b sft 单机四卡v100，run tokenizer的时候一直卡着，最后报错cuda显存不够，是什么情况？

5

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction  ### Expected behavior _No response_ ### System Info _No response_ ### Others _No...

单机多卡qwen1.5_7b_base fsdp+qlora sft，加载模型报错RuntimeError: Only Tensors of floating point and complex dtype can require gradients

1

### Reminder - [X] I have read the README and searched the existing issues. ### Reproduction CUDA_VISIBLE_DEVICES=0,1 accelerate launch \ --config_file ${cur_path}/examples/accelerate/fsdp_config.yaml \ ${cur_path}/src/train_bash.py \ --stage sft \ --do_train \...