ccutyear

run error about "InternalError (see above for traceback): Blas xGEMMBatched launch failed : a.shape=[12,512,64], b.shape=[12,64,512], m=512, n=512, k=64, batch_size=12"

2

this is my run bash,new_gpu_squad_bash.sh(Modified from:gpu_squad_base.sh) ` #### local path SQUAD_DIR=../SQUAD INIT_CKPT_DIR=../xlnet_cased_L-12_H-768_A-12 PROC_DATA_DIR=proc_data/squad MODEL_DIR=experiment/squad_new_gpu #### Use 3 GPUs, each with 8 seqlen-512 samples python ../run_squad.py \ --use_tpu=False \ --num_hosts=1 \...