meshed-memory-transformer
meshed-memory-transformer copied to clipboard
Beam search error
Hi everyone,
While evaluating the model, I got the following error:
RuntimeError: CUDA error: CUBLAS_STATUS_EXECUTION_FAILED when calling
cublasLtMatmul( ltHandle, computeDesc.descriptor(), &alpha_val, mat1_ptr, Adesc.descriptor(), mat2_ptr, Bdesc.descriptor(), &beta_val, result_ptr, Cdesc.descriptor(), result_ptr, Cdesc.descriptor(), &heuristicResult.algo, workspace.data_ptr(), workspaceSize, at::cuda::getCurrentCUDAStream())`
I think that it could be a problem of shape for the input in the decoding stage of the model, when asking to search the best captions fot a batch of images.
How should I fix the error in your opinion? The error occurs exactly here: attention