insightface icon indicating copy to clipboard operation
insightface copied to clipboard

GPU Multithread report errors :CUDA failure 700

Open xxlisa opened this issue 1 year ago • 4 comments

GPU Multithreading always cause this problem:
CUDA failure 700: an illegal memory access was encountered ; GPU=0 ; hostname=*** ; expr=cudaMemcpyAsync(dst_data, src_data, bytes, cudaMemcpyDeviceToHost, static_cast<cudaStream_t>(stream.GetHandle())); and CUDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=***; expr=cudnnConvolutionForward(cudnn_handle, &alpha, s_.x_tensor, s_.x_data, s_.w_desc, s_.w_data, s_.conv_desc, s_.algo, workspace.get(), s_.workspace_bytes, &beta, s_.y_tensor, s_.y_data); and CUDNN failure 4 But gpu single threading has no problem

xxlisa avatar May 17 '23 13:05 xxlisa

c / c++ code?

nttstar avatar May 17 '23 15:05 nttstar

python fastapi multithreading

xxlisa avatar May 18 '23 01:05 xxlisa

Did you find any solution?

yoavchai avatar Sep 28 '23 13:09 yoavchai

can you show the code?

maxmelichov avatar Dec 26 '23 15:12 maxmelichov