insightface
insightface copied to clipboard
GPU Multithread report errors :CUDA failure 700
GPU Multithreading always cause this problem:
CUDA failure 700: an illegal memory access was encountered ; GPU=0 ; hostname=*** ; expr=cudaMemcpyAsync(dst_data, src_data, bytes, cudaMemcpyDeviceToHost, static_cast<cudaStream_t>(stream.GetHandle())); and
CUDNN failure 8: CUDNN_STATUS_EXECUTION_FAILED ; GPU=0 ; hostname=***; expr=cudnnConvolutionForward(cudnn_handle, &alpha, s_.x_tensor, s_.x_data, s_.w_desc, s_.w_data, s_.conv_desc, s_.algo, workspace.get(), s_.workspace_bytes, &beta, s_.y_tensor, s_.y_data); and
CUDNN failure 4
But gpu single threading has no problem
c / c++ code?
python fastapi multithreading
Did you find any solution?
can you show the code?