llama-chat icon indicating copy to clipboard operation
llama-chat copied to clipboard

CUDA error: an illegal memory access was encountered

Open zeke opened this issue 2 years ago • 2 comments

Seeing this error in the console:

{
  "detail": "CUDA error: an illegal memory access was encountered\\nCUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.\\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.\\nCompile with `TORCH_USE_CUDA_DSA` to enable device-side assertions."
}

zeke avatar Aug 04 '23 20:08 zeke

Seems to always happen on the second message. First chat interaction works, then the second fails.

Screenshot 2023-08-04 at 1 49 04 PM

zeke avatar Aug 04 '23 20:08 zeke

@zeke Is this still happening for you?

fofr avatar Sep 12 '23 12:09 fofr