h2ogpt icon indicating copy to clipboard operation
h2ogpt copied to clipboard

Published 20 hours ago • verified publisher icon h2oai

Windows cuda issue

Open elich11 opened this issue 1 year ago • 2 comments

Try to install on 2 separate windows machines (10, 11). In both cases for an error: CUDA Setup failed despite GPU being available. Here is the full issue log (TLDR: it can't find libbitsandbytes_cuda121.dll although it exists in this location): python -m bitsandbytes

===================================BUG REPORT=================================== Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

bin D:\projects\llm_gpu\gpu\Lib\site-packages\bitsandbytes\libbitsandbytes_cuda121.dll False CUDA SETUP: CUDA runtime path found: D:\Program Files\cuda\bin\cudart64_12.dll CUDA SETUP: Highest compute capability among GPUs detected: 7.5 CUDA SETUP: Detected CUDA version 121 CUDA SETUP: Loading binary D:\projects\llm_gpu\gpu\Lib\site-packages\bitsandbytes\libbitsandbytes_cuda121.dll... Could not find module 'D:\projects\llm_gpu\gpu\Lib\site-packages\bitsandbytes\libbitsandbytes_cuda121.dll' (or one of its dependencies). Try using the full path with constructor syntax.

elich11 avatar Jul 07 '23 10:07 elich11

Hi, did you try following the windows specific instructions? https://github.com/h2oai/h2ogpt/blob/main/docs/README_WINDOWS.md

That is what worked for me, using the bitsandbytes linked there.

pseudotensor avatar Jul 07 '23 20:07 pseudotensor

Thanks, I did, on 2 independent machines. Anyway, maybe I missed something. I will try again.

Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: pseudotensor @.> Sent: Friday, July 7, 2023 11:21:15 PM To: h2oai/h2ogpt @.> Cc: elich11 @.>; Author @.> Subject: Re: [h2oai/h2ogpt] Windows cuda issue (Issue #399)

Hi, did you try following the windows specific instructions? https://github.com/h2oai/h2ogpt/blob/main/docs/README_WINDOWS.md

That is what worked for me, using the bitsandbytes linked there.

— Reply to this email directly, view it on GitHubhttps://github.com/h2oai/h2ogpt/issues/399#issuecomment-1626030723, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AE4MWRAQB7KIBI5X6CZD5A3XPBVTXANCNFSM6AAAAAA2BUH36M. You are receiving this because you authored the thread.Message ID: @.***>

elich11 avatar Jul 07 '23 20:07 elich11

I revamped and fully tested the docs for windows, please try again: https://github.com/h2oai/h2ogpt/blob/main/docs/README_WINDOWS.md

pseudotensor avatar Jul 26 '23 05:07 pseudotensor