GPU support?

Open fancellu opened this issue 8 months ago • 1 comments

I have Jlama running fine (via langchain4j), but don't see it using my GPU at all (4090)

Is there something I need to do to enable this? Or is it CPU only?

Thanks

Apr 17 '25 17:04 fancellu

Hi, I'm working on a GPU backend see #150

ATM its CPU/SIMD Only

Apr 18 '25 00:04 tjake