Jake Luciani

icon company Anthropic icon location Stamford CT

Results 96 comments of Jake Luciani

GPU support?

Hi, I'm working on a GPU backend see #150 ATM its CPU/SIMD Only

jlama-native shared library not found

Can you run this with debug logging? it should show more details as to why it failed to load.

quantize not working

You should use `jlama chat Qwen/Qwen2-0.5B-JQ4`

Bug: Error parsing tokenizer.json when loading embedding model

Hi @Jozurf I looked into this and this requires Jlama support for unigram tokenizers. (see https://huggingface.co/learn/nlp-course/en/chapter6/7) This can be done but not as trivial as I was initially hoping

FileNotFounException when running langchain4j example

thanks for the report. I will test this on windows

The qwen2 model downloaded from Huggingface reports an error during runtime

Looks like an issue in the native code. Can you tell me the exact model you are using (with link) and how you are loading it in the code?