defmodenet

I'm having this exact same issue. File organizer works when selecting date or type, but not content. Has anyone tried just running a model with nexa to make sure inference...

After a lot of exploration, it seems like llava vicuna will not utilize llama-cpp unless ran with huggingface. I think this error is related to how the model is initialized,...

@reconrad48 Just a disclaimer: These changes should be made on local machines only and are not intended for distribution unless licensed to do so. For those not familiar with editing...

Testing with the modifications failed with the following error: ``` ⠼ llama_init_from_model: n_ctx_per_seq (2048) < n_ctx_train (131072) -- the full capacity of the model will not be utilized **----------------------------------------------** **...

@mattsmith95 this helped me get beyond the initial error as well, thank you! On Debian 12 with rtx 3060, installed nexa ai with the following: ``` CMAKE_ARGS="-DGGML_CUDA=ON -DSD_CUBLAS=ON" pip install...

If you have anaconda installed, then you need to ensure you activate the environment for which nexa was installed. This type of error can occur if you try to run...