Iñigo Ballester
Iñigo Ballester
> What about exec `export LIGHTEN=0` before building image? I already managed to build the image, but that could be an option also, thanks!
After having a look to the codebase of both the `NexaVLMInference` and `NexaTextInference` class definitions, I noticed that the parameter to pass in the call made from `main.py` is `nctx`...
> What is the max value that n_ctx can be set to? That depends on the model you refer to. For the text model used here, `llama3.2-3b`, I think it...
> I am on Mac M2 and it is working, I am mainly trying to use it to organize a pdf ebook library, but as soon as I put more...