(Mac M1) FileNotFoundError: Shared library with base name 'llava_shared' not found

[sanghviharshit]

Stacktrace

Please choose the mode to organize your files:
1. By Content
2. By Date
3. By Type
Enter 1, 2, or 3 (or type '/exit' to exit): 1
Checking if the model is already downloaded. If not, downloading it now.
Traceback (most recent call last):
  File "/Users/hsanghvi/workspace/personal/Local-File-Organizer/main.py", line 337, in <module>
    main()
  File "/Users/hsanghvi/workspace/personal/Local-File-Organizer/main.py", line 222, in main
    initialize_models()
  File "/Users/hsanghvi/workspace/personal/Local-File-Organizer/main.py", line 51, in initialize_models
    image_inference = NexaVLMInference(
                      ^^^^^^^^^^^^^^^^^
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/gguf/nexa_inference_vlm.py", line 150, in __init__
    self._load_model()
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/utils.py", line 304, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/gguf/nexa_inference_vlm.py", line 163, in _load_model
    self.projector_handler(
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/gguf/llama/llama_chat_format.py", line 2670, in __init__
    import nexa.gguf.llama.llava_cpp as llava_cpp
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/gguf/llama/llava_cpp.py", line 40, in <module>
    _libllava = load_library(_libllava_base_name)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/hsanghvi/miniconda3/envs/local_file_organizer/lib/python3.12/site-packages/nexa/gguf/lib_utils.py", line 75, in load_library
    raise FileNotFoundError(
FileNotFoundError: Shared library with base name 'llava_shared' not found
(local_file_organizer) hsanghvi@hsanghv-ltmcuum:~/workspace/personal/Local-File-Organizer|main⚡ ⇒

System Information

• OS: Darwin 23.6.0
• OS Version: Darwin Kernel Version 23.6.0: Fri Nov 15 15:13:15 PST 2024; root:xnu-10063.141.1.702.7~1/RELEASE_ARM64_T6000
• Machine: arm64
• Processor: arm

Python Information

• Python Version: 3.12.9 | packaged by Anaconda, Inc. | (main, Feb 6 2025, 12:55:12) [Clang 14.0.6 ]
• Python Implementation: CPython
• Python Compiler: Clang 14.0.6

Environment Information

• Conda Environment: local_file_organizer

Installed Packages

altair==5.5.0
annotated-types==0.7.0
anyio==4.8.0
attrs==25.1.0
audioread==3.0.1
autocommand==2.2.2
av==14.1.0
backports.tarfile==1.2.0
blinker==1.9.0
cachetools==5.5.1
certifi==2025.1.31
cffi==1.17.1
charset-normalizer==3.4.1
click==8.1.8
cmake==3.31.4
coloredlogs==15.0.1
ctranslate2==4.5.0
decorator==5.1.1
diskcache==5.6.3
et-xmlfile==2.0.0
fastapi==0.115.8
faster-whisper==1.1.1
filelock==3.17.0
flatbuffers==25.1.24
fsspec==2025.2.0
gitdb==4.0.12
gitpython==3.1.44
h11==0.14.0
huggingface-hub==0.28.1
humanfriendly==10.0
idna==3.10
importlib-metadata==8.0.0
inflect==7.3.1
jaraco.collections==5.1.0
jaraco.context==5.3.0
jaraco.functools==4.0.1
jaraco.text==3.12.1
jinja2==3.1.5
joblib==1.4.2
jsonschema-specifications==2024.10.1
jsonschema==4.23.0
lazy-loader==0.4
librosa==0.10.2.post1
llvmlite==0.44.0
lxml==5.3.0
markdown-it-py==3.0.0
markupsafe==3.0.2
mdurl==0.1.2
modelscope==1.22.3
more-itertools==10.3.0
mpmath==1.3.0
msgpack==1.1.0
narwhals==1.25.2
nexaai==0.0.9.8
nltk==3.9.1
numba==0.61.0
numpy==2.1.3
onnxruntime==1.20.1
openpyxl==3.1.5
packaging==24.2
pandas==2.2.3
pillow==11.1.0
pip==25.0
platformdirs==4.3.6
pooch==1.8.2
prompt-toolkit==3.0.50
protobuf==5.29.3
pyarrow==19.0.0
pycparser==2.22
pydantic-core==2.27.2
pydantic==2.10.6
pydeck==0.9.1
pygments==2.19.1
pymupdf==1.25.3
pytesseract==0.3.13
python-dateutil==2.9.0.post0
python-docx==1.1.2
python-multipart==0.0.20
python-pptx==1.0.2
pytz==2025.1
pyyaml==6.0.2
referencing==0.36.2
regex==2024.11.6
requests==2.32.3
rich==13.9.4
rpds-py==0.22.3
scikit-learn==1.6.1
scipy==1.15.1
setuptools==75.8.0
six==1.17.0
smmap==5.0.2
sniffio==1.3.1
soundfile==0.13.1
soxr==0.5.0.post1
starlette==0.45.3
streamlit-audiorec==0.1.3
streamlit==1.42.0
sympy==1.13.3
tabulate==0.9.0
tenacity==9.0.0
threadpoolctl==3.5.0
tokenizers==0.21.0
toml==0.10.2
tomli==2.0.1
tornado==6.4.2
tqdm==4.67.1
typeguard==4.3.0
typing-extensions==4.12.2
tzdata==2025.1
urllib3==2.3.0
uvicorn==0.34.0
wcwidth==0.2.13
wheel==0.45.1
xlrd==2.0.1
xlsxwriter==3.2.2
zipp==3.19.2