ollama icon indicating copy to clipboard operation
ollama copied to clipboard

Unable to load dynamic server library on Mac

Open elewis787 opened this issue 2 years ago • 2 comments

What is the issue?

When using the llm package and calling New the auto-detect dynamic lib fails auto-detect.

This is related to pull request https://github.com/ollama/ollama/pull/2403 and issue https://github.com/ollama/ollama/issues/2386.

The current fix does not set available dynamic libs after auto-detection causing the dynamic lib path to be empty.

availableDynLibs should be checked and used after calling native init.

What did you expect to see?

The expectation is that the dynamic lib will be found

Steps to reproduce

import LLM package and attempt to initialize an LLM using New

Are there any recent changes that introduced the issue?

No response

OS

macOS

Architecture

arm64

Platform

No response

Ollama version

main branch

GPU

Apple

GPU info

No response

CPU

Apple

Other software

No response

elewis787 avatar Mar 14 '24 23:03 elewis787

I think this should be covered by https://github.com/ollama/ollama/pull/3122

dhiltgen avatar Mar 15 '24 22:03 dhiltgen

I think this should be covered by https://github.com/ollama/ollama/pull/3122

I'll pull the changes and test it out. At a first glance I don't know if this solves the empty path for the dynamic libs map but I'll verify.

elewis787 avatar Mar 16 '24 02:03 elewis787

If you're still seeing problems related to tmpdir cleanup, let us know.

dhiltgen avatar Apr 12 '24 21:04 dhiltgen