lms
lms copied to clipboard
Error: 'Utility process is not defined.'
Crashed when I executed:
(llm) ~/work/llm$ lms get
No exact match found. Please choose a model from the list below.
! Use the arrow keys to navigate, and press enter to select.
? Select a model to download Qwen2.5 7B Instruct 1M
! Use the arrow keys to navigate, and press enter to select.
? Select an option to download Qwen2.5 7B Instruct 1M [Q4_K_M] (4.68 GB)
Downloading Qwen2.5 7B Instruct 1M [Q4_K_M] (4.68 GB)
Finalizing download...
Download completed. You can load the model with:
lms load qwen2.5-7b-instruct-1m
(llm) ~/work/llm$ lms load qwen2.5-7b-instruct-1m
Loading model "lmstudio-community/Qwen2.5-7B-Instruct-1M-GGUF/Qwen2.5-7B-Instruct-1M-Q4_K_M.gguf"...
[LMStudioClient][LLM] Start loading model qwen2.5-7b-instruct-1m...
Error:
┌ Error ────────────────────────────────────────────────────────────────────────────────────────────────┐
│ │
│ Attempt to pull a snapshot of system resources failed. Error: 'Utility process is not defined.' │
│ │
│ │
│ </> STACK TRACE │
│ │
│ at loadModel (./dist/index.js:96620:83) │
│ at Object.handler (./dist/index.js:96568:15) │
│ at process.processTicksAndRejections (node:internal/process/task_queues:95:5) │
│ at async Object.run (./dist/index.js:3159:23) │
│ at async Object.run (./dist/index.js:2920:32) │
│ at async runSafely (./dist/index.js:4668:24) │
│ at async run (./dist/index.js:4653:20) │
│ │
└───────────────────────────────────────────────────────────────────────────────────────────────────────┘
(llm) ~/work/llm$
hello @egberts which operating system is this on? and did you run LM Studio at least once?
lms version --json {"version":"0.0.36"}
On Debian 12 latest update.
$ cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
Downloaded LM-Studio-0.3.10-6-x64.AppImage
and did you run LM Studio at least once?
Yes. A few times that the LM-Studio GUI comes up over a span of a few days before starting to use lms CLI to open the API.
For me this is a GPU driver failure external to LM Studio and a reboot resets the driver. I know this because I get similar driver failure problems when trying to use the GPU with ffmpeg and the only fix is a reboot. Perhaps the error message could add a hint to reboot.
happens here as well (lmstudio 0.3.15b11, rocm) and seems to be related to some state held by the persistent processes that lmstudio launches. there's 5 or so processes that are left behind when exiting lmstudio and after PC goes to sleep and resumes it's no longer able to load models and at least for me doing pkill -f lmstudio and rerunning lmstudio gets it working again.