lms
lms copied to clipboard
LMS Hangs After Displaying "Verification succeeded. The server is running on port <number>" and Doesn't Load Model
Describe the bug
lms hangs after displaying Verification succeeded. The server is running on port 11435. and doesn't load a model, though LM Studio itself opens successfully.
To Reproduce Steps to reproduce the behavior (when LM Studio is closed):
- Open PowerShell 7.4.3 (
pwsh) - Type:
lms server start && lms load MaziyarPanahi/DARE_TIES_13B-GGUF --gpu max -y - The LM Studio GUI will open. PowerShell output will be:
PS C:\Users\unnamed> lms server start && lms load MaziyarPanahi/DARE_TIES_13B-GGUF --gpu max -y
Attempting to start the server on port 11435...
Launching LM Studio minimized... (Disable auto-launching via the --no-launch flag.)
Requested the server to be started on port 11435.
Verifying the server is running...
Verification succeeded. The server is running on port 11435.
LM Studio log:
[2024-06-27 22:41:21.620] [INFO] [LM STUDIO SERVER] Verbose server logs are ENABLED
[2024-06-27 22:41:21.641] [INFO] [LM STUDIO SERVER] Success! HTTP server listening on port 11435
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] Supported endpoints:
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] -> GET http://localhost:11435/v1/models
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] -> POST http://localhost:11435/v1/chat/completions
[2024-06-27 22:41:21.643] [INFO] [LM STUDIO SERVER] -> POST http://localhost:11435/v1/completions
[2024-06-27 22:41:21.643] [INFO] [LM STUDIO SERVER] -> POST http://localhost:11435/v1/embeddings <------------ NEW!
[2024-06-27 22:41:21.644] [INFO] [LM STUDIO SERVER] Logs are saved into C:\tmp\lmstudio-server-log.txt
- Type
lms lsin a new PowerShell window. It hangs and doesn't show anything. - Make a CURL query:
PS C:\Users\unnamed> curl http://localhost:11435/v1/models
{
"data": [],
"object": "list"
}
Expected behavior The model should load successfully and be listed when queried.
System Info:
- OS: Windows 11
- Platform: x64
- PowerShell Version: 7.4.3
- LM Studio version: 0.2.24
- lms - LM Studio CLI - v0.2.24 GitHub: https://github.com/lmstudio-ai/lmstudio-cli