lms icon indicating copy to clipboard operation
lms copied to clipboard

LMS Hangs After Displaying "Verification succeeded. The server is running on port <number>" and Doesn't Load Model

Open magicxor opened this issue 1 year ago • 4 comments

Describe the bug lms hangs after displaying Verification succeeded. The server is running on port 11435. and doesn't load a model, though LM Studio itself opens successfully.

To Reproduce Steps to reproduce the behavior (when LM Studio is closed):

  1. Open PowerShell 7.4.3 (pwsh)
  2. Type: lms server start && lms load MaziyarPanahi/DARE_TIES_13B-GGUF --gpu max -y
  3. The LM Studio GUI will open. PowerShell output will be:
PS C:\Users\unnamed> lms server start && lms load MaziyarPanahi/DARE_TIES_13B-GGUF --gpu max -y
Attempting to start the server on port 11435...
Launching LM Studio minimized... (Disable auto-launching via the --no-launch flag.)
Requested the server to be started on port 11435.
Verifying the server is running...
Verification succeeded. The server is running on port 11435.

LM Studio log:

[2024-06-27 22:41:21.620] [INFO] [LM STUDIO SERVER] Verbose server logs are ENABLED
[2024-06-27 22:41:21.641] [INFO] [LM STUDIO SERVER] Success! HTTP server listening on port 11435
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] Supported endpoints:
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] ->	GET  http://localhost:11435/v1/models
[2024-06-27 22:41:21.642] [INFO] [LM STUDIO SERVER] ->	POST http://localhost:11435/v1/chat/completions
[2024-06-27 22:41:21.643] [INFO] [LM STUDIO SERVER] ->	POST http://localhost:11435/v1/completions
[2024-06-27 22:41:21.643] [INFO] [LM STUDIO SERVER] ->	POST http://localhost:11435/v1/embeddings     <------------ NEW!
[2024-06-27 22:41:21.644] [INFO] [LM STUDIO SERVER] Logs are saved into C:\tmp\lmstudio-server-log.txt
  1. Type lms ls in a new PowerShell window. It hangs and doesn't show anything.
  2. Make a CURL query:
PS C:\Users\unnamed> curl http://localhost:11435/v1/models
{
  "data": [],
  "object": "list"
}

Expected behavior The model should load successfully and be listed when queried.

System Info:

  • OS: Windows 11
  • Platform: x64
  • PowerShell Version: 7.4.3
  • LM Studio version: 0.2.24
  • lms - LM Studio CLI - v0.2.24 GitHub: https://github.com/lmstudio-ai/lmstudio-cli

magicxor avatar Jun 28 '24 02:06 magicxor