lms icon indicating copy to clipboard operation
lms copied to clipboard

Windows: using --verbose prevents ability to load model

Open mferris77 opened this issue 1 year ago • 0 comments

Hi and thanks for creating this utility. I was putting together a batch file to run LM Studio so I can connect from a networked machine and was trying out some of the various options to get it started.

My goal is simple: Start the server, load a model, show the logs as activity comes in. Here is the batch file I put together:

@echo off
echo LMS Starting...
lms server start --cors --verbose
timeout 5
echo Loading Model...
lms load <modelname> --gpu max -y
echo Logging LMS stream...
lms log stream

...and executing it via another batch file which kicks off some other processes:

start "LMS" cmd /k lms_start.bat

It would hang at Loading Model.... When I removed --verbose, it worked as expected.

EDIT: I was wrong, and --verbose is not the culprit! It seems simply trying to load the model when launched in a new window causes it to hang. If I run all of the above commands manually, everything works as expected. But when run from a batch file, it hangs when loading the model. I'll try a few more scenarios and will report back to see if one of the flags are the cause.

I thought about deleting this outright but wanted to bring it to the dev's attention as it is still unexpected behavior.

mferris77 avatar Jun 16 '24 13:06 mferris77