llm icon indicating copy to clipboard operation
llm copied to clipboard

adds lm studio in plugin directory

Open agustif opened this issue 8 months ago • 11 comments

There was already possible to use LM Studio via OpenAI comaptible plugin but it was not ideal as you had to manually edit config files to add your desired models etc.

This plugin leverages LM Studio api to list available models, etc

https://github.com/agustif/llm-lmstudio

agustif avatar Apr 25 '25 18:04 agustif

Plugin looks good but it's not on PyPI yet: https://pypi.org/project/llm-lmstudio/ - so llm install llm-lmstudio doesn't work.

simonw avatar May 04 '25 21:05 simonw

Plugin looks good but it's not on PyPI yet: https://pypi.org/project/llm-lmstudio/ - so llm install llm-lmstudio doesn't work.

Thank you simon indeed i wanted to add the attachments/image support before publishing, good news is did that today and just published it's v0.1.0 🥳 https://pypi.org/project/llm-lmstudio/0.1.0/

agustif avatar May 06 '25 23:05 agustif

@agustif Any chance you could add some description to the pypi release? Right now it looks quite barren. Some points:

  • The required python release > 3.8 is likely too old as I think llm requires a newer version of python already
  • There is no link back to the project page
  • There is no readme, so it is really hard to discover what the plugin is supposed to do.

dwt avatar Jul 01 '25 06:07 dwt

@agustif Any chance you could add some description to the pypi release? Right now it looks quite barren. Some points:

  • The required python release > 3.8 is likely too old as I think llm requires a newer version of python already
  • There is no link back to the project page
  • There is no readme, so it is really hard to discover what the plugin is supposed to do.

hey! yes will polish it up and publish, thank you for pinging me had forgotten I had not published it to pypi

agustif avatar Jul 03 '25 18:07 agustif

Friendly ping @agustif - I would like to package your project for nixpkgs. But that currently hangs because pypi still looks barren and this pull request is not merged. Is there anything I can do to support you?

dwt avatar Jul 14 '25 05:07 dwt

Friendly ping @agustif, I have added some pull requests to your repo

I hope that this speeds up providing a release with a nice GitHub Page, as that is currently holding back packaging in Nixpkgs.

dwt avatar Jul 21 '25 17:07 dwt

@agustif Thanks for the merges, I was hoping to also get a release on https://pypi.org/project/llm-lmstudio/, so I can proceed to package this in nixpkgs. Anything you are still missing there?

dwt avatar Aug 02 '25 13:08 dwt

@agustif Thanks for the merges, I was hoping to also get a release on https://pypi.org/project/llm-lmstudio/, so I can proceed to package this in nixpkgs. Anything you are still missing there?

will create release now! sorry there for the delay and thank you for all the PR's and help

agustif avatar Aug 02 '25 14:08 agustif

Friendly ping @agustif

It seems your release may have gotten stuck somewhere. Do you perhaps have a guess when you might be able to take another look?

If you found some bugs that are blocking the release, I might be able to help.

dwt avatar Aug 11 '25 21:08 dwt

Friendly ping @agustif - the release on pypi is still elusive, which is currently blocking its inclusion in the plugin directory, which is in turn blociking me from packaging this plugin in nixos. Could you perhaps give some sort of time table when you might get around to publishing the release? I was really hoping that my pull requests (which you merged, thanks for that) should remove almost all the friction of a new release?

dwt avatar Aug 19 '25 20:08 dwt

Friendly ping @agustif - the release page on pypi still looks very barren: https://pypi.org/project/llm-lmstudio/ Could you perhaps get to do a release soonish?

dwt avatar Sep 20 '25 16:09 dwt

I have just tried the instructions at https://github.com/agustif/llm-lmstudio (basically https://github.com/agustif/llm-lmstudio) and I can use models from LM Studio.

That said, the models don't seem to appear prefixed.

$llm models list
...
qwen/qwen3-4b-2507 ● ⚒
deepseek-r1-0528-qwen3-8b-mlx ⚒
mlx-community/embeddinggemma-300m ⚒
qwen3-embedding-0.6b-mxl ⚒
qwen3-embedding-0.6b-dwq ⚒
openai/gpt-oss-20b ⚒
...

Same happens on the CLI command:

$ echo test | llm -m qwen/qwen3-4b-2507
Hello! It seems you've entered "test." Is there a specific question or topic you'd like to explore? I'm here to help with anything from general knowledge to problem-solving! 😊
$ echo test | llm -m lmstudio/qwen/qwen3-4b-2507
Error: 'Unknown model: lmstudio/qwen/qwen3-4b-2507'

madrover avatar Dec 02 '25 11:12 madrover