adds lm studio in plugin directory
There was already possible to use LM Studio via OpenAI comaptible plugin but it was not ideal as you had to manually edit config files to add your desired models etc.
This plugin leverages LM Studio api to list available models, etc
https://github.com/agustif/llm-lmstudio
Plugin looks good but it's not on PyPI yet: https://pypi.org/project/llm-lmstudio/ - so llm install llm-lmstudio doesn't work.
Plugin looks good but it's not on PyPI yet: https://pypi.org/project/llm-lmstudio/ - so
llm install llm-lmstudiodoesn't work.
Thank you simon indeed i wanted to add the attachments/image support before publishing, good news is did that today and just published it's v0.1.0 🥳 https://pypi.org/project/llm-lmstudio/0.1.0/
@agustif Any chance you could add some description to the pypi release? Right now it looks quite barren. Some points:
- The required python release > 3.8 is likely too old as I think llm requires a newer version of python already
- There is no link back to the project page
- There is no readme, so it is really hard to discover what the plugin is supposed to do.
@agustif Any chance you could add some description to the pypi release? Right now it looks quite barren. Some points:
- The required python release > 3.8 is likely too old as I think llm requires a newer version of python already
- There is no link back to the project page
- There is no readme, so it is really hard to discover what the plugin is supposed to do.
hey! yes will polish it up and publish, thank you for pinging me had forgotten I had not published it to pypi
Friendly ping @agustif - I would like to package your project for nixpkgs. But that currently hangs because pypi still looks barren and this pull request is not merged. Is there anything I can do to support you?
Friendly ping @agustif, I have added some pull requests to your repo
- Update requires-python to 3.9 #5
- Add readme to package metadata #6
- Add links to project pages for pypi #7
I hope that this speeds up providing a release with a nice GitHub Page, as that is currently holding back packaging in Nixpkgs.
@agustif Thanks for the merges, I was hoping to also get a release on https://pypi.org/project/llm-lmstudio/, so I can proceed to package this in nixpkgs. Anything you are still missing there?
@agustif Thanks for the merges, I was hoping to also get a release on https://pypi.org/project/llm-lmstudio/, so I can proceed to package this in nixpkgs. Anything you are still missing there?
will create release now! sorry there for the delay and thank you for all the PR's and help
Friendly ping @agustif
It seems your release may have gotten stuck somewhere. Do you perhaps have a guess when you might be able to take another look?
If you found some bugs that are blocking the release, I might be able to help.
Friendly ping @agustif - the release on pypi is still elusive, which is currently blocking its inclusion in the plugin directory, which is in turn blociking me from packaging this plugin in nixos. Could you perhaps give some sort of time table when you might get around to publishing the release? I was really hoping that my pull requests (which you merged, thanks for that) should remove almost all the friction of a new release?
Friendly ping @agustif - the release page on pypi still looks very barren: https://pypi.org/project/llm-lmstudio/ Could you perhaps get to do a release soonish?
I have just tried the instructions at https://github.com/agustif/llm-lmstudio (basically https://github.com/agustif/llm-lmstudio) and I can use models from LM Studio.
That said, the models don't seem to appear prefixed.
$llm models list
...
qwen/qwen3-4b-2507 ● ⚒
deepseek-r1-0528-qwen3-8b-mlx ⚒
mlx-community/embeddinggemma-300m ⚒
qwen3-embedding-0.6b-mxl ⚒
qwen3-embedding-0.6b-dwq ⚒
openai/gpt-oss-20b ⚒
...
Same happens on the CLI command:
$ echo test | llm -m qwen/qwen3-4b-2507
Hello! It seems you've entered "test." Is there a specific question or topic you'd like to explore? I'm here to help with anything from general knowledge to problem-solving! 😊
$ echo test | llm -m lmstudio/qwen/qwen3-4b-2507
Error: 'Unknown model: lmstudio/qwen/qwen3-4b-2507'