lms
lms copied to clipboard
Is there a way to select a particular variant on the command line without doing it interactively?
How do I load an arbitrary variant without doing it programatically? If I use --exact it fails without interaction and without exact, it prompts for the variant.
(Ignore the fact that I already loaded the model manually in the ui)
lms ls
You have 19 models, taking up 222.84 GB of disk space.
LLM PARAMS ARCH SIZE
devstral-vision-small-2507 13B Llama 15.21 GB
ibm/granite-4-h-tiny (3 variants) 7B granitehybrid 4.23 GB ✓ LOADED
lms ls --variants
You have 19 models, taking up 222.84 GB of disk space.
LLM PARAMS ARCH SIZE
devstral-vision-small-2507 13B Llama 15.21 GB
ibm/granite-4-h-tiny (3 variants)
* ibm/granite-4-h-tiny@q4_k_m 7B granitehybrid 4.23 GB ✓ LOADED
ibm/granite-4-h-tiny@q6_k 7B granitehybrid 5.71 GB ✓ LOADED
ibm/granite-4-h-tiny@q8_0 7B granitehybrid 7.39 GB ✓ LOADED
lms load "ibm/granite-4-h-tiny@q4_k_m"
! Cannot find a model matching the provided path (ibm/granite-4-h-tiny@q4_k_m). Please select one from the list below.
! Use the arrow keys to navigate, type to filter, and press enter to select.
? Select a model to load | Type to filter...