lms icon indicating copy to clipboard operation
lms copied to clipboard

Is there a way to select a particular variant on the command line without doing it interactively?

Open jmaver opened this issue 4 months ago • 0 comments

How do I load an arbitrary variant without doing it programatically? If I use --exact it fails without interaction and without exact, it prompts for the variant.

(Ignore the fact that I already loaded the model manually in the ui)

lms ls

You have 19 models, taking up 222.84 GB of disk space.
LLM                                             PARAMS      ARCH             SIZE                
devstral-vision-small-2507                      13B         Llama            15.21 GB            
ibm/granite-4-h-tiny (3 variants)               7B          granitehybrid    4.23 GB     ✓ LOADED
lms ls --variants

You have 19 models, taking up 222.84 GB of disk space.

LLM                                             PARAMS      ARCH             SIZE                
devstral-vision-small-2507                      13B         Llama            15.21 GB            
ibm/granite-4-h-tiny (3 variants)                                                                
 * ibm/granite-4-h-tiny@q4_k_m                  7B          granitehybrid    4.23 GB     ✓ LOADED
   ibm/granite-4-h-tiny@q6_k                    7B          granitehybrid    5.71 GB     ✓ LOADED
   ibm/granite-4-h-tiny@q8_0                    7B          granitehybrid    7.39 GB     ✓ LOADED
lms load "ibm/granite-4-h-tiny@q4_k_m"

! Cannot find a model matching the provided path (ibm/granite-4-h-tiny@q4_k_m). Please select one from the list below.
! Use the arrow keys to navigate, type to filter, and press enter to select.

? Select a model to load | Type to filter...

jmaver avatar Oct 07 '25 21:10 jmaver