sglang
                                
                                 sglang copied to clipboard
                                
                                    sglang copied to clipboard
                            
                            
                            
                        Beginner here, how to load the model from checkpoint
Hi, I am relatively new to this. Currently, I am trying to fine tune llava-v1.6-mistral-7b on a sample dataset. I have a beginner level question:
How do I load the model from the checkpoint for evaluation? Are the weights model weights on adapter_model.safetensors? I am struggling to load the checkpoint to evaluate on a test set
@HoqueMahmudul We only support huggingface format to load model weights. I am not sure what is your checkpoint's format, you can figure out how to convert it to huggingface format.
This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.