sglang icon indicating copy to clipboard operation
sglang copied to clipboard

Beginner here, how to load the model from checkpoint

Open HoqueMahmudul opened this issue 1 year ago • 1 comments

Hi, I am relatively new to this. Currently, I am trying to fine tune llava-v1.6-mistral-7b on a sample dataset. I have a beginner level question:

How do I load the model from the checkpoint for evaluation? Are the weights model weights on adapter_model.safetensors? I am struggling to load the checkpoint to evaluate on a test set

adapter

HoqueMahmudul avatar Apr 05 '24 09:04 HoqueMahmudul

@HoqueMahmudul We only support huggingface format to load model weights. I am not sure what is your checkpoint's format, you can figure out how to convert it to huggingface format.

hnyls2002 avatar Apr 07 '24 08:04 hnyls2002

This issue has been automatically closed due to inactivity. Please feel free to reopen it if needed.

github-actions[bot] avatar Jul 25 '24 06:07 github-actions[bot]