mbzuai-oryx
Inference Relevant Issue
Wanted to use geochat for inference over some photos but upon loading was getting errors:
`model_path = "MBZUAI/geochat-7B" # Hugging Face model path
model_base = "openlm-research/open_llama_7b" # Base model if required
model_name = "geochat-7B" # Name of the model
load_8bit = False
load_4bit = False
device_map = "auto"
device = "cuda" if torch.cuda.is_available() else "cpu"
Load the model
tokenizer, model, image_processor, context_len = load_pretrained_model(
model_path=model_path,
model_base=model_base,
model_name=model_name,
load_8bit=load_8bit,
load_4bit=load_4bit,
device_map=device_map,
device=device,
)
I was getting:FileNotFoundError: [Errno 2] No such file or directory: 'MBZUAI/geochat-7B/mm_projector.bin'`
