unsloth
unsloth copied to clipboard
NotImplementedError: Unsloth: HuggingFaceM4/idefics2-8b not supported yet!
How we can fine tune Multimodal LLM like IDEFICS -2 using unsloth package ?
config.json: 100%
 684/684 [00:00<00:00, 43.8kB/s]
---------------------------------------------------------------------------
NotImplementedError Traceback (most recent call last)
[<ipython-input-2-aba42707d972>](https://localhost:8080/#) in <cell line: 4>()
2 import numpy as np
3 from unsloth import FastLanguageModel
----> 4 model, tokenizer = FastLanguageModel.from_pretrained(
5 model_name = "HuggingFaceM4/idefics2-8b",
6 max_seq_length = 2048,
[/usr/local/lib/python3.10/dist-packages/unsloth/models/loader.py](https://localhost:8080/#) in from_pretrained(model_name, max_seq_length, dtype, load_in_4bit, token, device_map, rope_scaling, fix_tokenizer, trust_remote_code, use_gradient_checkpointing, *args, **kwargs)
120 dispatch_model = FastGemmaModel
121 else:
--> 122 raise NotImplementedError(
123 f"Unsloth: {model_name} not supported yet!\n"\
124 "Make an issue to https://github.com/unslothai/unsloth!",
NotImplementedError: Unsloth: HuggingFaceM4/idefics2-8b not supported yet!
Make an issue to https://github.com/unslothai/unsloth!
If I am not wrong this model architecture is currently not supported by unsloth. You can request for its inclusion
Hmmm i wonder what the arch is ill need to check