unsloth icon indicating copy to clipboard operation
unsloth copied to clipboard

NotImplementedError: Unsloth: HuggingFaceM4/idefics2-8b not supported yet!

Open KaifAhmad1 opened this issue 10 months ago • 2 comments

How we can fine tune Multimodal LLM like IDEFICS -2 using unsloth package ?

config.json: 100%
 684/684 [00:00<00:00, 43.8kB/s]
---------------------------------------------------------------------------
NotImplementedError                       Traceback (most recent call last)
[<ipython-input-2-aba42707d972>](https://localhost:8080/#) in <cell line: 4>()
      2 import numpy as np
      3 from unsloth import FastLanguageModel
----> 4 model, tokenizer = FastLanguageModel.from_pretrained(
      5     model_name = "HuggingFaceM4/idefics2-8b",
      6     max_seq_length = 2048,

[/usr/local/lib/python3.10/dist-packages/unsloth/models/loader.py](https://localhost:8080/#) in from_pretrained(model_name, max_seq_length, dtype, load_in_4bit, token, device_map, rope_scaling, fix_tokenizer, trust_remote_code, use_gradient_checkpointing, *args, **kwargs)
    120             dispatch_model = FastGemmaModel
    121         else:
--> 122             raise NotImplementedError(
    123                 f"Unsloth: {model_name} not supported yet!\n"\
    124                 "Make an issue to https://github.com/unslothai/unsloth!",

NotImplementedError: Unsloth: HuggingFaceM4/idefics2-8b not supported yet!
Make an issue to https://github.com/unslothai/unsloth!

KaifAhmad1 avatar Apr 24 '24 08:04 KaifAhmad1

If I am not wrong this model architecture is currently not supported by unsloth. You can request for its inclusion

erwe324 avatar Apr 24 '24 08:04 erwe324

Hmmm i wonder what the arch is ill need to check

danielhanchen avatar Apr 24 '24 10:04 danielhanchen