oslo icon indicating copy to clipboard operation
oslo copied to clipboard

is there any plan to support llama model?

Open yuyaxiong opened this issue 1 year ago • 0 comments

It seems like that oslo currently version can not load llama model, do you have any plan to support llama model?

AssertionError: Currently, LlamaForCausalLM is not supported. The current supported models are [<class 'transformers.models.albert.modeling_albert.AlbertPreTrainedModel'>, <class 'oslo.transformers.models.albert.modeling_albert.AlbertPreTrainedModel'>, <class 'transformers.models.bart.modeling_bart.BartPreTrainedModel'>, <class 'transformers.models.bert.modeling_bert.BertPreTrainedModel'>, <class 'transformers.models.blenderbot.modeling_blenderbot.BlenderbotPreTrainedModel'>, <class 'transformers.models.blenderbot_small.modeling_blenderbot_small.BlenderbotSmallPreTrainedModel'>, <class 'transformers.models.t5.modeling_t5.T5PreTrainedModel'>, <class 'oslo.transformers.models.t5.modeling_t5.T5PreTrainedModel'>, <class 'transformers.models.gpt2.modeling_gpt2.GPT2PreTrainedModel'>, <class 'oslo.transformers.models.gpt2.modeling_gpt2.GPT2PreTrainedModel'>, <class 'transformers.models.gpt_neo.modeling_gpt_neo.GPTNeoPreTrainedModel'>, <class 'transformers.models.gpt_neox.modeling_gpt_neox.GPTNeoXPreTrainedModel'>, <class 'transformers.models.gptj.modeling_gptj.GPTJPreTrainedModel'>, <class 'transformers.models.opt.modeling_opt.OPTPreTrainedModel'>, <class 'transformers.models.electra.modeling_electra.ElectraPreTrainedModel'>, <class 'oslo.transformers.models.electra.modeling_electra.ElectraPreTrainedModel'>, <class 'transformers.models.roberta.modeling_roberta.RobertaPreTrainedModel'>, <class 'oslo.transformers.models.roberta.modeling_roberta.RobertaPreTrainedModel'>, <class 'transformers.models.vit.modeling_vit.ViTPreTrainedModel'>]

yuyaxiong avatar Sep 12 '23 04:09 yuyaxiong