ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[FEATURE]: support google/gemma-2-2b for Tensor Parallelism

Open jing-4369 opened this issue 1 year ago • 0 comments

Describe the feature

[rank0]: NotImplementedError: Auto policy for Gemma2ForCausalLM (transformers.models.gemma2.modeling_gemma2.Gemma2ForCausalLM) is not implemented

can you please tell me how to support gemma2 for Tensor Parallelism? or do you have a plan for it?

jing-4369 avatar Nov 09 '24 04:11 jing-4369