VideoGPT-plus icon indicating copy to clipboard operation
VideoGPT-plus copied to clipboard

Phi3Model ImportError

Open zimenglan-sysu-512 opened this issue 1 year ago • 2 comments

when run the script, met the problem: ImportError: cannot import name 'Phi3Model' from 'transformers'

zimenglan-sysu-512 avatar Jul 08 '24 07:07 zimenglan-sysu-512

Hi @zimenglan-sysu-512,

Thank you for your interest in our work. Which transformers version are you using? Please make sure that you are using transformers==4.41.0. Please let me know if it fixes the issue.

mmaaz60 avatar Jul 08 '24 19:07 mmaaz60

Get it. and need to update accelerate to 0.27.0. but still meet some problem: [rank6]: RuntimeError: FlashAttention only supports Ampere GPUs or newer. hi @mmaaz60 can u show me how to close the flash attention? thanks.

zimenglan-sysu-512 avatar Jul 09 '24 06:07 zimenglan-sysu-512