petals icon indicating copy to clipboard operation
petals copied to clipboard

attention_mask = FalconModel._prepare_attn_mask(attention_mask, (batch_size, seq_length), past_length) AttributeError: type object 'FalconModel' has no attribute '_prepare_attn_mask'

Open peteblank opened this issue 1 year ago • 0 comments

I can't run the falcon 7b instruct model it gives me that error

peteblank avatar Aug 10 '24 10:08 peteblank