CTranslate2 icon indicating copy to clipboard operation
CTranslate2 copied to clipboard

feature request: support 4d attention masks

Open poedator opened this issue 6 months ago • 0 comments

this is a Feature Request to implement custom 4D mask for Llama (and possibly any other model) similar to https://github.com/huggingface/transformers/pull/27539

poedator avatar Dec 23 '23 13:12 poedator