Maximilian Heil

icon location Data Science in Quant Investments @ Deka, CS @ Georgia Tech, M.Sc. Finance & Data Analyics @ Nova Business School

Results 1 comments of Maximilian Heil

"RuntimeError: p.attn_bias_ptr is not correctly aligned" when using ``` in a prompt with images

I still run into this issue with even with the Tokenizer usign pad_to_multiple_of=8. I could only circumvent it with eager-attn instead of flash-attn