Alessio Plebe comments

Repositories
Issues
Comments

Results 1 comments of


                                            Alessio Plebe

"RuntimeError: p.attn_bias_ptr is not correctly aligned" when using ``` in a prompt with images

I got same error randomly for both gemma-3-4b-it and gemma-3-12b-it, even without images. I tried the suggested do_pan_and_scan=True with no effect, while attn_implementation="eager" possibly fixes the issue, but soon causes...