Kevin Koehncke comments

Repositories
Issues
Comments

Results 2 comments of


                                            Kevin Koehncke

Windows 32 bit native resource

Unexpected inference results from Flan-T5 XXL converted to ctranslate2 with version 4.2.1 and 4.1.1 (using tensor parallel)

I am also seeing this regression for all variants of Flan-T5 (base, large, XL). Model is just outputting `` repeatedly. We convert correctly to use `bfloat16` as it is a...