Hailey Collet issues

Repositories
Issues
Comments

Results 1 issues of


                                            Hailey Collet

Bloom 176B inference is broken

I have a q4_0 quant of bloomz-176B (created with bloomz.cpp). As with bloomz.cpp, inference on this model is broken. For example, this command: llm infer -a bloom -m bloomz_q4_0.bin -p...

issue:bug

model:bloom