n89nanda comments

Repositories
Issues
Comments

Results 3 comments of


                                            n89nanda

Doesn't even start on Windows because 2000 threads is apparently too much

Hi @PawelTroka , thanks for reporting and looking into this. I will push an update to fix this soon.

Doesn't even start on Windows because 2000 threads is apparently too much

thanks @ddanny @FlavienVernier. The number of threads shouldn't be hardcoded. Will be happy to review/merge any PR's. Otherwise I hope to fix it soon. thanks for reporting...

Phi 3 Mini output near random (Phi-3-mini-4k-instruct-q4f16_1-MLC)

I got the same random output on MacOS Safari with webGPU feature flag enabled. Worked fine in Chrome, in the same machine ![Screenshot 2024-09-25 at 2 17 21 PM](https://github.com/user-attachments/assets/17218fb6-07a9-4e81-8b24-2a7a882c02fc)