tinychat-tutorial

tinychat-tutorial copied to clipboard

Wrong Model response

3

Hi @meenchen , @RaymondWang0 I'm implementing this tinychat in Windows OS (x86), I'm receiving gibberish response from model. Can i know what is the issue here, is it from model?...

s-swathib

error while running ./chat

1

Hi @meenchen , @RaymondWang0 I'm implementing this tinychat tutorial in Windows OS. Follwed the instructions mentioned in the MIT_Efficient_AI_Lab_5_Optimize_LLM_on_Edge document. I've downloaded x86 model. I'm facing error while running ./chat....

Imran2708

Improve checking to detect `NaN` case

1

The current `check_two_equal` may not able to check the `NaN` case. We can improve it by using `std::isnan`. When the following incorrect SIMD implementation runs on M1 environment, the test...

insop

Hi @meenchen , @RaymondWang0 I'm implementing this tinychat tutorial in Windows OS. Follwed the instructions mentioned in the MIT_Efficient_AI_Lab_5_Optimize_LLM_on_Edge document. I've downloaded x86 model. I'm facing error while running ./evaluate.sh...

s-swathib

In starter_code, `order of weights with QM_x86`, `QM_ARM order`=> `QM_x86 order` In `QM_x86`, use `w_de_32` instead of `w_de_16` to fit order of weights with QM_x86 better.

Livinfly

Bonus Performance Optimization: Cache Blocking Technique

4

I implemented a cache blocking technique to optimize matrix multiplication and achieved a 1.5x on first run and 1.6x performance improvement (approximately **49.2% and 59.5%** respectively) faster compared to the...

joachimasare

Hi, can I ask why my TinyChat is garbled? No matter what question you type, he answers with the same garbled answer，thanks

619135593