Skyseaee

Results 5 issues of Skyseaee

add insert sort and heap sort in sort.c and add related unit test.

I have been experimenting with duo_scaling using the formula `scales = (act_scales.pow(alpha) / w_scales.pow(1 - alpha)).clamp(min=1e-4).to(device).to(dtype)` in auto AWQ. However, I observed a `1%` decrease in accuracy when tested on...

Greetings, I am currently engaged in the development of the Quant Llava-1.5 model. I am inquiring whether it is feasible to perform quant model using a custom dataset that I...

### 📚 The doc issue 文档里面提到打开 search-scale 和 batch-size 可以提高精度,想问一下打开和默认关闭 search-scale 是有什么区别呢,我看了一下代码,我的理解是 search-scale 使用了 grid-search 类似论文中的 AWQ,而默认关闭是走的是 SmoothQuant 么,还是减去了网格搜索的过程,默认 scale = 0.5,因为打开 search-scale 后精度有一些下降,因此想问一下,谢谢解答 ### Suggest a potential alternative/fix _No...