Wan Rui

icon company Beijing Jiaotong University icon location Beijing

Results 1 issues of Wan Rui

[Polite inquiry]: What are the differences between ggml_qgemm_lut() and ggml_vec_dot_i2_i8_s()?

1. In the ggml_compute_forward_mul_mat() function in ggml.c, ggml_qgemm_lut() is executed first, which I think is an accumulation operation. 1. Subsequently, in the ggml_compute_forward_mul_mat_one_chunk() function, ggml_vec_dot_i2_i8_s() is executed, which performs a...