tabby Check whether avx2 instruction set is supported for linux binary

Please describe the feature you want Before running llama-server binary.

Additional context Code location: https://github.com/TabbyML/tabby/blob/5aa27b590e23e905813e26c41f3a015cd474a70b/crates/llama-cpp-server/src/supervisor.rs#L32

Please reply with a 👍 if you want this feature.

Jan 14 '25 23:01 wsxiaoys

i'd like to take this (replied). What would be the outcome of the check here? any additional info helps :)

Jan 15 '25 13:01 Evalir

i'd like to take this (replied). What would be the outcome of the check here? any additional info helps :)

On Linux build - when avx2 instruction is not supported, generated a warning messages saying llama-server would likely fail with default binary distribution

Jan 15 '25 14:01 wsxiaoys

awesome. i'll get to it this weekend!

Jan 16 '25 11:01 Evalir

i'd like to take this (replied). What would be the outcome of the check here? any additional info helps :)

On Linux build - when avx2 instruction is not supported, generated a warning messages saying llama-server would likely fail with default binary distribution

Do you think this problem is caused by the CPU or from Linux?

Jan 17 '25 08:01 haro3535

Fixed in #3814

Mar 18 '25 03:03 Sma1lboy