Rex L comments

Repositories
Issues
Comments

Results 2 comments of


                                            Rex L

benchmarks?

CPU: E5-2680v4 MEM: 64GB $ ./build/bin/Release/main.exe -m ./models/65B/ggml-model-q4_0.bin -t 14 -n 128 system_info: n_threads = 14 / 28 | AVX = 1 | AVX2 = 1 | AVX512 = 0...

benchmarks?

$ ./build/bin/Release/main.exe -m ./models/llama-7B-ggml-int4/ggml-model-q4_0.bin -t 14 -n 128 system_info: n_threads = 14 / 28 | AVX = 1 | AVX2 = 1 | AVX512 = 0 | FMA = 1...