Konstantin

@lvasa Edit `cmake\FindGMPfTetWild.cmake` source file. Find the following two lines: ``` find_library(GMP_LIBRARIES NAMES gmp libgmp PATHS $ENV{GMP_LIB} ${GMP_WINDOWS_PATH}) find_library(GMPXX_LIBRARIES NAMES gmpxx libgmpxx PATHS $ENV{GMP_LIB} ${GMP_WINDOWS_PATH}) ``` Replace them with the...

I’m not sure I fully understood your spec, but here’s AVX2 decompressor for these blocks: https://gist.github.com/Const-me/a0529a8c9885d371138a1c50e0622040 Tested very little, haven’t tested performance at all, but still, it seems to work...

@ggerganov Here’s the codes. https://gist.github.com/Const-me/65ff46c31553493d13fcd6646e162494 The implementation of `quantize_row_q4_0` is in `compressRow40` function in that source file. The implementation of `ggml_vec_dot_q4_0` is in the `dotProductCompressed40` function in that source file....

@ggerganov About the compression for intermediate tensors, I’ve made another function if you want to try, [dotProduct_q40_f16](https://gist.github.com/Const-me/0c5dc78d5174976eb0779eb6dbb6cde6#file-dotproduct_q40_f16-cpp-L155-L156) I’m not sure what you’ll find, but it’s possible FP16 intermediates might be...

@benaclejames If you’re integrating into your own game, a proper solution is D3D12 (I never tested but I would expect my code to be compatible with [D3D11On12](https://github.com/microsoft/D3D11On12) emulation layer), use...

@Ovler-Young That option is already present in the CLI, `-nc` or `--no-colors` command-line switch. The option is currently missing from the GUI app, however…

@luyinla2017 Please run the GUI app, go to the first screen (if it automatically loads the previous model, click the “Back” button), and click the “advanced…” button on that screen....

@martjay Currently, there’re two ways to implement batching. 1. Use the command-line application `main.exe` from the `cli.zip` archive, it can accept many input files. Will transcribe them one by one....

@martjay main.exe is a console application. Press Win+R, type `cmd`, press Enter. Use `cd` command to navigate to the directory where you have the main.exe First run `main.exe -h`, it...

@martjay You should download that program from Releases page of this repository, unpack `cli.zip` somewhere, then use the `cd` command to navigate to the folder which contains the unpacked `main.exe`