Rahul Vivek Nair

AVX-512 support for llama.cpp models

3

**Description** Currently when loading llama.cpp models through the webui, on inspecting the command line, only avx2 flags have been set. I want to enable avx-512 like in regular llama.cpp to...

Allow scroll up while text generation takes place.

2

Currently the ui always scroll to the bottom when text generation takes place. It would be nice to allow scrolling up to start reading answers while generating

@seominseok0429 training the model using the code provided does not match the pretrained model. Have you uploaded the full code or fixed some bugs that are not published yet? Does...

Is your application still being maintained because it's quite good! One feature that would really nice is bulk adding of URLs.