3dluvr

Running in WSL, all deps satisified, most recent code pull, on a RTX 3090. Command line: `./build/bin/main -m models/7B/llama-7b-relu.powerinfer.gguf -n 128 -t 8 -p "Once upon a time" --vram-budget 12`...

Hi, Would you please provide instructions, or a method, for sideloading of the components (onnx files) in an off-line mode, so that the app does not have to automatically download...