Austin

I've been doing some thinking about our `ModelLoader` class. Using `AutoModel` with `from_pretrained` for differing class definitions, dealing with all sorts of wrappers, libraries, and runners is getting complex quickly....

I'm also working on `hf_hub_download` implementation to handle automating the retrieval for GGML models. ```sh 17:16:53 | ~/Documents/code/git/localGPT git:(dev | Δ) λ python -m localGPT.ggml --text_input "Hello! What is your...

@PromtEngineer Can you provide the command line and options you used? It's difficult to say without that information. I would need to see the full output.

Have you tried deleting the DB directory and starting fresh?

Which commit?

I'll triple check it. It worked last time I tested it, but I knew it wouldn't guarantee functionality in a general sense. That's why I needed people to test it....

I was able to reproduce the issue. I'm looking into it. ```sh # ... CUDA SETUP: Loading binary /home/austin/.local/lib/python3.11/site-packages/bitsandbytes/libbitsandbytes_c pu.so... The model weights are not tied. Please use the `tie_weights`...

I was able to narrow down the problem to `bitsandbytes`. You'll need to clone, build for CPU, and then install the build for CPU. ```sh 05:04:47 | ~/Documents/code/bitsandbytes-rocm git:(main |...

`bitsandbytes` is a 8-Bit Optimizer process for Matrix Multiplication and was originally built for CUDA with `nvcc`. The `python` `ctype` bindings to the underlying binaries are compiled for Nvidia GPUs....

Whenever `glfwWindowShouldClose(window)` is called, it causes the entire DE to crash. Example Source Code ```c #include #include int main() { if (!glfwInit()) { return -1; } glfwWindowHint(GLFW_CONTEXT_VERSION_MAJOR, 3); glfwWindowHint(GLFW_CONTEXT_VERSION_MINOR, 2);...