Brandon Roberts

Results 59 comments of Brandon Roberts

```python data = DataSet() data.headers = source_data[0].keys() data.extend([item.values() for item in source_data]) ``` I'll note that this only works if your dicts have all of the keys, which a lot...

An update: I've been working through this and in the code there's references to the necessity of rows aligning, etc, but I'm not sure if this is strictly required by...

I gave up on this, as well. I was able to get the jobs to run, but got deprecation warnings and other intermittent issues. Unfortunately, I think this project is...

Is it just a matter of removing those three lines that is blocking this? Being able to disable the auto deploy upon commit functionality here would be super useful.

> It's unclear to me the exact steps from reading the README I was able to get the 4bit version kind of working on 8G 2060 SUPER (still OOM occasionally...

> Would you be willing to post a Gist or provide the steps you ran beyond those 2 Python commands? Should I run it on a CPU only machine or...

Here's all my steps. I'm using Ubuntu 22.04, Python 3.10, CUDA 11.7 and everything is working on my NVIDIA RTX 2060 SUPER 8G card with the 4bit 7B model. https://gist.github.com/brandonrobertz/972d943d5442a06aa983ac09cb424a39...

> After you saved the model. How do you load it? By using the `--load` argument (same value as with `--save`). The script they have only works on the three...

These instructions work for systems WITHOUT a GPU: https://til.simonwillison.net/llms/llama-7b-m2 uses this lib: https://github.com/ggerganov/llama.cpp