Matthew Hendricks

Results 9 comments of Matthew Hendricks

did I miss anything in my submission?

Thank you for your kind words.😊 On Mon, Sep 26, 2022, 3:31 AM Paliak ***@***.***> wrote: > @QuickStick123 This is just a tooltip > text change so i don't think...

I am experiencing long response times as well. How do I look at the prompt being delivered to the ollama model?

was using a derivative of adriens [notebook](https://www.kaggle.com/code/matthewhendricks/notebook0cd9dcd006) ``` --------------------------------------------------------------------------- KeyboardInterrupt Traceback (most recent call last) Cell In[8], line 53 43 llm = Ollama(model=OLLAMA_MODEL) 44 # response = llm.complete("""Who is Grigori...

I was having trouble but ``` root@62d88bdd9d38:/workspace/axolotl# export BNB_CUDA_VERSION= root@62d88bdd9d38:/workspace/axolotl# accelerate launch -m axolotl.cli.train examples/openllama-3b/lora.yml The following values were not passed to `accelerate launch` and had defaults used instead: `--num_processes`...

Just understand the code, bro. ![Screenshot_20240717-114040](https://github.com/user-attachments/assets/0cd6543e-25aa-459e-aa77-d48452d863e6)

The server logs for the problematic system are the ones I posted in my original comment above. Problematic system: ``` flags : fpu vme de pse tsc msr pae mce...

I ran ``` ollama run tinyllama --verbose hello ``` Older machine ![image](https://github.com/user-attachments/assets/ac49d026-b7fd-4bee-9d21-49fa1720958a) Newer, buggy machine with tinyllama ![image](https://github.com/user-attachments/assets/f2adf322-837a-4284-98d4-7773793a47c3) and orca ![image](https://github.com/user-attachments/assets/3d539ee1-2829-4be6-91f8-892b2a3b4180) I'm curious to know what's going on, though it's...