phalexo

I have a similar issue. I do not know if the UserWarning is related to the accuracy problem or not. /home/developer/anaconda3/envs/PyTorch/lib/python3.6/site-packages/onnx_caffe2/backend.py:521: UserWarning: This version of onnx-caffe2 targets ONNX operator set...

I was able to load different models into different sets of GPUs, but changing the ports manually, using OLLAMA_HOST, was a pain. It should fail over to the next numbered...

You can do it now. I have been doing it. Just use multiple Ollama servers. On Sun, Dec 24, 2023, 4:55 PM shroominic ***@***.***> wrote: > Would be sick to...

Another useful ability would be to delete changes, layer by layer. I have seen the pilot make huge mistakes, like overwriting working app because of some misunderstanding of what the...

> Your model is likely not following the instructions well enough and doesn't return the expected format. A basic question: Is there ANY open source LLM that can be used...

> with hermes 2 pro 7b it seems to work best, even if the code it generates is not usable due to some syntax errors.. > > I have this...

Ok, but the system itself is designed to correct syntax errors through more iterations. Add prompting to correct its own mistakes. On Fri, Apr 5, 2024, 11:11 AM nokirunner ***@***.***>...

I am using gpt-pilot with ollama serving Llama 3 70b Instruct model. Seems to work in general, but I am not sure yet if the code it produces is any...

Ollama already provides an OpenAI compatible API. Why bother with litellm?

I think I have the same question. I would like to add objects to a preexisting photo scene. It seems onerous to have to define some mask, I'd want the...