Jmkernes

Memory Leak with Jit and multiple Convolutions

1

Hey everyone 👋! I was trying to run a simple jit-compiled convnet when I noticed RAM spiking. I've whittled down the problem to the minimal amount of code that reproduces...

Is there any way to migrate this code to TensorFlow 2.0+? It seems like in V2 we no longer have access to the graph_replace function. Also, in V2's keras implementation,...

guanaco-7B-demo-colab.ipynb breaks with 4bit

4

Uncommenting `load_in_4bit` in the colab demo causes an error upon calling `m.merge_and_unload()` ``` │ /usr/local/lib/python3.10/dist-packages/peft/tuners/lora.py:352 in merge_and_unload │ │ │ │ 349 │ │ │ raise ValueError("GPT2 models are not...

Set endpoint for OpenAI calls

2

It seems like the endpoint attribute is not set for the OpenAI LLM. This causes the system to fail when using the REST API caller. We've also added a warning...