gorilla
gorilla copied to clipboard
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
Hi, thanks for the demo video. Just wanted to understand how did you created gorilla spotlight feature and how can we create something out of it. Also i couldnt understand...
When applying [these deltas](https://huggingface.co/gorilla-llm/gorilla-7b-hf-delta-v0) to [these base weights](https://huggingface.co/decapoda-research/llama-7b-hf) I get the following error: ``` $ python apply_delta.py --base-model-path ../../llama-7b-hf/ --target-model-path ../../gorilla-7b-hf-v0/ --delta-path ../../gorilla-7b-hf-delta-v0/ Loading the delta weights from ../../gorilla-7b-hf-delta-v0/ Traceback...
Exception: Error communicating with OpenAI: HTTPConnectionPool(host='34.132.127.197', port=8000): Max retries exceeded with url: /v1/chat/completions (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Failed model: gorilla-7b-hf-v0, for...
lora_target_modules='["query_key_value"]' "not part of this model"
Needs to be easy to query for which API and version fully supported
I encounter this problem downloading model weights. Seems weights larger than 4 GB are not correctly handled on Windows. Do you upload the models from windows system? ``` root@4bd793bb2ded:/workspace/gorilla# git...
Hi, is it also possible to self host Gorilla with an API that is compatible with the OpenAI chat completion API? So essentially the same as depicted in the Colab?
**Describe the issue** When I use the `--load-8bit` flag it's returning a `load_compress_model` that's not imported anywhere (and for that reason -I guess- it's failing?). Any ideas on how to...