FastChat

FastChat copied to clipboard

start openai_api_server.py。The streaming interface output using OpenAI requires a long wait of 23 seconds before it can be output. But the openai interface can return results within 3 seconds. How can I solve this problem

1

The streaming interface output using OpenAI requires a long wait of 23 seconds before it can be output. But the openai interface can return results within 3 seconds. How can...

wgq910668

report error while i execute `python -m fastchat.serve.openai_api_server --host localhost --port 8000`

2

1，already execute `git pull` 2，web model and cli mode works 3，it reports error below: /root/anaconda3/envs/fastchat/lib/python3.9/runpy.py:197 in _run_module_as_main │ │ │ │ 194 │ main_globals = sys.modules["__main__"].__dict__ │ │ 195 │...

lplzyp

Support Semantic Kernel with FastChat

1

[Semantic Kernel ](https://github.com/microsoft/semantic-kernel) is a lightweight open-source orchestration SDK that lets you easily mix-and-match AI prompts with conventional programming languages like C# and Python.

geffzhang

See: https://github.com/PanQiWei/AutoGPTQ/ For reference, text gen ui is using it here: https://github.com/oobabooga/text-generation-webui/blob/main/modules/AutoGPTQ_loader.py

fblissjr

Robin-7b is finetuned from LLaMA, achieving competitive performance on chitchat, commonsense reasoning, and instruction-following tasks. ## Checks - [x] I've run `format.sh` to lint the changes in this PR. -...

hanningzhang

It's very fuck!!! like this:

9


Hzzhang-nlp

当我按照langchain_integration.md配置好前三个服务，都是正常的。使用测试代码，报错，发生异常: ConnectionError HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /encodings/cl100k_base.tiktoken (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 110] Connection timed out')) TimeoutError: [Errno 110] Connection timed out...

hashiqi-233

Fine-tuning Falcon

4

When I try to train Vicuna against Falcon it fails, The big thing is the padding, since Falcon has no padding. (that is the part I can't figure out myself)...

ehartford

Converting the weights into HuggingFace transformers format is resulting in creating tmp folder

1

Could someone please help as I have been stuck at it?

kyawthetkt

OpenAI style API : Object of type SeparatorStyle is not JSON serializable

1

Hello, I've deployed the OpenAI style API in a container when trying to use through OpenAI package I get this kind of error, any idea? The command line: `python -m...

Extremys