byzer-llm

byzer-llm copied to clipboard

chat 模型可以试用一下命令部署： ``` byzerllm deploy --pretrained_model_type saas/official_openai \ --cpus_per_worker 0.01 \ --gpus_per_worker 0 \ --num_workers 1 \ --infer_params saas.api_key=xxxxx saas.model=llama2 saas.base_url="http://localhost:11434/v1/" \ --model ollama_llama2_chat ``` 嵌入及重排及重排呢？部署了嵌入模型，测试：`byzerllm query --model bge-m3 --query...

lordk911

hanfangyuan4396

xianbaoqian

false document implication

ArtificialZeng

> qianfan.errors.InvalidArgumentError: The provided model `ERNIE-3.5-128K` is not in the list of supported models. If this is a recently added model, try using the `endpoint` arguments and create an issue...

kgbook

readme的中英文链接弄反了 | [English](https://github.com/allwefantasy/byzer-llm/blob/master/docs/zh) | [中文](https://github.com/allwefantasy/byzer-llm/blob/master/docs/en) |

sunweihunu

[data_副本.txt](https://github.com/allwefantasy/byzer-llm/files/15233131/data_.txt) 使用下面的代码运行的时候出现下面的异常 `/Users/xxxxxx/miniforge3/lib/python3.10/site-packages/langchain/__init__.py:29: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead. warnings.warn( /Users/xxxxxx/miniforge3/lib/python3.10/site-packages/langchain/__init__.py:29: UserWarning: Importing PromptTemplate from langchain root module is no longer...

xiaoshyang

OpenAI-Compatible RESTful API 并不支持function_call吗？我用https://platform.openai.com/docs/guides/function-calling的例子测试了下，但发现始终返回的是function_call=None, tool_calls=None

1

``` # https://platform.openai.com/docs/guides/function-calling from openai import OpenAI import json client = OpenAI( base_url="http://127.0.0.1:8000/v1", api_key="simple" ) # Example dummy function hard coded to return the same weather # In production, this...

zhangjiekui

macOS 安装后启动报 code() argument 13 must be str, not int 错误

1

如题所述，是不是 macOS 目前不支持，各版本如下： ``` (base) ➜ ~ byzerllm --version Traceback (most recent call last): File "/Users/mintisan/miniconda3/bin/byzerllm", line 5, in from byzerllm.byzerllm import main File "/Users/mintisan/miniconda3/lib/python3.11/site-packages/byzerllm/__init__.py", line 3, in from pyjava.api.mlsql...

mintisan

Hansen523