ShikangPang

In the paper，we can see two methods of inject anomalies. But these methods do not exist in your experiment. Look forward to your reply.

### 提交前必须检查以下项目 - [X] 请确保使用的是仓库最新代码（git pull） - [X] 已阅读[项目文档](https://github.com/ymcui/Chinese-LLaMA-Alpaca-3/wiki)和[FAQ章节](https://github.com/ymcui/Chinese-LLaMA-Alpaca-3/wiki/常见问题)并且已在Issue中对问题进行了搜索，没有找到相似问题和解决方案。 - [X] 第三方插件问题：例如[llama.cpp](https://github.com/ggerganov/llama.cpp)、[text-generation-webui](https://github.com/oobabooga/text-generation-webui)等，建议优先去对应的项目中查找解决方案。 ### 问题类型 模型训练与精调 ### 基础模型 None ### 操作系统 Linux ### 详细描述问题 希望能学习到从0搭建大模型的知识 ### 依赖情况（代码类问题务必提供） ``` # 请在此处粘贴依赖情况（请粘贴在本代码块里） ```...

Uncaught ValueError

1

``` ray.exceptions.RayTaskError(ValueError): ray::UDFWorker.build_model() (pid=2734747, ip=10.224.197.108, actor_id=a6bd0f39b7099c757a2caac81d000000, repr=) File "/home/pang/miniforge3/envs/auto-coder/lib/python3.10/concurrent/futures/_base.py", line 451, in result return self.__get_result() File "/home/pang/miniforge3/envs/auto-coder/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result raise self._exception File "/home/pang/miniforge3/envs/auto-coder/lib/python3.10/site-packages/pyjava/udf/udf_worker.py", line 39, in build_model self.model...

To resolve some configuration issues with `OpenAiCompatible`. It has already been verified locally.

How can I convert an OpenAI endpoint to a local VLLM endpoint?

3

I deployed the vllm model locally and tried to connect using the void extension, but I can't initiate a conversation. What should I do?