embedding过程中报错
System Info / 系統信息
{"code":500,"msg":"Traceback (most recent call last):\n File "/app/src/build_index/build_supplierqa_index.py", line 175, in build_suppliervecqa_index\n vecstore.add_documents(all_docs)\n File "/usr/local/lib/python3.12/site-packages/langchain_core/vectorstores/base.py", line 279, in add_documents\n return self.add_texts(texts, metadatas, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/langchain_community/vectorstores/milvus.py", line 567, in add_texts\n embeddings = self.embedding_func.embed_documents(texts)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/langchain_openai/embeddings/base.py", line 591, in embed_documents\n return self._get_len_safe_embeddings(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/langchain_openai/embeddings/base.py", line 479, in _get_len_safe_embeddings\n response = self.client.create(\n ^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/openai/resources/embeddings.py", line 132, in create\n return self._post(\n ^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/openai/_base_client.py", line 1259, in post\n return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/site-packages/openai/_base_client.py", line 1047, in request\n raise self._make_status_error_from_response(err.response) from None\nopenai.InternalServerError: Error code: 500 - {'detail': "[address=0.0.0.0:29143, pid=2768896] 'SentenceTransformerEmbeddingModel' object has no attribute 'pydantic_model'"}\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n File "/app/server/supplier_router.py", line 443, in index_qa_handler\n milvus_result = await loop.run_in_executor(executor, build_suppliervecqa_index, qa_dic, req.data_id)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/usr/local/lib/python3.12/concurrent/futures/thread.py", line 59, in run\n result = self.fn(*self.args, **self.kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n File "/app/src/build_index/build_supplierqa_index.py", line 182, in build_suppliervecqa_index\n raise RuntimeError(str(e))\nRuntimeError: Error code: 500 - {'detail': "[address=0.0.0.0:29143, pid=2768896] 'SentenceTransformerEmbeddingModel' object has no attribute 'pydantic_model'"}\n","data":null}
注意看它不是全部报错,而是执行过程中,部分报错,我们有海量数据需要embedding,帮忙check下问题。
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?
- [ ] docker / docker
- [x] pip install / 通过 pip install 安装
- [ ] installation from source / 从源码安装
Version info / 版本信息
xinference==1.12.0 pydantic==2.11.7
The command used to start Xinference / 用以启动 xinference 的命令
nohup xinference-local --host 0.0.0.0 --port 5556 > ~/xinference.log 2>&1 &
Reproduction / 复现过程
nohup xinference-local --host 0.0.0.0 --port 5556 > ~/xinference.log 2>&1 & 拉起服务,前端页面配置bge-m3,批量访问该服务。
Expected behavior / 期待表现
不能出现该错误
@llyycchhee 帮忙看下。
This issue is stale because it has been open for 7 days with no activity.
看起来像是langchain的报错 方便提供下langchain的版本吗?