QAnything [BUG] 一直卡在<Triton服务正在启动，可能需要一段时间>这里

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

[X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

[X] 我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

前面的步骤都没问题，直到出现Triton服务正在启动，可能需要一段时间，等了很久并没什么变化

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:Windows 10
- NVIDIA Driver:546.33
- CUDA:12.3
- Docker Compose:v2.23.0-desktop.1
- NVIDIA GPU Memory:22GB

QAnything日志 | QAnything logs

I0116 04:31:36.346519 88 pinned_memory_manager.cc:240] Pinned memory pool is created at '0x304800000' with size 268435456 I0116 04:31:36.347640 88 cuda_memory_manager.cc:105] CUDA memory pool is created on device 0 with size 67108864 I0116 04:31:39.185947 88 model_lifecycle.cc:462] loading: rerank:1 I0116 04:31:39.192572 88 model_lifecycle.cc:462] loading: embed:1 I0116 04:31:39.200466 88 model_lifecycle.cc:462] loading: base:1 I0116 04:31:39.211187 88 onnxruntime.cc:2504] TRITONBACKEND_Initialize: onnxruntime I0116 04:31:39.211807 88 onnxruntime.cc:2514] Triton TRITONBACKEND API version: 1.12 I0116 04:31:39.212389 88 onnxruntime.cc:2520] 'onnxruntime' TRITONBACKEND API version: 1.12 I0116 04:31:39.213066 88 onnxruntime.cc:2550] backend configuration: {"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","default-max-batch-size":"4"}} I0116 04:31:39.255971 88 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: rerank (version 1) I0116 04:31:39.256016 88 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: embed (version 1) I0116 04:31:39.259643 88 onnxruntime.cc:666] skipping model configuration auto-complete for 'embed': inputs and outputs already specified I0116 04:31:39.259731 88 onnxruntime.cc:666] skipping model configuration auto-complete for 'rerank': inputs and outputs already specified I0116 04:31:39.265515 88 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: embed (GPU device 0) I0116 04:31:39.266954 88 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: rerank (GPU device 0) I0116 04:31:39.944943 88 libfastertransformer.cc:459] Before Loading Weights: terminate called after throwing an instance of 'std::length_error' what(): basic_string::_M_create [1a7591640d8d:00088] *** Process received signal *** [1a7591640d8d:00088] Signal: Aborted (6) [1a7591640d8d:00088] Signal code: (-6) [1a7591640d8d:00088] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f0b0ae95520] [1a7591640d8d:00088] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f0b0aee99fc] [1a7591640d8d:00088] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f0b0ae95476] [1a7591640d8d:00088] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f0b0ae7b7f3] [1a7591640d8d:00088] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f0b0b11db9e] [1a7591640d8d:00088] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f0b0b12920c] [1a7591640d8d:00088] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f0b0b129277] [1a7591640d8d:00088] [ 7] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae4d8)[0x7f0b0b1294d8] [1a7591640d8d:00088] [ 8] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZSt20__throw_length_errorPKc+0x40)[0x7f0b0b120449] [1a7591640d8d:00088] [ 9] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x14bc69)[0x7f0b0b1c6c69] [1a7591640d8d:00088] [10] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(+0xa6ba3c)[0x7f0aa5bf2a3c] [1a7591640d8d:00088] [11] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer21loadWeightFromBinFuncI6__halfS1_EEiPT_St6vectorImSaImEENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x187)[0x7f0aa5c0b227] [1a7591640d8d:00088] [12] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer17loadWeightFromBinI6__halfEEiPT_St6vectorImSaImEENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEENS_14FtCudaDataTypeE+0x282)[0x7f0aa5c0ed12] [1a7591640d8d:00088] [13] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer11LlamaWeightI6__halfE16loadEncryptModelENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x184)[0x7f0aa57cb0b4] [1a7591640d8d:00088] [14] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN16LlamaTritonModelI6__halfE19createSharedWeightsEii+0x2ad)[0x7f0aa57b219d] [1a7591640d8d:00088] [15] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253)[0x7f0b0b157253] [1a7591640d8d:00088] [16] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x94ac3)[0x7f0b0aee7ac3] [1a7591640d8d:00088] [17] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x126660)[0x7f0b0af79660] [1a7591640d8d:00088] *** End of error message ***

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

Jan 16 '24 04:01 zhlmi

镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(

Jan 16 '24 05:01 highkay

镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(

俺来试试

Jan 16 '24 08:01 zhlmi

镜像升级到1.0.9，这个问题就好了，不过推理的时候还会有其他的错误:(

俺来试试

测试结果是什么？我与你一样，但好像还是不行

Jan 18 '24 01:01 caihexin

(base) PS E:\QAnything> bash run.sh models 文件夹已存在，无需下载。 Checking model directories... 检查模型目录... 检查模型版本成功，当前版本为 v2.1.0。 Model directories check passed. (0/8) 模型路径和模型版本检查通过. (0/8) Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes Running under WSL Container qanything-container-local Stopping Container qanything-container-local Stopped Container qanything-container-local Removing Container qanything-container-local Removed Container milvus-standalone-local Stopping Container mysql-container-local Stopping Container milvus-standalone-local Stopped Container milvus-standalone-local Removing Container mysql-container-local Stopped Container mysql-container-local Removing Container milvus-standalone-local Removed Container milvus-minio-local Stopping Container milvus-etcd-local Stopping Container mysql-container-local Removed Container milvus-etcd-local Stopped Container milvus-etcd-local Removing Container milvus-minio-local Stopped Container milvus-minio-local Removing Container milvus-etcd-local Removed Container milvus-minio-local Removed Network qanything_milvus_mysql_local Removing Network qanything_milvus_mysql_local Removed [+] Running 6/6 ✔ Network qanything_milvus_mysql_local Created 0.1s ✔ Container milvus-minio-local Started 0.2s ✔ Container mysql-container-local Started 0.2s ✔ Container milvus-etcd-local Started 0.2s ✔ Container milvus-standalone-local Started 0.1s ✔ Container qanything-container-local Started 0.2s qanything-container-local | qanything-container-local | ============================= qanything-container-local | == Triton Inference Server == qanything-container-local | ============================= qanything-container-local | qanything-container-local | NVIDIA Release 23.05 (build 61161506) qanything-container-local | Triton Server Version 2.34.0 qanything-container-local | qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License. qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license: qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license qanything-container-local | qanything-container-local | GPU ID: 0, 0 qanything-container-local | The triton server will start on 0 GPU qanything-container-local | The llm transfer service is ready! (1/8) qanything-container-local | 大模型中转服务已就绪! (1/8) qanything-container-local | The rerank service is ready! (2/8) qanything-container-local | rerank服务已就绪! (2/8) qanything-container-local | The ocr service is ready! (3/8) qanything-container-local | OCR服务已就绪! (3/8) qanything-container-local | The qanything backend service is ready! (4/8) qanything-container-local | qanything后端服务已就绪! (4/8) qanything-container-local | Waiting for [npm run install]（5/8)

qanything-container-local | up to date in 5s qanything-container-local | qanything-container-local | 177 packages are looking for funding qanything-container-local | run npm fund for details qanything-container-local | [npm run install] Installed successfully（5/8) qanything-container-local | Waiting for npm run build qanything-container-local | qanything-container-local | > [email protected] build qanything-container-local | > vite build qanything-container-local | qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details. qanything-container-local | vite v5.0.12 building for production...

qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime qanything-container-local | qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue qanything-container-local | 39:5 warning Unexpected console statement no-console qanything-container-local | 47:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/store/useKnowledgeModal.ts qanything-container-local | 55:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/store/useOptiionList.ts qanything-container-local | 43:7 warning Unexpected console statement no-console qanything-container-local | 45:9 warning Unexpected console statement no-console qanything-container-local | 52:9 warning Unexpected console statement no-console qanything-container-local | 55:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue qanything-container-local | 39:5 warning Unexpected console statement no-console qanything-container-local | 47:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue qanything-container-local | 72:1 warning Unexpected console statement no-console qanything-container-local | 97:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | (x2) [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/autoRetry.ts qanything-container-local | 17:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/forceRetry.ts qanything-container-local | 5:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue qanything-container-local | 72:1 warning Unexpected console statement no-console qanything-container-local | 97:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | ✓ 3390 modules transformed. dist/qanything/index.html 0.81 kB │ gzip: 0.48 kB qanything-container-local | dist/qanything/assets/ai-avatar-Mfa3nGpi.png 4.48 kB qanything-container-local | dist/qanything/assets/logo-small-G9Aimh5e.png 7.12 kB qanything-container-local | dist/qanything/assets/icon-file-cc9GkaT6.png 12.36 kB qanything-container-local | dist/qanything/assets/index-N7ZRDdsa.css 4.72 kB │ gzip: 1.54 kB qanything-container-local | dist/qanything/assets/Home-fBCPtTdS.css 10.80 kB │ gzip: 2.43 kB qanything-container-local | dist/qanything/assets/index-qS-55NZJ.css 11.60 kB │ gzip: 2.39 kB qanything-container-local | dist/qanything/assets/index-RapwEZsc.js 88.21 kB │ gzip: 31.34 kB qanything-container-local | dist/qanything/assets/index-LKprbnns.js 280.95 kB │ gzip: 94.50 kB qanything-container-local | dist/qanything/assets/useOptiionList-x3dMi9Nk.js 294.00 kB │ gzip: 102.64 kB qanything-container-local | dist/qanything/assets/Home-zTKfjtjJ.js 560.19 kB │ gzip: 157.61 kB qanything-container-local | qanything-container-local | (!) Some chunks are larger than 500 kB after minification. Consider: qanything-container-local | - Using dynamic import() to code-split the application qanything-container-local | - Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks qanything-container-local | - Adjust chunk size limit for this warning via build.chunkSizeWarningLimit. qanything-container-local | ✓ built in 19m 33s qanything-container-local | qanything-container-local | > [email protected] postbuild qanything-container-local | > node writeVersion.js qanything-container-local | qanything-container-local | file:///workspace/qanything_local/front_end/writeVersion.js:1 qanything-container-local | const fs = require('fs'); qanything-container-local | ^ qanything-container-local | qanything-container-local | ReferenceError: require is not defined in ES module scope, you can use import instead qanything-container-local | This file is being treated as an ES module because it has a '.js' file extension and '/workspace/qanything_local/front_end/package.json' contains "type": "module". To treat it as a CommonJS script, rename it to use the '.cjs' file extension. qanything-container-local | at file:///workspace/qanything_local/front_end/writeVersion.js:1:12 qanything-container-local | at ModuleJob.run (node:internal/modules/esm/module_job:195:25) qanything-container-local | at async ModuleLoader.import (node:internal/modules/esm/loader:336:24) qanything-container-local | at async loadESM (node:internal/process/esm_loader:34:7) qanything-container-local | at async handleMainPromise (node:internal/modules/run_main:106:12) qanything-container-local | qanything-container-local | Node.js v18.19.0 qanything-container-local | Failed to build the front end. qanything-container-local exited with code 1 (base) PS E:\QAnything> bash run.sh models 文件夹已存在，无需下载。 Checking model directories... 检查模型目录... 检查模型版本成功，当前版本为 v2.1.0。 Model directories check passed. (0/8) 模型路径和模型版本检查通过. (0/8) Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes Running under WSL Container qanything-container-local Stopping Container qanything-container-local Stopped Container qanything-container-local Removing Container qanything-container-local Removed Container mysql-container-local Stopping Container milvus-standalone-local Stopping Container milvus-standalone-local Stopped Container milvus-standalone-local Removing Container milvus-standalone-local Removed Container milvus-minio-local Stopping Container milvus-etcd-local Stopping Container milvus-etcd-local Stopped Container milvus-etcd-local Removing Container milvus-etcd-local Removed Container milvus-minio-local Stopped Container milvus-minio-local Removing Container milvus-minio-local Removed Container mysql-container-local Stopped Container mysql-container-local Removing Container mysql-container-local Removed Network qanything_milvus_mysql_local Removing Network qanything_milvus_mysql_local Removed [+] Running 6/6 ✔ Network qanything_milvus_mysql_local Created 0.1s ✔ Container milvus-minio-local Started 0.4s ✔ Container milvus-etcd-local Started 0.4s ✔ Container mysql-container-local Started 0.4s ✔ Container milvus-standalone-local Started 0.1s ✔ Container qanything-container-local Started 0.1s qanything-container-local | qanything-container-local | ============================= qanything-container-local | == Triton Inference Server == qanything-container-local | ============================= qanything-container-local | qanything-container-local | NVIDIA Release 23.05 (build 61161506) qanything-container-local | Triton Server Version 2.34.0 qanything-container-local | qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License. qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license: qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license qanything-container-local | qanything-container-local | GPU ID: 0, 0 qanything-container-local | The triton server will start on 0 GPU qanything-container-local | The llm transfer service is ready! (1/8) qanything-container-local | 大模型中转服务已就绪! (1/8) qanything-container-local | The rerank service is ready! (2/8) qanything-container-local | rerank服务已就绪! (2/8) qanything-container-local | The ocr service is ready! (3/8) qanything-container-local | OCR服务已就绪! (3/8) qanything-container-local | The qanything backend service is ready! (4/8) qanything-container-local | qanything后端服务已就绪! (4/8) qanything-container-local | Waiting for [npm run install]（5/8)

qanything-container-local | up to date, audited 887 packages in 8s qanything-container-local | qanything-container-local | 177 packages are looking for funding qanything-container-local | run npm fund for details qanything-container-local | qanything-container-local | 7 moderate severity vulnerabilities qanything-container-local | qanything-container-local | To address all issues (including breaking changes), run: qanything-container-local | npm audit fix --force qanything-container-local | qanything-container-local | Run npm audit for details. qanything-container-local | npm notice qanything-container-local | npm notice New minor version of npm available! 10.2.3 -> 10.3.0 qanything-container-local | npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.3.0 qanything-container-local | npm notice Run npm install -g [email protected] to update! qanything-container-local | npm notice qanything-container-local | [npm run install] Installed successfully（5/8) qanything-container-local | Waiting for npm run build qanything-container-local | qanything-container-local | > [email protected] build qanything-container-local | > vite build qanything-container-local | qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details. qanything-container-local | vite v5.0.12 building for production...

qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime qanything-container-local | qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue qanything-container-local | 44:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue qanything-container-local | 47:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue qanything-container-local | 187:5 warning Unexpected console statement no-console qanything-container-local | 197:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue qanything-container-local | 265:7 warning Unexpected console statement no-console qanything-container-local | 267:9 warning Unexpected console statement no-console qanything-container-local | 280:13 warning Unexpected console statement no-console qanything-container-local | 286:7 warning Unexpected console statement no-console qanything-container-local | 288:7 warning Unexpected console statement no-console qanything-container-local | 304:7 warning Unexpected console statement no-console qanything-container-local | 305:7 warning Unexpected console statement no-console qanything-container-local | 315:7 warning Unexpected console statement no-console qanything-container-local | 330:3 warning Unexpected console statement no-console qanything-container-local | 361:5 warning Unexpected console statement no-console qanything-container-local | 381:7 warning Unexpected console statement no-console qanything-container-local | 385:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 12 problems (0 errors, 12 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue qanything-container-local | 39:5 warning Unexpected console statement no-console qanything-container-local | 47:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/store/useKnowledgeModal.ts qanything-container-local | 55:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/store/useOptiionList.ts qanything-container-local | 43:7 warning Unexpected console statement no-console qanything-container-local | 45:9 warning Unexpected console statement no-console qanything-container-local | 52:9 warning Unexpected console statement no-console qanything-container-local | 55:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue qanything-container-local | 39:5 warning Unexpected console statement no-console qanything-container-local | 47:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue qanything-container-local | 73:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue qanything-container-local | 95:3 warning Unexpected console statement no-console qanything-container-local | 120:3 warning Unexpected console statement no-console qanything-container-local | 125:3 warning Unexpected console statement no-console qanything-container-local | 146:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 4 problems (0 errors, 4 warnings) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue qanything-container-local | 40:3 warning Unexpected console statement no-console qanything-container-local | 59:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | [plugin:vite-plugin-eslint] [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue qanything-container-local | 72:1 warning Unexpected console statement no-console qanything-container-local | 97:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | (x2) [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/autoRetry.ts qanything-container-local | 17:7 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/forceRetry.ts qanything-container-local | 5:5 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 1 problem (0 errors, 1 warning) qanything-container-local | [plugin:vite-plugin-eslint] qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue qanything-container-local | 72:1 warning Unexpected console statement no-console qanything-container-local | 97:3 warning Unexpected console statement no-console qanything-container-local | qanything-container-local | ✖ 2 problems (0 errors, 2 warnings) qanything-container-local | ✓ 3390 modules transformed. dist/qanything/index.html 0.81 kB │ gzip: 0.48 kB qanything-container-local | dist/qanything/assets/ai-avatar-Mfa3nGpi.png 4.48 kB qanything-container-local | dist/qanything/assets/logo-small-G9Aimh5e.png 7.12 kB qanything-container-local | dist/qanything/assets/icon-file-cc9GkaT6.png 12.36 kB qanything-container-local | dist/qanything/assets/index-N7ZRDdsa.css 4.72 kB │ gzip: 1.54 kB qanything-container-local | dist/qanything/assets/Home-fBCPtTdS.css 10.80 kB │ gzip: 2.43 kB qanything-container-local | dist/qanything/assets/index-qS-55NZJ.css 11.60 kB │ gzip: 2.39 kB qanything-container-local | dist/qanything/assets/index-RapwEZsc.js 88.21 kB │ gzip: 31.34 kB qanything-container-local | dist/qanything/assets/index-LKprbnns.js 280.95 kB │ gzip: 94.50 kB qanything-container-local | dist/qanything/assets/useOptiionList-x3dMi9Nk.js 294.00 kB │ gzip: 102.64 kB qanything-container-local | dist/qanything/assets/Home-zTKfjtjJ.js 560.19 kB │ gzip: 157.61 kB qanything-container-local | qanything-container-local | (!) Some chunks are larger than 500 kB after minification. Consider: qanything-container-local | - Using dynamic import() to code-split the application qanything-container-local | - Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks qanything-container-local | - Adjust chunk size limit for this warning via build.chunkSizeWarningLimit. qanything-container-local | ✓ built in 21m 56s qanything-container-local | qanything-container-local | > [email protected] postbuild qanything-container-local | > node writeVersion.js qanything-container-local | qanything-container-local | [npm run build] build successfully(6/8) qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | qanything-container-local | > [email protected] serve qanything-container-local | > vite preview --port 5052 qanything-container-local | qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details. qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | Waiting for the front-end service to start... qanything-container-local | 等待启动前端服务 qanything-container-local | ➜ Local: http://localhost:5052/qanything qanything-container-local | ➜ Network: http://172.19.0.6:5052/qanything qanything-container-local | The front-end service is ready!...(7/8) qanything-container-local | 前端服务已就绪!...(7/8) qanything-container-local | Time elapsed: 1440 seconds. qanything-container-local | 已耗时: 1440 秒. qanything-container-local | The triton service is starting up, it can be long... you have time to make a coffee :) qanything-container-local | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :) qanything-container-local | 启动Triton服务超时，请进入容器内检查/model_repos/QAEnsemble_base/QAEnsemble_base.log以获取更多信息。 qanything-container-local exited with code 1

我的显示启动超时！容器里面就停止了！

Jan 20 '24 08:01 huweibin1983

+1 QAEnsemble.log:

terminate called after throwing an instance of 'std::runtime_error'  what(): [FT][ERROR] Assertion fail: /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89   [af64e462bb34:00106] *** Process received signal *** [af64e462bb34:00106] Signal: Aborted (6) [af64e462bb34:00106] Signal code: (-6) [af64e462bb34:00106] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f9ce0895520] [af64e462bb34:00106] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f9ce08e99fc] [af64e462bb34:00106] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f9ce0895476] [af64e462bb34:00106] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f9ce087b7f3] [af64e462bb34:00106] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f9ce0b1db9e] [af64e462bb34:00106] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f9ce0b2920c] [af64e462bb34:00106] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f9ce0b29277] [af64e462bb34:00106] [ 7] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae4d8)[0x7f9ce0b294d8] [af64e462bb34:00106] [ 8] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN17fastertransformer17throwRuntimeErrorEPKciRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x27f)[0x7f9c7b7c4c5f] [af64e462bb34:00106] [ 9] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN16LlamaTritonModelI6__halfEC1EmmiNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEi+0x70e)[0x7f9c7ba9fdae] [af64e462bb34:00106] [10] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x275ca)[0x7f9cd07865ca] [af64e462bb34:00106] [11] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x2f0d9)[0x7f9cd078e0d9] [af64e462bb34:00106] [12] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x35f56)[0x7f9cd0794f56] [af64e462bb34:00106] [13] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(TRITONBACKEND_ModelInitialize+0x4c2)[0x7f9cd0795732] [af64e462bb34:00106] [14] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x174497)[0x7f9ce125e497] [af64e462bb34:00106] [15] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x252d80)[0x7f9ce133cd80] [af64e462bb34:00106] [16] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x2563c3)[0x7f9ce13403c3] [af64e462bb34:00106] [17] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x39a052)[0x7f9ce1484052] [af64e462bb34:00106] [18] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253)[0x7f9ce0b57253] [af64e462bb34:00106] [19] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x94ac3)[0x7f9ce08e7ac3] [af64e462bb34:00106] [20] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x126660)[0x7f9ce0979660] [af64e462bb34:00106] *** End of error message *** 

Jan 20 '24 13:01 ycycyc

同样的问题，有解决方案吗

Jan 22 '24 01:01 luy710