QAnything
QAnything copied to clipboard
netease-youdao
[BUG] 获取算力时出错
是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?
- [X] 我已经搜索过FAQ | I have searched FAQ
当前行为 | Current Behavior
python3: can't open file '/model_repos/QAEnsemble_embed_rerank/scripts/get_cuda_capability.py': [Errno 2] No such file or directory
期望行为 | Expected Behavior
No response
运行环境 | Environment
- OS: Ubuntu 22.04.3
- NVIDIA Driver: 545.23.08
- CUDA: 12.3
- docker: 20.10.21
- docker-compose: 2.26.1
- NVIDIA GPU: GeForce RTX 4090
- NVIDIA GPU Memory: 24GB
QAnything日志 | QAnything logs
qanything-container-local | qanything-container-local | ============================= qanything-container-local | == Triton Inference Server == qanything-container-local | ============================= qanything-container-local | qanything-container-local | NVIDIA Release 23.05 (build 61161506) qanything-container-local | Triton Server Version 2.34.0 qanything-container-local | qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved. qanything-container-local | qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License. qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license: qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license qanything-container-local | qanything-container-local | llm_api is set to [cloud] qanything-container-local | device_id is set to [0] qanything-container-local | runtime_backend is set to [default] qanything-container-local | model_name is set to [] qanything-container-local | conv_template is set to [] qanything-container-local | tensor_parallel is set to [1] qanything-container-local | gpu_memory_utilization is set to [0.81] qanything-container-local | GPU ID: 0, 0 qanything-container-local | python3: can't open file '/model_repos/QAEnsemble_embed_rerank/scripts/get_cuda_capability.py': [Errno 2] No such file or directory qanything-container-local | 您的显卡型号 NVIDIA GeForce RTX 4090 获取算力时出错，请联系技术支持。
复现方法 | Steps To Reproduce
No response
备注 | Anything else?
No response
今天拉取了最新代码，启动也是提示这个错误。进容器里面查看，确实不存在这个文件。有解决吗？
https://github.com/netease-youdao/QAnything/blob/master/scripts/run_for_cloud_option.sh#L128
我把这个地方的路径改成容器里对应文件的路径了：
/workspace/qanything_local/scripts/get_cuda_capability.py
不好意思,我命令输成了cloud了,bug解决
这...... cloud也遇到这个问题了，怎么破？
cloud 遇到同样问题
author说更新后会自动解决(我没测试过),老版本是根据本地一个算力json文件去获取的,这个问题是说他在这个json文件里没有找到你响应的显卡型号,解决方法: 1.你用CUDA获取算力后把型号和算力根据格式填进去就行了 2.在bash脚本中把检测算力的function 写死成你的算力结果