Serving

Serving copied to clipboard

A10的GPU上运行模型，过一段时间就会报CUDA error(700), an illegal memory access was encountered，机器看不出任何问题

1

ERROR 2023-08-18 22:36:56,242 [operator.py:1079] [text_quality] failed to predict. (data_id=517045 log_id=517045) [text_quality|6] Failed to process(batch: [517045]): (External) CUDA error(700), an illegal memory access was encountered. [Hint: Please search for the error...

bdbaigc

golang mod require 1.19

1


qixiaobo

Serving模式推理异常

9

我在使用飞桨的框架实现模型训练和推理过程中发生了一些问题，有人了解的吗？麻烦帮忙分析解决，谢谢！ 问题：同一批图片进行推理多次推理时，偶尔出现结果不一样的情况，关闭TRT加速后暂未发现，但关闭后无法实现推理加速。 服务端启动命令：python3 -m paddle_serving_server.serve --model serving_server --runtime_thread_num 6 --batch_infer_size 32 --port 9595 --gpu_ids 0 --gpu_multi_stream --use_trt 环境：服务端在Ubuntu系统，运行Serving模式进行推理。客户端在windows端（采用GRPC协议，异步通信方式）。

weida008

ubuntu20.04 按照Docker安装Paddle Serving环境检查一直有错误。 xxx gpu environment running failure

2

折腾两天了，无论在线安装还是离线安装Wheel 包，环境检查都有错误 117a5d2df849 /paddle/Serving {v0.9.0} python3 -m paddle_serving_server.serve check /usr/local/lib/python3.6/runpy.py:125: RuntimeWarning: 'paddle_serving_server.serve' found in sys.modules after import of package 'paddle_serving_server', but prior to execution of 'paddle_serving_server.serve'; this may result in...

fanxinkeji

AttributeError: 'TestFitALine' object has no attribute 'truth_val'

1

the branch is v0.8.3 python3.8.10 client build success app build success server build success pip3 install success but when run the cmd: `python3 -m paddle_serving_server.serve check` error occur: ``` ../../usr/local/lib/python3.8/dist-packages/paddle_serving_server/env_check/test_fit_a_line.py...

LuLu2kANG

client编译报错

1

google/protobuf/descriptor.proto: File not found. pds_option.proto: Import "google/protobuf/descriptor.proto" was not found or had errors. pds_option.proto:19:8: "google.protobuf.FieldOptions" is not defined. pds_option.proto:23:8: "google.protobuf.ServiceOptions" is not defined. core/pdcodegen/CMakeFiles/pdcodegen.dir/build.make:62: recipe for target 'core/pdcodegen/pds_option.pb.h' failed make[2]:...

ancenye

1、python pipeline_service.py 启动服务，一切正常 2023/08/08 23:46:45 start proxy service 2、curl 访问算子 pipeline_service.py直接挂掉，同时std_out打印如下日志： W0808 23:46:51.424680 206179 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 8.6, Driver API Version: 11.2, Runtime API Version:...

bdbaigc

源码编译错误

1

[ 37%] Built target extern_glog Scanning dependencies of target utils [ 37%] Building CXX object core/util/CMakeFiles/utils.dir/src/timer.cc.o cc1plus: warning: /usr/include/python3.8/Python.h: not a directory [ 38%] Linking CXX static library libutils.a [...

stilong

uci_housing_model

1

使用Paddle Serving部署深度模型，看https://github.com/PaddlePaddle/Serving/tree/develop/examples/Pipeline/simple_web_service 例子，使用命令 python3 -m paddle_serving_server.serve --model uci_housing_model --thread 10 --port 9292 其中uci_housing_model这个文件目录是怎么生成的呢

wanzhixiao

libproxy_server.so加载失败，提示OSError: dlopen: cannot load any more object with static TLS

1

执行 python pipeline_service.py，弹出如下报错 但是 /ssd2/workspace/libai/python_env/lib/python3.7/site-packages/paddle_serving_server/pipeline/gateway/libproxy_server.so 这个so是存在的，求助 Python 版本 3.7.16 (default, Jan 17 2023, 22:20:44) ---------- [PipelineServicer] succ init Process Process-1: Traceback (most recent call last): File "/ssd2/workspace/libai/python_env/lib/python3.7/multiprocessing/process.py", line 297, in...

bdbaigc