Tong Cheng

Results 9 comments of Tong Cheng

Hi, Is there any progress? I just find this awesome project and looking for some info about this feature

We also met this problem. TF-serving occupied all GPU memory when it started and there is no way to know how much memory really needed for a specific model. If...

没有,需要写 PHP 扩展支持。我们是升级内部扩展增加了对 tseer 的支持

/home/tcheng/tools/TSeer/TseerServer/src/RequestEtcdCallback.cpp:1299 就是一个日志输出语句: `ETCDPROC_LOG

回头来继续看了一下这个问题,对最近的几次 core 分析,代码有修改,位置也有所不同,都最终都是 core 在 `ETCDPROC_LOG

Is there any furthur progress with official support for MPS ?

+1 for this

这个问题是影响线上大规模使用的,等待进一步解决