coolmian
coolmian
> I recommend opening an issue in https://github.com/intel/scikit-learn-intelex, because the issue only happens when `sklearnex` patches `scikit-learn`. With that in mind, I am closing this issue because it is not...
是的,我也发现了,我周末放两天不用之后,周一再来就几乎用不了,大部分请求超时。原来1秒内的响应时间变成了几十上百秒
> > 现在的服务框架似乎对高并发不够友好? num_workers设置决定了并发数量吧 @hanxiao > > 并不是高并发,我的并发不高,而且worker 设置的3。 对,我频繁访问反而没事,放着不用一段时间就会这样超时。而且我试过,两个bert客户端连接一个bert服务端,一个超时一个正常
> > > > 现在的服务框架似乎对高并发不够友好? num_workers设置决定了并发数量吧 @hanxiao > > > > > > > > > 并不是高并发,我的并发不高,而且worker 设置的3。 > > > > > > 对,我频繁访问反而没事,放着不用一段时间就会这样超时。而且我试过,两个bert客户端连接一个bert服务端,一个超时一个正常 > > 难道要没事就访问一下那个服务。。。无奈啊。。我后来用这个都加了容灾处理,如果那个接口超时,就采用其他的方案。 或者你可以试试transformers加上Service Streamer来自己计算向量...
突然想起来一个问题,你在建立连接以后 bc = BertClient() 是否在不同线程中共用这个变量 bc
I have this problem, and so far it has not been solved
After debugging, I found that when this error occurs, the response format returned by the server is different from the normal response format
> > After debugging, I found that when this error occurs, the response format returned by the server is different from the normal response format > > hello, how to...
> [LmeSzinc/AzurLaneAutoScript#876 (comment)](https://github.com/LmeSzinc/AzurLaneAutoScript/issues/876#issuecomment-1013101714) > > Summary > > * Problems occurs only when reload is enabled (`--reload`), not sure about `--workers` because we don't use it > > Solution >...
其实就是不支持写正则表达式吧