Keyword-BERT icon indicating copy to clipboard operation
Keyword-BERT copied to clipboard

性能问题

Open jieli4970 opened this issue 4 years ago • 2 comments

您好,您用6layer的并发支持好吗?我是用tf serving来落地的,但是并发一般呀。感谢回复

jieli4970 avatar Jun 11 '20 23:06 jieli4970

serving的并发和模型关系不大,和框架有关。你可以试试nvidia的transformer加速模块

DataTerminatorX avatar Jun 15 '20 23:06 DataTerminatorX

感谢。

jieli4970 avatar Jun 16 '20 08:06 jieli4970