TurboTransformers icon indicating copy to clipboard operation
TurboTransformers copied to clipboard
verified publisher icon Tencent

Benchmark testing for accuracy

Open QSZL-SZ opened this issue 4 years ago • 1 comments

The benchmark testing script just shows the QPS or latency comparison without accuracy testing. Does turbo have the method for accuracy testing or some suggestion to do this? Thanks.

QSZL-SZ avatar May 24 '21 07:05 QSZL-SZ

Accuracy is checked in unitests. Therefore benchmark is only for performance evaluation. Scripts in ./python/example compared the accuracy results

feifeibear avatar May 24 '21 07:05 feifeibear