TurboTransformers Set num threads ineffective

Set num threads ineffective

Open auspicious3000 opened this issue 5 years ago • 3 comments

trafficstars

turbo_transformers.set_num_threads(?)

Whatever number I put in there, it is always using 4 threads.

Nov 15 '20 05:11 auspicious3000

In your command line set export OMP_NUM_THREADS=?

Nov 16 '20 01:11 feifeibear

Does not seem to work either ...

Nov 16 '20 02:11 auspicious3000

If you are using onnxrt as backend. The multiple-threading is not managed by OMP env. export MKL_VERBOSE=1. See the number of threads used for GEMM.

Nov 16 '20 05:11 feifeibear