onnxruntime icon indicating copy to clipboard operation
onnxruntime copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Why is MLAS_MAXIMUM_THREAD_COUNT set to 16?

Open jasonsi1993 opened this issue 1 year ago • 2 comments

Describe the issue

I am doing some testing on cpus that have way more than 16 cores. I am seeing that MLAS is setting the max thread number to 16. Is there any reasons behind it?

To reproduce

onnxruntime/core/mlas/lib/mlasi.h:290

Urgency

No response

Platform

Linux

OS Version

Centos

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

1.16.0

ONNX Runtime API

C++

Architecture

ARM64

Execution Provider

Default CPU

Execution Provider Library Version

No response

jasonsi1993 avatar Nov 25 '23 09:11 jasonsi1993

@yufenglee, could you please help answer the question?

snnn avatar Nov 27 '23 17:11 snnn

@yufenglee, Is there any updates regarding this question?

jasonsi1993 avatar Feb 22 '24 09:02 jasonsi1993