dalai icon indicating copy to clipboard operation
dalai copied to clipboard

Default to system CPU thread count

Open matbeedotcom opened this issue 2 years ago • 2 comments

Instead of defaulting to 8, default to system CPU.

matbeedotcom avatar Mar 19 '23 04:03 matbeedotcom

The system thread count isn't always the most efficient, as I learned through testing. It would be better to have an input which allows you to select the thread count in the UI. For instance, I have 32 threads, but using 24 actually ended up being significantly faster (by about 4x)

watzon avatar Mar 20 '23 15:03 watzon

Defaulting to CPU thread count isnt always the best.

  1. It should be a power of 2 or multiple of 8. 16 threads will perform better than 18.
  2. It should not be the max number of threads available. e.g. if you have 32 threads, it might be better to use 16 or 24.

ItsPi3141 avatar Mar 20 '23 20:03 ItsPi3141