dalai
dalai copied to clipboard
Default to system CPU thread count
Instead of defaulting to 8, default to system CPU.
The system thread count isn't always the most efficient, as I learned through testing. It would be better to have an input which allows you to select the thread count in the UI. For instance, I have 32 threads, but using 24 actually ended up being significantly faster (by about 4x)
Defaulting to CPU thread count isnt always the best.
- It should be a power of 2 or multiple of 8. 16 threads will perform better than 18.
- It should not be the max number of threads available. e.g. if you have 32 threads, it might be better to use 16 or 24.