trash-cant comments

Repositories
Issues
Comments

Results 1 comments of


                                            trash-cant

Only 4 threads seem to be used on an 8 thread machine.

Ryzen 5600X : defaullt = 4.33s/it INFERENCE_NUM_THREADS: 12 = 3.7s/it INFERENCE_NUM_THREADS: 10 = 3.8s/it INFERENCE_NUM_THREADS: 8 = 4.22s/it INFERENCE_NUM_THREADS: 6 = 4.16s/it Love being able to run this on CPU!