GLiNER icon indicating copy to clipboard operation
GLiNER copied to clipboard

Gliner on CPU with multiple cores

Open vijayendra-g opened this issue 7 months ago • 14 comments

I want to use Gliner on CPU . The medium model takes anywhere between 18- 20 minutes for extracting entities from given text. My question is,

  1. Does Gliner support multiple cores on a single cpu and multiple cpus ? Will there be improvement in performance ?
  2. Assuming the answer to question 1 is yes, If I were to increase the no of cores and no of cpus, Then what sort of time improvement can we expect. Has anyone tried doing this?

vijayendra-g avatar Jul 16 '24 09:07 vijayendra-g