vosk-server icon indicating copy to clipboard operation
vosk-server copied to clipboard
verified publisher icon alphacep

Server capacity & resources

Open aslam-t opened this issue 1 year ago • 2 comments

Question (Not an Issue)

Hi team,

I have a question rather than a issue. Please bear with me as I have no knowledge of vosk internals. So, I am hosting a docker instance of vosk-server. My primary use case is to utilize it in a conferencing system as transcriber. It works fine with my initial testing with few users but some clarity on following is still required before I confidently release:

  1. Which resource is most important for vosk-server CPU, RAM or GPU etc.?
  2. How many instances are enough to handle 1000 concurrent sessions?
  3. Do we have a pointer if such info already exists.?

I am only transcribing English for now, no other language, if that matter for my case.

Looking forward to any help.

Thanks

aslam-t avatar Aug 07 '24 23:08 aslam-t

Which resource is most important for vosk-server CPU, RAM or GPU etc.

Memory bandwidth and model size are most restricting factors.

How many instances are enough to handle 1000 concurrent sessions?

10 CPU servers of 48 cores each or 5 GPU servers with RTX4090

nshmyrev avatar Aug 08 '24 05:08 nshmyrev

Is there any way to optimize CPU usage? For example, not recognizing the contents of silent packages

zhq1 avatar Aug 28 '24 02:08 zhq1