kaldi-grpc-server icon indicating copy to clipboard operation
kaldi-grpc-server copied to clipboard

Missing requirements

Open kosniaz opened this issue 3 years ago • 3 comments

To be added:

software requirements

  • python >= 3.8, <=4.0

hardware requirements

  • 10-15GB free memory
  • 4 cores
  • ~10GB

kosniaz avatar Jan 17 '22 17:01 kosniaz

What is the max workers value you pass? (https://github.com/georgepar/kaldi-grpc-server/blob/main/Makefile#L24)

10-15gb ram sounds a bit excessive

georgepar avatar Jan 17 '22 22:01 georgepar

Turns out I was running with the defaults, i.e. max_workers=10. I switched to 3 workers and it didn't take much RAM. So, a rough estimation would be ~2GB*$max_workers

kosniaz avatar Mar 07 '22 15:03 kosniaz

TODO: Specify memory requirements as a function of num-workers and model size

georgepar avatar Mar 10 '22 09:03 georgepar