kaldi-grpc-server
kaldi-grpc-server copied to clipboard
Missing requirements
To be added:
software requirements
- python >= 3.8, <=4.0
hardware requirements
- 10-15GB free memory
- 4 cores
- ~10GB
What is the max workers value you pass? (https://github.com/georgepar/kaldi-grpc-server/blob/main/Makefile#L24)
10-15gb ram sounds a bit excessive
Turns out I was running with the defaults, i.e. max_workers=10. I switched to 3 workers and it didn't take much RAM. So, a rough estimation would be ~2GB*$max_workers
TODO: Specify memory requirements as a function of num-workers and model size