maxaki
maxaki
> Using these changes I was able to fit 3 `ggml-medium.en.bin` models into 2 x RTX 3070s, and handle 6 simultaneous transcriptions with an ASP.NET Core API I built. >...
> > > Using these changes I was able to fit 3 `ggml-medium.en.bin` models into 2 x RTX 3070s, and handle 6 simultaneous transcriptions with an ASP.NET Core API I...
> @adamreed90 I like the idea of integer index in that string, it’s simple and it works. Will be fixed in the next version. In the meantime, update from master...
Are you sure the Whisperer project is processing the audio in batches? Whenever I try process files they do it in sequence using a 12GB VRAM card.