Georgi Gerganov

Results 420 comments of Georgi Gerganov

Maybe @fitzsim can provide some info - they developed most of the PPC64 port

Yes - you are correct. It seems I didn't design the `whisper_context` in the best possible way. For now, you can achieve parallel processing using a single `whisper_context` by hacking...

Yes, I think the tokens are as follows: - token 0: `*` - token 1: `wind` - token 2: ` blowing`

You are correct that having more context in general improves the quality of the ASR quality. However, more text context makes the decoder slower, so I thought it is OK...

I believe this has been resolved at some point. Feel free to reopen if problem persists

Sure, you can install it and manually modify the Makefile with the correct path. In the future, we might add option to specify the path via environment variable.

OpenBLAS does not help on Mac - `whisper.cpp` already uses [Apple's Accelerate BLAS](https://developer.apple.com/documentation/accelerate/blas?language=objc) which is superior.

I think we can measure and report both. On non-Windows system we can use the existing `ggml_cycles()`: https://github.com/ggerganov/whisper.cpp/blob/d1ea1220ffeff846efd0578e8df3b1d1b802bb5d/ggml.c#L315-L321