Matt Pelletier
Matt Pelletier
+1. @bradphelan any chance you could accept this pull request? Thanks!
@andreibondarev yeah for sure, should be able to do in the next few days
@andreibondarev yeah, I'm not super familiar with the other LLM APIs but am happy to tackle in another PR if we don't have any other devs who are pseudo-maintainers of...
@andreibondarev just an update, I'll get support in the other LLM validators for their version of `:max_tokens` over the next few days.
@hopsoft I'm getting this too, running on 0.0.3 and turbo-rails 1.3.2. First of all amazing set of new tools, thank you. Second, I am happy to opt-out of token validation,...
I'm having the same issue. Command is `insanely-fast-whisper --file-name test.mp3 --device-id mps --model-name distil-whisper/distil-large-v3` or `insanely-fast-whisper --file-name test.mp3 --device-id mps --model-name openai/whisper-large-v3-turbo`, with or without `--batch-size 4`