Transcription WorkBench

[lutangar]

Description

┬───────────────────────┬──────────────────────┬──────────┬────────┬───────────────────────┐
│          WER          │         CER          │ duration │ model  │        engine         │
┼───────────────────────┼──────────────────────┼──────────┼────────┼───────────────────────┤
│ '30.373831775700932%' │ '9.824046920821115%' │  '31s'   │ 'tiny' │   'openai-whisper'    │
│ '25.233644859813083%' │      undefined       │  '12s'   │ 'tiny' │ 'whisper-ctranslate2' │
│ '35.046728971962615%' │      undefined       │  '18s'   │ 'tiny' │ 'whisper-timestamped' │
┴───────────────────────┴──────────────────────┴──────────┴────────┴───────────────────────┘
┬───────────────────────┬──────────────────────┬──────────┬─────────┬───────────────────────┐
│          WER          │         CER          │ duration │  model  │        engine         │
┼───────────────────────┼──────────────────────┼──────────┼─────────┼───────────────────────┤
│ '15.887850467289718%' │      undefined       │ '2m 51s' │ 'small' │   'openai-whisper'    │
│ '16.355140186915886%' │ '18.10850439882698%' │  '42s'   │ 'small' │ 'whisper-ctranslate2' │
│ '16.822429906542055%' │      undefined       │ '1m 5s'  │ 'small' │ 'whisper-timestamped' │
┴───────────────────────┴──────────────────────┴──────────┴─────────┴───────────────────────┘

:computer: i7-7500U :movie_camera: :fr: 1m28s https://podeduc.apps.education.fr/numerique-educatif/video/21893-communiquer-lors-dune-classe-transplantee/

Related issues

Has this been tested?

• [x] 👍 yes, I added tests to the test suite

see specific transcriptions tests https://github.com/larriereguichet/PeerTube/actions/workflows/transcription.yml

• [ ] 💭 no, because this PR is a draft and still needs work
• [ ] 🙅 no, because this PR does not update server code
• [ ] 🙋 no, because I need help

Screenshots

[socket-security[bot]]

👍 Dependency issues cleared. Learn more about Socket for GitHub ↗︎

This PR previously contained dependency changes with security issues that have been resolved, removed, or ignored.

View full report↗︎

[socket-security[bot]]

New and removed dependencies detected. Learn more about Socket for GitHub ↗︎

Package	New capabilities	Transitives	Size	Publisher
npm/[email protected]	None	0	17.6 kB	ljharb
npm/[email protected]	None	0	22 kB	ljharb

🚮 Removed packages: npm/[email protected], npm/[email protected]

View full report↗︎

[Chocobozzz]

Merged manually in develop :sparkles: :sparkles: :sparkles: https://github.com/Chocobozzz/PeerTube/commit/ef14cf4a5cb755f5bcfc80a3c70a47ce20f268fb

Thanks a lot!

[Agorise]

The llama3 LLM is amazing, would be nice if we could choose this one in peertube admin ui: https://ollama.com/library?q=llama An amazing demo of it: https://cast.garden/w/byuK9wLdgAjSMKxCEnf61N