chatcraft.org icon indicating copy to clipboard operation
chatcraft.org copied to clipboard

Make some sort of a voice assistant

Open tarasglek opened this issue 1 year ago • 7 comments

  1. Chatcraft provides function support https://blog.humphd.org/teaching-chatcraft-to-do-citations/ or https://www.youtube.com/watch?v=z7euXeDU5vM (using webrtc!)
  2. This means we can use chatcraft to do a lot of automation better than any google home or alexa. Eg one could comebine this with hardware and say "Chatcraft make me coffee" :)
  3. we tie it to a stable open source model to handle those requests, so we wont get dumber over time like alexa or google home.
  4. Really the only thing we need is wakeword support, which we can either do ourselves or integrate from rhasspy or wyoming protocol. It might be easier to bypass all that and run openWakeWord onnx via webgpu
  5. It would be nice to support jitsi or discord sdks so we could expose chatcraft as an assistant in meetings.

Use-cases: Meeting bot that opens and closes jiras, sends emails to summarize meetings, turns recordings on/off

tarasglek avatar Dec 24 '23 18:12 tarasglek