cal.com icon indicating copy to clipboard operation
cal.com copied to clipboard

[CAL-2903] Transcribe and summarize video meetings using AI

Open aar2dee2 opened this issue 1 year ago • 9 comments

Is your proposal related to a problem?

I use Cal to schedule user interviews for Telborg, then take handwritten notes during the video meeting and rewrite those notes in Slab.

Describe the solution you'd like

I'd love a workflow where I can:

  1. request consent to record automatically when meeting starts
  2. transcribe the conversation using a speech-to-text model such as Whisper
  3. Summarise the conversation using GPT 3.5/4 /other LLM
  4. Send transcript + summary to Notion/Slab/Google Docs/other wiki provider
  5. (Optional) send follow-up email to meeting attendees summarising the conversation

Describe alternatives you've considered

I currently use Google Meet for the meetings. A Zapier workflow with access to Google Drive might be possible but I would have to

  1. remember to ask for consent and enable recording
  2. setup zapier + google drive to access recording
  3. setup zapier + openai to transcribe and summarise
  4. setup zapier + notion/slab/google docs to store transcript and summary

The whole setup can be simplified by

  1. using daily.co's transcription service - this has native support for Whisper
  2. building Cal integrations for the wiki providers we want to support

Additional context

I love Loom's AI features - using AI to transcribe the recording, generate a summary, generate a relevant title. And all of this happens nearly real-time.

Happy to work on this independently or with other contributors!

Requirement/Document

CAL-2903

aar2dee2 avatar Aug 29 '23 18:08 aar2dee2

Thank you for opening your first issue, one of our team members will review it as soon as it possible. ❤️🎉

github-actions[bot] avatar Aug 29 '23 18:08 github-actions[bot]

So you want a browser extension of cal.com to transcribe meets and summarize them?

goesbyabhi avatar Aug 29 '23 19:08 goesbyabhi

This is a pretty big change and honestly i think this will be helpful for the users. I am all for it.

Akhilbisht798 avatar Aug 29 '23 20:08 Akhilbisht798

yes the daily.co transcription service is perfect for this

PeerRich avatar Aug 30 '23 10:08 PeerRich

we can send the call summary by email afterwards to all attendees as bullet points

PeerRich avatar Aug 30 '23 10:08 PeerRich

yes the daily.co transcription service is perfect for this

great. I'll get started on this.

aar2dee2 avatar Aug 31 '23 04:08 aar2dee2

So you want a browser extension of cal.com to transcribe meets and summarize them?

is there a browser extension that does this?

aar2dee2 avatar Aug 31 '23 04:08 aar2dee2

@aar2dee2, Hey are you working on this issue.

Akhilbisht798 avatar Sep 10 '23 07:09 Akhilbisht798

Hey @Akhilbisht798, yea I am

aar2dee2 avatar Sep 10 '23 07:09 aar2dee2