Cap icon indicating copy to clipboard operation
Cap copied to clipboard

Subtitle/caption generation in Studio Mode recordings

Open richiemcilroy opened this issue 10 months ago • 9 comments

In the editor, make it an option to download a local transcription AI model, and add captions to the Studio Mode recording.

This will bake the captions directly into the video frames.

This should be in the form of a new tab in the editor.

If the local transcription AI model has not been downloaded yet, prompt the user to download it first.

In the new captions tab, if the model exists and the video has audio, add a "Generate captions" button.

The caption transcription should be editable, including the design/how the text looks on the video.

Rendering the text on the GPU would probably be best achieved with glyphon

richiemcilroy avatar Mar 12 '25 01:03 richiemcilroy

/bounty $500

richiemcilroy avatar Mar 12 '25 01:03 richiemcilroy

💎 $500 bounty • Cap

Steps to solve:

  1. Start working: Comment /attempt #361 with your implementation plan
  2. Submit work: Create a pull request including /claim #361 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to CapSoftware/Cap!

Add a bountyShare on socials

Attempt Started (GMT+0) Solution
🟢 @benya7 Mar 12, 2025, 6:41:34 AM WIP
🟢 @onyedikachi-david #364
🟢 @Harsh9485 #402

algora-pbc[bot] avatar Mar 12 '25 01:03 algora-pbc[bot]

/attempt #361

Algora profile Completed bounties Tech Active attempts Options
@benya7 2 bounties from 2 projects
TypeScript, JavaScript,
Vue & more
Cancel attempt

benya7 avatar Mar 12 '25 06:03 benya7

💡 @onyedikachi-david submitted a pull request that claims the bounty. You can visit your bounty board to reward.

algora-pbc[bot] avatar Mar 12 '25 12:03 algora-pbc[bot]

this issue is still open

Harsh9485 avatar Mar 28 '25 14:03 Harsh9485

if this issue is open then I have some good steps to make this feature

  • make a script to download AI model and setup in the local machine
  • give some sample style to user easily choose one like major professional software did to enhance user experience also we give customize text feature using glyphon library
  • now other steps is easy to implement like generate subtitle button and any more

Harsh9485 avatar Mar 28 '25 14:03 Harsh9485

Hey thanks for this. We still have a PR that has been submitted as a claim that we're still checking through :)

richiemcilroy avatar Mar 28 '25 14:03 richiemcilroy

ok good I'm work on this feature

Harsh9485 avatar Mar 28 '25 14:03 Harsh9485

💡 @Harsh9485 submitted a pull request that claims the bounty. You can visit your bounty board to reward.

algora-pbc[bot] avatar Mar 30 '25 03:03 algora-pbc[bot]

Hi @richiemcilroy , is this still available to work on?

rahulrajesh21 avatar May 15 '25 05:05 rahulrajesh21

🎉 The pull request of @onyedikachi-david has been merged. The bounty can be rewarded here

cc @CapSoftware

algora-pbc[bot] avatar May 26 '25 09:05 algora-pbc[bot]

Hi, @Brendonovich. The bounty is yet to be rewarded. Could you please process the payment when possible?

onyedikachi-david avatar Jun 02 '25 01:06 onyedikachi-david

Ping @Brendonovich

onyedikachi-david avatar Jun 08 '25 18:06 onyedikachi-david

Hey @onyedikachi-david - I will sort this. Apologies for the delay 🙏

richiemcilroy avatar Jun 08 '25 19:06 richiemcilroy

Alright. @richiemcilroy

onyedikachi-david avatar Jun 08 '25 20:06 onyedikachi-david

🎉🎈 @onyedikachi-david has been awarded $500 by Cap! 🎈🎊

algora-pbc[bot] avatar Jun 10 '25 21:06 algora-pbc[bot]