Visualize live sound within the Orcasound live-listening web app

[valentina-s]

Visualize live sound within the Orcasound live-listening web app

Display audio stream as a spectrogram or other visualization that evolves over time.

Stretch goal: add both human and ML annotations and labels in real-time!

Required skills: Elixir, Javascript

Bonus skills: time-series analysis

Possible mentors: Scott, Paul (with technical assistance from Orcasound contributors Sam and Skander)

References and open-source building blocks:

• Associated Orcasound feature card (Trello) in the long-term road map
• Inspiring web-based real-time spectrogram with machine learning model outputs: Cornell’s BirdNet (open in FireFox)
• Spectrogram with WebAudio

Getting Started (these are suggestions, there is no one way to go)

• Get acquainted with the code on the spectrogram branch
• Study how the Birdnet demo (for Raspberry Pi) can be adapted to run on your computer, what can be integrated with Orcasound website

[rathovarun]

Hi, I am interested to work on this issue. Below is the link to my proposal draft. I am looking forward to get feedback from you on my proposal. Thank you for your time!! https://docs.google.com/document/d/1t0Gzh5V-ISLm3y9GwoA2OA0FB_ZlvjpuOvX2_JgyUU4/edit?usp=sharing

[YashKumarVerma]

was the label supposed to be 2021?

[d-e-v-esh]

Hey @ivanoats I want to confirm if this issue is available for the GSOC 2021, and can I start working on a proposal for this project?

[ivanoats]

On the map or the main site? @scottveirs ?

[scottveirs]

@ivanoats This feature was initially requested in the Orcasound live-listening web app roadmap. It's beyond the scope of the current version 3 re-design, but having a student work on it could provide new functionality to version 4.

It's an interesting question of how such a visualization of the real-time audio data might manifest in a map UI like the one that's emerging in orcamap-react repo...

[scottveirs]

Clarifying title: this is a feature request for the live-listening web app at live.orcasound.net, rather than one of the other web apps that is emerging within the Orcasound organization.

[kushalShukla-web]

Hello guys , this is my first time to the opensource . iam interested in this project can anyone tell me where is code for this project. pls

[Molkree]

@kushalShukla-web, the code is here: https://github.com/orcasound/orcasite