essentia
essentia copied to clipboard
Add C++ and Python demos for using Essentia real-time
Add C++ and Python demos for using Essentia real-time.
This issue summarizes some of the previous requests (https://github.com/MTG/essentia/issues/1065, https://github.com/MTG/essentia/issues/766, https://github.com/MTG/essentia/issues/678, https://github.com/MTG/essentia/issues/75, https://github.com/MTG/essentia/issues/1035).
Use-cases:
- Spectral features (energy bands, mel)
- Mel-spectrograms and inference with TensorFlow (similar to our current demo)
- Onset detection
- Key, chords
Audio sources to consider:
- Reading from system audio
- Reading from a microphone
There's some work done for adding the rtaudio dependency in the rtaudio branch.
Question related to this. Since this issue is related to adding demos for using Essentia real-time, does that mean that the library itself supports real-time functionality as of today? Just that demos/examples are needed to showcase that implementation?
@dbogdanov any updates on this :)?
It would be really helpful to have some official examples using RingBufferInput as some in the (essentiaRT) example is deprecated. I tried to use auto-connector for real-time use cases, but have been having issue (#1237) setting it up.
Echoing here the same request. It appears that available examples referenced against past inquiries about real-time uses of Essentia are now deprecated and I'm unable to find working examples elsewhere.
If there are any additional snippets that folks have or can link to that demonstrate how to manage real-time input and output, I'd be happy to put some work in on compiling them and creating such an example.
Any updates on this?
Sigh...