essentia icon indicating copy to clipboard operation
essentia copied to clipboard

Add C++ and Python demos for using Essentia real-time

Open dbogdanov opened this issue 5 years ago • 6 comments

Add C++ and Python demos for using Essentia real-time.

This issue summarizes some of the previous requests (https://github.com/MTG/essentia/issues/1065, https://github.com/MTG/essentia/issues/766, https://github.com/MTG/essentia/issues/678, https://github.com/MTG/essentia/issues/75, https://github.com/MTG/essentia/issues/1035).

Use-cases:

  • Spectral features (energy bands, mel)
  • Mel-spectrograms and inference with TensorFlow (similar to our current demo)
  • Onset detection
  • Key, chords

Audio sources to consider:

  • Reading from system audio
  • Reading from a microphone

There's some work done for adding the rtaudio dependency in the rtaudio branch.

dbogdanov avatar Oct 29 '20 12:10 dbogdanov

Question related to this. Since this issue is related to adding demos for using Essentia real-time, does that mean that the library itself supports real-time functionality as of today? Just that demos/examples are needed to showcase that implementation?

myasir2 avatar Mar 31 '21 02:03 myasir2

@dbogdanov any updates on this :)?

p-hlp avatar Dec 06 '21 14:12 p-hlp

It would be really helpful to have some official examples using RingBufferInput as some in the (essentiaRT) example is deprecated. I tried to use auto-connector for real-time use cases, but have been having issue (#1237) setting it up.

yyf avatar Apr 04 '22 04:04 yyf

Echoing here the same request. It appears that available examples referenced against past inquiries about real-time uses of Essentia are now deprecated and I'm unable to find working examples elsewhere.

If there are any additional snippets that folks have or can link to that demonstrate how to manage real-time input and output, I'd be happy to put some work in on compiling them and creating such an example.

BlindElephants avatar Apr 10 '23 17:04 BlindElephants

Any updates on this?

05k4rausdertonne avatar Oct 12 '23 12:10 05k4rausdertonne

Sigh...

zumpchke avatar Apr 27 '24 04:04 zumpchke