ex_nvr icon indicating copy to clipboard operation
ex_nvr copied to clipboard

ExNVR and machine learning

Open gBillal opened this issue 1 year ago • 1 comments

Bring machine learning to ex-nvr, try a machine learning model (object detection, face detection, motion estimation, ...etc.) The final result may be as follows:

  • Read a stream from IP cameras, use the sub-stream if possible (already done)
  • Decode the snapshots
  • Feed the snapshot to the machine learning model
  • Save the results somewhere (or include it in the snapshots)
  • Show it on the web UI (there's multiple ways, overlay the results on the video player, encode the video with the metadata hardcoded on the snapshots, ...etc.)

How to include ML in Elixir:

  • Pre-trained models and hugging face models with Bumblebee
  • Onnx models with Ortex
  • Or be brave and build a model yourself using Axon
  • Or be super brave and run it using NIF/CNode with C/C++ code :sunglasses: like this lady

gBillal avatar Aug 24 '23 21:08 gBillal