As per you mention in README about onnxruntime for AI Capabilities,
I create one custom plugin for that, in that I use rtsp plugin first to pull stream then I processed onnxruntime on that stream and set implementation to show live feed for that from preview plugin, I tried to show both streams normal rtsp stream and processed onnxruntime feed I can show it in preview plugin but when I click on the link I didn't get live feed in Jessibuca Player.
Will you help me out how can I play onnxruntime feed with preview plugin?
I also check with APIs with using curl command it gives me results that my plugin is worked but not get live feed, below is my logs of server...
go run -tags sqlite main.go
2025/07/22 10:19:03 RTSP AI Analytics Server started
2025/07/22 10:19:03 Available endpoints:
2025/07/22 10:19:03 - POST /rtsp_ai/api/start?stream=<stream_path>
2025/07/22 10:19:03 - DELETE /rtsp_ai/api/stop?stream=<stream_path>
2025/07/22 10:19:03 - GET /rtsp_ai/api/status
2025/07/22 10:19:03 - GET /rtsp_ai/api/list
2025/07/22 10:19:03 - GET /rtsp_ai/api/results?stream=<stream_path>
2025/07/22 10:19:03 - POST /rtsp_ai/api/pull?target=&streamPath=
2025/07/22 10:19:03 - POST /rtsp_ai/api/push?target=&streamPath=
2025/07/22 10:19:03
2025/07/22 10:19:03 Example usage:
2025/07/22 10:19:03 1. Start streaming to RTSP: rtsp://localhost:8554/live/test
2025/07/22 10:19:03 2. Start AI analysis: curl -X POST 'http://localhost:9040/rtsp_ai/api/start?stream=live/test'
2025/07/22 10:19:03 3. Check status: curl 'http://localhost:9040/rtsp_ai/api/status'
2025/07/22 10:19:03 4. Stop analysis: curl -X DELETE 'http://localhost:9040/rtsp_ai/api/stop?stream=live/test'
10:19:06.425011 INF listen http server=2 addr=:9040
10:19:06.426267 INF listen tcp server=2 addr=:50051
10:19:06.428420 INF init server=2 plugin=LogRotate version=dev
10:19:06.428702 INF grpc handler registered server=2 plugin=LogRotate
10:19:06.431238 INF init server=2 plugin=Monitor version=dev
10:19:06.438633 INF monitor session start server=2 plugin=Monitor session=23
10:19:06.439866 INF grpc handler registered server=2 plugin=Monitor
10:19:06.442280 INF init server=2 plugin=HLS version=dev
10:19:06.448357 INF init server=2 plugin=LLHLS version=dev
10:19:06.450632 INF init server=2 plugin=Preview version=dev
10:19:06.452690 INF init server=2 plugin=FLV version=dev
10:19:06.455637 INF grpc handler registered server=2 plugin=FLV
10:19:06.458795 INF init server=2 plugin=MP4 version=dev
10:19:06.463402 INF grpc handler registered server=2 plugin=MP4
10:19:06.463499 INF No record directories configured, skipping recovery server=2 plugin=MP4
10:19:06.466630 INF init server=2 plugin=RTMP version=dev
10:19:06.466926 INF listen tcp server=2 plugin=RTMP addr=:1935
10:19:06.467097 INF grpc handler registered server=2 plugin=RTMP
10:19:06.470273 INF init server=2 plugin=GB28181 version=dev
10:19:06.470509 INF GB28181 initing server=2 plugin=GB28181 !BADKEY=[]
10:19:06.470622 ERR GB28181 init failed,please set Sip.ListenAddr in GB28181 configuration like this
sip:
listenaddr:
- udp::5060
server=2 plugin=GB28181
10:19:06.471150 INF grpc handler registered server=2 plugin=GB28181
10:19:06.475658 INF init server=2 plugin=RTSPAI version=dev
10:19:06.476112 INF listen tcp server=2 plugin=RTSPAI addr=:8554
10:19:06.476316 INF RTSP AI Plugin initializing server=2 plugin=RTSPAI modelPath=/models/yolov8n.onnx confidenceThreshold=0.5 processingFPS=2 enableGPU=false maxConcurrent=4
10:19:06.476949 INF AI engine initialized successfully server=2 plugin=RTSPAI
10:19:06.477073 INF RTSP AI Plugin initialized successfully server=2 plugin=RTSPAI
10:19:06.481527 INF init server=2 plugin=RTSPAIConfig version=dev
10:19:06.481798 INF RTSP AI Plugin initializing server=2 plugin=RTSPAIConfig !BADKEY={modelPath 15
/models/yolov8n.onnx } !BADKEY={confidenceThreshold 10 1056964608 } !BADKEY={processingFPS 11 2 } !BADKEY={enableGPU 4 0 } !BADKEY={maxConcurrent 11 4 }
10:19:06.481927 INF RTSP AI Plugin initialized successfully server=2 plugin=RTSPAIConfig
10:19:06.486002 INF init server=2 plugin=SEI version=dev
10:19:06.486628 INF grpc handler registered server=2 plugin=SEI
10:19:06.490390 INF init server=2 plugin=SRT version=dev
10:19:06.493007 INF init server=2 plugin=Stress version=dev
10:19:06.493223 INF grpc handler registered server=2 plugin=Stress
10:19:06.496074 INF init server=2 plugin=Transcode version=dev
10:19:06.496960 INF grpc handler registered server=2 plugin=Transcode
10:19:06.500731 INF init server=2 plugin=WebRTC version=dev
10:19:06.501076 INF webrtc start listen server=2 plugin=WebRTC port=9000
10:19:06.505108 INF init server=2 plugin=Debug version=dev
10:19:06.505621 INF grpc handler registered server=2 plugin=Debug
10:19:06.507362 INF server started server=2
10:19:08.478065 INF Puller created server=2 plugin=RTSPAI streamPath=live/camera1 targetURL=rtsp://admin:@Camera-RTSP
10:19:08.478177 INF Auto-pulled stream server=2 plugin=RTSPAI streamPath=live/camera1 targetURL=rtsp://admin:@Camera-RTSP
10:19:29.269618 INF tick server=2 cpu=44.54428754934158 streams=0 subscribers=0 waits=0
10:19:34.268786 INF tick server=2 cpu=23.145780050621433 streams=0 subscribers=0 waits=0
10:19:34.459747 INF subscribe server=2 plugin=FLV streamPath=live/camera1 sId=35
10:19:39.269413 INF tick server=2 cpu=83.18471337608545 streams=0 subscribers=1 waits=1
10:19:44.269402 INF tick server=2 cpu=43.974358973916964 streams=0 subscribers=1 waits=1
10:19:44.531502 INF unsubscribe server=2 plugin=FLV streamPath=live/camera1 sId=35 reason=context canceled
10:19:44.664503 INF subscribe server=2 plugin=FLV streamPath=live/camera1 sId=38
10:19:49.269758 INF tick server=2 cpu=71.72236503991515 streams=0 subscribers=1 waits=1
10:19:54.271390 INF tick server=2 cpu=99.8751560548152 streams=0 subscribers=1 waits=1
10:19:54.683211 INF unsubscribe server=2 plugin=FLV streamPath=live/camera1 sId=38 reason=context canceled
10:19:54.946629 INF subscribe server=2 plugin=FLV streamPath=live/camera1 sId=40
10:19:59.268413 INF tick server=2 cpu=95.71788413154604 streams=0 subscribers=1 waits=1
10:20:04.269424 INF tick server=2 cpu=56.96040868557317 streams=0 subscribers=1 waits=1
10:20:09.270410 INF tick server=2 cpu=52.970922881957975 streams=0 subscribers=1 waits=1
I am currently undergoing a refactoring with significant changes. Please wait for me to complete the refactoring before proceeding with the development
Thanks for referring the issue.
How much time it will take as I am also waiting for the same.........I tried Integrating the Onnx model in the server but I am not able to succeed
langhuihui
