luminal
luminal copied to clipboard
Yolo v8
YOLOv9 is out already, might be a better candidate: https://github.com/WongKinYiu/yolov9/
YOLOv10 https://github.com/THU-MIG/yolov10
Just finished whisper which involved some work on the conv layers. Should be pretty straightforward to do yolo now. With the current rate of change I expect it'll be outdated in 2 weeks
Trying out the Yolo8 example (to compare speed with Candle) and see if I should switch.
Running into:
error: couldn't read `src\../roboto-mono-stripped.ttf`: The system cannot find the file specified. (os error 2)
--> src/main.rs:190:26
|
190 | let font = Vec::from(include_bytes!("../roboto-mono-stripped.ttf") as &[u8]);
Copy in the fonts it compiles (with some warnings)
Then when running there is a dim missmatch
C:\git\luminal\examples\yolo_v8\target\release>yolo_v8.exe
thread 'main' panicked at C:\git\luminal\src\hl_ops\binary.rs:65:9:
assertion `left == right` failed: Dims must match to multiply tensors.
left: [16, 27]
right: [16, 1, 1, 1]
stack backtrace:
0: std::panicking::begin_panic_handler
at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\std\src\panicking.rs:652
1: core::panicking::panic_fmt
at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\core\src\panicking.rs:72
2: core::panicking::assert_failed_inner
at /rustc/051478957371ee0084a7c0913941d2a8c4757bb9/library\core\src\panicking.rs:403
3: core::panicking::assert_failed
4: luminal::hl_ops::binary::<impl core::ops::arith::Mul for luminal::graph_tensor::GraphTensor>::mul
5: yolo_v8::model::ConvBlock::new
6: yolo_v8::model::Yolo::new
7: petgraph::graph_impl::stable_graph::StableGraph<N,E,Ty,Ix>::add_node
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
Btw there is an ongoing Yolo9MIT rewrite here: https://github.com/WongKinYiu/YOLO
Yeah sorry been backed up, the yolo example isn't complete yet. should be done very soon