altius
altius copied to clipboard
Small ONNX inference runtime written in Rust
- [x] initial support (model: https://huggingface.co/timm/fastvit_s12.apple_in1k) - [ ] improve performance
- Create `struct GraphModifier` or something like that, to easily implement graph modification code.
- [ ] MatMul+Add fusion - MatMul+Add → Gemm - ![image](https://user-images.githubusercontent.com/9913176/221422741-4c7f94d9-5a1e-4925-ae24-62e7529adad1.png) - [x] Reshape+Transpose fusion - ![image](https://user-images.githubusercontent.com/9913176/223770169-1dfe68cd-3df7-49d7-825c-845d897408e2.png) - [ ] **Automatic fusion for element-wise operations**
Supported kernels: - [x] LeakyRelu - [x] Resize - [x] Concat - [x] Transpose - [x] Squeeze - [x] Div - [ ] ReduceMin - [ ] Round - [x]...