pzoltowski

significant performance regression in 0.0.2

2

I'm seeing serious performance regression on version 0.0.2. I'm having macbook m2 max (with latest MacOS). Before I was having around ~12x realtime speedup factor (in some cases somtimes even...

Would be great to have support for recent Lite Whisper series of models. They have recently been incorporated into transformers.js with models in ONNX format here: https://huggingface.co/onnx-community/lite-whisper-large-v3-turbo-fast-ONNX https://huggingface.co/onnx-community/lite-whisper-large-v3-turbo-acc-ONNX https://huggingface.co/onnx-community/lite-whisper-large-v3-turbo-ONNX and...

[Feature] Support for Rust language in nitrogen

12

FWIW, came across this repo: https://github.com/getditto/rn-jsi-rust-bridging and accompanying article: https://ditto.live/blog/bridging-react-native-and-rust-via-jsi and some other of their related repos: https://github.com/getditto/react-ditto https://github.com/getditto/react-native-sample-app where they are bridging react native to rust (for both old...

export to CoreML

4

I did try to export to CoreML to try to run on edge devices but failed (most likely on model tracing) The reason I want CoreML rather than ONNXRuntime is...

[Feature Request] Local docs sync and numerous dx improvements

2

This is great repo but I wish this had some improvements: 1) Local llms.txt sync Right now it fetches directly to context. I think it would be better that context7...