Mihai Chirculescu
Mihai Chirculescu
This is a continuation of #1712 . We are in 2023 now and we have ML.NET 2. Does ML.NET 2 support KNN?
I'd like to build a benchmark and I'd like to set up some rules based on which I can constrain the responses the LLM provides - then eval with pre-determined...
### Feature request Right now transformers.js works with ONNX models. It would be useful to also support GGUF files (see llama.cpp) ### Motivation Wider support + ONNX doesn't quantize below...
### 起始日期 | Start Date _No response_ ### 实现PR | Implementation PR _No response_ ### 相关Issues | Reference Issues _No response_ ### 摘要 | Summary Since V2.6 now accepts multiple...
### Feature request It look like ONNX now supports 4bit: https://onnx.ai/onnx/technical/int4.html It would be nice if we could use 4bit models with transformers.js . ### Motivation Make models for [semantic-autocomplete](https://github.com/Mihaiii/semantic-autocomplete)...