Robert Gay

This looks sweet! Does it make sense to put this in `packages`? It doesn't _seem_ like it's being managed as an npm package, so it could probably be another top-level...

from rust_embedding_lib README.md > Am I crazy not to use https://github.com/huggingface/swift-transformers? You might be. :) (edit: although it doesn't seem like there's a ton actually present in that library right...

It looks like somebody already posted a coreml conversion of `gte-small`: https://huggingface.co/thenlper/gte-small/tree/main/coreml/feature-extraction/float32_model.mlpackage I have no experience w/ this, so I don't know if that's a format we can use but...

I guess that's a question I should have asked initially -- is the FFI bridge + rust lib the way you'd prefer to go? Or something more native like CoreML?

> rust embeddings approach means any safetensors model with config and tokenizers should work Agreed. The "run anything on the internet" was one of the reasons I felt like my...

Not having great luck with prebuilt coreml model. Will post more later on that. re: rust/candle - I did notice that candle doesn't support metal acceleration yet, only the 'accelerate'...

> Well, I felt this was much, much simpler, and actually captures everything including the status bar, desktop, etc. without having to do a bunch of fiddling. Fair point. I...

I wonder about per-window OCR -- I'm curious how that would interact w/ overlapping windows, particularly in the simple implementation where there's just a CGImage generated over a rectangle. Also...

@marcosnils Thanks for the response. Yeah, I originally considered lowering retries to 0, but I think I actually do want retries for "MOVED" responses, so that we can add/remove nodes...

Hmm... it also looks like if there's a ConnectException when trying to connect to a particular node, the request will be retried, but is retried with `tryRandomNode=true`, so the follow-up...