Dominik Weckmüller

[Feature Request]: Instructions how to use metal backend (Apple silicon)

1

### Is your feature request related to a problem? Please describe. Current defaults only work with CUDA. It would be great to be able to run it on other platforms...

Larger models (70B, 405B)

9

Thanks a lot for open sourcing this amazing library! I was wondering whether you tried/are planning to prepare some larger models too, like Llama-3.1-70B/405B. As it seems, there is an...

Thanks for this great plugin, looks really cool! I just noticed, that it crashes with video embeds. I am using starlightVideos and once I hover over the video thumbnail... ...

### Feature request @MinishLab created really good and super small embedding models. I didn't find any other way to run these models in Rust so I thought it might be...

Hey, thanks for this library, very useful! Could you add the example to GitHub pages and linking the url in this repo? That might save potential users the 5 mins...

Performance on high end server - RPS

4

I know that the scope of airmail is to run a geocoder on cheap hardware with acceptable latency but I was wondering if you had a high end server available,...

Seems like the CSS is broken on the homepage. It's impossible to interact with the map (move, zoom or click on pins): 

Support for model2vec

3

### Feature request Model2vec would make for a great addition to transformers.js: https://github.com/MinishLab/model2vec ### Motivation The library distills conventional embedding models and produces static models that are magnitudes faster with...

General Questions

3

Hi Andy, thanks for maintaining this repo, very useful! This issue might be better suited for a discussion section as it's some open-ended questions - would you mind opening it...

Seems like your demo API is down on https://airmail.rs/#demo-section