Jed Fox

Results 602 comments of Jed Fox

An update on this issue: - [x] When on the details screen, you can't read the text of the current Toot. _Fixed in #491!_ - [x] There are a few...

What text isn’t changing size? Posts should change instantly, but some other text may require a restart of the app to show up.

Once the team merges https://github.com/mastodon/mastodon-ios/pull/815, autoplay of gifs will be disabled if Reduce Motion is enabled.

This was recently added in https://github.com/mastodon/mastodon-ios/pull/691!

It could be useful for cases where you want to pull structured data out of the model (for example, asking for a city’s population, then reading tokens up until the...

`[end of text]` is actually a single token (sometimes represented as `` but llama.cpp translates it as the empty string by default) that we have special behavior for.

That’s because you’re trying to tokenize that literal string — if you search in the source code for `"[end of text]"` you’ll see where it gets printed out.

> I'll also note that the gains here are mostly due to not copying memory anymore, and better cooperation with the kernel's page manager. We unfortunately aren't getting any additional...

> We could create a combined ggml model file as part of the setup process, but this way we go back to the issue of needing double disk space. Maybe...