Jed Fox
Jed Fox
An update on this issue: - [x] When on the details screen, you can't read the text of the current Toot. _Fixed in #491!_ - [x] There are a few...
Thanks!
What text isn’t changing size? Posts should change instantly, but some other text may require a restart of the app to show up.
Once the team merges https://github.com/mastodon/mastodon-ios/pull/815, autoplay of gifs will be disabled if Reduce Motion is enabled.
This was recently added in https://github.com/mastodon/mastodon-ios/pull/691!
It could be useful for cases where you want to pull structured data out of the model (for example, asking for a city’s population, then reading tokens up until the...
`[end of text]` is actually a single token (sometimes represented as `` but llama.cpp translates it as the empty string by default) that we have special behavior for.
That’s because you’re trying to tokenize that literal string — if you search in the source code for `"[end of text]"` you’ll see where it gets printed out.
> I'll also note that the gains here are mostly due to not copying memory anymore, and better cooperation with the kernel's page manager. We unfortunately aren't getting any additional...
> We could create a combined ggml model file as part of the setup process, but this way we go back to the issue of needing double disk space. Maybe...