Aaron Pham

We can probably add an option to render mermaid to the result bundle as svg to avoid importing mermaid (given that mermaid doesn't do tree-shaking)

feat(rss): styling for the webview

7

ofc you should use a reader aggregator for your own rss feed, but we should have a default view for these Example from [my end](https://aarnphm.xyz/feed.xml) with the [feed.xsl](https://github.com/aarnphm/aarnphm.github.io/blob/main/quartz/static/feed.xsl) also might...

use https://github.com/rehypejs/rehype-github/tree/main/packages/viewscreen-mermaid once it is released.

[Chore] debloat some initial logs

1

This PR moves a few log lines onto debug mode ```bash INFO 06-10 17:32:33 [cli_args.py:309] non-default args: ... INFO 06-10 17:32:38 [config.py:1946] Defaulting to use mp for distributed inference INFO...

[Chore] logging metrics rename

1

This PR renames the metrics logs to be more clear wrt the functionality. prompt throughput is similar to prefill, and generations throughput is mostly decode. Signed-off-by: Aaron Pham

chore: return early python_packages

1

This PR aims to return the instance early from self.python_packages Signed-off-by: Aaron Pham

The general consensus on interaction: - Please don't tag the maintainers on all issues. We all have lives outside of the project and maintain this in our free time. We...