hono icon indicating copy to clipboard operation
hono copied to clipboard

Invite to assess results of automated perf coding on Hono

Open dsyme opened this issue 2 months ago • 1 comments

HI all,

I'm a researcher at GitHub Next in semi-automated agentic software engineering. Some details here: https://dsyme.net/2025/10/12/towards-semi-automatic-performance-engineering/

I did a trial run of some automated performance analysis and engineering over Hono, and wanted to share the pull requests generated in case they are of interest:

https://github.com/githubnext/gh-aw-trial-hono/pulls?q=is%3Apr+is%3Aclosed

This is an invite for someone highly familiar with Hono perf take a look over the PRs and see if there's anything of interest.

These were produced by an automated run of Daily Perf Improver. https://github.com/githubnext/agentics/blob/main/docs/daily-perf-improver.md

We understand there are many caveats

  • AI often generates garbage
  • Performance figures produced in VM cloud environments are indicative at best
  • Although the AI has, generally, run performance checks, it sometimes does this incorrectly.
  • There is absolutely no substitute for humans checking performance figures, and actual workloads

Ones that passed thee "first glance" check are:

  • https://github.com/githubnext/gh-aw-trial-hono/pull/7
  • https://github.com/githubnext/gh-aw-trial-hono/pull/10
  • https://github.com/githubnext/gh-aw-trial-hono/pull/11
  • https://github.com/githubnext/gh-aw-trial-hono/pull/12
  • https://github.com/githubnext/gh-aw-trial-hono/pull/20
  • https://github.com/githubnext/gh-aw-trial-hono/pull/22
  • https://github.com/githubnext/gh-aw-trial-hono/pull/25
  • https://github.com/githubnext/gh-aw-trial-hono/pull/26
  • https://github.com/githubnext/gh-aw-trial-hono/pull/27

Plus there are various proposed changes to get build and test to run faster, maybe worth a glance though some are junk

  • https://github.com/githubnext/gh-aw-trial-hono/pull/33

We're quite happy to throw these PRs away, and there is no obligation to even look at this stuff, but some of them may be of value. If so we can transfer the PRs you select over the the Hono repo and iterate with proper CI support, review and community discussion.

I put this message in Discord as well. Please feel free to close this.

Thank you Don Syme

dsyme avatar Oct 17 '25 12:10 dsyme

There is another collection of automated PRs from a different coding agent here: https://github.com/githubnext/gh-aw-trial-hono-copilot-cli/pulls?q=is%3Apr+is%3Aclosed

Many of these look like small but realistic gains.

dsyme avatar Oct 17 '25 14:10 dsyme