neon-bindings
Benchmarking Suite (Neon Bench)
I'd like to build a test suite to catch performance regressions as we evolve the design. This is similar to what Ruby Bench does for Ruby and Rails. The only known production use case of neon that I know of today is the Wire app. It'd be great to start using the crypto/sodium work there as the start. Thoughts? /cc @bennyn @ffflorian @dherman
This would be awesome!
I wouldn't worry about hooking it up to the Neon CLI, since it's really for testing the performance of Neon proper, rather than for benchmarking individual Neon projects. Also, neon bench has to deal with the annoying issue that cargo bench isn't a stabilized feature yet (it uses Nightly-only APIs).
It's fine if it's just a custom command to start with. Eventually maybe we could set up performance regression tests by putting them in the test/ directory, but it's fine if we crawl before we walk.
Ah, I forgot about the CLI and didn't mean to imply the neon bench command. I was modeling the name after the Ruby Bench project which is run separate from Ruby and Rails itself.