Describe what do you want us to implement

Create a benchmark automation tool for paper forks and run it on CI to measure the impact of each changes on performance

Possible implementations

Chunk Generation Speed

Create a plugin to generate a certain number of chunks and shutdown the server.

Used API

• PaperLib.isChunkGenerated()
• PaperLib.getChunkAtAsync()

Entities

Create a script and a plugin to automatically

1. Increase entity-activation-range and entity-tracking-range to some big number and use a bot to activate entities.
2. Wait a few minutes and record ticking time and shutdown the server.

Hello, we appreciate your idea to start. I spoke to 2 people (Jettison Jerry, our benchmark guy and phantom) who would be willing to work with you to implement this. You can discuss this in #contributors.

If other people have other ideas they can put them here and if you want to work on the project do not hesitate to join us on discord.

I wish you a good end of the day.

I think this idea deserves an own repo. A tool for testing craftbukkit forks OR configurations would be greatly appreciated by community, including server admins, plugin creators, spigot devs etc. In the future this idea could even expand to the modding community, to check performance impacts of mods to the server. I think you could reach out to spigot/paperspigot devs for even further help, as such tool could be a have to once it's done.

This idea is interesting. But the the real problem is how would the benchmarking utility account for differing hardware? This should really be looked into more.

It wouldnt i think, because the public benchmarks listings should comprise of an average of all the results and ofcourse the hardware will be same for you when you test it for yourself 😄