iggy icon indicating copy to clipboard operation
iggy copied to clipboard

Dump `iggy-bench` results to csv

Open hubcio opened this issue 1 year ago • 4 comments

Append them to given csv, and if possible generate excel file with relevant charts.

hubcio avatar Oct 29 '23 10:10 hubcio

I would like to work on it.

Molter23 avatar Nov 08 '23 20:11 Molter23

Go ahead @Molter23 , it's assigned to you now

BartoszCiesla avatar Nov 08 '23 21:11 BartoszCiesla

@hubcio / @BartoszCiesla

  1. I think we can go with --bechmark_csv_file as argument name for csv file
  2. I assume only one line(info in the below snippet) will be written to this file depending on if it's send_benchmark/poll_benchmark/..etc. We can have something that reads this csv files and generates charts on top of this.
    fn display_settings(&self) {
        let total_messages = self.total_messages();
        let total_size_bytes = total_messages * self.args().message_size() as u64;
        info!(
                "\x1B[32mBenchmark: {}, total messages: {}, total size: {} bytes, {} streams, {} messages per batch, {} batches, {} bytes per message, {} producers\x1B[0m",
                self.kind(),
                total_messages,
                total_size_bytes,
                self.args().number_of_streams(),
                self.args().messages_per_batch(),
                self.args().message_batches(),
                self.args().message_size(),
                self.args().producers(),
            );
    }

seroze avatar Apr 16 '24 17:04 seroze

Yes, that's good idea. Basic use case would be to call bench multiple times so file would have to be updated with each run in order to have data from all the tests. Then charts could be created by importing to spreadsheet or using tools like GNUplot or other tools.

BartoszCiesla avatar Apr 18 '24 17:04 BartoszCiesla