descartes_light icon indicating copy to clipboard operation
descartes_light copied to clipboard

Benchmark Output Format

Open John-Bonnin opened this issue 3 years ago • 1 comments

From MRip: It probably makes sense for us to save the results of the benchmark into a structured format (like CSV, YAML, JSON, XML, etc.), rather than parsing the text that we arbitrarily wrote to document the benchmark results.

My vote would be to use YAML in a structure like this:

- name: planner_name
  results:
    - n_waypoints: 10
      n_samples: 10
      dof: 6
      build_time: 0.05185
      search_time: 6.2715678
    - n_waypoints: 10
      n_samples: 50
      dof: 6
      build_time: 0.06768
      search_time: 8.123486

@Levi-Armstrong any thoughts on the structure of the benchmark output, especially if we plan to use Google Benchmark in the future?

Originally posted by @marip8 in https://github.com/swri-robotics/descartes_light/pull/78#discussion_r703565338

John-Bonnin avatar Sep 09 '21 21:09 John-Bonnin

I am not sure the actual format it outputs but I may be able to generate one from Tesseract benchmarks.

Levi-Armstrong avatar Sep 14 '21 14:09 Levi-Armstrong