data icon indicating copy to clipboard operation
data copied to clipboard

[WIP] Benchmark Script

Open NivekT opened this issue 2 years ago • 0 comments

Stack from ghstack:

  • -> #734

This PR is primarily focused on adding more datasets for benchmarking.

Notable changes that are in progress:

  • Using PrototypeMultiprocessingReadingService as that will become the official one in the near future
  • Adding various datasets to benchmarking script
    • [WIP] Need to modify make_dp and etc to make sure that works for each dataset (I am thinking that I can take certain implementation steps from the prototype folder in vision or preferably directly use those)
    • [WIP] Need to add some datasets to the cluster's ontap
  • Add support for the equivalent datasets for external cluster

NivekT avatar Aug 15 '22 23:08 NivekT