moonshot icon indicating copy to clipboard operation
moonshot copied to clipboard

add changes to handle multiple operations

Open imda-lionelteo opened this issue 9 months ago • 0 comments

  1. Modified to allow multiple operations to be run at the same time.
  2. Benchmark results files will have <runner_id>-<run_id>.json
  3. Red teaming is not tested yet.
  4. Benchmark callback function will need to use run_id to differentiate

Will need benchmarking.py to modify the mandatory values to set as self.run_progress.run_arguments.results_id

# ------------------------------------------------------------------------------
# Prepare ResultArguments
# ------------------------------------------------------------------------------
print("[Benchmarking] Preparing results...")
start_time = time.perf_counter()
result_args = None
try:
    result_args = ResultArguments(
        # Mandatory values
        id=self.run_progress.run_arguments.results_id,
        start_time=self.run_progress.run_arguments.start_time,
        ...
    )

imda-lionelteo avatar May 16 '24 08:05 imda-lionelteo