moonshot
moonshot copied to clipboard
add changes to handle multiple operations
- Modified to allow multiple operations to be run at the same time.
- Benchmark results files will have <runner_id>-<run_id>.json
- Red teaming is not tested yet.
- Benchmark callback function will need to use run_id to differentiate
Will need benchmarking.py to modify the mandatory values to set as self.run_progress.run_arguments.results_id
# ------------------------------------------------------------------------------
# Prepare ResultArguments
# ------------------------------------------------------------------------------
print("[Benchmarking] Preparing results...")
start_time = time.perf_counter()
result_args = None
try:
result_args = ResultArguments(
# Mandatory values
id=self.run_progress.run_arguments.results_id,
start_time=self.run_progress.run_arguments.start_time,
...
)