algorithmic-efficiency icon indicating copy to clipboard operation
algorithmic-efficiency copied to clipboard

Issue 452: Added the assertion for consistency check and evaluation frequency check

Open harneet862 opened this issue 1 year ago • 1 comments

For this PR, I added two assertions to validate the timing and evaluation consistency at the end of the training loop:

  1. Duration consistency check: The total duration of training (submission time + logging time + evaluation time) is asserted to match the final evaluation result's total_duration, with a tolerance of 10 seconds.

  2. Evaluation frequency check: Ensures the number of evaluations does not exceed the allowed evaluations based on the accumulated submission time and the workload's evaluation period.

harneet862 avatar Sep 13 '24 11:09 harneet862

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

github-actions[bot] avatar Sep 13 '24 11:09 github-actions[bot]