algorithmic-efficiency
algorithmic-efficiency copied to clipboard
Issue 452: Added the assertion for consistency check and evaluation frequency check
For this PR, I added two assertions to validate the timing and evaluation consistency at the end of the training loop:
-
Duration consistency check: The total duration of training (submission time + logging time + evaluation time) is asserted to match the final evaluation result's total_duration, with a tolerance of 10 seconds.
-
Evaluation frequency check: Ensures the number of evaluations does not exceed the allowed evaluations based on the accumulated submission time and the workload's evaluation period.
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅