datatracker icon indicating copy to clipboard operation
datatracker copied to clipboard

Published 20 hours ago • verified publisher icon ietf-tools

Reproducible tests

Open microamp opened this issue 5 months ago • 2 comments

Description

I have seen some Python tests failing in a non-deterministic manner.

  • https://github.com/ietf-tools/datatracker/actions/runs/10786037653/job/29912248540#step:6:1902
  • https://github.com/ietf-tools/datatracker/actions/runs/10802493115/job/29964666951?pr=7921#step:6:1897
  • https://github.com/ietf-tools/datatracker/actions/runs/10802493115/job/29971686883?pr=7921#step:6:1896

They are not always reproducible, and they usually pass when retried.

It would be helpful to identify where the source of such randomness is in the tests, and ensure more consistent behaviour.

Code of Conduct

microamp avatar Sep 11 '24 22:09 microamp