sdk
sdk copied to clipboard
dart-lang
Docs on how to access and use the test status database
The testing docs mention the results database, but don't link to it or give any instructions for how to access it, understand current test status, etc. I cannot find any other docs on it either.
I was assigned https://github.com/dart-lang/sdk/issues/56002 but I have no idea how to actually go about addressing that. For example, how can I find a recent failure, or know what the current status is?
In general, these issues should have some documentation they can point to, for how to diagnose a test that is failing etc.
Presumably also this would be a good place to put documentation on how to list all the currently failing tests for a project, etc?
The documentation there is right now is go/dart-status-file-free-workflow which links to go/dart-test-approval which links to the results feed UI.
Can we link to these from the external docs, and/or transcribe them into the external docs/ directory? I don't see how somebody is intended to discover these?
Ah, fwiw https://dart-current-results.web.app/ seems to be the most useful, to me at least. I found I can pretty easily search for a test based on path and see the status, as well as logs for recent failures. I will for now at least add a link to that to the docs.
I don't understand how the test filters on https://dart-ci.firebaseapp.com/ work at all, I can't get anything I want to show up.
I do think a distilled version of go/dart-status-file-free-workflow is really what we need here.
I don't understand how the test filters on https://dart-ci.firebaseapp.com/ work at all, I can't get anything I want to show up.
Example of a search with results (the problem is likely that you tried a prefix search and got no results because it doesn't do those, unlike the more modern current results app): https://dart-ci.web.app/#showLatestFailures=false&test=pkg/analysis_server/test/integration/edit/get_postfix_completion_test&configurations=analyzer-unittest-asserts-release-win
The results feed AngularDart app should be rewritten in Flutter and offer a consistent UX with current results Flutter app (sharing most UI, but also improving search). Not sure if that will ever happen, though.
Example of a search with results (the problem is likely that you tried a prefix search and got no results because it doesn't do those, unlike the more modern current results feed app):
Hmm, I also did try putting in the full name (or what I thought was the full name, maybe it was wrong, idk).
It would be great if some of these internal Google docs could be migrated to public markdown docs at some point also.