AeneasVerif
Tracking issue for not crashing on the rustc test suite
In https://github.com/AeneasVerif/charon/pull/136/ we added a script that runs charon on the rustc test suite and displays the results. As we'd like to support a large portion of the rust language, we track in this issue our results on these tests.
Our first aim is to never panic. Initial results:
5269 expected-failure
2585 failure
3105 panic
4207 success
27 timeout
(Please don't post on this conversation, it's mean for automated posting)
Summary of the results: 4673 expected-failure 2065 failure 1731 panic 3546 success 30 timeout 3148 unsupported-build-settings
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Summary of the results: 4672 expected-failure 2060 failure 1731 panic 3556 success 25 timeout 3149 unsupported-build-settings
Summary of the results: 4692 expected-failure 2152 failure 1609 panic 3563 success 28 timeout 3149 unsupported-build-settings
Summary of the results: 4692 expected-failure 2150 failure 1608 panic 3565 success 29 timeout 3149 unsupported-build-settings
Summary of the results: 4500 expected-failure 1604 failure 1620 panic 4289 success 31 timeout 3149 unsupported-build-settings
Summary of the results: 5725 expected-failure 2122 failure 4531 success 29 timeout 3306 unsupported-build-settings
Summary of the results: 5740 expected-failure 2130 failure 4501 success 36 timeout 3306 unsupported-build-settings
Summary of the results: 5717 expected-failure 2057 failure 4606 success 26 timeout 3307 unsupported-build-settings
Summary of the results: 5706 expected-failure 2033 failure 4641 success 26 timeout 3307 unsupported-build-settings
Summary of the results: 5711 expected-failure 2017 failure 4654 success 23 timeout 3308 unsupported-build-settings
Summary of the results: 5480 expected-failure 1442 failure 5451 success 35 timeout 3305 unsupported-build-settings
Summary of the results: 5506 expected-failure 1444 failure 5424 success 35 timeout 3304 unsupported-build-settings
Summary of the results: 5507 expected-failure 1446 failure 5423 success 32 timeout 3305 unsupported-build-settings
Summary of the results: 5510 expected-failure 1448 failure 5420 success 30 timeout 3305 unsupported-build-settings
Summary of the results: 5510 expected-failure 1448 failure 5420 success 30 timeout 3305 unsupported-build-settings
Summary of the results: 5531 expected-failure 1456 failure 5392 success 29 timeout 3305 unsupported-build-settings
Summary of the results: 5531 expected-failure 1475 failure 5373 success 29 timeout 3305 unsupported-build-settings
Summary of the results: 5526 expected-failure 1471 failure 5385 success 26 timeout 3305 unsupported-build-settings
Summary of the results: 5381 expected-failure 1245 failure 5751 success 31 timeout 3305 unsupported-build-settings
Summary of the results: 5315 expected-failure 1140 failure 5922 success 31 timeout 3305 unsupported-build-settings
Summary of the results: 5274 expected-failure 997 failure 6105 success 34 timeout 3303 unsupported-build-settings
Summary of the results: 5275 expected-failure 997 failure 6106 success 31 timeout 3304 unsupported-build-settings
Summary of the results: 5275 expected-failure 1001 failure 6098 success 36 timeout 3303 unsupported-build-settings
Summary of the results: 5169 expected-failure 780 failure 6425 success 36 timeout 3303 unsupported-build-settings
Summary of the results: 5163 expected-failure 764 failure 6448 success 35 timeout 3303 unsupported-build-settings
Summary of the results: 13 expected-failure 11 failure 5181 panic 7173 success 30 timeout 3305 unsupported-build-settings
I might have been too lenient in my recent PRs: I think we're now treating rust errors as panics. See also #306.