libROM icon indicating copy to clipboard operation
libROM copied to clipboard

Regression Tests(addition to the PR: try compiling mfem with gitlab actions)

Open kevinhkhuynh opened this issue 2 years ago • 6 comments

The goal here is to compile libROM with MFEM for Gitlab actions so that we can run the example scripts as part of a test suite.

kevinhkhuynh avatar Jun 20 '22 15:06 kevinhkhuynh

@kevinhkhuynh do you think you need to pass this to @pranav-vempati as well?

chldkdtn avatar Jul 28 '22 18:07 chldkdtn

For some reason, for Linux, the test is failing at the example run due to "Operating system error: Cannot allocate memory"

kevinhkhuynh avatar Jul 28 '22 19:07 kevinhkhuynh

For some reason, for Linux, the test is failing at the example run due to "Operating system error: Cannot allocate memory"

@axla-io Axel, didn't you run into a similar issue on your virtual machine, relating to the cannot allocate memory? How did you end up fixing it?

kevinhkhuynh avatar Jul 28 '22 19:07 kevinhkhuynh

For some reason, for Linux, the test is failing at the example run due to "Operating system error: Cannot allocate memory"

@axla-io Axel, didn't you run into a similar issue on your virtual machine, relating to the cannot allocate memory? How did you end up fixing it?

Yes I did! In the end I allocated more memory and more swap memory for my vm. Did you set the mc-model = large flag also?

axla-io avatar Jul 28 '22 21:07 axla-io

@dylan-copeland @siuwuncheung Pranav needs your help on reviewing this PR. The PR is not complete yet, but it would be very helpful for you to start reviewing and point out what is missing to Pranav. Then he can fill the gap.

chldkdtn avatar Oct 19 '22 17:10 chldkdtn

@pranav-vempati Should regression_tests/simulationLogFile be in this PR?

dylan-copeland avatar Oct 21 '22 18:10 dylan-copeland

All suggestions except the comparison of examples' relative errors are now incorporated in this PR.

pranav-vempati avatar Oct 24 '22 18:10 pranav-vempati

@dylan-copeland @siuwuncheung , @pranav-vempati has just informed me that this PR is ready for review except continuous integration part. All the regression tests must be working locally, so we can start reviewing the local regression test implementation. I suggest not to wait until the CI is fixed. Let's start giving @pranav-vempati valuable feedbacks on this PR.

chldkdtn avatar Nov 15 '22 20:11 chldkdtn

@pranav-vempati, I intentionally broke one of dmd examples and ran regression tests. The regression tests correctly identified the failing example, but I cannot find any log or output files which tells me what exactly broke. If there is such an output file, can you tell me where? If not, can you modify the regression test so that it outputs the error or the reason for failure?

chldkdtn avatar Nov 29 '22 23:11 chldkdtn

@pranav-vempati, can you add instruction of how to add a new regression test?

chldkdtn avatar Nov 30 '22 16:11 chldkdtn

@chldkdtn Instructions on how to add a new regression test have been added to REGRESSIONTEST.md.

pranav-vempati avatar Dec 02 '22 07:12 pranav-vempati

Thanks @pranav-vempati! The tests all pass on linux and mac. One small suggestion is that the squash-and-merge has resulted in some very long commit messages in the libROM history. Since this PR has almost 200 commits, it would be a good idea to replace all those commit messages with a brief summary of this PR.

@dylan-copeland Thanks for the suggestion. I will do this before I merge this PR.

pranav-vempati avatar Dec 02 '22 07:12 pranav-vempati