Test errors with LLVM Clang on Ubuntu 24.04

[mmuetzel]

trafficstars

When configuring with CC=clang CXX=clang++ cmake -DWITH_OpenMP=ON -DOpenMP_C_FLAGS=-fopenmp=libgomp -DOpenMP_CXX_FLAGS=-fopenmp=libgomp --fresh .. on Ubuntu 24.04, the following tests are failing:

Total Test time (real) = 2128.75 sec

The following tests FAILED:
	123 - CurvedBoundaryCylH (Failed)
	124 - CurvedBoundaryCylH_np3 (Failed)
	125 - CurvedBoundaryCylH_np8 (Failed)
	126 - CurvedBoundaryCylHquadratic (Failed)
	127 - CurvedBoundaryCylP (Failed)
	128 - CurvedBoundaryCylPH (Failed)
	129 - CurvedBoundaryP (Failed)
	149 - DisContBoundaryFullAngle (Failed)
	243 - FixTangentVelo (Failed)
	271 - HelmholtzStructure (Failed)
	275 - Hybrid2dMeshPartitionMetis_np8 (Failed)
	282 - IncreaseOrderTet (Failed)
	291 - InternalPartitioning_np8 (Failed)
	293 - InternalPartitioning2_np6 (Failed)
	295 - InternalPartitioning3_np6 (Failed)
	339 - MazeMeshPartitionMetisContig_np6 (Failed)
	483 - RotatingBeamFlow2 (Failed)
	574 - ShoeboxFsiStatic (Failed)
	576 - ShoeboxFsiStaticShell (Failed)
	611 - StressConstraintModes3 (Timeout)
	655 - WinkelPartitionMetis_np8 (Failed)
	786 - mgdyn_airgap_force_np2 (Failed)
	824 - mgdyn_steady_quad_extruded_restart (Failed)
	825 - mgdyn_steady_quad_extruded_restart_np3 (Failed)
Errors while running CTest

Please, let me know if you need further details.

[mmuetzel]

With the change from #506, the list of failing tests reduces to this for me:

Total Test time (real) = 1994.97 sec

The following tests FAILED:
	124 - CurvedBoundaryCylH_np3 (Failed)
	125 - CurvedBoundaryCylH_np8 (Failed)
	271 - HelmholtzStructure (Failed)
	275 - Hybrid2dMeshPartitionMetis_np8 (Failed)
	291 - InternalPartitioning_np8 (Failed)
	293 - InternalPartitioning2_np6 (Failed)
	295 - InternalPartitioning3_np6 (Failed)
	339 - MazeMeshPartitionMetisContig_np6 (Failed)
	574 - ShoeboxFsiStatic (Failed)
	576 - ShoeboxFsiStaticShell (Failed)
	611 - StressConstraintModes3 (Failed)
	655 - WinkelPartitionMetis_np8 (Failed)
	786 - mgdyn_airgap_force_np2 (Failed)
	824 - mgdyn_steady_quad_extruded_restart (Failed)
	825 - mgdyn_steady_quad_extruded_restart_np3 (Failed)
Errors while running CTest

[mmuetzel]

Re-ran all tests with b77508edb4348c1d63a2d6d91aaf0175a52bb260 with the following results:

Total Test time (real) = 1546.92 sec

The following tests FAILED:
	124 - CurvedBoundaryCylH_np3 (Failed)
	125 - CurvedBoundaryCylH_np8 (Failed)
	271 - HelmholtzStructure (Failed)
	275 - Hybrid2dMeshPartitionMetis_np8 (Failed)
	339 - MazeMeshPartitionMetisContig_np6 (Failed)
	655 - WinkelPartitionMetis_np8 (Failed)
	786 - mgdyn_airgap_force_np2 (Failed)
Errors while running CTest

[mmuetzel]

I re-ran all tests again with 3d5697d05 (plus the changes from #535) with the following results:

Total Test time (real) = 7050.57 sec

The following tests FAILED:
	178 - EMWaveBoxHexasEigen (Failed)
	634 - TopoOptElast2DCompliance (Failed)
	635 - TopoOptElast2DCompliance2 (Failed)
	636 - TopoOptHeat2DCompliance (Failed)
	637 - TopoOptHeat2DCompliance2 (Failed)
Errors while running CTest

[mmuetzel]

Repeated with 130758c21a67f3d319c2c3b07e6a54344e99ac17 (without any local changes):

otal Test time (real) = 2077.39 sec

The following tests FAILED:
	 32 - BlockLinElast3 (Failed)
	 33 - BlockLinElast3b (Failed)
	 34 - BlockLinElast3c (Failed)
	361 - ParStokes_ISMIP_HOM_A010 (Timeout)
	482 - SD_ViscoElasticMaxwell (Failed)
	731 - mgdyn_airgap_force_np2 (Failed)
	768 - mgdyn_steady_quad_extruded_restart (Failed)
Errors while running CTest

[raback]

Sorry, a bug sneaked in. Most of these should be fixed now.

[mmuetzel]

Thanks for the quick turnaround!

Would it make that some of these tests get the quick label so that a regression would be caught earlier in the regular CI runs?

[raback]

When I added the label "quick" I sorted the tests on some of my platforms by time. For <1s I set label "quick" and for >10s label "slow". So there is no rocket science behind. Computers get faster but generally I think this is still usable classification. At the same time it is not too strict so it may make sense to break the rule to get better representation.

[mmuetzel]

I re-ran the tests with a current head (073697a6233e79d376859fa824f42402479f1ed3) of the repository with the following results:

Total Test time (real) = 3739.95 sec

The following tests FAILED:
	738 - mgdyn_airgap_force_np2 (Failed)
	775 - mgdyn_steady_quad_extruded_restart (Failed)
Errors while running CTest

[mmuetzel]

Re-ran with commit 9ef332cfdbbacd68fe4861b339f342732f83d6f3:

Total Test time (real) = 3795.71 sec

The following tests FAILED:
	286 - Hybrid2dMeshPartitionMetis_np8 (Failed)
	353 - MazeMeshPartitionMetisContig_np6 (Failed)
	676 - WinkelPartitionMetis_np8 (Failed)
Errors while running CTest