nalu-wind icon indicating copy to clipboard operation
nalu-wind copied to clipboard

Published 20 hours ago • verified publisher icon Exawind

NDTW problem with different number of procs

Open marchdf opened this issue 1 year ago • 2 comments

I am seeing a problem with the NDTW calculation using the latest nalu-wind.

Left is NDTW from a run with 4 procs, right is with 8 procs. About halfway up you can see NDTW drop to 0 for the run with 8 procs. It only drops at the corners of the domain. A slices through there shows that the rest of the field in that plane is fine.

I think it's happening at a MPI grid boundary. I increased the tolerance on NDTW and that didn't change anything. Does anyone have any ideas? Here's the input file: ndtw-test.txt. I can provide the mesh (120MB) if it helps.

Screen Shot 2022-11-15 at 15 22 35

Zoom: Screen Shot 2022-11-15 at 15 24 08

MPI boundaries Screen Shot 2022-11-15 at 15 24 45

marchdf avatar Nov 15 '22 22:11 marchdf

@marchdf do you see this at the corners of every processor boundary or just that one instance?

psakievich avatar Nov 15 '22 23:11 psakievich

Just at that processor boundary... All others are fine.

On Tue, Nov 15, 2022, 16:57 psakievich @.***> wrote:

@marchdf https://github.com/marchdf do you see this at the corners of every processor boundary or just that one instance?

— Reply to this email directly, view it on GitHub https://github.com/Exawind/nalu-wind/issues/1080#issuecomment-1316049188, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADSXPT3VE44SZHY645DJO5DWIQPMTANCNFSM6AAAAAASBNO6I4 . You are receiving this because you were mentioned.Message ID: @.***>

marchdf avatar Nov 16 '22 03:11 marchdf