moose icon indicating copy to clipboard operation
moose copied to clipboard

Replace XMLDiff and JSONDiff with new universal differ

Open socratesgorilla opened this issue 2 years ago • 16 comments

Closes #21532

This will break falcon and isopod until we can update their tests with the new differ, so we will need to do some repointing in those repos when this PR is approved to be merged in.

socratesgorilla avatar Aug 05 '22 21:08 socratesgorilla

Job Precheck on 311310e wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Aug 05 '22 21:08 moosebuild

Job Precheck on 962a433 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Aug 05 '22 21:08 moosebuild

Job Precheck on eafac3d wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Aug 05 '22 21:08 moosebuild

Job Documentation on 17fe732 wanted to post the following:

View the site here

This comment will be updated on new commits.

moosebuild avatar Aug 05 '22 23:08 moosebuild

Job Coverage on 17fe732 wanted to post the following:

Framework coverage

Coverage did not change

Modules coverage

Coverage did not change

Full coverage reports

Reports

This comment will be updated on new commits.

moosebuild avatar Aug 06 '22 00:08 moosebuild

I guess this is ready to go after preparing the patch for the applications using JSONDiff? Another alternative is to still keep both JSONDiff and XMLDiff, and just let them call SchemaDiff. This could be a valid option because we might need to do some custom operations differently for JSON and XML.

YaqiWang avatar Aug 29 '22 20:08 YaqiWang

The message for the second commit is a bit long. I guess it is accidental, thus suggest to reword it.

YaqiWang avatar Aug 29 '22 21:08 YaqiWang

When this PR can be merged?

YaqiWang avatar Sep 16 '22 18:09 YaqiWang

We need a better name than SchemaDiff ? XML and JSON are both hierarchic right, is there any other characteristic which could be used for the name

GiudGiud avatar Sep 16 '22 18:09 GiudGiud

We need a better name than SchemaDiff ? XML and JSON are both hierarchic right, is there any other characteristic which could be used for the name

Are they not both schema languagess? The only other thing I could see would be MarkupDiff or DataDiff.

Additionally, changing the name now would require rewriting 60 or so tests again to use the new name. If possible, I'd prefer to avoid it.

socratesgorilla avatar Sep 16 '22 19:09 socratesgorilla

I've suggested to keep the original names. Their codes could be the same but if they name differently, I assume in the future there could be differences in the differ codes. I am not familiar with Python, but in c++, we can just derive two new classes. If a python package is used for this, I guess there could be an option for doing settings differently for XML and GSON? If we keep the original names, we will not break any applications.

YaqiWang avatar Sep 16 '22 19:09 YaqiWang

Rewriting tests should be done with scripts btw, you should never do this manually.

I have never heard about schema languages but that's probably just my ignorance. @loganharbour @permcody you familiar with that?

GiudGiud avatar Sep 16 '22 19:09 GiudGiud

How's this coming along?

lindsayad avatar Sep 26 '22 16:09 lindsayad

@socratesgorilla where are we on this? Have you patched all the apps?

Yaqi's idea of keeping the old names is good. SchemaDiff is not as intuitive as JSONDiff or XMLDiff, we can just map the new names to the old name

GiudGiud avatar Oct 11 '22 13:10 GiudGiud

Only failing app is falcon, and only one test. Could be fixed fairly easily with coordinated effort. Been waiting for a discussion for what to do on this.

I suppose it could be changed into both JSONDiff and XMLDiff if necessary. Would avoid having to change falcon at least.

socratesgorilla avatar Oct 11 '22 14:10 socratesgorilla

backwards compatible is always great

lindsayad avatar Oct 11 '22 17:10 lindsayad

Can the test be fixed and this be merged soon? Thanks.

YaqiWang avatar Oct 13 '22 16:10 YaqiWang

Job Precheck on a291b99 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 13 '22 17:10 moosebuild

Working on the falcon stuff now

socratesgorilla avatar Oct 13 '22 17:10 socratesgorilla

Unfortunately Peter is out on travel and he is sort of the spearhead of this libtorch stochastic tools stuff that is failing. It is failing legitimately, the differ is accurately detecting a difference larger than the accepted error, so something is wrong there.

The falcon issue is completely mindboggling. The diff it creates could not be replicated locally, and its totally unclear why the new json output is using "unsigned long" instead of "unsigned long long" like in the gold file. If anyone has any guidance on it, that would be ideal.

socratesgorilla avatar Oct 13 '22 19:10 socratesgorilla

Job Precheck on 8861ba9 wanted to post the following:

The following commit(s) contain fixups:

  • 8861ba95823: fixup! Deleted remaining old differ files, fixed relative error to work as intended

moosebuild avatar Oct 17 '22 21:10 moosebuild

Job Precheck on 8861ba9 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 17 '22 21:10 moosebuild

Job Precheck on 528efb0 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 17 '22 21:10 moosebuild

Job Precheck on 8225b62 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 18 '22 21:10 moosebuild

Job Precheck on 341c9e9 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 19 '22 15:10 moosebuild

Job Precheck on 1a71aff wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 19 '22 18:10 moosebuild

Abs zero has been re-implemented and there should be no barriers to merging.

socratesgorilla avatar Oct 19 '22 20:10 socratesgorilla

Can this be merged since it is passing all tests?

YaqiWang avatar Oct 20 '22 18:10 YaqiWang

It has not been reviewed so not yet. Any takers? EDIT: @loganharbour assigned himself so he's slated to take care of this

GiudGiud avatar Oct 20 '22 18:10 GiudGiud

Job Precheck on 0402cd5 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 26 '22 22:10 moosebuild

Job Precheck on 5a4fe8f wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 27 '22 15:10 moosebuild

Job Precheck on 728d7df wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 27 '22 15:10 moosebuild

Job Precheck on c9c8008 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 27 '22 15:10 moosebuild

Job Precheck on a841052 wanted to post the following:

A change of the following file(s) triggered this check:

conda/tools

The following file(s) are unchanged:

conda/mpich/conda_build_config.yaml

The conda build config was not changed but one or more of its dependencies have changed

moosebuild avatar Oct 27 '22 17:10 moosebuild