findutils icon indicating copy to clipboard operation
findutils copied to clipboard

Address the differences with the GNU testsuite results

Open sylvestre opened this issue 4 years ago • 4 comments

Currently:

# TOTAL: 16
# PASS:  3
# SKIP:  1
# XFAIL: 0
# FAIL:  11
# XPASS: 0
# ERROR: 1

sylvestre avatar Sep 07 '21 21:09 sylvestre

If you're looking for more external tests, I have a fairly large find testsuite as part of https://github.com/tavianator/bfs. You can use it like this:

$ git clone https://github.com/tavianator/bfs.git
$ cd bfs
$ make all
...
$ ./tests.sh --bfs=/absolute/path/to/uutils/findutils/target/release/find --gnu
...
tests passed: 82
tests failed: 143

Note that currently GNU find scores

$ ./tests.sh --bfs=/usr/bin/find --gnu
...
tests passed: 206
tests failed: 19

due to things that I consider bugs in findutils.

tavianator avatar Sep 14 '21 20:09 tavianator

@tavianator oh, cool, thanks

You would be interested in adding this testsuite in:

https://github.com/uutils/findutils/blob/master/util/build-gnu.sh ?

sylvestre avatar Sep 14 '21 20:09 sylvestre

@sylvestre Here you go: https://github.com/uutils/findutils/pull/116

tavianator avatar Sep 15 '21 13:09 tavianator

I just noticed your run of the GNU tests is missing a lot of them. A complete make check includes the dejagnu tests:

                === find Summary ===

# of expected passes            487
find (GNU findutils) 4.9.0.1-caba
...
                === xargs Summary ===

# of expected passes            96
xargs (GNU findutils) 4.9.0.1-caba

Currently uutils gets:

                === find Summary ===

# of expected passes            184
# of unexpected failures        624
find (Rust) 0.3.0
...
                === xargs Summary ===

# of expected passes            50
# of unexpected failures        46
xargs 0.3.0

tavianator avatar Feb 02 '22 13:02 tavianator