cue
cue copied to clipboard
Published
20 hours ago •
cue-lang
cue-lang
matchN: inconsistent reporting of the full set of validation errors
What version of CUE are you using (cue version)?
$ cue version
cue version v0.11.0-0.dev.0.20240822081630-a20e523c2059
go version go1.23.0
-buildmode exe
-compiler gc
DefaultGODEBUG asynctimerchan=1,gotypesalias=0,httpservecontentkeepheaders=1,tls3des=1,tlskyber=0,x509keypairleaf=0,x509negativeserial=1
CGO_ENABLED 1
GOARCH amd64
GOOS linux
GOAMD64 v1
cue.lang.version v0.11.0
Does this issue reproduce with the latest stable release?
n/a (function is not available in latest, v0.10.0)
What did you do?
! exec cue vet
cmp stderr stderr.golden
-- f.cue --
package p
A: 42
A: matchN(0, [int])
A: matchN(0, [string, number])
A: matchN(0, [42, >100, >1000])
B: 42
B: matchN(1, [int, >10])
B: matchN(1, [string, >100])
-- stderr.golden --
A: invalid value 42 (does not satisfy matchN(0, [int])): 1 matched, expected 0:
./f.cue:4:4
./f.cue:3:4
./f.cue:4:11
./f.cue:5:4
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [string,number])): 1 matched, expected 0:
./f.cue:5:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:11
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [42,>100,>1000])): 1 matched, expected 0:
./f.cue:6:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
B: invalid value 42 (does not satisfy matchN(1, [int,>10])): 2 matched, expected 1:
./f.cue:9:4
./f.cue:8:4
./f.cue:9:11
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
./f.cue:9:4
./f.cue:10:11
Repro from @myitcv in https://github.com/cue-lang/cue/issues/3388#issuecomment-2304204638
What did you expect to see?
A passing test.
What did you see instead?
> ! exec cue vet
[stderr]
A: invalid value 42 (does not satisfy matchN(0, [int])): 1 matched, expected 0:
./f.cue:4:4
./f.cue:3:4
./f.cue:4:11
./f.cue:5:4
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [string,number])): 1 matched, expected 0:
./f.cue:5:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:11
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [42,>100,>1000])): 1 matched, expected 0:
./f.cue:6:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
./f.cue:9:4
./f.cue:10:11
[exit status 1]
> cmp stderr stderr.golden
diff stderr stderr.golden
--- stderr
+++ stderr.golden
@@ -16,6 +16,10 @@
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
+B: invalid value 42 (does not satisfy matchN(1, [int,>10])): 2 matched, expected 1:
+ ./f.cue:9:4
+ ./f.cue:8:4
+ ./f.cue:9:11
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
FAIL: /tmp/testscript912524492/matchN.inconsistentErrorReporting.txtar/script.txtar:2: stderr and stderr.golden differ
Thanks for the report, @jpluscplusm.
If you will allow me, I think the repro is clearer like this:
! exec cue vet
cmp stderr stderr.golden
-- f.cue --
package p
A: 42
A: matchN(0, [int])
A: matchN(0, [string, number])
A: matchN(0, [42, >100, >1000])
B: 42
B: matchN(1, [int, >10])
B: matchN(1, [string, >100])
-- stderr.golden --
A: invalid value 42 (does not satisfy matchN(0, [int])): 1 matched, expected 0:
./f.cue:4:4
./f.cue:3:4
./f.cue:4:11
./f.cue:5:4
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [string,number])): 1 matched, expected 0:
./f.cue:5:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:11
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [42,>100,>1000])): 1 matched, expected 0:
./f.cue:6:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
B: invalid value 42 (does not satisfy matchN(1, [int,>10])): 2 matched, expected 1:
./f.cue:9:4
./f.cue:8:4
./f.cue:9:11
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
./f.cue:9:4
./f.cue:10:11
Expectation is that it should pass but we get:
> cmp stderr stderr.golden
diff stderr stderr.golden
--- stderr
+++ stderr.golden
@@ -16,6 +16,10 @@
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
+B: invalid value 42 (does not satisfy matchN(1, [int,>10])): 2 matched, expected 1:
+ ./f.cue:9:4
+ ./f.cue:8:4
+ ./f.cue:9:11
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
FAIL: /tmp/testscript2903460784/repro.txtar/script.txtar:2: stderr and stderr.golden differ
This appears to be fixed for both the old and new evaluators now; the testscript below passes:
env CUE_EXPERIMENT=evalv3=0
! exec cue vet
cmp stderr stderr.golden
env CUE_EXPERIMENT=evalv3=1
! exec cue vet
cmp stderr stderr.golden
-- f.cue --
package p
A: 42
A: matchN(0, [int])
A: matchN(0, [string, number])
A: matchN(0, [42, >100, >1000])
B: 42
B: matchN(1, [int, >10])
B: matchN(1, [string, >100])
-- stderr.golden --
A: invalid value 42 (does not satisfy matchN(0, [int])): 1 matched, expected 0:
./f.cue:4:4
./f.cue:3:4
./f.cue:4:11
./f.cue:5:4
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [string,number])): 1 matched, expected 0:
./f.cue:5:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:11
./f.cue:6:4
A: invalid value 42 (does not satisfy matchN(0, [42,>100,>1000])): 1 matched, expected 0:
./f.cue:6:4
./f.cue:3:4
./f.cue:4:4
./f.cue:5:4
./f.cue:6:11
B: invalid value 42 (does not satisfy matchN(1, [int,>10])): 2 matched, expected 1:
./f.cue:9:4
./f.cue:8:4
./f.cue:9:11
./f.cue:10:4
B: invalid value 42 (does not satisfy matchN(1, [string,>100])): 0 matched, expected 1:
./f.cue:10:4
./f.cue:8:4
./f.cue:9:4
./f.cue:10:11
I bisected the fix to https://review.gerrithub.io/c/cue-lang/cue/+/1202211. Since that change already included plenty of test changes, and this bug only affected the old evaluator in the first place, I'm going to mark this issue as resolved now without adding an extra test to the repository.
Also, the bisection above would make this issue a duplicate of https://github.com/cue-lang/cue/issues/3418, which makes complete sense. There, @rogpeppe said that a matchN error showed up on evalv3 but not on evalv2, which matches Jonathan's behavior.