Gamma correction table was non-monotonic (was: Total error -NAN and colprof error)

[svenpilz]

I attached the output of /usr/lib/colord/colord-session --verbose (see colord-session.txt) for a failed calibration. Settings were Medium and Native. Versions are colord 1.3.4 and ColorHug 2.0.7. Note

16:11:32	CdMain: Emitting UpdateGamma(2 elements)
16:11:34	Absolute luminance at this point should be 1.000000 but is 3.921053
16:11:34	Lab: inf	-nan	-nan error -nan
16:11:34	Total error -nan
16:11:34	try 1.000000,1.000000,0.950000

and

16:24:19	CdMain: Emitting Finished(5,colprof failed: /usr/bin/colprof: Error - Write file: 1, icmCurve_write: write_U8Fixed8umber(-5.41305723) failed
)

Any idea what went wrong? Thanks :).

Edit: I should mention, the Low profile works.

[hughsie]

What version argyllcms? What distro? Thanks!

[svenpilz]

Distro is Arch and argyllcms is 1.9.2. Sadly I can no longer reproduce the behavior (USB/connection issues?), but now I get ;-)

CdMain: Emitting Finished(5,Gamma correction table was non-monotonic: 0.000000,0.000000,0.000000 0.153125,0.109335,0.000731 0.146875,0.106170,0.017087 0.168750,0.121755,0.033443 0.225000,0.168591,0.065424 0.268750,0.202926,0.091154 0.325000,0.243511,0.116885 0.375000,0.284096,0.142616 0.425000,0.324681,0.174597 0.493750,0.377766,0.215953 0.525000,0.405851,0.232309 0.590625,0.458937,0.273665 0.628125,0.487022,0.296271 0.681250,0.536982,0.334502 0.721875,0.568192,0.360232 0.768750,0.608777,0.398463 0.809375,0.649362,0.433569 0.859375,0.689947,0.474925 0.906250,0.736783,0.522531 0.959375,0.796118,0.585762 1.000000,0.811703,0.577118)

Any idea where to start debugging this?

[hughsie]

It looks like the display isn't quite doing what we're asking it to; do you have any kind of "enhancement" functionality turned on? e.g. GamerMode or DynamicContrast?

[svenpilz]

None that I know of.

[german-rios-gonzalez]

Hi, I don't know if I have the exact same issue (I quote it lower), I have a ColorMunki Smile and this time I used Fedora 30 (same error from Fedora 25-30), I tried with several monitor all failed with high quality, only if I use the lower quality the process it's done.

«calibration failed with code 5: Gamma correction table was non-monotonic: 0,000000,0,000000,0,000000 0,050000,0,049499,0,015591 0,100000,0,098999,0,081181 0,150000,0,148498,0,071772 0,200000,0,197997,0,087363 0,250000,0,247497,0,127954 0,275000,0,296996,0,181044 0,325000,0,346495,0,209135 0,375000,0,395994,0,249726 0,425000,0,432994,0,287191 0,500000,0,494993,0,330907 0,537500,0,544492,0,371498 0,575000,0,593992,0,412089 0,637500,0,643491,0,452679 0,712500,0,705490,0,505770 0,743750,0,742490,0,533861 0,787500,0,791989,0,586952 0,837500,0,838363,0,640042 0,900000,0,897238,0,711883 0,950000,0,940487,0,777474 1,000000,0,989986,0,811814»

[fedelibre]

Same error on Fedora 35 Silverblue (with argyllcms package overlayed). Here the logs of a high quality calibration:

feb 09 13:28:44 federico kernel: usb 1-1.2: new full-speed USB device number 5 using ehci-pci
feb 09 13:28:45 federico kernel: usb 1-1.2: New USB device found, idVendor=0765, idProduct=5020, bcdDevice= 0.01
feb 09 13:28:45 federico kernel: usb 1-1.2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
feb 09 13:28:45 federico kernel: usb 1-1.2: Product: ColorMunki Display
feb 09 13:28:45 federico kernel: usb 1-1.2: Manufacturer: X-Rite, Inc.
feb 09 13:28:45 federico kernel: hid-generic 0003:0765:5020.0006: hiddev96,hidraw0: USB HID v1.11 Device [X-Rite, Inc. ColorMunki Display] on usb-0000:00:1a.0-1.2/input0
feb 09 13:28:48 federico systemd[1645]: Started Application launched by gsd-color.
feb 09 13:30:09 federico systemd[1645]: Starting Color management helper...
feb 09 13:30:09 federico systemd[1645]: Started Color management helper.
feb 09 13:30:09 federico gnome-shell[1767]: meta_window_set_stack_position_no_sync: assertion 'window->stack_position >= 0' failed
feb 09 13:31:38 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 2, 98, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:32:24 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:33:12 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:34:08 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:35:15 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 2, 98, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:36:08 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:37:00 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:37:46 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:38:33 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:39:19 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:40:06 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:41:44 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:43:08 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:44:30 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:45:22 federico systemd[1645]: Started app-flatpak-com.google.Chrome-38348.scope.
feb 09 13:46:05 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:47:41 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:49:09 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:51:09 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:52:50 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 3, 97, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:54:57 federico colord-session[36984]: steps were set as [ 3, 97, -1 ] but should have been: [ 4, 96, -1 ] at ../contrib/session-helper/cd-main.c:430
feb 09 13:54:57 federico colord-session[36984]: child is at 19/20 steps and parent done [../contrib/session-helper/cd-main.c:739]
feb 09 13:54:57 federico colord-session[36984]: 2) ../contrib/session-helper/cd-main.c:1248 (0/3)
feb 09 13:54:57 federico colord-session[36984]: 1) ../contrib/session-helper/cd-main.c:626 (2/5)
feb 09 13:54:57 federico colord-session[36984]: 0) ../contrib/session-helper/cd-main.c:717 (19/20)
feb 09 13:54:59 federico colord-session[36984]: child is at 19/20 steps and parent done [../contrib/session-helper/cd-main.c:751]
feb 09 13:54:59 federico colord-session[36984]: 2) ../contrib/session-helper/cd-main.c:1248 (0/3)
feb 09 13:54:59 federico colord-session[36984]: 1) ../contrib/session-helper/cd-main.c:626 (2/5)
feb 09 13:54:59 federico colord-session[36984]: 0) ../contrib/session-helper/cd-main.c:717 (19/20)
feb 09 13:54:59 federico gnome-control-c[36827]: calibration failed with code 5: Gamma correction table was non-monotonic: 0,000000,0,000000,0,000000 0,048570,0,050000,0,071592 0,097140,0,100000,0,093184 0,145710,0,100000,0,089777 0,1942>
feb 09 13:54:59 federico systemd[1645]: colord-session.service: Consumed 1.206s CPU time.

[hughsie]

I gave up fighting with argyllcms some time ago I'm afraid.