blktests
blktests copied to clipboard
osandov
blktests block/001 failed with "Failed to issue io.systemd.service.Ping() varlink call: Timer expired"
I found this failure during recent blktests:
# uname -r
6.18.0-0.rc3.251030ge53642b87a4f4.33.fc44.x86_64
# free
total used free shared buff/cache available
Mem: 8081492 1470824 5011744 3828 1896052 6610668
Swap: 8081404 3140 8078264
# free -g
total used free shared buff/cache available
Mem: 7 1 4 0 1 6
Swap: 7 0 7
# nproc
4
# uname -r
6.18.0-0.rc3.251030ge53642b87a4f4.33.fc44.x86_64
# ./check block/001
block/001 (stress device hotplugging) [failed]
runtime ... 154.490s
--- tests/block/001.out 2025-11-03 02:09:32.125072082 -0500
+++ /root/blktests/results/nodev/block/001.out.bad 2025-11-03 02:13:37.590569533 -0500
@@ -1,4 +1,5 @@
Running block/001
Stressing sd
Stressing sr
+Failed to issue io.systemd.service.Ping() varlink call: Timer expired
# cat /root/blktests/results/nodev/block/001.out.bad
Running block/001
Stressing sd
Stressing sr
Failed to issue io.systemd.service.Ping() varlink call: Timer expired
Test complete
Could you check if the udevd daemon is really busy? It seems this test could potentially be another source for overloading udevd.
Seems the error log is from https://github.com/systemd/systemd/blob/main/src/libsystemd/sd-varlink/varlink-util.c#L67
Here is part of the ude event during the test:
KERNEL[150.329185] add /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.329235] remove /devices/virtual/bdi/11:3 (bdi)
KERNEL[150.329321] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.339519] add /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.339710] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.339840] bind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.339940] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr1 (block)
KERNEL[150.340070] change /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.340179] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.340275] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr2 (block)
KERNEL[150.340346] unbind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.340415] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.340534] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.340607] remove /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.340721] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.340799] unbind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.340875] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.340964] remove /devices/pseudo_0/adapter1/host8/target8:0:0 (scsi)
KERNEL[150.341053] change /10:0:0:0 (scsi)
KERNEL[150.341273] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.341361] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.341444] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.341515] remove /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.341617] change /8:0:0:0 (scsi)
KERNEL[150.341738] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr3 (block)
KERNEL[150.341794] unbind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.341846] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.341896] remove /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.342867] change /7:0:0:0 (scsi)
KERNEL[150.343800] add /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.343899] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.344840] add /devices/pseudo_0/adapter1/host8/target8:0:0 (scsi)
KERNEL[150.344940] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.345996] add /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.346103] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.349382] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.349444] unbind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.349500] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.349546] remove /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.349970] change /9:0:0:0 (scsi)
KERNEL[150.352350] add /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.352477] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.352562] bind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.352663] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.352762] change /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.352823] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.352882] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.352938] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.353012] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.353079] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.353127] remove /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.353208] add /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.353296] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.354313] add /devices/virtual/bdi/11:3 (bdi)
KERNEL[150.354448] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr3 (block)
KERNEL[150.354539] add /devices/virtual/bdi/11:2 (bdi)
KERNEL[150.354632] bind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.354744] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.354837] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.354918] bind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.355117] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_device/8:0:0:0 (scsi_device)
KERNEL[150.355225] change /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr3 (block)
KERNEL[150.355318] change /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.355418] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.355515] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_generic/sg27 (scsi_generic)
KERNEL[150.356745] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/bsg/8:0:0:0 (bsg)
KERNEL[150.356851] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.356965] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/bsg/8:0:0:0 (bsg)
KERNEL[150.357083] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.357151] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.357211] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.357272] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_generic/sg27 (scsi_generic)
KERNEL[150.357330] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_device/8:0:0:0 (scsi_device)
KERNEL[150.357380] remove /devices/virtual/bdi/11:3 (bdi)
KERNEL[150.357427] remove /devices/virtual/bdi/11:2 (bdi)
KERNEL[150.364517] add /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.364652] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.364786] bind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.364871] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.364964] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.365095] unbind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.365168] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.365284] change /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.365356] remove /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.365437] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.365520] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.365625] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.365694] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.365750] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.365795] change /10:0:0:0 (scsi)
KERNEL[150.366081] remove /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.368669] add /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.368777] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.372539] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr3 (block)
KERNEL[150.372626] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.372683] unbind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.372735] unbind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.372832] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.372936] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.373036] remove /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.373108] remove /devices/pseudo_0/adapter1/host8/target8:0:0 (scsi)
KERNEL[150.373466] change /7:0:0:0 (scsi)
KERNEL[150.374039] change /8:0:0:0 (scsi)
KERNEL[150.374301] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr0 (block)
KERNEL[150.374357] unbind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.374414] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.374460] remove /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.374932] change /9:0:0:0 (scsi)
KERNEL[150.376643] add /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.376749] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.377127] add /devices/pseudo_0/adapter1/host8/target8:0:0 (scsi)
KERNEL[150.377252] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.377409] add /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.377566] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.377636] bind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.377739] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.377838] change /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.377900] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.377958] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.378105] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.378166] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.378218] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.378265] remove /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.378350] add /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.378436] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.385424] add /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.385571] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.385686] bind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.385768] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.385873] change /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.385934] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.385994] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.386105] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.386164] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.386217] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.386264] remove /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.387387] add /devices/virtual/bdi/11:2 (bdi)
KERNEL[150.387476] add /devices/virtual/bdi/11:3 (bdi)
KERNEL[150.387592] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.388566] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr3 (block)
KERNEL[150.388721] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.388810] bind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.388931] bind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.388986] unbind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.389045] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.389139] change /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.389233] change /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr3 (block)
KERNEL[150.389296] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_device/8:0:0:0 (scsi_device)
KERNEL[150.390106] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.390176] remove /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.390238] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.390375] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg27 (scsi_generic)
KERNEL[150.390446] add /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/bsg/8:0:0:0 (bsg)
KERNEL[150.390515] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.390562] change /10:0:0:0 (scsi)
KERNEL[150.390621] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/bsg/8:0:0:0 (bsg)
KERNEL[150.390683] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.390739] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/scsi_device/8:0:0:0 (scsi_device)
KERNEL[150.390796] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
KERNEL[150.390853] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg27 (scsi_generic)
KERNEL[150.390905] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_device/9:0:0:0 (scsi_device)
KERNEL[150.390956] remove /devices/virtual/bdi/11:2 (bdi)
KERNEL[150.391019] remove /devices/virtual/bdi/11:3 (bdi)
KERNEL[150.391695] add /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.391793] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.396433] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.396502] unbind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.396550] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.396596] remove /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.397034] change /7:0:0:0 (scsi)
KERNEL[150.400266] add /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
KERNEL[150.400383] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.401383] add /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.401514] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.401598] bind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.401690] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.401766] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr3 (block)
KERNEL[150.401861] change /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.401910] unbind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.401977] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr2 (block)
KERNEL[150.402498] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
KERNEL[150.402607] unbind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.402697] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
KERNEL[150.402753] remove /devices/pseudo_0/adapter2/host9/target9:0:0 (scsi)
KERNEL[150.402811] remove /devices/pseudo_0/adapter1/host8/target8:0:0 (scsi)
KERNEL[150.402880] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.402945] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.403012] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
KERNEL[150.403083] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.403151] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
KERNEL[150.403202] remove /devices/virtual/bdi/11:1 (bdi)
KERNEL[150.410509] add /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.410649] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.410819] bind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.410937] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.411050] change /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.411113] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.411173] add /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.411230] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/bsg/7:0:0:0 (bsg)
KERNEL[150.411284] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_generic/sg26 (scsi_generic)
KERNEL[150.411335] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/scsi_device/7:0:0:0 (scsi_device)
KERNEL[150.411392] remove /devices/virtual/bdi/11:0 (bdi)
KERNEL[150.412309] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr1 (block)
KERNEL[150.412366] unbind /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.412415] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0 (scsi)
KERNEL[150.412462] remove /devices/pseudo_0/adapter3/host10/target10:0:0 (scsi)
KERNEL[150.422521] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0/block/sr0 (block)
KERNEL[150.422594] unbind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.422728] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
KERNEL[150.422812] remove /devices/pseudo_0/adapter0/host7/target7:0:0 (scsi)
udevadm settle is running here and reported "Failed to issue io.systemd.service.Ping() varlink call: Timer expired"
Here start to remove the scsi-debug module
KRNEL[270.560492] remove /devices/pseudo_0/adapter3/host10/scsi_host/host10 (scsi_host)
KERNEL[270.560566] remove /devices/pseudo_0/adapter3/host10 (scsi)
KERNEL[270.566405] remove /devices/virtual/workqueue/scsi_tmf_10 (workqueue)
KERNEL[270.566475] unbind /devices/pseudo_0/adapter3 (pseudo)
KERNEL[270.566515] remove /devices/pseudo_0/adapter3 (pseudo)
KERNEL[270.570454] remove /devices/pseudo_0/adapter2/host9/scsi_host/host9 (scsi_host)
KERNEL[270.570520] remove /devices/pseudo_0/adapter2/host9 (scsi)
KERNEL[270.580311] remove /devices/virtual/workqueue/scsi_tmf_9 (workqueue)
KERNEL[270.580382] unbind /devices/pseudo_0/adapter2 (pseudo)
KERNEL[270.580422] remove /devices/pseudo_0/adapter2 (pseudo)
KERNEL[270.584448] remove /devices/pseudo_0/adapter1/host8/scsi_host/host8 (scsi_host)
KERNEL[270.584517] remove /devices/pseudo_0/adapter1/host8 (scsi)
KERNEL[270.595295] remove /devices/virtual/workqueue/scsi_tmf_8 (workqueue)
KERNEL[270.595386] unbind /devices/pseudo_0/adapter1 (pseudo)
KERNEL[270.595426] remove /devices/pseudo_0/adapter1 (pseudo)
KERNEL[270.599479] remove /devices/pseudo_0/adapter0/host7/scsi_host/host7 (scsi_host)
KERNEL[270.599549] remove /devices/pseudo_0/adapter0/host7 (scsi)
KERNEL[270.609271] remove /devices/virtual/workqueue/scsi_tmf_7 (workqueue)
KERNEL[270.609344] unbind /devices/pseudo_0/adapter0 (pseudo)
KERNEL[270.609381] remove /devices/pseudo_0/adapter0 (pseudo)
KERNEL[270.609437] remove /bus/pseudo/drivers/scsi_debug (drivers)
KERNEL[270.609478] remove /bus/pseudo (bus)
KERNEL[270.616309] remove /module/scsi_debug (module)
After the block/001 case finished, the udevadm can still monitor the udev event:
UDEV [363.960284] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/bsg/9:0:0:0 (bsg)
UDEV [363.961973] add /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
UDEV [363.964976] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0/block/sr3 (block)
UDEV [363.966247] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/block/sr1 (block)
UDEV [363.986332] unbind /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
UDEV [363.986384] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
UDEV [363.986432] unbind /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
UDEV [364.241106] add /devices/virtual/bdi/11:0 (bdi)
UDEV [364.241267] add /devices/virtual/bdi/11:2 (bdi)
UDEV [364.241450] add /devices/virtual/bdi/11:1 (bdi)
UDEV [364.241834] add /devices/virtual/bdi/11:3 (bdi)
UDEV [364.242436] add /devices/virtual/bdi/11:4 (bdi)
UDEV [393.160219] remove /devices/pseudo_0/adapter3/host10/scsi_host/host10 (scsi_host)
UDEV [393.180832] remove /devices/virtual/workqueue/scsi_tmf_10 (workqueue)
UDEV [393.217708] remove /devices/pseudo_0/adapter2/host9/scsi_host/host9 (scsi_host)
UDEV [393.239508] remove /devices/virtual/workqueue/scsi_tmf_9 (workqueue)
UDEV [393.276450] remove /devices/pseudo_0/adapter1/host8/scsi_host/host8 (scsi_host)
UDEV [393.296881] remove /devices/virtual/workqueue/scsi_tmf_8 (workqueue)
UDEV [393.332673] remove /devices/pseudo_0/adapter0/host7/scsi_host/host7 (scsi_host)
UDEV [393.353024] remove /devices/virtual/workqueue/scsi_tmf_7 (workqueue)
UDEV [393.436589] remove /bus/pseudo/drivers/scsi_debug (drivers)
UDEV [393.474956] remove /module/scsi_debug (module)
UDEV [393.475025] remove /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0/scsi_generic/sg26 (scsi_generic)
UDEV [393.475756] add /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/bsg/10:0:0:0 (bsg)
UDEV [393.490135] change /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/block/sr2 (block)
UDEV [393.714953] remove /devices/pseudo_0/adapter0/host7/target7:0:0/7:0:0:0 (scsi)
UDEV [393.715362] remove /devices/pseudo_0/adapter3/host10/target10:0:0/10:0:0:0/scsi_device/10:0:0:0 (scsi_device)
UDEV [393.715429] remove /devices/pseudo_0/adapter1/host8/target8:0:0/8:0:0:0 (scsi)
UDEV [393.715504] remove /devices/virtual/bdi/11:2 (bdi)
UDEV [393.715559] remove /devices/virtual/bdi/11:0 (bdi)
UDEV [393.715610] remove /devices/virtual/bdi/11:4 (bdi)
UDEV [393.715963] unbind /devices/pseudo_0/adapter2/host9/target9:0:0/9:0:0:0 (scsi)
UDEV [393.716264] remove /devices/virtual/bdi/11:3 (bdi)
UDEV [393.716522] remove /devices/virtual/bdi/11:1 (bdi)
I downgrade the systemd from systemd-258.1-2.fc44 to systemd-257.10-1.fc42.x86_64, the issue cannot be reproduced now. And the udevadm settle alwasy can be finished within 120s.
109.844s
111.851s
115.309s
111.077s
110.926s
113.967s
111.459s
114.940s
112.110s
112.416s
111.942s
111.924s
112.365s
110.875s
106.495s
113.543s
108.099s
109.772s
110.635s
113.199s
110.291s
112.432s
108.922s
108.288s
113.270s
109.597s
110.154s
112.142s
Thanks for looking into it. Is the varlink feature new for udevd in v268? If so, the test might trigger a bug? In this case we should get upstream systemd devs involved.
Thanks for looking into it. Is the varlink feature new for udevd in v268? If so, the test might trigger a bug? In this case we should get upstream systemd devs involved.
I tried to find it in the git log, but I'm not sure, just filed one issue to systemd and get systemd developer involved. https://github.com/systemd/systemd/issues/39583