Flatcar icon indicating copy to clipboard operation
Flatcar copied to clipboard

Ignition file passed by QEMU not being detected at boot on MacOS

Open jmgilman opened this issue 3 years ago • 12 comments

Description

Flatcar is not properly finding the Ignition config file being passed by QEMU through the fw_cfg option.

Impact

Unable to provision a QEMU VM using Ignition configuration file.

Environment and steps to reproduce

  1. Set-up:
    $ qemu-system-x86_64 --version
    QEMU emulator version 6.0.0
    Copyright (c) 2003-2021 Fabrice Bellard and the QEMU Project developer
    $ wget https://stable.release.flatcar-linux.net/amd64-usr/current/flatcar_production_qemu_uefi_image.img.bz2  -O flatcar.img.bz2
    $ wget https://stable.release.flatcar-linux.net/amd64-usr/current/flatcar_production_qemu_uefi_efi_code.fd  -O efi_code.fd
    $ wget https://stable.release.flatcar-linux.net/amd64-usr/current/flatcar_production_qemu_uefi_efi_vars.fd -O efi_vars.fd
    $ bzip2 -d flatcar.img.bz2
    
  2. Task: Booting the QEMU image and passing an Ignition configuration
  3. Action(s): a. Perform steps outlined in setup b. Start the VM
qemu-system-x86_64 \
  -m 1024 \
  -serial stdio \
  -pflash efi_code.fd \
  -pflash efi_vars.fd \
  -drive "if=none,file=flatcar.img,id=hd0" \
  -device virtio-blk-pci,drive=hd0 \
  -fw_cfg name=opt/org.flatcar-linux/config,file=config.ign \
  -netdev user,id=eth0,hostfwd=tcp::5022-:22,hostname=core \
  -device virtio-net-pci,netdev=eth0
  1. Error:
Jul 16 16:29:17 localhost ignition[377]: Ignition v0.34.0-22-g032f620
Jul 16 16:29:17 localhost ignition[377]: Stage: disks
Jul 16 16:29:17 localhost ignition[377]: reading system config file "/usr/lib/ignition/base.ign"
Jul 16 16:29:17 localhost ignition[377]: no config at "/usr/lib/ignition/base.ign"
Jul 16 16:29:17 localhost ignition[377]: parsed url from cmdline: ""
Jul 16 16:29:17 localhost ignition[377]: no config URL provided
Jul 16 16:29:17 localhost ignition[377]: reading system config file "/usr/lib/ignition/user.ign"
Jul 16 16:29:17 localhost ignition[377]: no config at "/usr/lib/ignition/user.ign"
Jul 16 16:29:17 localhost ignition[377]: op(1): [started]  loading QEMU firmware config module
Jul 16 16:29:17 localhost ignition[377]: op(1): executing: "modprobe" "qemu_fw_cfg"
Jul 16 16:29:17 localhost ignition[377]: op(1): [finished] loading QEMU firmware config module 
Jul 16 16:29:17 localhost ignition[377]: QEMU firmware config was not found. Ignoring...
Jul 16 16:29:17 localhost ignition[377]: QEMU firmware config was not found. Ignoring...
Jul 16 16:29:17 localhost ignition[377]: parsing config with SHA512: cf83e1357eefb8bdf1542850d66d8007d620e4050b5715dc83f4a921d36ce9ce47d0d13c5d85f2b0ff8318d2877eec2f63b931bd47417a81a538327af927da3e
Jul 16 16:29:17 localhost ignition[377]: failed to fetch config: not a config (empty)
Jul 16 16:29:17 localhost ignition[377]: not a config (empty): ignoring user-provided config
Jul 16 16:29:17 localhost ignition[377]: reading system config file "/usr/lib/ignition/default.ign"
Jul 16 16:29:17 localhost ignition[377]: no config at "/usr/lib/ignition/default.ign"
Jul 16 16:29:17 localhost ignition[377]: disks: disks passed
Jul 16 16:29:17 localhost ignition[377]: Ignition finished successfully

Expected behavior

Expected Ignition to find the config file being passed by QEMU.

Additional information

This is being run on a macOS Big Sur OS with QEMU installed via brew.

jmgilman avatar Jul 16 '21 17:07 jmgilman

hi @jmgilman, I can reproduce your issue using your steps and an empty ignition file: could you check that your config.ign is not empty ? For your information, we also provide a flatcar_production_qemu_uefi.sh helper to start an instance (https://stable.release.flatcar-linux.net/amd64-usr/current/flatcar_production_qemu_uefi.sh)

tormath1 avatar Jul 19 '21 09:07 tormath1

Can confirm the file is not empty. The provided shell script is only applicable to Linux and not OSX which is why I chose the manual route.

jmgilman avatar Jul 19 '21 21:07 jmgilman

Thanks for reporting, I guess it's worth forwarding this to upstream QEMU

pothos avatar Jan 28 '22 15:01 pothos

Hi @jmgilman, we recently got some MacOS related changes on the Flatcar QEMU script: https://github.com/flatcar-linux/scripts/pull/348. It would be worth to see if it solves your issue...

tormath1 avatar Jun 27 '22 17:06 tormath1

The changes don't seem to work? Or are they not in stable?

❯ ./flatcar_production_qemu.sh
./flatcar_production_qemu.sh: mktemp -d failed!
❯ uname -a
Darwin MacBook-Air.localdomain 21.6.0 Darwin Kernel Version 21.6.0: Mon Aug 22 20:17:10 PDT 2022; root:xnu-8020.140.49~2/RELEASE_X86_64 x86_64

till avatar Oct 01 '22 14:10 till

Per my last comment, I tried to mess around with the provided qemu script (in stable) but I also went the manual route. At first I took the parts of the script that created a config drive in order to see if I can have something that works with our existing configuration. But if I follow through and boot the image, the config drive is not read and nothing is applied.

Then I went ahead and tried what I actually wanted to work on:

And I can also confirm the original bug report. I also have a pretty basic ignition file as I am trying to explore what we have to do to update our ignition configurations. On a side-note, I tried to read the docs, but it's a bit unclear what the actual status is per website. As to what someone is supposed to use, ignition or cloud-init and also which version of ignition? It frequently seems to use ignition and cloud-init/config as they are the same things and I am not sure what is actually deprecated or what I should go with. :D

Anyway, started off with this (as a template in bash) - which I took from the docs:

systemd:
  units:
    - name: sshd.service
      enable: true
    - name: sshd.socket
      mask: true
    - name: systemd-journald.service
      dropins:
        - name: 10-debug.conf
          contents: |
            [Service]
            Environment=SYSTEMD_LOG_LEVEL=debug 

passwd:
  users:
    - name: core
      ssh_authorized_keys:
        - ${ssh_key}

Then compiled it to ignition. Ran ct -strict -in-file ... -out-file=flatcar.ign (just installed it today via homebrew):

{"ignition":{"config":{},"security":{"tls":{}},"timeouts":{},"version":"2.3.0"},"networkd":{},"passwd":{"users":[{"name":"core","sshAuthorizedKeys":["...PUB-KEY-HERE..,"]}]},"storage":{},"systemd":{"units":[{"enable":true,"name":"sshd.service"},{"mask":true,"name":"sshd.socket"},{"dropins":[{"contents":"[Service]\nEnvironment=SYSTEMD_LOG_LEVEL=debug \n","name":"10-debug.conf"}],"name":"systemd-journald.service"}]}}

I can boot an instance, but the file is not used.

/usr/local/bin/qemu-system-x86_64 -m 1024 \
    -cpu host \
    -machine q35,accel=${machine_accel} \
    -smp 1,sockets=1,cores=1,threads=1 \
    -boot order=c,splash-time=40,menu=on \
    -drive if=virtio,file=${disk} \
    -fw_cfg name=opt/org.flatcar-linux/config,file=flatcar.ign \
...

I also downloaded the current alpha release (part of this was trying to make ign work and the other was the weird clocksource message I am being flooded with see at the very bottom.) So the following logs are from the current alpha release:

[H[J[1;1H[?25l[m[H[J[1;1H[2;30HGNU GRUB  version 2.02


[m[4;2H+----------------------------------------------------------------------------+[5;2H|[5;79H|[6;2H|[6;79H|[7;2H|[7;79H|[8;2H|[8;79H|[9;2H|[9;79H|[10;2H|[10;79H|[11;2H|[11;79H|[12;2H|[12;79H|[13;2H|[13;79H|[14;2H|[14;79H|[15;2H|[15;79H|[16;2H|[16;79H|[17;2H+----------------------------------------------------------------------------+[m[18;2H[19;2H[m     Use the ^ and v keys to select which entry is highlighted.          

      Press enter to boot the selected OS, `e' to edit the commands       

      before booting or `c' for a command-line.                           [5;80H [7m[5;3H*Flatcar default                                                            [m[5;78H[m[m[6;3H Flatcar USR-A                                                              [m[6;78H[m[m[7;3H Flatcar USR-B                                                              [m[7;78H[m[m[8;3H                                                                            [m[8;78H[m[m[9;3H                                                                            [m[9;78H[m[m[10;3H                                                                            [m[10;78H[m[m[11;3H                                                                            [m[11;78H[m[m[12;3H                                                                            [m[12;78H[m[m[13;3H                                                                            [m[13;78H[m[m[14;3H                                                                            [m[14;78H[m[m[15;3H                                                                            [m[15;78H[m[m[16;3H                                                                            [m[16;78H[m[16;80H [5;78H[22;1H   The highlighted entry will be executed automatically in 1s.                 [5;78H[22;1H   The highlighted entry will be executed automatically in 0s.                 [5;78H[?25h[H[J[1;1H[H[J[1;1H  Booting `Flatcar default'


[    0.000000] Linux version 5.15.63-flatcar ([email protected]) (x86_64-cros-linux-gnu-gcc (Gentoo Hardened 11.3.0 p7) 11.3.0, GNU ld (Gentoo 2.38 p4) 2.38) #1 SMP Mon Aug 29 23:14:58 -00 2022
[    0.000000] Command line: BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=qemu flatcar.autologin verity.usrhash=024c6b1f19e8cc48facdff6229d8e32f3672ea3cf31076946696b3a6d3dbd8e7
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[5]: 1088, xstate_sizes[5]:   64
[    0.000000] x86/fpu: xstate_offset[6]: 1152, xstate_sizes[6]:  512
[    0.000000] x86/fpu: xstate_offset[7]: 1664, xstate_sizes[7]: 1024
[    0.000000] x86/fpu: Enabled xstate features 0xe7, context size is 2688 bytes, using 'standard' format.
[    0.000000] signal: max sigframe size: 3632
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ffdbfff] usable
[    0.000000] BIOS-e820: [mem 0x000000003ffdc000-0x000000003fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[    0.000000] last_pfn = 0x3ffdc max_arch_pfn = 0x400000000
[    0.000000] Disabled
[    0.000000] x86/PAT: MTRRs disabled, skipping PAT initialization too.
[    0.000000] CPU MTRRs all blank - virtualized system.
[    0.000000] x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WB  WT  UC- UC  
[    0.000000] Using GB pages for direct mapping
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F59A0 000014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 0x000000003FFE22BB 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 0x000000003FFE20B3 0000F4 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 0x000000003FFE0040 002073 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: FACS 0x000000003FFE0000 000040
[    0.000000] ACPI: APIC 0x000000003FFE21A7 000078 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: HPET 0x000000003FFE221F 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: MCFG 0x000000003FFE2257 00003C (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: WAET 0x000000003FFE2293 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.000000] ACPI: Reserving FACP table memory at [mem 0x3ffe20b3-0x3ffe21a6]
[    0.000000] ACPI: Reserving DSDT table memory at [mem 0x3ffe0040-0x3ffe20b2]
[    0.000000] ACPI: Reserving FACS table memory at [mem 0x3ffe0000-0x3ffe003f]
[    0.000000] ACPI: Reserving APIC table memory at [mem 0x3ffe21a7-0x3ffe221e]
[    0.000000] ACPI: Reserving HPET table memory at [mem 0x3ffe221f-0x3ffe2256]
[    0.000000] ACPI: Reserving MCFG table memory at [mem 0x3ffe2257-0x3ffe2292]
[    0.000000] ACPI: Reserving WAET table memory at [mem 0x3ffe2293-0x3ffe22ba]
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000003ffdbfff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3ffd6000-0x3ffdbfff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x000000003ffdbfff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000003ffdbfff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003ffdbfff]
[    0.000000] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.000000] On node 0, zone DMA: 97 pages in unavailable ranges
[    0.000000] On node 0, zone DMA32: 36 pages in unavailable ranges
[    0.000000] ACPI: PM-Timer IO Port: 0x608
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] [mem 0x40000000-0xafffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] percpu: Embedded 55 pages/cpu s185560 r8192 d31528 u2097152
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 257756
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: rootflags=rw mount.usrflags=ro BOOT_IMAGE=/flatcar/vmlinuz-a mount.usr=/dev/mapper/usr verity.usr=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132 rootflags=rw mount.usrflags=ro consoleblank=0 root=LABEL=ROOT console=ttyS0,115200n8 console=tty0 flatcar.first_boot=detected flatcar.oem.id=qemu flatcar.autologin verity.usrhash=024c6b1f19e8cc48facdff6229d8e32f3672ea3cf31076946696b3a6d3dbd8e7
[    0.000000] Unknown kernel command line parameters "BOOT_IMAGE=/flatcar/vmlinuz-a", will be passed to user space.
[    0.000000] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] Memory: 942852K/1048040K available (12294K kernel code, 2279K rwdata, 12980K rodata, 50204K init, 1404K bss, 104928K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] ftrace: allocating 34620 entries in 136 pages
[    0.000000] ftrace: allocated 136 pages with 2 groups
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.000000] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16
[    0.000000] random: crng init done
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] printk: console [tty0] enabled
[    0.000000] printk: console [ttyS0] enabled
[    0.000000] ACPI: Core revision 20210730
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.001000] APIC: Switch to symmetric I/O mode setup
[    0.006000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.014000] tsc: Unable to calibrate against PIT
[    0.015000] tsc: using HPET reference calibration
[    0.016000] tsc: Detected 1190.444 MHz processor
[    0.000008] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1128d87d5e7, max_idle_ns: 440795248349 ns
[    0.004986] Calibrating delay loop (skipped), value calculated using timer frequency.. 2380.88 BogoMIPS (lpj=1190444)
[    0.005987] pid_max: default: 32768 minimum: 301
[    0.007009] LSM: Security Framework initializing
[    0.007997] SELinux:  Initializing.
[    0.009021] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.009990] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.012749] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.012989] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.013991] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.014986] Spectre V2 : Mitigation: Retpolines
[    0.015985] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.016988] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[    0.017986] RETBleed: WARNING: Spectre v2 mitigation leaves CPU vulnerable to RETBleed attacks, data leaks possible!
[    0.018985] RETBleed: Vulnerable
[    0.019985] Speculative Store Bypass: Vulnerable
[    0.020994] MDS: Vulnerable: Clear CPU buffers attempted, no microcode
[    0.021985] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode
[    0.022987] SRBDS: Unknown: Dependent on hypervisor status
[    0.036582] Freeing SMP alternatives memory: 28K
[    0.116865] smpboot: CPU0: Intel 06/7e (family: 0x6, model: 0x7e, stepping: 0x5)
[    0.117121] Performance Events: unsupported p6 CPU model 126 no PMU driver, software events only.
[    0.118022] rcu: Hierarchical SRCU implementation.
[    0.120026] NMI watchdog: Perf NMI watchdog permanently disabled
[    0.121029] smp: Bringing up secondary CPUs ...
[    0.121986] smp: Brought up 1 node, 1 CPU
[    0.122986] smpboot: Max logical packages: 1
[    0.123987] smpboot: Total of 1 processors activated (2380.88 BogoMIPS)
[    0.125156] devtmpfs: initialized
[    0.126019] x86/mm: Memory block size: 128MB
[    0.127151] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.127988] futex hash table entries: 256 (order: 2, 16384 bytes, linear)
[    0.129034] pinctrl core: initialized pinctrl subsystem
[    0.131043] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.132078] audit: initializing netlink subsys (disabled)
[    0.133093] thermal_sys: Registered thermal governor 'step_wise'
[    0.133095] thermal_sys: Registered thermal governor 'user_space'
[    0.133994] cpuidle: using governor menu
[    0.136042] ACPI: bus type PCI registered
[    0.136985] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.138021] audit: type=2000 audit(1664715690.146:1): state=initialized audit_enabled=0 res=1
[    0.139072] dca service started, version 1.12.1
[    0.140101] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xb0000000-0xbfffffff] (base 0xb0000000)
[    0.140987] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    0.141996] PCI: Using configuration type 1 for base access
[    0.144088] Kprobes globally optimized
[    0.146012] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.146989] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.232337] ACPI: Added _OSI(Module Device)
[    0.232987] ACPI: Added _OSI(Processor Device)
[    0.233986] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.234991] ACPI: Added _OSI(Processor Aggregator Device)
[    0.236052] ACPI: Added _OSI(Linux-Dell-Video)
[    0.238043] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.238987] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.241396] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    0.243047] ACPI: Interpreter enabled
[    0.243993] ACPI: PM: (supports S0 S3 S5)
[    0.244991] ACPI: Using IOAPIC for interrupt routing
[    0.246013] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.247113] ACPI: Enabled 2 GPEs in block 00 to 3F
[    0.249664] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.249990] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.251040] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]
[    0.252036] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]
[    0.253427] PCI host bridge to bus 0000:00
[    0.253988] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.254986] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.255986] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.256985] pci_bus 0000:00: root bus resource [mem 0x40000000-0xafffffff window]
[    0.257985] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    0.258992] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]
[    0.259987] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.261096] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    0.263431] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000
[    0.264986] pci 0000:00:01.0: reg 0x10: [io  0xc0c0-0xc0df]
[    0.266744] pci 0000:00:01.0: reg 0x14: [mem 0xfebd0000-0xfebd0fff]
[    0.269491] pci 0000:00:01.0: reg 0x20: [mem 0xfe800000-0xfe803fff 64bit pref]
[    0.271454] pci 0000:00:01.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
[    0.273860] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00
[    0.275304] pci 0000:00:02.0: reg 0x10: [io  0xc0e0-0xc0ff]
[    0.278267] pci 0000:00:02.0: reg 0x20: [mem 0xfe804000-0xfe807fff 64bit pref]
[    0.281219] pci 0000:00:03.0: [1af4:1050] type 00 class 0x030000
[    0.282983] pci 0000:00:03.0: reg 0x10: [mem 0xfe000000-0xfe7fffff pref]
[    0.283986] pci 0000:00:03.0: reg 0x18: [mem 0xfe808000-0xfe80bfff 64bit pref]
[    0.285983] pci 0000:00:03.0: reg 0x20: [mem 0xfebd1000-0xfebd1fff]
[    0.286987] pci 0000:00:03.0: reg 0x30: [mem 0xfebc0000-0xfebcffff pref]
[    0.288072] pci 0000:00:03.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.290679] pci 0000:00:04.0: [1af4:1052] type 00 class 0x090000
[    0.292944] pci 0000:00:04.0: reg 0x14: [mem 0xfebd2000-0xfebd2fff]
[    0.294303] pci 0000:00:04.0: reg 0x20: [mem 0xfe80c000-0xfe80ffff 64bit pref]
[    0.297606] pci 0000:00:05.0: [1af4:1052] type 00 class 0x090200
[    0.299236] pci 0000:00:05.0: reg 0x14: [mem 0xfebd3000-0xfebd3fff]
[    0.301983] pci 0000:00:05.0: reg 0x20: [mem 0xfe810000-0xfe813fff 64bit pref]
[    0.303983] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000
[    0.304769] pci 0000:00:06.0: reg 0x10: [io  0xc000-0xc07f]
[    0.305571] pci 0000:00:06.0: reg 0x14: [mem 0xfebd4000-0xfebd4fff]
[    0.307465] pci 0000:00:06.0: reg 0x20: [mem 0xfe814000-0xfe817fff 64bit pref]
[    0.310022] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    0.311789] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    0.313099] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    0.316664] pci 0000:00:1f.2: reg 0x20: [io  0xc100-0xc11f]
[    0.317484] pci 0000:00:1f.2: reg 0x24: [mem 0xfebd5000-0xfebd5fff]
[    0.318983] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    0.320178] pci 0000:00:1f.3: reg 0x20: [io  0x0700-0x073f]
[    0.322350] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[    0.324084] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[    0.326035] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[    0.327083] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[    0.328148] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[    0.329089] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[    0.330090] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[    0.331181] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[    0.332049] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[    0.332997] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[    0.333997] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[    0.335988] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[    0.336997] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[    0.338002] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[    0.339004] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[    0.339999] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[    0.342168] iommu: Default domain type: Translated 
[    0.342985] iommu: DMA domain TLB invalidation policy: lazy mode 
[    0.345017] pci 0000:00:03.0: vgaarb: setting as boot VGA device
[    0.345983] pci 0000:00:03.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.345993] pci 0000:00:03.0: vgaarb: bridge control possible
[    0.347986] vgaarb: loaded
[    0.349069] pps_core: LinuxPPS API ver. 1 registered
[    0.349985] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[    0.351004] PTP clock support registered
[    0.352118] PCI: Using ACPI for IRQ routing
[    0.445917] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.445985] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.449025] clocksource: Switched to clocksource tsc-early
[    0.456377] VFS: Disk quotas dquot_6.6.0
[    0.458563] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.464634] pnp: PnP ACPI init
[    0.466577] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved
[    0.470730] pnp: PnP ACPI: found 5 devices
[    0.477857] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.482201] NET: Registered PF_INET protocol family
[    0.484418] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.488755] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[    0.493062] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.496752] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.500133] TCP bind hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    0.503357] TCP: Hash tables configured (established 8192 bind 8192)
[    0.506202] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.510723] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    0.514334] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.516999] NET: Registered PF_XDP protocol family
[    0.519424] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.522225] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.524955] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.528358] pci_bus 0000:00: resource 7 [mem 0x40000000-0xafffffff window]
[    0.531921] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    0.535272] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]
[    0.538705] PCI: CLS 0 bytes, default 64
[    0.547578] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer
[    0.581571] Initialise system trusted keyrings
[    0.583880] workingset: timestamp_bits=39 max_order=18 bucket_order=0
[    0.587622] xor: automatically using best checksumming function   avx       
[    0.600205] Key type asymmetric registered
[    0.602196] Asymmetric key parser 'x509' registered
[    0.604422] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    0.624003] io scheduler mq-deadline registered
[    0.626938] io scheduler kyber registered
[    0.628880] io scheduler bfq registered
[    0.639517] ioatdma: Intel(R) QuickData Technology Driver 5.00
[    0.648121] ACPI: \_SB_.GSIF: Enabled at IRQ 21
[    0.657146] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[    0.675832] ACPI: \_SB_.GSIH: Enabled at IRQ 23
[    0.685568] ACPI: \_SB_.GSIE: Enabled at IRQ 20
[    0.700877] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    0.711217] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.723293] wireguard: WireGuard 1.0.0 loaded. See www.wireguard.com for information.
[    0.726753] wireguard: Copyright (C) 2015-2019 Jason A. Donenfeld <[email protected]>. All Rights Reserved.
[    0.741796] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    0.756723] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.768367] serio: i8042 AUX port at 0x60,0x64 irq 12
[    0.775259] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    0.779858] rtc_cmos 00:03: RTC can wake from S4
[    0.783589] rtc_cmos 00:03: registered as rtc0
[    0.785930] rtc_cmos 00:03: setting system clock to 2022-10-02T13:01:32 UTC (1664715692)
[    0.809574] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    0.821876] fail to initialize ptp_kvm
[    0.821879] intel_pstate: CPU model not supported
[    0.831778] NET: Registered PF_INET6 protocol family
[    0.843117] Segment Routing with IPv6
[    0.844949] In-situ OAM (IOAM) with IPv6
[    0.848395] NET: Registered PF_PACKET protocol family
[    0.850830] Key type dns_resolver registered
[    0.855865] IPI shorthand broadcast: enabled
[    0.860890] sched_clock: Marking stable (873858953, -13016772)->(1238474487, -377632306)
[    0.874407] registered taskstats version 1
[    0.878179] Loading compiled-in X.509 certificates
[    1.030951] Loaded X.509 cert 'Kinvolk GmbH: Module signing key for 5.15.63-flatcar: 916d39678fb94e9237782dd8eba675c62693ce9c'
[    1.035841] Key type ._fscrypt registered
[    1.037657] Key type .fscrypt registered
[    1.039478] Key type fscrypt-provisioning registered
[    1.042939] ima: No TPM chip found, activating TPM-bypass!
[    1.046590] ima: Allocated hash algorithm: sha1
[    1.048728] ima: No architecture policies found
[    1.058686] Freeing unused kernel image (initmem) memory: 50204K
[    1.061595] Write protecting the kernel read-only data: 28672k
[    1.065673] Freeing unused kernel image (text/rodata gap) memory: 2040K
[    1.069053] Freeing unused kernel image (rodata/data gap) memory: 1356K
[    1.072162] Run /init as init process
[    1.080693] systemd[1]: systemd 250 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL -ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    1.095644] systemd[1]: Detected virtualization qemu.
[    1.098045] systemd[1]: Detected architecture x86-64.
[    1.100403] systemd[1]: Running in initial RAM disk.
[    1.105027] systemd[1]: No hostname configured, using default hostname.
[    1.109583] systemd[1]: Hostname set to <localhost>.
[    1.112050] systemd[1]: Initializing machine ID from random generator.
[    1.260281] systemd[1]: Queued start job for default target Initrd Default Target.
[    1.263942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    1.269436] systemd[1]: Reached target Local Encrypted Volumes.
[    1.275566] systemd[1]: Reached target Path Units.
[    1.279042] systemd[1]: Reached target Slice Units.
[    1.282547] systemd[1]: Reached target Swaps.
[    1.285554] systemd[1]: Reached target Timer Units.
[    1.288898] systemd[1]: Listening on Open-iSCSI iscsid Socket.
[    1.294262] systemd[1]: Listening on Open-iSCSI iscsiuio Socket.
[    1.298999] systemd[1]: Listening on Journal Audit Socket.
[    1.303146] systemd[1]: Listening on Journal Socket (/dev/log).
[    1.307915] systemd[1]: Listening on Journal Socket.
[    1.311531] systemd[1]: Listening on Network Service Netlink Socket.
[    1.316654] systemd[1]: Listening on udev Control Socket.
[    1.320770] systemd[1]: Listening on udev Kernel Socket.
[    1.325262] systemd[1]: Reached target Socket Units.
[    1.328845] systemd[1]: Afterburn Initrd Setup Network Kernel Arguments was skipped because all trigger condition checks failed.
[    1.335260] systemd[1]: Starting Create List of Static Device Nodes...
[    1.342688] systemd[1]: Finished Network Cleanup.
[    1.347042] systemd[1]: Starting Journal Service...
[    1.356655] systemd[1]: Starting Load Kernel Modules...
[    1.372090] systemd[1]: Starting Setup Virtual Console...
[    1.396510] systemd[1]: Finished Create List of Static Device Nodes.
[    1.433652] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.442867] Bridge firewalling registered
[    1.535067] audit: type=1130 audit(1664715693.247:2): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=kmod-static-nodes comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.545753] systemd[1]: Started Journal Service.
[    1.556792] tsc: Refined TSC clocksource calibration: 1190.471 MHz
[    1.556795] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1128f202a1f, max_idle_ns: 440795235686 ns
[    1.556808] clocksource: Switched to clocksource tsc
[    1.564516] audit: type=1130 audit(1664715693.265:3): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.564520] audit: type=1130 audit(1664715693.268:4): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-modules-load comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.587315] audit: type=1130 audit(1664715693.300:5): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-vconsole-setup comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.633513] audit: type=1130 audit(1664715693.345:6): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-sysctl comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.655458] audit: type=1130 audit(1664715693.355:7): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-tmpfiles-setup-dev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.655462] audit: type=1130 audit(1664715693.362:8): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline-ask comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.755583] SCSI subsystem initialized
[    1.765320] Loading iSCSI transport class v2.0-870.
[    1.777613] iscsi: registered transport (tcp)
[    1.803030] iscsi: registered transport (qla4xxx)
[    1.805224] QLogic iSCSI HBA Driver
[    1.819578] audit: type=1130 audit(1664715693.531:9): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-cmdline comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    1.851274] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    1.857019] device-mapper: uevent: version 1.0.3
[    1.859364] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: [email protected]
[    1.911142] raid6: avx512x4 gen() 48128 MB/s
[    1.931180] raid6: avx512x4 xor() 17712 MB/s
[    1.952612] raid6: avx512x2 gen() 38953 MB/s
[    1.972426] raid6: avx512x2 xor() 28661 MB/s
[    1.992132] raid6: avx512x1 gen() 41520 MB/s
[    2.012058] raid6: avx512x1 xor() 26300 MB/s
[    2.032835] raid6: avx2x4   gen() 37747 MB/s
[    2.054960] raid6: avx2x4   xor() 16828 MB/s
[    2.074437] raid6: avx2x2   gen() 34584 MB/s
[    2.094129] raid6: avx2x2   xor() 20346 MB/s
[    2.113544] raid6: avx2x1   gen() 30859 MB/s
[    2.134040] raid6: avx2x1   xor() 16890 MB/s
[    2.158128] raid6: sse2x4   gen()  9918 MB/s
[    2.177787] raid6: sse2x4   xor()  5381 MB/s
[    2.197415] raid6: sse2x2   gen()  9335 MB/s
[    2.217503] raid6: sse2x2   xor()  6648 MB/s
[    2.238074] raid6: sse2x1   gen()  9303 MB/s
[    2.257789] raid6: sse2x1   xor()  5747 MB/s
[    2.259916] raid6: using algorithm avx512x4 gen() 48128 MB/s
[    2.262588] raid6: .... xor() 17712 MB/s, rmw enabled
[    2.265699] raid6: using avx512x2 recovery algorithm
[    2.380592] Btrfs loaded, crc32c=crc32c-intel, zoned=no, fsverity=no
[    2.395285] audit: type=1130 audit(1664715694.107:10): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=dracut-pre-udev comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[    2.799993] virtio_blk virtio5: [vda] 17805312 512-byte logical blocks (9.12 GB/8.49 GiB)
[    2.818150] cryptd: max_cpu_qlen set to 1000
[    2.846110]  vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9
[    2.900427] AVX2 version of gcm_enc/dec engaged.
[    2.916352] AES CTR mode by8 optimization enabled
[    2.946941] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[    2.948466] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[    2.948469] ahci 0000:00:1f.2: flags: 64bit ncq only 
[    2.970271] scsi host0: ahci
[    2.977302] scsi host1: ahci
[    2.983247] scsi host2: ahci
[    2.991151] scsi host3: ahci
[    2.996395] scsi host4: ahci
[    3.003112] scsi host5: ahci
[    3.003257] ata1: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5100 irq 29
[    3.003269] ata2: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5180 irq 29
[    3.003281] ata3: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5200 irq 29
[    3.003293] ata4: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5280 irq 29
[    3.003305] ata5: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5300 irq 29
[    3.003317] ata6: SATA max UDMA/133 abar m4096@0xfebd5000 port 0xfebd5380 irq 29
[    3.008295] BTRFS: device label OEM devid 1 transid 12 /dev/vda6 scanned by systemd-udevd (354)
[    3.208434]  vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9
[    3.225140]  vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9
[    3.319779] ata4: SATA link down (SStatus 0 SControl 300)
[    3.325101] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    3.331133] ata2: SATA link down (SStatus 0 SControl 300)
[    3.337935] ata1: SATA link down (SStatus 0 SControl 300)
[    3.343112] ata6: SATA link down (SStatus 0 SControl 300)
[    3.348971] ata5: SATA link down (SStatus 0 SControl 300)
[    3.357962] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[    3.362858] ata3.00: applying bridge limits
[    3.385388] ata3.00: configured for UDMA/100
[    3.398965] scsi 2:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
[    3.463684] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    3.467275] cdrom: Uniform CD-ROM driver Revision: 3.20
[    3.860777] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[    4.234996]  vda: vda1 vda2 vda3 vda4 vda6 vda7 vda9
[    4.443244] BTRFS info (device vda6): using free space tree
[    4.447998] BTRFS info (device vda6): has skinny extents
[    4.660787] device-mapper: verity: sha256 using implementation "sha256-generic"
[    4.879252] EXT4-fs (vda9): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[    4.884140] ext4 filesystem being mounted at /sysroot supports timestamps until 2038 (0x7fffffff)
[    4.889914] EXT4-fs (dm-0): mounted filesystem without journal. Opts: (null). Quota mode: none.
[    5.359711] kauditd_printk_skb: 27 callbacks suppressed
[    5.359714] audit: type=1334 audit(1664715697.072:38): prog-id=11 op=LOAD
[    5.368529] audit: type=1334 audit(1664715697.078:39): prog-id=0 op=UNLOAD
[    5.381784] audit: type=1334 audit(1664715697.078:40): prog-id=12 op=LOAD
[    5.381832] audit: type=1334 audit(1664715697.079:41): prog-id=0 op=UNLOAD
[    5.381853] audit: type=1334 audit(1664715697.079:42): prog-id=13 op=LOAD
[    5.381872] audit: type=1334 audit(1664715697.079:43): prog-id=0 op=UNLOAD
[    5.381884] audit: type=1334 audit(1664715697.079:44): prog-id=14 op=LOAD
[    5.381898] audit: type=1334 audit(1664715697.079:45): prog-id=15 op=LOAD
[    5.381913] audit: type=1334 audit(1664715697.079:46): prog-id=0 op=UNLOAD
[    5.381927] audit: type=1334 audit(1664715697.079:47): prog-id=0 op=UNLOAD
[    5.829662] systemd-journald[174]: Received SIGTERM from PID 1 (n/a).
[    6.031791] SELinux:  Class mctp_socket not defined in policy.
[    6.034850] SELinux:  Class anon_inode not defined in policy.
[    6.038366] SELinux: the above unknown classes and permissions will be allowed
[    6.043972] SELinux:  policy capability network_peer_controls=1
[    6.046375] SELinux:  policy capability open_perms=1
[    6.048873] SELinux:  policy capability extended_socket_class=1
[    6.052363] SELinux:  policy capability always_check_network=0
[    6.056314] SELinux:  policy capability cgroup_seclabel=1
[    6.058948] SELinux:  policy capability nnp_nosuid_transition=1
[    6.061627] SELinux:  policy capability genfs_seclabel_symlinks=0
[    6.064331] SELinux:  policy capability ioctl_skip_cloexec=0
[    6.083900] systemd[1]: Successfully loaded SELinux policy in 68.836ms.
[    6.120162] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 6.399ms.
[    6.128320] systemd[1]: systemd 250 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL -ACL +BLKID +CURL -ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    6.142290] systemd[1]: Detected virtualization qemu.
[    6.144615] systemd[1]: Detected architecture x86-64.
[    6.147034] systemd[1]: Detected first boot.
[    6.157923] systemd[1]: Initializing machine ID from random generator.
[    9.941951] systemd[1]: Populated /etc with preset unit settings.
[   10.052111] systemd[1]: /run/systemd/system/docker.socket:8: ListenStream= references a path below legacy directory /var/run/, updating /var/run/docker.sock → /run/docker.sock; please update the unit file accordingly.
[   10.117394] systemd[1]: initrd-switch-root.service: Current command vanished from the unit file, execution of the command list won't be resumed.
[   10.140354] systemd[1]: initrd-switch-root.service: Deactivated successfully.
[   10.143655] systemd[1]: Stopped Switch Root.
[   10.148129] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
[   10.153114] systemd[1]: Created slice Slice /system/addon-config.
[   10.157611] systemd[1]: Created slice Slice /system/addon-run.
[   10.162433] systemd[1]: Created slice Slice /system/getty.
[   10.167179] systemd[1]: Created slice Slice /system/modprobe.
[   10.171554] systemd[1]: Created slice Slice /system/serial-getty.
[   10.176012] systemd[1]: Created slice Slice /system/system-cloudinit.
[   10.181661] systemd[1]: Created slice Slice /system/systemd-fsck.
[   10.186577] systemd[1]: Created slice User and Session Slice.
[   10.190737] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   10.196492] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   10.202416] systemd[1]: Set up automount Boot partition Automount Point.
[   10.207022] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   10.213278] systemd[1]: Stopped target Switch Root.
[   10.217202] systemd[1]: Stopped target Initrd File Systems.
[   10.220993] systemd[1]: Stopped target Initrd Root File System.
[   10.225008] systemd[1]: Reached target Local Integrity Protected Volumes.
[   10.230065] systemd[1]: Reached target Remote Encrypted Volumes.
[   10.235019] systemd[1]: Reached target Remote File Systems.
[   10.238773] systemd[1]: Reached target Slice Units.
[   10.242172] systemd[1]: Reached target Swaps.
[   10.246096] systemd[1]: Reached target Verify torcx succeeded.
[   10.250758] systemd[1]: Reached target Local Verity Protected Volumes.
[   10.257341] systemd[1]: Listening on Process Core Dump Socket.
[   10.261155] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   10.267414] systemd[1]: Listening on Network Service Netlink Socket.
[   10.272085] systemd[1]: Listening on udev Control Socket.
[   10.275828] systemd[1]: Listening on udev Kernel Socket.
[   10.280579] systemd[1]: Listening on User Database Manager Socket.
[   10.286537] systemd[1]: Mounting Huge Pages File System...
[   10.298544] systemd[1]: Mounting POSIX Message Queue File System...
[   10.309227] systemd[1]: Mounting External Media Directory...
[   10.316951] systemd[1]: /proc/xen was skipped because of a failed condition check (ConditionVirtualization=xen).
[   10.322398] systemd[1]: Mounting Kernel Debug File System...
[   10.330480] systemd[1]: Mounting Kernel Trace File System...
[   10.339551] systemd[1]: Mounting Temporary Directory /tmp...
[   10.347739] systemd[1]: Starting Create missing system files...
[   10.357357] systemd[1]: Ignition (delete config) was skipped because all trigger condition checks failed.
[   10.367148] systemd[1]: Starting Create List of Static Device Nodes...
[   10.376402] systemd[1]: Starting Load Kernel Module configfs...
[   10.386975] systemd[1]: Starting Load Kernel Module drm...
[   10.400021] systemd[1]: Starting Load Kernel Module fuse...
[   10.410631] systemd[1]: Create /etc/nsswitch.conf was skipped because of a failed condition check (ConditionPathExists=!/etc/nsswitch.conf).
[   10.423291] systemd[1]: systemd-fsck-root.service: Deactivated successfully.
[   10.426759] fuse: init (API version 7.34)
[   10.429047] systemd[1]: Stopped File System Check on Root Device.
[   10.434829] kauditd_printk_skb: 77 callbacks suppressed
[   10.434831] audit: type=1131 audit(1664715702.147:123): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck-root comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   10.447227] systemd[1]: systemd-fsck-usr.service: Deactivated successfully.
[   10.450845] systemd[1]: Stopped systemd-fsck-usr.service.
[   10.454750] systemd[1]: Stopped Journal Service.
[   10.456920] audit: type=1131 audit(1664715702.166:124): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-fsck-usr comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   10.469880] systemd[1]: Starting Journal Service...
[   10.480411] audit: type=1130 audit(1664715702.180:125): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   10.490937] audit: type=1131 audit(1664715702.180:126): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 msg='unit=systemd-journald comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
[   10.503680] systemd[1]: Starting Load Kernel Modules...
[   10.510390] audit: type=1334 audit(1664715702.181:127): prog-id=30 op=LOAD
[   10.520484] systemd[1]: Starting Generate network units from Kernel command line...
[   10.524329] audit: type=1334 audit(1664715702.181:128): prog-id=31 op=LOAD
[   10.533337] audit: type=1334 audit(1664715702.181:129): prog-id=32 op=LOAD
[   10.533341] audit: type=1334 audit(1664715702.181:130): prog-id=0 op=UNLOAD
[   10.533342] audit: type=1334 audit(1664715702.181:131): prog-id=0 op=UNLOAD
[   10.556593] systemd[1]: Starting Remount Root and Kernel File Systems...
[   10.572757] audit: type=1305 audit(1664715702.285:132): op=set audit_enabled=1 old=1 auid=4294967295 ses=4294967295 subj=system_u:system_r:kernel_t:s0 res=1
[   10.582929] systemd[1]: Repartition Root Disk was skipped because all trigger condition checks failed.
[   10.592064] systemd[1]: Starting Coldplug All udev Devices...
[   10.599897] systemd[1]: verity-setup.service: Deactivated successfully.
[   10.607380] systemd[1]: Stopped verity-setup.service.
[   10.619620] systemd[1]: Set fake PV driver version for XenServer was skipped because of a failed condition check (ConditionVirtualization=xen).
[   10.629942] systemd[1]: Started Journal Service.
[   10.767649] systemd-journald[787]: Received client request to flush runtime journal.
[   11.602652] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2
[   11.655702] ACPI: button: Power Button [PWRF]
[   11.717062] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:04.0/virtio3/input/input3
[   11.753962] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   11.772829] input: QEMU Virtio Mouse as /devices/pci0000:00/0000:00:05.0/virtio4/input/input4
[   11.791216] i2c i2c-0: 1/1 memory slots populated (from DMI)
[   11.794355] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[   11.818881] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input5
[   11.899605] mousedev: PS/2 mouse device common for all mice
[   12.186774] BTRFS info (device vda6): using free space tree
[   12.189383] BTRFS info (device vda6): has skinny extents



This is flatcar (Linux x86_64 5.15.63-flatcar) 13:01:46
SSH host key: SHA256:dqpvZgn6XyEZ3V6SzlS08dzUeUrFrbr7DawBeQP+zkk (ECDSA)
SSH host key: SHA256:exgl4rrkpVh52xP15qaLYMKMK8CwGV4S8iCmxrIhpQA (DSA)
SSH host key: SHA256:bZA8of9rXr9jnLMee+7L8YfRtQ5VL62QN/pNpQPKQnY (ED25519)
SSH host key: SHA256:KqcBUwpyeXNx2m6Q8Vlu8dtHypk9m8AS9VFGe8i9WlA (RSA)
eth0: 10.0.2.15 fe80::5055:55ff:fecd:fbc7

flatcar login: core (automatic login)


Last login: Sun Oct  2 13:01:46 UTC 2022 on tty1
[38;5;75mFlatcar Container Linux by Kinvolk[39m alpha 3346.0.0 for QEMU
[?2004hcore@flatcar ~ $ [   14.948426] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 55000ns
[   14.959234] clocksource: wd-tsc-wd read-back delay of 128000ns, clock-skew test skipped!
[   15.427023] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 57000ns
[   15.438100] clocksource: wd-tsc-wd read-back delay of 152000ns, clock-skew test skipped!
[   16.397304] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 54000ns
[   16.408883] clocksource: wd-tsc-wd read-back delay of 112000ns, clock-skew test skipped!
[   16.888523] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   16.900119] clocksource: wd-tsc-wd read-back delay of 179000ns, clock-skew test skipped!
[   17.864677] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 56000ns
[   17.876069] clocksource: wd-tsc-wd read-back delay of 140000ns, clock-skew test skipped!
[   18.843257] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 53000ns
[   18.855016] clocksource: wd-tsc-wd read-back delay of 141000ns, clock-skew test skipped!
[   19.327746] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 53000ns
[   19.340355] clocksource: wd-tsc-wd read-back delay of 132000ns, clock-skew test skipped!
[   19.822795] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 58000ns
[   19.835535] clocksource: wd-tsc-wd read-back delay of 161000ns, clock-skew test skipped!
[   21.295926] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   21.309344] clocksource: wd-tsc-wd read-back delay of 195000ns, clock-skew test skipped!
[   22.778305] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   22.791556] clocksource: wd-tsc-wd read-back delay of 161000ns, clock-skew test skipped!
[   24.759728] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 83000ns
[   24.770654] clocksource: wd-tsc-wd read-back delay of 150000ns, clock-skew test skipped!
[   25.248082] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   25.261224] clocksource: wd-tsc-wd read-back delay of 152000ns, clock-skew test skipped!
[   26.242413] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   26.254492] clocksource: wd-tsc-wd read-back delay of 184000ns, clock-skew test skipped!
[   26.740799] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 59000ns
[   26.753089] clocksource: wd-tsc-wd read-back delay of 209000ns, clock-skew test skipped!
[   28.227833] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 61000ns
[   28.241268] clocksource: wd-tsc-wd read-back delay of 165000ns, clock-skew test skipped!
[   29.222283] clocksource: timekeeping watchdog on CPU0: hpet wd-wd read-back delay of 109000ns
[   29.235176] clocksource: wd-tsc-wd read-back delay of 129000ns, clock-skew test skipped!

till avatar Oct 02 '22 13:10 till

@pothos If this is a mac related issue in qemu. Is there anything to follow?

till avatar Oct 06 '22 10:10 till

I think nobody reported this upstream yet. Would be good to do one manual check whether the fw cfg file is somehow accessible or not (path should be /sys/firmware/qemu_fw_cfg/by_name/opt/org.flatcar-linux/config/raw after modprobe qemu_fw_cfg).

pothos avatar Oct 06 '22 18:10 pothos

@pothos I used the command by @jmgilman

QEMU 2022-10-07 at 4 19 48 PM

No config?

Noticed my qemu is more recent than his:

❯ qemu-system-x86_64 --version
QEMU emulator version 7.1.0
Copyright (c) 2003-2022 Fabrice Bellard and the QEMU Project developers

till avatar Oct 07 '22 14:10 till

I compiled qemu and I think I was wrong, it is all there. I have to check tomorrow with the one I had installed. I just ran it with the alpha it seems to at least populate the authorized keys. I'll try stable again too tomorrow. Only realized now that by_name/opt/fqdn/etc is a symlink. 🤦🏼

till avatar Oct 07 '22 22:10 till

Deleted everything and tried again, with qemu 7.1.0 and an old ignition file (v2.3.0) it works. I couldn't get it to read it the other day but now everything in journal is a-ok. 👍🏼 But not sure why it wouldn't find anything the other day. Maybe I typo'd a path when I started the VM?

Also (unrelated), but half the time the VM dies or loops with a clocksource error. Not on the latest qemu though. When it loops it drops me into an emergency shell. But not sure how to capture more information. Couldn't put the file it generates anywhere. But I will probably open a new ticket rather if it keeps happening and this can be closed? :D

Thanks for the help @pothos!

core@repo-bug ~ $ sudo journalctl --identifier=ignition --all --no-pager
Oct 02 13:01:36 localhost ignition[489]: Ignition 2.14.0
Oct 02 13:01:36 localhost ignition[489]: Stage: fetch-offline
Oct 02 13:01:36 localhost ignition[489]: no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:36 localhost ignition[489]: no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:36 localhost ignition[489]: parsed url from cmdline: ""
Oct 02 13:01:36 localhost ignition[489]: no config URL provided
Oct 02 13:01:36 localhost ignition[489]: reading system config file "/usr/lib/ignition/user.ign"
Oct 02 13:01:36 localhost ignition[489]: no config at "/usr/lib/ignition/user.ign"
Oct 02 13:01:36 localhost ignition[489]: op(1): [started]  loading QEMU firmware config module
Oct 02 13:01:36 localhost ignition[489]: op(1): executing: "modprobe" "qemu_fw_cfg"
Oct 02 13:01:36 localhost ignition[489]: op(1): [finished] loading QEMU firmware config module
Oct 02 13:01:36 localhost ignition[489]: parsing config with SHA512: c9582905b1445bde038c892876ef162e386ca817a52ce438a9a8ee8d3c4f6cd9c7bb8ebb100ed52a3b20d39b62cf309d947c6020d2632f0310ca47c55b4f79d5
Oct 02 13:01:36 localhost ignition[489]: fetch-offline: fetch-offline passed
Oct 02 13:01:36 localhost ignition[489]: Ignition finished successfully
Oct 02 13:01:36 localhost ignition[495]: Ignition 2.14.0
Oct 02 13:01:36 localhost ignition[495]: Stage: kargs
Oct 02 13:01:36 localhost ignition[495]: no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:36 localhost ignition[495]: no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:36 localhost ignition[495]: kargs: kargs passed
Oct 02 13:01:36 localhost ignition[495]: Ignition finished successfully
Oct 02 13:01:36 localhost ignition[500]: Ignition 2.14.0
Oct 02 13:01:36 localhost ignition[500]: Stage: disks
Oct 02 13:01:36 localhost ignition[500]: no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:36 localhost ignition[500]: no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:36 localhost ignition[500]: disks: disks passed
Oct 02 13:01:36 localhost ignition[500]: Ignition finished successfully
Oct 02 13:01:36 localhost ignition[544]: INFO     : Ignition 2.14.0
Oct 02 13:01:36 localhost ignition[544]: INFO     : Stage: mount
Oct 02 13:01:36 localhost ignition[544]: INFO     : no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:36 localhost ignition[544]: INFO     : no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:36 localhost ignition[544]: INFO     : mount: mount passed
Oct 02 13:01:36 localhost ignition[544]: INFO     : Ignition finished successfully
Oct 02 13:01:36 localhost ignition[549]: INFO     : Ignition 2.14.0
Oct 02 13:01:36 localhost ignition[549]: INFO     : Stage: files
Oct 02 13:01:36 localhost ignition[549]: INFO     : no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:36 localhost ignition[549]: INFO     : no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:36 localhost ignition[549]: DEBUG    : files: compiled without relabeling support, skipping
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: ensureUsers: op(1): [started]  creating or modifying user "core"
Oct 02 13:01:36 localhost ignition[549]: DEBUG    : files: ensureUsers: op(1): executing: "usermod" "--root" "/sysroot" "core"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: ensureUsers: op(1): [finished] creating or modifying user "core"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: ensureUsers: op(2): [started]  adding ssh keys to user "core"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: ensureUsers: op(2): [finished] adding ssh keys to user "core"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(3): [started]  processing unit "sshd.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(3): [finished] processing unit "sshd.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(4): [started]  processing unit "sshd.socket"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(4): [finished] processing unit "sshd.socket"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(5): [started]  masking unit "sshd.socket"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(5): [finished] masking unit "sshd.socket"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(6): [started]  processing unit "systemd-journald.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(6): op(7): [started]  writing systemd drop-in "10-debug.conf" at "/sysroot/etc/systemd/system/systemd-journald.service.d/10-debug.conf"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(6): op(7): [finished] writing systemd drop-in "10-debug.conf" at "/sysroot/etc/systemd/system/systemd-journald.service.d/10-debug.conf"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(6): [finished] processing unit "systemd-journald.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(8): [started]  setting preset to enabled for "sshd.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: op(8): [finished] setting preset to enabled for "sshd.service"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: createResultFile: createFiles: op(9): [started]  writing file "/sysroot/etc/.ignition-result.json"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: createResultFile: createFiles: op(9): [finished] writing file "/sysroot/etc/.ignition-result.json"
Oct 02 13:01:36 localhost ignition[549]: INFO     : files: files passed
Oct 02 13:01:36 localhost ignition[549]: INFO     : Ignition finished successfully
Oct 02 13:01:37 localhost ignition[685]: INFO     : Ignition 2.14.0
Oct 02 13:01:37 localhost ignition[685]: INFO     : Stage: umount
Oct 02 13:01:37 localhost ignition[685]: INFO     : no configs at "/usr/lib/ignition/base.d"
Oct 02 13:01:37 localhost ignition[685]: INFO     : no config dir at "/usr/lib/ignition/base.platform.d/qemu"
Oct 02 13:01:37 localhost ignition[685]: INFO     : umount: umount passed
Oct 02 13:01:37 localhost ignition[685]: INFO     : Ignition finished successfully

I also tried butan (briefly), and it seems to work as well. All well enough to update our ignition config and test it, without doing it online.

till avatar Oct 08 '22 15:10 till

Also (unrelated), but half the time the VM dies or loops with a clocksource error. Not on the latest qemu though. When it loops it drops me into an emergency shell. But not sure how to capture more information. Couldn't put the file it generates anywhere. But I will probably open a new ticket rather if it keeps happening and this can be closed? :D

The error came back (even with the compiled qemu), albeit sporadic. Added kernel args tsc=reliable (in butane) which "fixed" it. From reading tickets on various projects, it seems Monterey related.

till avatar Oct 09 '22 18:10 till