src
src copied to clipboard
opnsense
Kernel crash: Fatal trap 12: page fault while in kernel mode due to Suricata/netmap
Important notices
Before you add a new report, we ask you kindly to acknowledge the following:
- [x] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
- [x] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue
Describe the bug
Kernel crash.
To Reproduce
I have no idea. I don't do anything special to be honest. OPNsense just keep crashing at random, this one was around 4am.
Expected behavior
No random kernel crashes.
Describe alternatives you considered
Move away from FreeBSD.
Relevant log files
dmesg.boot:
---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.1-RELEASE-p6 stable/24.7-n267939-fd5bc7f34e1 SMP amd64
FreeBSD clang version 18.1.5 (https://github.com/llvm/llvm-project.git llvmorg-18.1.5-0-g617a15a9eac9)
VT(vga): resolution 640x480
CPU: AMD EPYC 3201 8-Core Processor (1497.26-MHz K8-class CPU)
Origin="AuthenticAMD" Id=0x800f12 Family=0x17 Model=0x1 Stepping=2
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB>
SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
TSC: P-state invariant, performance statistics
real memory = 17179869184 (16384 MB)
avail memory = 16452407296 (15690 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INSYDE WALLABY>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 2 cache groups x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 128 != hw id 0
ioapic1: MADT APIC ID 129 != hw id 0
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 6 4 7 1 2 3 5
random: entropy device external interface
wlan: mac acl policy registered
kbd0 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0x793d2000-0x793d201e
smbios0: Version: 3.0, BCD Revision: 3.0
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <INSYDE WALLABY>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
apei0: <ACPI Platform Error Interface> on acpi0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.3 on pci0
pci1: <ACPI PCI bus> on pcib1
nvme0: <Generic NVMe Device> mem 0x80d00000-0x80d03fff at device 0.0 on pci1
pcib2: <ACPI PCI-PCI bridge> at device 1.4 on pci0
pci2: <ACPI PCI bus> on pcib2
igc0: <Intel(R) Ethernet Controller I226-V> mem 0x80b00000-0x80bfffff,0x80c00000-0x80c03fff at device 0.0 on pci2
igc0: EEPROM V2.25-0 eTrack 0x800003b1
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 4 RX queues 4 TX queues
igc0: Using MSI-X interrupts with 5 vectors
igc0: Ethernet address: f4:90:ea:01:2b:e0
igc0: netmap queues/slots: TX 4/1024, RX 4/1024
pcib3: <ACPI PCI-PCI bridge> at device 1.5 on pci0
pci3: <ACPI PCI bus> on pcib3
igc1: <Intel(R) Ethernet Controller I226-V> mem 0x80900000-0x809fffff,0x80a00000-0x80a03fff at device 0.0 on pci3
igc1: EEPROM V2.25-0 eTrack 0x800003b1
igc1: Using 1024 TX descriptors and 1024 RX descriptors
igc1: Using 4 RX queues 4 TX queues
igc1: Using MSI-X interrupts with 5 vectors
igc1: Ethernet address: f4:90:ea:01:2b:e1
igc1: netmap queues/slots: TX 4/1024, RX 4/1024
pcib4: <ACPI PCI-PCI bridge> at device 1.6 on pci0
pci4: <ACPI PCI bus> on pcib4
igc2: <Intel(R) Ethernet Controller I226-V> mem 0x80700000-0x807fffff,0x80800000-0x80803fff at device 0.0 on pci4
igc2: EEPROM V2.25-0 eTrack 0x800003b1
igc2: Using 1024 TX descriptors and 1024 RX descriptors
igc2: Using 4 RX queues 4 TX queues
igc2: Using MSI-X interrupts with 5 vectors
igc2: Ethernet address: f4:90:ea:01:2b:e2
igc2: netmap queues/slots: TX 4/1024, RX 4/1024
pcib5: <ACPI PCI-PCI bridge> at device 1.7 on pci0
pci5: <ACPI PCI bus> on pcib5
igc3: <Intel(R) Ethernet Controller I226-V> mem 0x80500000-0x805fffff,0x80600000-0x80603fff at device 0.0 on pci5
igc3: EEPROM V2.25-0 eTrack 0x800003b1
igc3: Using 1024 TX descriptors and 1024 RX descriptors
igc3: Using 4 RX queues 4 TX queues
igc3: Using MSI-X interrupts with 5 vectors
igc3: Ethernet address: f4:90:ea:01:2b:e3
igc3: netmap queues/slots: TX 4/1024, RX 4/1024
pcib6: <ACPI PCI-PCI bridge> at device 7.1 on pci0
pci6: <ACPI PCI bus> on pcib6
pci6: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci0: <XHCI (generic) USB 3.0 controller> mem 0x80200000-0x802fffff at device 0.3 on pci6
xhci0: 64 bytes context size, 64-bit DMA
usbus0: waiting for BIOS to give up control
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib7: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <encrypt/decrypt> at device 0.1 (no driver attached)
ax0: <AMD 10 Gigabit Ethernet Driver> mem 0x80160000-0x8017ffff,0x80140000-0x8015ffff,0x80180000-0x80181fff at device 0.4 on pci7
ax0: Using 512 TX descriptors and 512 RX descriptors
ax0: Using 8 RX queues 8 TX queues
ax0: Using MSI-X interrupts with 12 vectors
ax0: Ethernet address: f4:90:ea:01:2b:e4
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Enabled
ax0: VLAN filtering Enabled
ax0: VLAN Stripping Enabled
ax0: Checking GPIO expander validity
ax0: GPIO configuration valid
ax0: xgbe_phy_sfp_signals: port_sfp_inputs: 0x4
ax0: SFP detected:
ax0: vendor: Zaram
ax0: part number: ZXOS11NPI
ax0: revision level: 1B
ax0: serial number: ZRMT23060637
ax0: netmap queues/slots: TX 8/512, RX 8/512
ax1: <AMD 10 Gigabit Ethernet Driver> mem 0x80120000-0x8013ffff,0x80100000-0x8011ffff,0x80182000-0x80183fff at device 0.5 on pci7
ax1: Using 512 TX descriptors and 512 RX descriptors
ax1: Using 8 RX queues 8 TX queues
ax1: Using MSI-X interrupts with 12 vectors
ax1: Ethernet address: f4:90:ea:01:2b:e5
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Enabled
ax1: VLAN filtering Enabled
ax1: VLAN Stripping Enabled
ax1: Checking GPIO expander validity
ax1: GPIO configuration valid
ax1: SFP detected:
ax1: vendor: FS
ax1: part number: SFPP-PC005
ax1: revision level: A
ax1: serial number: G2340637796-2
ax1: netmap queues/slots: TX 8/512, RX 8/512
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
uart2: <16x50 with 256 byte FIFO> iomem 0xfedc9000-0xfedc9fff,0xfedc7000-0xfedc7fff irq 3 on acpi0
ns8250: UART FCR is broken
uart2: console (115384,n,8,1)
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC" frequency 1497186964 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <AMD XHCI root HUB> at usbus0
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ax1: Link is UP - 10Gbps/Full - flow control off
ax1: link state changed to UP
ax0: Link is UP - 10Gbps/Full - flow control off
ax0: link state changed to UP
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
nda0 at nvme0 bus 0 scbus0 target 0 lun 1
nda0: <TS256GMTE712A 82B2W2AA I689870120>
nda0: Serial Number I689870120
nda0: nvme version 1.4
nda0: 244198MB (500118192 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 8 ports with 8 removable, self powered
pid 30 (zpool) is attempting to use unsafe AIO requests - not logging anymore
/var/crash/info.0:
Dump header from device: /dev/gpt/swapfs
Architecture: amd64
Architecture Version: 4
Dump Length: 155648
Blocksize: 512
Compression: none
Dumptime: 2025-01-27 04:05:57 +0100
Hostname: OPNsense.home
Magic: FreeBSD Text Dump
Version String: FreeBSD 14.1-RELEASE-p6 stable/24.7-n267939-fd5bc7f34e1 SMP
Panic String: page fault
Dump Parity: 1435364609
Bounds: 0
Dump Status: good
/var/crash/textdump.tar.0:
ddb.txt06000014000014745574025 7107 ustarrootwheeldb:0:kdb.enter.default> run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo> show alllocks
No such command; use "help" to list available commands
db:1:lockinfo> show lockedvnods
Locked vnodes
db:0:kdb.enter.default> show pcpu
cpuid = 0
dynamic pcpu = 0x12fc080
curthread = 0xfffff80001959740: pid 11 tid 100003 critnest 3 "idle: cpu0"
curpcb = 0xfffff80001959c60
fpcurthread = none
idlethread = 0xfffff80001959740: tid 100003 "idle: cpu0"
self = 0xffffffff82e10000
curpmap = 0xffffffff81b81670
tssp = 0xffffffff82e10384
rsp0 = 0xfffffe001d71b000
kcr3 = 0xffffffffffffffff
ucr3 = 0xffffffffffffffff
scr3 = 0x0
gs32p = 0xffffffff82e10404
ldt = 0xffffffff82e10444
tss = 0xffffffff82e10434
curvnet = 0
db:0:kdb.enter.default> bt
Tracing pid 11 tid 100003 td 0xfffff80001959740
kdb_enter() at kdb_enter+0x33/frame 0xfffffe001d71a8c0
panic() at panic+0x43/frame 0xfffffe001d71a920
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe001d71a980
trap_pfault() at trap_pfault+0x46/frame 0xfffffe001d71a9d0
calltrap() at calltrap+0x8/frame 0xfffffe001d71a9d0
--- trap 0xc, rip = 0xffffffff80c13be7, rsp = 0xfffffe001d71aaa0, rbp = 0xfffffe001d71aac0 ---
sleepq_remove_thread() at sleepq_remove_thread+0x67/frame 0xfffffe001d71aac0
sleepq_resume_thread() at sleepq_resume_thread+0x45/frame 0xfffffe001d71ab00
sleepq_timeout() at sleepq_timeout+0x94/frame 0xfffffe001d71ab20
softclock_call_cc() at softclock_call_cc+0x12c/frame 0xfffffe001d71abd0
callout_process() at callout_process+0x1e7/frame 0xfffffe001d71ac40
handleevents() at handleevents+0x180/frame 0xfffffe001d71ac80
timercb() at timercb+0x24c/frame 0xfffffe001d71acd0
lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe001d71acf0
Xtimerint() at Xtimerint+0xb1/frame 0xfffffe001d71acf0
--- interrupt, rip = 0xffffffff81065b02, rsp = 0xfffffe001d71adc0, rbp = 0xfffffe001d71add0 ---
cpu_idle_hlt() at cpu_idle_hlt+0x32/frame 0xfffffe001d71add0
cpu_idle() at cpu_idle+0x9d/frame 0xfffffe001d71adf0
sched_idletd() at sched_idletd+0x576/frame 0xfffffe001d71aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d71af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d71af30
--- trap 0x93d3a881, rip = 0x1b94a12917d4a12d, rsp = 0xbca33a65b0e33a61, rbp = 0x9c164b0cdc164f ---
db:0:kdb.enter.default> ps
pid ppid pgrp uid state wmesg wchan cmd
8190 6512 6512 0 S accept 0xfffff8003b4821d0 php-cgi
98723 1 98723 0 Ss (threaded) suricata
101832 S nanslp 0xffffffff81bc48e0 suricata
302928 S select 0xfffff803015a6bc0 W#01-ax1
302963 S select 0xfffff802d5149840 W#02-ax1
302964 S select 0xfffff802dc7f5d40 W#03-ax1
302965 S select 0xfffff8042d073dc0 W#04-ax1
302966 S select 0xfffff800142e75c0 W#05-ax1
302967 S select 0xfffff8023a1e6540 W#06-ax1
302968 S select 0xfffff803011201c0 W#07-ax1
302969 S select 0xfffff803e633cc40 W#08-ax1
[....]
<7>cannot forward src fe80:6::fccd:ef81:dd7b:6ece, dst 2620:2d:4002:1::196, nxt 6, rcvif ax1, outif pppoe0
kernel trap 12 with interrupts disabled
Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address = 0xd00028
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80c13be7
stack pointer = 0x28:0xfffffe001d71aaa0
frame pointer = 0x28:0xfffffe001d71aac0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = resume, IOPL = 0
current process = 11 (idle: cpu0)
rdi: fffff80001e58380 rsi: fffff80001e28000 rdx: 0000000000000000
rcx: 0000000000000000 r8: fffff80001e28478 r9: 000000009bafc01b
rax: 0000000000d00000 rbx: fffff80001e28000 rbp: fffffe001d71aac0
r10: 00000000000007d0 r11: 0000000000002710 r12: fffff80001e58380
r13: 00000000819c9958 r14: 00000000819c9958 r15: 0000000000000000
trap number = 12
panic: page fault
cpuid = 0
time = 1737947157
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe001d71a790
vpanic() at vpanic+0x131/frame 0xfffffe001d71a8c0
panic() at panic+0x43/frame 0xfffffe001d71a920
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe001d71a980
trap_pfault() at trap_pfault+0x46/frame 0xfffffe001d71a9d0
calltrap() at calltrap+0x8/frame 0xfffffe001d71a9d0
--- trap 0xc, rip = 0xffffffff80c13be7, rsp = 0xfffffe001d71aaa0, rbp = 0xfffffe001d71aac0 ---
sleepq_remove_thread() at sleepq_remove_thread+0x67/frame 0xfffffe001d71aac0
sleepq_resume_thread() at sleepq_resume_thread+0x45/frame 0xfffffe001d71ab00
sleepq_timeout() at sleepq_timeout+0x94/frame 0xfffffe001d71ab20
softclock_call_cc() at softclock_call_cc+0x12c/frame 0xfffffe001d71abd0
callout_process() at callout_process+0x1e7/frame 0xfffffe001d71ac40
handleevents() at handleevents+0x180/frame 0xfffffe001d71ac80
timercb() at timercb+0x24c/frame 0xfffffe001d71acd0
lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe001d71acf0
Xtimerint() at Xtimerint+0xb1/frame 0xfffffe001d71acf0
--- interrupt, rip = 0xffffffff81065b02, rsp = 0xfffffe001d71adc0, rbp = 0xfffffe001d71add0 ---
cpu_idle_hlt() at cpu_idle_hlt+0x32/frame 0xfffffe001d71add0
cpu_idle() at cpu_idle+0x9d/frame 0xfffffe001d71adf0
sched_idletd() at sched_idletd+0x576/frame 0xfffffe001d71aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d71af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d71af30
--- trap 0x93d3a881, rip = 0x1b94a12917d4a12d, rsp = 0xbca33a65b0e33a61, rbp = 0x9c164b0cdc164f ---
KDB: enter: panic
panic.txt0600001214745574025 7146 ustarrootwheelpage faultversion.txt0600007414745574025 7551 ustarrootwheelFreeBSD 14.1-RELEASE-p6 stable/24.7-n267939-fd5bc7f34e1 SMP
Environment
OPNsense 24.10.1-amd64 Official Deciso DEC3852 hardware
If your crashes are rather random (which at a first glance is the case), there are a couple of things to look at:
- check memory using memtest (efi payload can be downloaded from https://www.memtest86.com/download.htm)
- check machine grounding, there's a ground pin at the back of the machine, floating power rails can cause hard to find issues
- try a clean install to rule out file system issues
These are good starting points, thank you Ad.
- I will do a memtest
- Machine is already grounded to earth fully. Grounded to PDU. Zie hier hoe
- I will do a reinstall if memtest is showing no errors
EDIT: Here is the system health check results:
***GOT REQUEST TO AUDIT HEALTH***
Currently running OPNsense 24.10.1 (amd64) at Tue Jan 28 20:56:01 CET 2025
Strict TLS 1.3 and CRL checking is enabled.
>>> Root file system: zroot/ROOT/default
>>> Check installed kernel version
Version 24.7.8 is correct.
>>> Check for missing or altered kernel files
No problems detected.
>>> Check installed base version
Version 24.7.8 is correct.
>>> Check for missing or altered base files
No problems detected.
>>> Check installed repositories
OPNsense (Priority: 11)
>>> Check installed plugins
os-OPNBEcore 1.4_3
os-iperf 1.0_2
>>> Check locked packages
No locks found.
>>> Check for missing package dependencies
Checking all packages: .......... done
>>> Check for missing or altered package files
Checking all packages: .......... done
>>> Check for core packages consistency
Core package "opnsense-business" at 24.10.1 has 70 dependencies to check.
Checking packages: ....................................................................... done
***DONE***
For some reason I do not have any crashes anymore for weeks now.
While I didn't change anything. That makes me really wonder what was going on.
We operate two DEC2752 in the carp high availability cluster in our data center. We have just experienced a few minutes of increased packet loss and then noticed the crash on the active firewall. The crash dump is almost identical to the first case here.
A memory test and a grounding check are still pending.
/var/crash/textdump.tar.0:
...
Fatal trap 12: page fault while in kernel mode
cpuid = 3; apic id = 03
fault virtual address = 0xffffff800e640160
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff810951cf
stack pointer = 0x28:0xfffffe00835f6a70
frame pointer = 0x28:0xfffffe00835f6af0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 9 (dom0)
rdi: ffffffff81807940 rsi: fffffe00835f6b74 rdx: fffffe000d040f98
rcx: ffffff800e640160 r8: 0000000005010009 r9: 0000000000000501
rax: ffffff800e640160 rbx: ffffffff81c1b250 rbp: fffffe00835f6af0
r10: fffff800020a7000 r11: fffff80000000000 r12: 0000000000000000
r13: 0000000000000000 r14: 0000000000000003 r15: fffffe000d040f98
trap number = 12
panic: page fault
cpuid = 3
time = 1741342350
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00835f6760
vpanic() at vpanic+0x131/frame 0xfffffe00835f6890
panic() at panic+0x43/frame 0xfffffe00835f68f0
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe00835f6950
trap_pfault() at trap_pfault+0x46/frame 0xfffffe00835f69a0
calltrap() at calltrap+0x8/frame 0xfffffe00835f69a0
--- trap 0xc, rip = 0xffffffff810951cf, rsp = 0xfffffe00835f6a70, rbp = 0xfffffe00835f6af0 ---
pmap_ts_referenced() at pmap_ts_referenced+0x9f/frame 0xfffffe00835f6af0
vm_pageout_worker() at vm_pageout_worker+0xb4b/frame 0xfffffe00835f6eb0
vm_pageout() at vm_pageout+0x1d7/frame 0xfffffe00835f6ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe00835f6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00835f6f30
--- trap 0x25900298, rip = 0xadd70b30a1970b34, rsp = 0xae0907c06a09078, rbp = 0xb6dfbc52ba9fbc56 ---
KDB: enter: panic
panic.txt0600001214762543216 7143 ustarrootwheelpage faultversion.txt0600007414762543216 7546 ustarrootwheelFreeBSD 14.1-RELEASE-p6 stable/24.7-n267939-fd5bc7f34e1 SMP
Environment OPNsense 24.10.1 82f48e0d5 FreeBSD 14.1-RELEASE-p6 stable/24.7-n267939-fd5bc7f34e1 SMP amd64 Official Deciso DEC2752 hardware
The panics are not related, but we are investigating a pf table corruption regarding supervisor read data, page not present. Do you get more random panics like this one?
@melroy89 are you still getting these crashes? if so have you tried https://github.com/opnsense/core/commit/69bc5229e0 yet?
I use to had 4 kernel crashes after each other. Now, I do not get any crashes anymore for a couple of weeks. While again, I didn't change anything, I didn't change the hardware or software.
I tried to sent all info I had and reports to you guys. So to be honest, I still have no idea what the root is/was.
I'm currently on 24.10.2 (on type: Business). Which is the latest Business release. I'm happy to test whenever you have a new business release coming. 25.4?
Last night, around 1AM last night I again suddenly had a page fault / kernel crash.
After months of running stable, i just crashed (page fault). Running OPNsense Business v25.4.
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:128.0) Gecko/20100101 Firefox/128.0
FreeBSD 14.2-RELEASE-p2 stable/25.4-n269702-2a564b0b6525 SMP amd64
OPNsense 25.4 bf44a6801
Plugins os-OPNBEcore-1.5_1 os-iperf-1.0_2
Time Wed, 21 May 2025 14:09:57 +0200
OpenSSL 3.0.16
Python 3.11.11
PHP 8.3.19
---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.2-RELEASE-p2 stable/25.4-n269702-2a564b0b6525 SMP amd64
FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)
VT(vga): resolution 640x480
CPU: AMD EPYC 3201 8-Core Processor (1497.26-MHz K8-class CPU)
Origin="AuthenticAMD" Id=0x800f12 Family=0x17 Model=0x1 Stepping=2
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB>
SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
TSC: P-state invariant, performance statistics
real memory = 17179869184 (16384 MB)
avail memory = 16452411392 (15690 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INSYDE WALLABY>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 2 cache groups x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 128 != hw id 0
ioapic1: MADT APIC ID 129 != hw id 0
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 6 5 3 7 1 4 2
random: entropy device external interface
wlan: mac acl policy registered
kbd0 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0x793d2000-0x793d201e
smbios0: Version: 3.0, BCD Revision: 3.0
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <INSYDE WALLABY>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
apei0: <ACPI Platform Error Interface> on acpi0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.3 on pci0
pci1: <ACPI PCI bus> on pcib1
nvme0: <Generic NVMe Device> mem 0x80d00000-0x80d03fff at device 0.0 on pci1
pcib2: <ACPI PCI-PCI bridge> at device 1.4 on pci0
pci2: <ACPI PCI bus> on pcib2
igc0: <Intel(R) Ethernet Controller I226-V> mem 0x80b00000-0x80bfffff,0x80c00000-0x80c03fff at device 0.0 on pci2
igc0: EEPROM V2.25-0 eTrack 0x800003b1
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 4 RX queues 4 TX queues
igc0: Using MSI-X interrupts with 5 vectors
igc0: Ethernet address: f4:90:ea:01:2b:e0
igc0: netmap queues/slots: TX 4/1024, RX 4/1024
pcib3: <ACPI PCI-PCI bridge> at device 1.5 on pci0
pci3: <ACPI PCI bus> on pcib3
igc1: <Intel(R) Ethernet Controller I226-V> mem 0x80900000-0x809fffff,0x80a00000-0x80a03fff at device 0.0 on pci3
igc1: EEPROM V2.25-0 eTrack 0x800003b1
igc1: Using 1024 TX descriptors and 1024 RX descriptors
igc1: Using 4 RX queues 4 TX queues
igc1: Using MSI-X interrupts with 5 vectors
igc1: Ethernet address: f4:90:ea:01:2b:e1
igc1: netmap queues/slots: TX 4/1024, RX 4/1024
pcib4: <ACPI PCI-PCI bridge> at device 1.6 on pci0
pci4: <ACPI PCI bus> on pcib4
igc2: <Intel(R) Ethernet Controller I226-V> mem 0x80700000-0x807fffff,0x80800000-0x80803fff at device 0.0 on pci4
igc2: EEPROM V2.25-0 eTrack 0x800003b1
igc2: Using 1024 TX descriptors and 1024 RX descriptors
igc2: Using 4 RX queues 4 TX queues
igc2: Using MSI-X interrupts with 5 vectors
igc2: Ethernet address: f4:90:ea:01:2b:e2
igc2: netmap queues/slots: TX 4/1024, RX 4/1024
pcib5: <ACPI PCI-PCI bridge> at device 1.7 on pci0
pci5: <ACPI PCI bus> on pcib5
igc3: <Intel(R) Ethernet Controller I226-V> mem 0x80500000-0x805fffff,0x80600000-0x80603fff at device 0.0 on pci5
igc3: EEPROM V2.25-0 eTrack 0x800003b1
igc3: Using 1024 TX descriptors and 1024 RX descriptors
igc3: Using 4 RX queues 4 TX queues
igc3: Using MSI-X interrupts with 5 vectors
igc3: Ethernet address: f4:90:ea:01:2b:e3
igc3: netmap queues/slots: TX 4/1024, RX 4/1024
pcib6: <ACPI PCI-PCI bridge> at device 7.1 on pci0
pci6: <ACPI PCI bus> on pcib6
pci6: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci0: <XHCI (generic) USB 3.0 controller> mem 0x80200000-0x802fffff at device 0.3 on pci6
xhci0: 64 bytes context size, 64-bit DMA
usbus0: waiting for BIOS to give up control
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib7: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <encrypt/decrypt> at device 0.1 (no driver attached)
ax0: <AMD 10 Gigabit Ethernet Driver> mem 0x80160000-0x8017ffff,0x80140000-0x8015ffff,0x80180000-0x80181fff at device 0.4 on pci7
ax0: Using 512 TX descriptors and 512 RX descriptors
ax0: Using 8 RX queues 8 TX queues
ax0: Using MSI-X interrupts with 12 vectors
ax0: Ethernet address: f4:90:ea:01:2b:e4
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Enabled
ax0: VLAN filtering Enabled
ax0: VLAN Stripping Enabled
ax0: Checking GPIO expander validity
ax0: GPIO configuration valid
ax0: xgbe_phy_sfp_signals: port_sfp_inputs: 0x4
ax0: SFP detected:
ax0: vendor: Zaram
ax0: part number: ZXOS11NPI
ax0: revision level: 1B
ax0: serial number: ZRMT23060637
ax0: netmap queues/slots: TX 8/512, RX 8/512
ax1: <AMD 10 Gigabit Ethernet Driver> mem 0x80120000-0x8013ffff,0x80100000-0x8011ffff,0x80182000-0x80183fff at device 0.5 on pci7
ax1: Using 512 TX descriptors and 512 RX descriptors
ax1: Using 8 RX queues 8 TX queues
ax1: Using MSI-X interrupts with 12 vectors
ax1: Ethernet address: f4:90:ea:01:2b:e5
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Enabled
ax1: VLAN filtering Enabled
ax1: VLAN Stripping Enabled
ax1: Checking GPIO expander validity
ax1: GPIO configuration valid
ax1: SFP detected:
ax1: vendor: FS
ax1: part number: SFPP-PC005
ax1: revision level: A
ax1: serial number: G2340637796-2
ax1: netmap queues/slots: TX 8/512, RX 8/512
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
uart2: <16x50 with 256 byte FIFO> iomem 0xfedc9000-0xfedc9fff,0xfedc7000-0xfedc7fff irq 3 on acpi0
ns8250: UART FCR is broken
uart2: console (115384,n,8,1)
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC" frequency 1497187121 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <AMD XHCI root HUB> at usbus0
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ax1: Link is UP - 10Gbps/Full - flow control off
ax1: link state changed to UP
ax0: Link is UP - 10Gbps/Full - flow control off
ax0: link state changed to UP
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
nda0 at nvme0 bus 0 scbus0 target 0 lun 1
nda0: <TS256GMTE712A 82B2W2AA I689870120>
nda0: Serial Number I689870120
nda0: nvme version 1.4
nda0: 244198MB (500118192 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 8 ports with 8 removable, self powered
pid 30 (zpool) is attempting to use unsafe AIO requests - not logging anymore
/var/crash/info.0:
Dump header from device: /dev/gpt/swapfs
Architecture: amd64
Architecture Version: 4
Dump Length: 120832
Blocksize: 512
Compression: none
Dumptime: 2025-05-21 00:44:13 +0200
Hostname: OPNsense.home
Magic: FreeBSD Text Dump
Version String: FreeBSD 14.2-RELEASE-p2 stable/25.4-n269702-2a564b0b6525 SMP
Panic String: page fault
Dump Parity: 3123989369
Bounds: 0
Dump Status: good
/var/crash/textdump.tar.0:
ddb.txt06000014000015013202675 7073 ustarrootwheeldb:0:kdb.enter.default> run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo> show alllocks
No such command; use "help" to list available commands
db:1:lockinfo> show lockedvnods
Locked vnodes
db:0:kdb.enter.default> show pcpu
cpuid = 3
dynamic pcpu = 0xfffffe009e9e2300
curthread = 0xfffff80295275000: pid 47832 tid 101573 critnest 1 "W#02-ax1^"
curpcb = 0xfffff80295275520
fpcurthread = 0xfffff80295275000: pid 47832 "W#02-ax1^"
idlethread = 0xfffff80001927000: tid 100006 "idle: cpu3"
self = 0xffffffff82e13000
curpmap = 0xfffff801085ccd38
tssp = 0xffffffff82e13384
rsp0 = 0xfffffe01197f8000
kcr3 = 0xffffffffffffffff
ucr3 = 0xffffffffffffffff
scr3 = 0x0
gs32p = 0xffffffff82e13404
ldt = 0xffffffff82e13444
tss = 0xffffffff82e13434
curvnet = 0
db:0:kdb.enter.default> bt
Tracing pid 47832 tid 101573 td 0xfffff80295275000
kdb_enter() at kdb_enter+0x33/frame 0xfffffe01197f7960
panic() at panic+0x43/frame 0xfffffe01197f79c0
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe01197f7a20
trap_pfault() at trap_pfault+0x46/frame 0xfffffe01197f7a70
calltrap() at calltrap+0x8/frame 0xfffffe01197f7a70
--- trap 0xc, rip = 0xffffffff80c1ca00, rsp = 0xfffffe01197f7b40, rbp = 0xfffffe01197f7b70 ---
sleepq_add() at sleepq_add+0x50/frame 0xfffffe01197f7b70
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0xb6/frame 0xfffffe01197f7bd0
seltdwait() at seltdwait+0x72/frame 0xfffffe01197f7c00
kern_poll_kfds() at kern_poll_kfds+0x4a7/frame 0xfffffe01197f7c90
kern_poll() at kern_poll+0x9d/frame 0xfffffe01197f7de0
sys_poll() at sys_poll+0x50/frame 0xfffffe01197f7e00
amd64_syscall() at amd64_syscall+0x10e/frame 0xfffffe01197f7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01197f7f30
--- syscall (209, FreeBSD ELF64, poll), rip = 0x82a9fd4da, rsp = 0x84711ae48, rbp = 0x84711ae70 ---
db:0:kdb.enter.default> ps
pid ppid pgrp uid state wmesg wchan cmd
2969 77839 77447 0 S nanslp 0xffffffff81bc47e7 sleep
87071 30123 253 0 S nanslp 0xffffffff81bc47e5 sleep
30123 28590 253 0 S wait 0xfffffe011b4abac0 sh
28590 255 253 0 S wait 0xfffffe011a629000 sh
11031 1 7250 0 S select 0xfffff803e998f240 tail
9952 7250 7250 0 S pipewr 0xfffffe01189535c0 tail
7250 255 7250 0 Ss pipewr 0xfffffe01189589e0 python3.11
55955 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
14360 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
74494 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
55897 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
50420 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
31995 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
55334 44268 44268 0 S (threaded) php-cgi
100356 S accept 0xfffff8011aa9f210 php-cgi
37356 1 37356 0 Ss bpf 0xfffff8037888ec00 filterlog
73994 1 73994 0 Ss (threaded) ntpd
100461 S select 0xfffff8022df3dd40 ntpd
55907 55899 55899 0 S (threaded) python3.11
101083 S kqread 0xfffff80223f0fe00 python3.11
101367 S uwait 0xfffff801b0b0e980 python3.11
101368 S uwait 0xfffff801b0c54780 python3.11
101369 S uwait 0xfffff801c9395780 python3.11
101370 S uwait 0xfffff801b0787a80 python3.11
101371 S uwait 0xfffff801b0787900 python3.11
101372 S uwait 0xfffff801b0c54700 python3.11
101373 S uwait 0xfffff801e3e56880 python3.11
101374 S uwait 0xfffff8023990d100 python3.11
55899 1 55899 0 Ss kqread 0xfffff80248fba300 daemon
54473 1 54473 0 Ss nanslp 0xffffffff81bc47e5 python3.11
33552 1 33552 0 Ss+ ttyin 0xfffff80001e894b0 getty
83268 1 83268 0 Ss nanslp 0xffffffff81bc47e7 cron
80094 23975 80094 0 S select 0xfffff8022b7c6ac0 python3.11
78929 23975 78929 0 S select 0xfffff801b0787c40 python3.11
47832 1 47832 0 Rs (threaded) suricata
100427 S nanslp 0xffffffff81bc47e5 suricata
101530 S select 0xfffff800635fd340 W#01-ax1
101565 S select 0xfffff8027a3493c0 W#02-ax1
101566 S select 0xfffff801e3bf33c0 W#03-ax1
101567 S select 0xfffff8022af1f940 W#04-ax1
101568 S select 0xfffff801e3c1c640 W#05-ax1
101569 S select 0xfffff8012d756140 W#06-ax1
101570 S select 0xfffff80239804b40 W#07-ax1
101571 S select 0xfffff801e3bf2bc0 W#08-ax1
101572 S select 0xfffff8027aadc040 W#01-ax1^
101573 Run CPU 3 W#02-ax1^
101574 S select 0xfffff8022af1f1c0 W#03-ax1^
101575 S select 0xfffff80229a904c0 W#04-ax1^
101576 S select 0xfffff8022ab30a40 W#05-ax1^
101577 S select 0xfffff8011af05840 W#06-ax1^
101578 S select 0xfffff80239831740 W#07-ax1^
101579 S select 0xfffff802398020c0 W#08-ax1^
101580 S uwait 0xfffff8018539be80 FM#01
101581 S uwait 0xfffff800042dfb00 FR#01
101582 S uwait 0xfffff8007629a900 CW
101583 S uwait 0xfffff801e3fe8300 CS
22086 1 21673 0 S (threaded) monit
100449 S nanslp 0xffffffff81bc47e6 monit
101584 S select 0xfffff801a221ae40 monit
66019 1 66019 0 Ss select 0xfffff80236f97f40 powerd
62681 1 62681 59 Ss (threaded) unbound
100348 S kqread 0xfffff8010843bd00 unbound
101335 S kqread 0xfffff801b000d400 unbound
101336 S kqread 0xfffff8012d219b00 unbound
101337 S kqread 0xfffff80207d06d00 unbound
101338 S kqread 0xfffff8023e559200 unbound
101339 S kqread 0xfffff80248fbdc00 unbound
101340 S kqread 0xfffff80248fb9700 unbound
101341 S kqread 0xfffff80207f3c900 unbound
87492 1 87492 0 Ss select 0xfffff801e3e59f40 radvd
77839 77447 77447 0 S wait 0xfffffe0020331ac0 sh
77447 1 77447 0 Ss kqread 0xfffff80202ab7200 daemon
76994 1 76994 136 Ss select 0xfffff801f0a6df40 dhcpd
73965 1 73965 136 Ss select 0xfffff801f0ce65c0 dhcpd
59447 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
59241 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
58723 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
58315 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
58107 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
57808 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
57235 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
56844 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
56437 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
55953 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
55313 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
55036 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
54589 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
53935 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
53686 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
53110 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
52553 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
52192 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
52016 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
51704 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
51636 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
51481 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
50828 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
50518 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
50045 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
49935 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
49670 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
49335 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
48675 44268 44268 0 S accept 0xfffff8011aa9f210 php-cgi
48262 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
47739 44268 44268 0 S (threaded) php-cgi
100359 S accept 0xfffff8011aa9f210 php-cgi
46790 44774 44774 0 S accept 0xfffff8011a982a10 php-cgi
46733 44268 44268 0 S (threaded) php-cgi
100376 S accept 0xfffff8011aa9f210 php-cgi
44774 43791 44774 0 Ss wait 0xfffffe01120c5560 php-cgi
44268 43791 44268 0 Ss wait 0xfffffe0111f3b560 php-cgi
43791 1 43596 0 S kqread 0xfffff801e6125300 lighttpd
39509 1 39509 0 Ss select 0xfffff8018539b0c0 sshd
98453 1 98453 0 Ss select 0xfffff801a2882dc0 dhcp6c
95903 1 95903 0 Ss select 0xfffff801b01c0a40 rtsold
95494 1 95494 0 Ss select 0xfffff801854e9040 rtsold
95398 1 95398 0 Ss select 0xfffff801854e95c0 rtsold
95313 1 95313 0 Ss select 0xfffff801b0261240 rtsold
93386 1 93386 0 Ss kqread 0xfffff80004106200 rtsold
76516 0 0 0 DL (threaded) [ng_queue]
100349 D sleep 0xffffffff83244930 [ng_queue0]
100761 D sleep 0xffffffff83244930 [ng_queue1]
100762 D sleep 0xffffffff83244930 [ng_queue2]
100763 D sleep 0xffffffff83244930 [ng_queue3]
100764 D sleep 0xffffffff83244930 [ng_queue4]
100765 D sleep 0xffffffff83244930 [ng_queue5]
100766 D sleep 0xffffffff83244930 [ng_queue6]
100767 D sleep 0xffffffff83244930 [ng_queue7]
75759 1 75759 0 Ss (threaded) mpd5
100768 S select 0xfffff80185707cc0 mpd5
23975 23794 23975 0 Ss (threaded) syslog-ng
100457 S kqread 0xfffff8012db82e00 syslog-ng
101236 S kqread 0xfffff8022d191600 syslog-ng
524308 S kqread 0xfffff804478fa100 syslog-ng
524330 S kqread 0xfffff801c8041300 syslog-ng
23794 1 23677 0 S wait 0xfffffe0118947040 syslog-ng
1782 1 1782 0 Ss select 0xfffff8012d8f2740 devd
255 253 253 0 S (threaded) python3.11
100315 S accept 0xfffff80108847210 python3.11
520641 S wait 0xfffffe0020332020 python3.11
253 1 253 0 Ss wait 0xfffffe01120c5ac0 python3.11
34 0 0 0 DL aiordy 0xfffffe00c6964020 [aiod4]
33 0 0 0 DL aiordy 0xfffffe00c6964580 [aiod3]
32 0 0 0 DL aiordy 0xfffffe00c6964ae0 [aiod2]
31 0 0 0 DL aiordy 0xfffffe00c6965040 [aiod1]
19 0 0 0 DL syncer 0xffffffff81bfe6a8 [syncer]
18 0 0 0 DL vlruwt 0xfffffe00ddfb3000 [vnlru]
17 0 0 0 DL (threaded) [bufdaemon]
100171 D psleep 0xffffffff81bfd6a8 [bufdaemon]
100172 D - 0xffffffff81802100 [bufspacedaemon-0]
100173 D - 0xffffffff81802380 [bufspacedaemon-1]
100174 D - 0xffffffff81802600 [bufspacedaemon-2]
100175 D - 0xffffffff81802880 [bufspacedaemon-3]
100176 D - 0xffffffff81802b00 [bufspacedaemon-4]
100177 D - 0xffffffff81802d80 [bufspacedaemon-5]
100178 D - 0xffffffff81803000 [bufspacedaemon-6]
16 0 0 0 DL psleep 0xffffffff81c32dd0 [vmdaemon]
9 0 0 0 DL (threaded) [pagedaemon]
100169 D psleep 0xffffffff81c1b238 [dom0]
100179 D launds 0xffffffff81c1b244 [laundry: dom0]
100180 D umarcl 0xffffffff80f501b0 [uma]
8 0 0 0 DL - 0xffffffff819c9870 [rand_harvestq]
7 0 0 0 DL pftm 0xffffffff8217ea10 [pf purge]
6 0 0 0 DL (threaded) [zfskern]
100127 D t->zthr 0xfffff80060260348 [arc_evict]
100128 D t->zthr 0xfffff80060260148 [arc_reap]
100129 D - 0xfffff80060261e00 [dbu_evict]
100130 D dbuf_ev 0xffffffff82718968 [dbuf_evict_thread]
100131 D - 0xfffff80060261b00 [z_vdev_file_0]
100132 D - 0xfffff80060261b00 [z_vdev_file_1]
100133 D - 0xfffff80060261b00 [z_vdev_file_2]
100134 D - 0xfffff80060261b00 [z_vdev_file_3]
100135 D - 0xfffff80060261b00 [z_vdev_file_4]
100136 D - 0xfffff80060261b00 [z_vdev_file_5]
100137 D - 0xfffff80060261b00 [z_vdev_file_6]
100138 D - 0xfffff80060261b00 [z_vdev_file_7]
100139 D - 0xfffff80060261b00 [z_vdev_file_8]
100140 D - 0xfffff80060261b00 [z_vdev_file_9]
100141 D - 0xfffff80060261b00 [z_vdev_file_10]
100142 D - 0xfffff80060261b00 [z_vdev_file_11]
100143 D - 0xfffff80060261b00 [z_vdev_file_12]
100144 D - 0xfffff80060261b00 [z_vdev_file_13]
100145 D - 0xfffff80060261b00 [z_vdev_file_14]
100146 D - 0xfffff80060261b00 [z_vdev_file_15]
100147 D l2arc_f 0xffffffff82717e68 [l2arc_feed_thread]
100148 D - 0xfffff80060262800 [zfsvfs]
100149 S zevent_ 0xffffffff82718ec8 [sysevent]
100237 D - 0xfffff800040cd400 [z_zvol]
100238 D - 0xfffff800040cd200 [z_metaslab_0]
100239 D - 0xfffff800040cd200 [z_metaslab_1]
100240 D - 0xfffff800040cd200 [z_metaslab_2]
100241 D - 0xfffff800040cd200 [z_metaslab_3]
100242 D - 0xfffff8007602fc00 [z_prefetch_0]
100243 D - 0xfffff8007602fc00 [z_prefetch_1]
100244 D - 0xfffff8007602fc00 [z_prefetch_2]
100245 D - 0xfffff8007602fc00 [z_prefetch_3]
100246 D - 0xfffff8007602fc00 [z_prefetch_4]
100247 D - 0xfffff8007602fc00 [z_prefetch_5]
100248 D - 0xfffff8007602fc00 [z_prefetch_6]
100249 D - 0xfffff8007602fc00 [z_prefetch_7]
100250 D - 0xfffff800040a5700 [z_upgrade_0]
100251 D - 0xfffff800040a5700 [z_upgrade_1]
100252 D - 0xfffff800040a5700 [z_upgrade_2]
100253 D - 0xfffff800040a5700 [z_upgrade_3]
100254 D - 0xfffff800040a5700 [z_upgrade_4]
100255 D - 0xfffff800040a5700 [z_upgrade_5]
100256 D - 0xfffff800040a5700 [z_upgrade_6]
100257 D - 0xfffff800040a5700 [z_upgrade_7]
100260 D - 0xfffff800601df400 [dp_sync_taskq_0]
100261 D - 0xfffff800601df400 [dp_sync_taskq_1]
100262 D - 0xfffff800601df400 [dp_sync_taskq_2]
100263 D - 0xfffff800601df400 [dp_sync_taskq_3]
100264 D - 0xfffff800601df400 [dp_sync_taskq_4]
100265 D - 0xfffff800601df400 [dp_sync_taskq_5]
100266 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100267 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100268 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100269 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100270 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100271 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100272 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100273 D - 0xfffff800041c2d00 [dp_zil_clean_taskq_]
100274 D - 0xfffff800041c2400 [z_zrele_0]
100275 D - 0xfffff800041c2400 [z_zrele_1]
100276 D - 0xfffff800041c2400 [z_zrele_2]
100277 D - 0xfffff800041c2400 [z_zrele_3]
100278 D - 0xfffff800041c2400 [z_zrele_4]
100279 D - 0xfffff800041c2400 [z_zrele_5]
100280 D - 0xfffff800041c2400 [z_zrele_6]
100281 D - 0xfffff800041c2400 [z_zrele_7]
100282 D - 0xfffff80076303400 [z_unlinked_drain_0]
100283 D - 0xfffff80076303400 [z_unlinked_drain_1]
100284 D - 0xfffff80076303400 [z_unlinked_drain_2]
100285 D - 0xfffff80076303400 [z_unlinked_drain_3]
100286 D - 0xfffff80076303400 [z_unlinked_drain_4]
100287 D - 0xfffff80076303400 [z_unlinked_drain_5]
100288 D - 0xfffff80076303400 [z_unlinked_drain_6]
100289 D - 0xfffff80076303400 [z_unlinked_drain_7]
100305 D tx->tx_ 0xfffff80001e68550 [txg_thread_enter]
100306 D tx->tx_ 0xfffff80001e68530 [txg_thread_enter]
100307 D mmp->mm 0xfffffe00de3a1498 [mmp_thread_enter]
100308 D t->zthr 0xfffff800040a7c48 [z_indirect_condense]
100309 D t->zthr 0xfffff800040a7148 [z_livelist_destroy]
100310 D t->zthr 0xfffff800040a8948 [z_livelist_condense]
100311 D t->zthr 0xfffff8006348bd48 [z_checkpoint_discar]
15 0 0 0 DL (threaded) [usb]
100096 D - 0xfffffe00d9b82440 [usbus0]
100097 D - 0xfffffe00d9b82498 [usbus0]
100098 D - 0xfffffe00d9b824f0 [usbus0]
100099 D - 0xfffffe00d9b82548 [usbus0]
100100 D - 0xfffffe00d9b825a0 [usbus0]
5 0 0 0 DL - 0xffffffff81c3d358 [busdma]
4 0 0 0 DL (threaded) [cam]
100088 D - 0xffffffff8199b240 [doneq0]
100089 D - 0xffffffff8199b2c0 [doneq1]
100090 D - 0xffffffff8199b1c0 [async]
100160 D - 0xffffffff8199b090 [scanner]
3 0 0 0 DL (threaded) [crypto]
100079 D crypto_ 0xffffffff81c186f0 [crypto]
100080 D crypto_ 0xfffff80001c04c30 [crypto returns 0]
100081 D crypto_ 0xfffff80001c04c80 [crypto returns 1]
100082 D crypto_ 0xfffff80001c04cd0 [crypto returns 2]
100083 D crypto_ 0xfffff80001c04d20 [crypto returns 3]
100084 D crypto_ 0xfffff80001c04d70 [crypto returns 4]
100085 D crypto_ 0xfffff80001c04dc0 [crypto returns 5]
100086 D crypto_ 0xfffff80001c04e10 [crypto returns 6]
100087 D crypto_ 0xfffff80001c04e60 [crypto returns 7]
14 0 0 0 DL seqstat 0xfffff80001ab0888 [sequencer 00]
13 0 0 0 DL (threaded) [geom]
100067 D - 0xffffffff81b80228 [g_event]
100068 D - 0xffffffff81b80230 [g_up]
100069 D - 0xffffffff81b80238 [g_down]
2 0 0 0 WL (threaded) [clock]
100057 I [clock (0)]
100058 I [clock (1)]
100059 I [clock (2)]
100060 I [clock (3)]
100061 I [clock (4)]
100062 I [clock (5)]
100063 I [clock (6)]
100064 I [clock (7)]
12 0 0 0 WL (threaded) [intr]
100030 I [swi6: task queue]
100031 I [swi6: Giant taskq]
100033 I [swi5: fast taskq]
100065 I [swi1: netisr 0]
100092 I [irq59: nvme0:admin]
100095 I [irq88: xhci0]
100102 I [irq90: ax0]
100103 I [irq91: ax0]
100104 I [irq92: ax0]
100106 I [irq102: ax1]
100107 I [irq103: ax1]
100108 I [irq104: ax1]
100109 I [swi0: uart]
100152 I [swi1: pf send]
100153 I [swi1: pfsync]
100161 I [irq60: nvme0:io0]
100162 I [irq61: nvme0:io1]
100163 I [irq62: nvme0:io2]
100164 I [irq63: nvme0:io3]
100165 I [irq64: nvme0:io4]
100166 I [irq65: nvme0:io5]
100167 I [irq66: nvme0:io6]
100168 I [irq67: nvme0:io7]
11 0 0 0 RL (threaded) [idle]
100003 Run CPU 0 [idle: cpu0]
100004 Run CPU 1 [idle: cpu1]
100005 Run CPU 2 [idle: cpu2]
100006 CanRun [idle: cpu3]
100007 Run CPU 4 [idle: cpu4]
100008 Run CPU 5 [idle: cpu5]
100009 Run CPU 6 [idle: cpu6]
100010 Run CPU 7 [idle: cpu7]
1 0 1 0 SLs wait 0xfffffe00c6816040 [init]
10 0 0 0 DL audit_w 0xffffffff81c18be0 [audit]
0 0 0 0 DLs (threaded) [kernel]
100000 D swapin 0xffffffff81b807b8 [swapper]
100011 D - 0xfffff8000122dd00 [softirq_0]
100012 D - 0xfffff8000122db00 [softirq_1]
100013 D - 0xfffff8000122d900 [softirq_2]
100014 D - 0xfffff8000122d700 [softirq_3]
100015 D - 0xfffff8000122d500 [softirq_4]
100016 D - 0xfffff8000122d300 [softirq_5]
100017 D - 0xfffff800018eb500 [softirq_6]
100018 D - 0xfffff800018eb300 [softirq_7]
100019 D - 0xfffff800018eb100 [if_io_tqg_0]
100020 D - 0xfffff800018ece00 [if_io_tqg_1]
100021 D - 0xfffff800018ecc00 [if_io_tqg_2]
100022 D - 0xfffff800018eca00 [if_io_tqg_3]
100023 D - 0xfffff800018ec800 [if_io_tqg_4]
100024 D - 0xfffff800018ec600 [if_io_tqg_5]
100025 D - 0xfffff800018ec400 [if_io_tqg_6]
100026 D - 0xfffff800018ec200 [if_io_tqg_7]
100027 D - 0xfffff800018ec000 [if_config_tqg_0]
100028 D - 0xfffff800018edd00 [pci_hp taskq]
100029 D - 0xfffff800018edb00 [kqueue_ctx taskq]
100032 D - 0xfffff800018ed300 [thread taskq]
100034 D - 0xfffff800018eed00 [aiod_kick taskq]
100035 D - 0xfffff800018eeb00 [deferred_unmount ta]
100036 D - 0xfffff800018ee900 [inm_free taskq]
100037 D - 0xfffff800018ee700 [in6m_free taskq]
100038 D - 0xfffff800018ee500 [linuxkpi_irq_wq]
100039 D - 0xfffff800018ee300 [linuxkpi_short_wq_0]
100040 D - 0xfffff800018ee300 [linuxkpi_short_wq_1]
100041 D - 0xfffff800018ee300 [linuxkpi_short_wq_2]
100042 D - 0xfffff800018ee300 [linuxkpi_short_wq_3]
100043 D - 0xfffff800018ee300 [linuxkpi_short_wq_4]
100044 D - 0xfffff800018ee300 [linuxkpi_short_wq_5]
100045 D - 0xfffff800018ee300 [linuxkpi_short_wq_6]
100046 D - 0xfffff800018ee300 [linuxkpi_short_wq_7]
100047 D - 0xfffff800018ee300 [linuxkpi_short_wq_8]
100048 D - 0xfffff800018ef800 [linuxkpi_long_wq_0]
100049 D - 0xfffff800018ef800 [linuxkpi_long_wq_1]
100050 D - 0xfffff800018ef800 [linuxkpi_long_wq_2]
100051 D - 0xfffff800018ef800 [linuxkpi_long_wq_3]
100052 D - 0xfffff800018ef800 [linuxkpi_long_wq_4]
100053 D - 0xfffff800018ef800 [linuxkpi_long_wq_5]
100054 D - 0xfffff800018ef800 [linuxkpi_long_wq_6]
100055 D - 0xfffff800018ef800 [linuxkpi_long_wq_7]
100056 D - 0xfffff800018ef800 [linuxkpi_long_wq_8]
100066 D - 0xfffff800019ca400 [firmware taskq]
100071 D - 0xfffff800019cc900 [crypto_0]
100072 D - 0xfffff800019cc900 [crypto_1]
100073 D - 0xfffff800019cc900 [crypto_2]
100074 D - 0xfffff800019cc900 [crypto_3]
100075 D - 0xfffff800019cc900 [crypto_4]
100076 D - 0xfffff800019cc900 [crypto_5]
100077 D - 0xfffff800019cc900 [crypto_6]
100078 D - 0xfffff800019cc900 [crypto_7]
100093 D - 0xfffff80001ef1900 [nvme taskq_0]
100094 D - 0xfffff80001ef1900 [nvme taskq_1]
100101 D - 0xfffff80004087700 [axgbe dev taskq]
100105 D - 0xfffff80004208a00 [axgbe dev taskq]
100110 D - 0xfffff80001e7bd00 [system_taskq_0]
100111 D - 0xfffff80001e7bd00 [system_taskq_1]
100112 D - 0xfffff80001e7bd00 [system_taskq_2]
100113 D - 0xfffff80001e7bd00 [system_taskq_3]
100114 D - 0xfffff80001e7bd00 [system_taskq_4]
100115 D - 0xfffff80001e7bd00 [system_taskq_5]
100116 D - 0xfffff80001e7bd00 [system_taskq_6]
100117 D - 0xfffff80001e7bd00 [system_taskq_7]
100118 D - 0xfffff80001e7b400 [system_delay_taskq_]
100119 D - 0xfffff80001e7b400 [system_delay_taskq_]
100120 D - 0xfffff80001e7b400 [system_delay_taskq_]
100121 D - 0xfffff80001e7b400 [system_delay_taskq_]
100122 D - 0xfffff80001e7b400 [system_delay_taskq_]
100123 D - 0xfffff80001e7b400 [system_delay_taskq_]
100124 D - 0xfffff80001e7b400 [system_delay_taskq_]
100125 D - 0xfffff80001e7b400 [system_delay_taskq_]
100126 D - 0xfffff80060260500 [arc_prune]
100150 D - 0xfffff80060263800 [ip_mroute_tskq task]
100154 D - 0xfffff800042edd00 [acpi_task_0]
100155 D - 0xfffff800042edd00 [acpi_task_1]
100156 D - 0xfffff800042edd00 [acpi_task_2]
100158 D - 0xfffff8000122a300 [mca taskq]
100159 D - 0xfffff80001ba6300 [CAM taskq]
100183 D - 0xfffff80004106300 [z_null_iss]
100184 D - 0xfffff800042ed000 [z_null_int]
100185 D - 0xfffff80004106000 [z_rd_iss_0]
100186 D - 0xfffff80004106000 [z_rd_iss_1]
100187 D - 0xfffff80004106000 [z_rd_iss_2]
100188 D - 0xfffff80004106000 [z_rd_iss_3]
100189 D - 0xfffff80004106000 [z_rd_iss_4]
100190 D - 0xfffff80004106000 [z_rd_iss_5]
100191 D - 0xfffff80004106000 [z_rd_iss_6]
100192 D - 0xfffff80004106000 [z_rd_iss_7]
100193 D - 0xfffff80004107600 [z_rd_int_0_0]
100194 D - 0xfffff80004107600 [z_rd_int_0_1]
100195 D - 0xfffff80004107600 [z_rd_int_0_2]
100196 D - 0xfffff80004107200 [z_rd_int_1_0]
100197 D - 0xfffff80004107200 [z_rd_int_1_1]
100198 D - 0xfffff80004107200 [z_rd_int_1_2]
100199 D - 0xfffff80001a43d00 [z_wr_iss_0]
100200 D - 0xfffff80001a43d00 [z_wr_iss_1]
100201 D - 0xfffff80001a43d00 [z_wr_iss_2]
100202 D - 0xfffff80001a43d00 [z_wr_iss_3]
100203 D - 0xfffff80001a43d00 [z_wr_iss_4]
100204 D - 0xfffff80001a43d00 [z_wr_iss_5]
100205 D - 0xfffff800040ca400 [z_wr_iss_h_0]
100206 D - 0xfffff800040ca400 [z_wr_iss_h_1]
100207 D - 0xfffff800040ca400 [z_wr_iss_h_2]
100208 D - 0xfffff800040ca400 [z_wr_iss_h_3]
100209 D - 0xfffff800040ca400 [z_wr_iss_h_4]
100210 D - 0xfffff800040cbd00 [z_wr_int_0_0]
100211 D - 0xfffff800040cbd00 [z_wr_int_0_1]
100212 D - 0xfffff800040cbd00 [z_wr_int_0_2]
100213 D - 0xfffff800040cb900 [z_wr_int_1_0]
100214 D - 0xfffff800040cb900 [z_wr_int_1_1]
100215 D - 0xfffff800040cb900 [z_wr_int_1_2]
100216 D - 0xfffff800040cb500 [z_wr_int_h_0]
100217 D - 0xfffff800040cb500 [z_wr_int_h_1]
100218 D - 0xfffff800040cb500 [z_wr_int_h_2]
100219 D - 0xfffff800040cb500 [z_wr_int_h_3]
100220 D - 0xfffff800040cb500 [z_wr_int_h_4]
100221 D - 0xfffff800040cce00 [z_fr_iss_0_0]
100222 D - 0xfffff800040cce00 [z_fr_iss_0_1]
100223 D - 0xfffff800040cce00 [z_fr_iss_0_2]
100224 D - 0xfffff800040cca00 [z_fr_iss_1_0]
100225 D - 0xfffff800040cca00 [z_fr_iss_1_1]
100226 D - 0xfffff800040cca00 [z_fr_iss_1_2]
100227 D - 0xfffff800040cc600 [z_fr_int]
100228 D - 0xfffff800040cc400 [z_cl_iss]
100229 D - 0xfffff800040cc200 [z_cl_int]
100230 D - 0xfffff800040cc000 [z_ioctl_iss]
100231 D - 0xfffff800040cdd00 [z_ioctl_int]
100232 D - 0xfffff800040cdb00 [z_trim_iss_0]
100233 D - 0xfffff800040cdb00 [z_trim_iss_1]
100234 D - 0xfffff800040cdb00 [z_trim_iss_2]
100235 D - 0xfffff800040cdb00 [z_trim_iss_3]
100236 D - 0xfffff800040cd600 [z_trim_int]
101531 D - 0xfffff8033a36e500 [tq ax1 RX0]
101532 D - 0xfffff80227903400 [tq ax1 RX1]
101533 D - 0xfffff80248fbaa00 [tq ax1 RX2]
101534 D - 0xfffff8022d0d8600 [tq ax1 RX3]
101535 D - 0xfffff8011afba300 [tq ax1 RX4]
101536 D - 0xfffff80207f3c800 [tq ax1 RX5]
101537 D - 0xfffff80223f0d300 [tq ax1 RX6]
101538 D - 0xfffff80227903a00 [tq ax1 RX7]
101539 D - 0xfffff80227aa7400 [tq ax1 RX8]
101540 D - 0xfffff8021cf34100 [tq ax1 RX9]
101541 D - 0xfffff801f0f09600 [tq ax1 RX10]
101542 D - 0xfffff801c9366e00 [tq ax1 RX11]
101543 D - 0xfffff80207f3ba00 [tq ax1 RX12]
101544 D - 0xfffff80202233800 [tq ax1 RX13]
101545 D - 0xfffff80202884400 [tq ax1 RX14]
101546 D - 0xfffff80202ee5800 [tq ax1 RX15]
101547 D - 0xfffff8012d860200 [tq ax1]
101548 D - 0xfffff80227904000 [tq ax1 TX0]
101549 D - 0xfffff80202885600 [tq ax1 TX1]
101550 D - 0xfffff80202886600 [tq ax1 TX2]
101551 D - 0xfffff8039d0cd900 [tq ax1 TX3]
101552 D - 0xfffff8039d0cd700 [tq ax1 TX4]
101553 D - 0xfffff8039d0cd500 [tq ax1 TX5]
101554 D - 0xfffff8039d0cd300 [tq ax1 TX6]
101555 D - 0xfffff8039d0cd100 [tq ax1 TX7]
101556 D - 0xfffff8039d0cee00 [tq ax1 TX8]
101557 D - 0xfffff8039d0cec00 [tq ax1 TX9]
101558 D - 0xfffff8039d0cea00 [tq ax1 TX10]
101559 D - 0xfffff8039d0ce800 [tq ax1 TX11]
101560 D - 0xfffff8039d0ce600 [tq ax1 TX12]
101561 D - 0xfffff8039d0ce400 [tq ax1 TX13]
101562 D - 0xfffff8039d0ce200 [tq ax1 TX14]
101563 D - 0xfffff8039d0ce000 [tq ax1 TX15]
101564 D - 0xfffff8039d0cfd00 [tq ax1]
db:0:kdb.enter.default> alltrace
Tracing command kernel pid 0 tid 100000 td 0xffffffff81b80d20
sched_switch() at sched_switch+0x88a/frame 0xffffffff82d26ec0
mi_switch() at mi_switch+0xbb/frame 0xffffffff82d26ee0
sleepq_timedwait() at sleepq_timedwait+0x2f/frame 0xffffffff82d26f20
_sleep() at _sleep+0x1c8/frame 0xffffffff82d26fa0
swapper() at swapper+0x69/frame 0xffffffff82d26ff0
Tracing command kernel pid 0 tid 100011 td 0xfffff80001918740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d742e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d742e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d742ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d742ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d742f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d742f30
--- trap 0x5a78820e, rip = 0xd23f8ba6de7f8ba2, rsp = 0x750810ea794810ee, rbp = 0xc9373cc4c5773cc0 ---
Tracing command kernel pid 0 tid 100012 td 0xfffff80001918000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d73de50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d73de70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d73dec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d73def0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d73df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d73df30
--- trap 0x9db3a5a, rip = 0x819c33f28ddc33f6, rsp = 0x26aba8be2aeba8ba, rbp = 0x9a94849096d48494 ---
Tracing command kernel pid 0 tid 100013 td 0xfffff80001919740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d768e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d768e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d768ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d768ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d768f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d768f30
--- trap 0xc8f11360, rip = 0x40b61ac84cf61acc, rsp = 0xe7818184ebc18180, rbp = 0x5bbeadaa57feadae ---
Tracing command kernel pid 0 tid 100014 td 0xfffff80001919000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d763e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d763e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d763ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d763ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d763f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d763f30
--- trap 0x8cbff2f3, rip = 0x4f8fb5b08b8fb5f, rsp = 0xa3cf6017af8f6013, rbp = 0x1ff04c3913b04c3d ---
Tracing command kernel pid 0 tid 100015 td 0xfffff8000191a740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d75ee50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d75ee70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d75eec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d75eef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d75ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d75ef30
--- trap 0x37d5e9aa, rip = 0xbf92e002b3d2e006, rsp = 0x18a57b4e14e57b4a, rbp = 0xa49a5760a8da5764 ---
Tracing command kernel pid 0 tid 100016 td 0xfffff8000191a000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d759e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d759e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d759ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d759ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d759f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d759f30
--- trap 0x28f46399, rip = 0xa0b36a31acf36a35, rsp = 0x784f17d0bc4f179, rbp = 0xbbbbdd53b7fbdd57 ---
Tracing command kernel pid 0 tid 100017 td 0xfffff800019e1740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d77ce50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d77ce70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d77cec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d77cef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d77cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d77cf30
--- trap 0x70cc63f2, rip = 0xf88b6a5af4cb6a5e, rsp = 0x5fbcf11653fcf112, rbp = 0xe383dd38efc3dd3c ---
Tracing command kernel pid 0 tid 100018 td 0xfffff800019e1000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d777e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d777e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d777ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d777ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d777f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d777f30
--- trap 0x34828261, rip = 0xbcc58bc9b0858bcd, rsp = 0x1bf2108517b21081, rbp = 0xa7cd3cabab8d3caf ---
Tracing command kernel pid 0 tid 100019 td 0xfffff800018e8740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d772e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d772e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d772ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d772ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d772f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d772f30
--- trap 0xe9939ae2, rip = 0x61d4934a6d94934e, rsp = 0xc6e30806caa30802, rbp = 0x7adc2428769c242c ---
Tracing command kernel pid 0 tid 100020 td 0xfffff800018e8000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d76de50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d76de70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d76dec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d76def0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d76df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d76df30
--- trap 0x15e00be3, rip = 0x9da7024b91e7024f, rsp = 0x3a90990736d09903, rbp = 0x86afb5298aefb52d ---
Tracing command kernel pid 0 tid 100021 td 0xfffff800018e9740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d790e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d790e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d790ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d790ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d790f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d790f30
--- trap 0xc0442ca2, rip = 0x4803250a4443250e, rsp = 0xef34be46e374be42, rbp = 0x530b92685f4b926c ---
Tracing command kernel pid 0 tid 100022 td 0xfffff800018e9000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d78be50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d78be70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d78bec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d78bef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d78bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d78bf30
--- trap 0xb2c8cd35, rip = 0x3a8fc49d36cfc499, rsp = 0x9db85fd191f85fd5, rbp = 0x218773ff2dc773fb ---
Tracing command kernel pid 0 tid 100023 td 0xfffff800018ea740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d786e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d786e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d786ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d786ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d786f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d786f30
--- trap 0xba49ce80, rip = 0x320ec7283e4ec72c, rsp = 0x95395c6499795c60, rbp = 0x2906704a2546704e ---
Tracing command kernel pid 0 tid 100024 td 0xfffff800018ea000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d781e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d781e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d781ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d781ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d781f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d781f30
--- trap 0xa56844b3, rip = 0x2d2f4d1b216f4d1f, rsp = 0x8a18d6578658d653, rbp = 0x3627fa793a67fa7d ---
Tracing command kernel pid 0 tid 100025 td 0xfffff800019dd740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d7a4e50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d7a4e70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d7a4ec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d7a4ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d7a4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d7a4f30
--- trap 0xfd5044d8, rip = 0x75174d7079574d74, rsp = 0xd220d63cde60d638, rbp = 0x6e1ffa12625ffa16 ---
Tracing command kernel pid 0 tid 100026 td 0xfffff800019dd000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d79fe50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d79fe70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d79fec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d79fef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d79ff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d79ff30
--- trap 0xaf5bda7, rip = 0x82b2b40f8ef2b40b, rsp = 0x25852f4329c52f47, rbp = 0x99ba036d95fa0369 ---
Tracing command kernel pid 0 tid 100027 td 0xfffff800019de740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d79ae50
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d79ae70
msleep_spin_sbt() at msleep_spin_sbt+0x186/frame 0xfffffe001d79aec0
gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe001d79aef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d79af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d79af30
--- trap 0xd7e4a524, rip = 0x5fa3ac8c53e3ac88, rsp = 0xf89437c0f4d437c4, rbp = 0x44ab1bee48eb1bea ---
Tracing command kernel pid 0 tid 100028 td 0xfffff800019de000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d795e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d795e40
_sleep() at _sleep+0x1e8/frame 0xfffffe001d795ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe001d795ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d795f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d795f30
--- trap 0x1d553421, rip = 0x95123d8999523d8d, rsp = 0x3225a6c53e65a6c1, rbp = 0x8e1a8aeb825a8aef ---
Tracing command kernel pid 0 tid 100029 td 0xfffff800019df740
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d7b8e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d7b8e40
_sleep() at _sleep+0x1e8/frame 0xfffffe001d7b8ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe001d7b8ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d7b8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001d7b8f30
--- trap 0x90fd2f7c, rip = 0x18ba26d414fa26d0, rsp = 0xbf8dbd98b3cdbd9c, rbp = 0x3b291b60ff291b2 ---
Tracing command kernel pid 0 tid 100032 td 0xfffff800019e0000
sched_switch() at sched_switch+0x88a/frame 0xfffffe001d7a9e20
mi_switch() at mi_switch+0xbb/frame 0xfffffe001d7a9e40
_sleep() at _sleep+0x1e8/frame 0xfffffe001d7a9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe001d7a9ef0
fork_exit() at fork_exit+0x7f/frame 0xfffffe001d7aconfig.txt0600001076215013202675 7542 ustarrootwheeloptions CONFIG_AUTOGENERATED
ident SMP
machine amd64
cpu HAMMER
makeoptions WITH_CTF=1
options TCP_SIGNATURE
options RSS
options MROUTING
options IPSTEALTH
options IPFIREWALL_VERBOSE
options IPFIREWALL_DEFAULT_TO_ACCEPT
options GEOM_UZIP
options GEOM_MIRROR
options GEOM_ELI
options GEOM_BDE
options DDB
options IICHID_SAMPLING
options HID_DEBUG
options EVDEV_SUPPORT
options XENHVM
options USB_DEBUG
options AH_AR5416_INTERRUPT_MITIGATION
options IEEE80211_SUPPORT_MESH
options IEEE80211_DEBUG
options SC_PIXEL_MODE
options PPS_SYNC
options COMPAT_LINUXKPI
options PCI_IOV
options PCI_HP
options IOMMU
options SMP
options NETGDB
options NETDUMP
options DEBUGNET
options ZSTDIO
options GZIO
options EKCD
options KDB_TRACE
options KDB
options RCTL
options RACCT_DEFAULT_TO_DISABLED
options RACCT
options INCLUDE_CONFIG_FILE
options DDB_CTF
options KDTRACE_HOOKS
options KDTRACE_FRAME
options MAC
options CAPABILITIES
options CAPABILITY_MODE
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD13
options COMPAT_FREEBSD12
options COMPAT_FREEBSD11
options COMPAT_FREEBSD10
options COMPAT_FREEBSD9
options COMPAT_FREEBSD7
options COMPAT_FREEBSD6
options COMPAT_FREEBSD5
options COMPAT_FREEBSD4
options COMPAT_FREEBSD32
options EFIRT
options GEOM_LABEL
options GEOM_RAID
options TMPFS
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options QUOTA
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options KERN_TLS
options SCTP_SUPPORT
options TCP_RFC7413
options TCP_HHOOK
options TCP_BLACKBOX
options TCP_OFFLOAD
options FIB_ALGO
options ROUTE_MPATH
options IPSEC_SUPPORT
options INET6
options INET
options VIMAGE
options PREEMPTION
options NUMA
options SCHED_ULE
options NETLINK
options NEW_PCIB
options CC_CUBIC
options GEOM_PART_GPT
options GEOM_PART_MBR
options GEOM_PART_EBR
options GEOM_PART_BSD
options EARLY_AP_STARTUP
options PPS_SYNC
device isa
device mem
device io
device uart_ns8250
device cpufreq
device acpi
device smbios
device pci
device fdc
device ahci
device ata
device mvs
device siis
device ahc
device ahd
device hptiop
device isp
device mpt
device mps
device mpr
device sym
device isci
device ocs_fc
device pvscsi
device scbus
device ch
device da
device sa
device cd
device pass
device ses
device arcmsr
device ciss
device ips
device smartpqi
device tws
device aac
device aacp
device aacraid
device ida
device mfi
device mlx
device mrsas
device nvme
device nvd
device vmd
device atkbdc
device atkbd
device psm
device kbdmux
device vga
device splash
device sc
device vt
device vt_vga
device vt_efifb
device vt_vbefb
device cbb
device cardbus
device uart
device ppc
device ppbus
device lpt
device ppi
device puc
device iflib
device em
device igc
device ix
device ixv
device ixl
device iavf
device ice
device vmx
device axp
device bxe
device le
device ti
device mlx5
device mlxfw
device mlx5en
device miibus
device ae
device age
device alc
device ale
device bce
device bfe
device bge
device cas
device dc
device et
device fxp
device gem
device jme
device lge
device msk
device nfe
device nge
device re
device rl
device sge
device sis
device sk
device ste
device stge
device vge
device vr
device xl
device wlan
device wlan_wep
device wlan_ccmp
device wlan_tkip
device wlan_amrr
device ath
device ath_hal
device ath_rate_sample
device ipw
device iwi
device iwn
device malo
device mwl
device ral
device wpi
device crypto
device aesni
device loop
device padlock_rng
device rdrand_rng
device ether
device vlan
device tuntap
device md
device gif
device firmware
device xz
device bpf
device uhci
device ohci
device ehci
device xhci
device usb
device usbhid
device hkbd
device ukbd
device umass
device sound
device snd_cmi
device snd_csa
device snd_emu10kx
device snd_es137x
device snd_hda
device snd_ich
device snd_via8233
device mmc
device mmcsd
device sdhci
device virtio
device virtio_pci
device vtnet
device virtio_blk
device virtio_scsi
device virtio_balloon
device kvm_clock
device hyperv
device xenefi
device xenpci
device xentimer
device netmap
device evdev
device uinput
device hid
device hidbus
device bwi
device bwn
device rum
device run
device u3g
device uark
device uath
device uftdi
device umct
device umodem
device upgt
device uplcom
device ural
device urtw
device uvisor
device uvscom
device zyd
device wlan_acl
device wlan_xauth
device speaker
msgbuf.txt06000017371715013202675 7652 ustarrootwheel
---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.2-RELEASE-p2 stable/25.4-n269702-2a564b0b6525 SMP amd64
FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67)
VT(vga): resolution 640x480
CPU: AMD EPYC 3201 8-Core Processor (1497.26-MHz K8-class CPU)
Origin="AuthenticAMD" Id=0x800f12 Family=0x17 Model=0x1 Stepping=2
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX>
Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA>
XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB>
SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768
TSC: P-state invariant, performance statistics
real memory = 17179869184 (16384 MB)
avail memory = 16452415488 (15690 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INSYDE WALLABY>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 2 cache groups x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 128 != hw id 0
ioapic1: MADT APIC ID 129 != hw id 0
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 6 4 1 2 5 3 7
random: entropy device external interface
wlan: mac acl policy registered
kbd0 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0x793d2000-0x793d201e
smbios0: Version: 3.0, BCD Revision: 3.0
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <INSYDE WALLABY>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 350
Event timer "HPET2" frequency 14318180 Hz quality 350
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
apei0: <ACPI Platform Error Interface> on acpi0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 1.3 on pci0
pci1: <ACPI PCI bus> on pcib1
nvme0: <Generic NVMe Device> mem 0x80d00000-0x80d03fff at device 0.0 on pci1
pcib2: <ACPI PCI-PCI bridge> at device 1.4 on pci0
pci2: <ACPI PCI bus> on pcib2
igc0: <Intel(R) Ethernet Controller I226-V> mem 0x80b00000-0x80bfffff,0x80c00000-0x80c03fff at device 0.0 on pci2
igc0: EEPROM V2.25-0 eTrack 0x800003b1
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 4 RX queues 4 TX queues
igc0: Using MSI-X interrupts with 5 vectors
<6>igc0: Ethernet address: f4:90:ea:01:2b:e0
<6>igc0: netmap queues/slots: TX 4/1024, RX 4/1024
pcib3: <ACPI PCI-PCI bridge> at device 1.5 on pci0
pci3: <ACPI PCI bus> on pcib3
igc1: <Intel(R) Ethernet Controller I226-V> mem 0x80900000-0x809fffff,0x80a00000-0x80a03fff at device 0.0 on pci3
igc1: EEPROM V2.25-0 eTrack 0x800003b1
igc1: Using 1024 TX descriptors and 1024 RX descriptors
igc1: Using 4 RX queues 4 TX queues
igc1: Using MSI-X interrupts with 5 vectors
<6>igc1: Ethernet address: f4:90:ea:01:2b:e1
<6>igc1: netmap queues/slots: TX 4/1024, RX 4/1024
pcib4: <ACPI PCI-PCI bridge> at device 1.6 on pci0
pci4: <ACPI PCI bus> on pcib4
igc2: <Intel(R) Ethernet Controller I226-V> mem 0x80700000-0x807fffff,0x80800000-0x80803fff at device 0.0 on pci4
igc2: EEPROM V2.25-0 eTrack 0x800003b1
igc2: Using 1024 TX descriptors and 1024 RX descriptors
igc2: Using 4 RX queues 4 TX queues
igc2: Using MSI-X interrupts with 5 vectors
<6>igc2: Ethernet address: f4:90:ea:01:2b:e2
<6>igc2: netmap queues/slots: TX 4/1024, RX 4/1024
pcib5: <ACPI PCI-PCI bridge> at device 1.7 on pci0
pci5: <ACPI PCI bus> on pcib5
igc3: <Intel(R) Ethernet Controller I226-V> mem 0x80500000-0x805fffff,0x80600000-0x80603fff at device 0.0 on pci5
igc3: EEPROM V2.25-0 eTrack 0x800003b1
igc3: Using 1024 TX descriptors and 1024 RX descriptors
igc3: Using 4 RX queues 4 TX queues
igc3: Using MSI-X interrupts with 5 vectors
<6>igc3: Ethernet address: f4:90:ea:01:2b:e3
<6>igc3: netmap queues/slots: TX 4/1024, RX 4/1024
pcib6: <ACPI PCI-PCI bridge> at device 7.1 on pci0
pci6: <ACPI PCI bus> on pcib6
pci6: <encrypt/decrypt> at device 0.2 (no driver attached)
xhci0: <XHCI (generic) USB 3.0 controller> mem 0x80200000-0x802fffff at device 0.3 on pci6
xhci0: 64 bytes context size, 64-bit DMA
usbus0: waiting for BIOS to give up control
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib7: <ACPI PCI-PCI bridge> at device 8.1 on pci0
pci7: <ACPI PCI bus> on pcib7
pci7: <encrypt/decrypt> at device 0.1 (no driver attached)
ax0: <AMD 10 Gigabit Ethernet Driver> mem 0x80160000-0x8017ffff,0x80140000-0x8015ffff,0x80180000-0x80181fff at device 0.4 on pci7
ax0: Using 512 TX descriptors and 512 RX descriptors
ax0: Using 8 RX queues 8 TX queues
ax0: Using MSI-X interrupts with 12 vectors
<6>ax0: Ethernet address: f4:90:ea:01:2b:e4
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Enabled
ax0: VLAN filtering Enabled
ax0: VLAN Stripping Enabled
ax0: Checking GPIO expander validity
ax0: GPIO configuration valid
ax0: xgbe_phy_sfp_signals: port_sfp_inputs: 0x4
ax0: SFP detected:
ax0: vendor: Zaram
ax0: part number: ZXOS11NPI
ax0: revision level: 1B
ax0: serial number: ZRMT23060637
<6>ax0: netmap queues/slots: TX 8/512, RX 8/512
ax1: <AMD 10 Gigabit Ethernet Driver> mem 0x80120000-0x8013ffff,0x80100000-0x8011ffff,0x80182000-0x80183fff at device 0.5 on pci7
ax1: Using 512 TX descriptors and 512 RX descriptors
ax1: Using 8 RX queues 8 TX queues
ax1: Using MSI-X interrupts with 12 vectors
<6>ax1: Ethernet address: f4:90:ea:01:2b:e5
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Enabled
ax1: VLAN filtering Enabled
ax1: VLAN Stripping Enabled
ax1: Checking GPIO expander validity
ax1: GPIO configuration valid
ax1: SFP detected:
ax1: vendor: FS
ax1: part number: SFPP-PC005
ax1: revision level: A
ax1: serial number: G2340637796-2
<6>ax1: netmap queues/slots: TX 8/512, RX 8/512
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
uart2: <16x50 with 256 byte FIFO> iomem 0xfedc9000-0xfedc9fff,0xfedc7000-0xfedc7fff irq 3 on acpi0
ns8250: UART FCR is broken
uart2: console (115384,n,8,1)
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC" frequency 1497186573 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <AMD XHCI root HUB> at usbus0
uhub0 on usbus0
uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ax1: Link is DOWN
ax0: Link is DOWN
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
nda0 at nvme0 bus 0 scbus0 target 0 lun 1
nda0: <TS256GMTE712A 82B2W2AA I689870120>
nda0: Serial Number I689870120
nda0: nvme version 1.4
nda0: 244198MB (500118192 512 byte sectors)
Trying to mount root from zfs:zroot/ROOT/default []...
uhub0: 8 ports with 8 removable, self powered
<118>Mounting filesystems...
<6>pid 30 (zpool) is attempting to use unsafe AIO requests - not logging anymore
<118>no pools available to import
<118>Setting hostuuid: 27576bbc-3e07-4abc-9963-c6de73a700f0.
<118>Setting hostid: 0x3f62e3a4.
<118>>>> Invoking import script 'importer'
<118>Configuring crash dump device: /dev/gpt/swapfs
<118>swapon: adding /dev/gpt/swapfs as swap device
<118>.ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/ipsec /usr/local/lib/perl5/5.36/mach/CORE
<118>32-bit compatibility ldconfig path:
<118>done.
<118>>>> Invoking early script 'upgrade'
<118>>>> Invoking early script 'configd'
<118>Starting configd.
ax0: Link is UP - 10Gbps/Full - flow control off
<6>ax0: link state changed to UP
<118>>>> Invoking early script 'templates'
<118>Generating configuration: OK
<118>>>> Invoking early script 'backup'
<118>>>> Invoking backup script 'captiveportal'
<118>>>> Invoking backup script 'dhcpleases'
<118>>>> Invoking backup script 'duid'
<118>>>> Invoking backup script 'netflow'
<118>>>> Invoking backup script 'rrd'
<118>>>> Invoking early script 'carp'
<118>CARP event system: OK
<118>Launching the init system...done.
<118>Initializing..........done.
<6>igc1: link state changed to UP
<6>igc2: link state changed to UP
<6>igc3: link state changed to UP
<118>Starting device manager...
intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci0
smbus0: <System Management Bus> on intsmb0
ig4iic0: <Designware I2C Controller> iomem 0xfedc2000-0xfedc2fff irq 10 on acpi0
iicbus0: <Philips I2C bus (ACPI-hinted)> on ig4iic0
ig4iic1: <Designware I2C Controller> iomem 0xfedc3000-0xfedc3fff irq 11 on acpi0
iicbus1: <Philips I2C bus (ACPI-hinted)> on ig4iic1
ig4iic2: <Designware I2C Controller> iomem 0xfedc4000-0xfedc4fff irq 12 on acpi0
iicbus2: <Philips I2C bus (ACPI-hinted)> on ig4iic2
ig4iic3: <Designware I2C Controller> iomem 0xfedc5000-0xfedc5fff irq 6 on acpi0
iicbus3: <Philips I2C bus (ACPI-hinted)> on ig4iic3
ig4iic4: <Designware I2C Controller> iomem 0xfedc6000-0xfedc6fff irq 14 on acpi0
iicbus4: <Philips I2C bus (ACPI-hinted)> on ig4iic4
ig4iic5: <Designware I2C Controller> iomem 0xfedcb000-0xfedcbfff irq 15 on acpi0
iicbus5: <Philips I2C bus (ACPI-hinted)> on ig4iic5
<118>done.
<118>Configuring login behaviour...done.
<118>Configuring loopback interface...
<6>lo0: link state changed to UP
<118>done.
<118>Configuring kernel modules...
amdsmn0: <AMD Family 17h System Management Network> on hostb0
amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb0
<118>done.
<118>Setting up extended sysctls...done.
<118>Setting timezone: Europe/Amsterdam
<118>Writing firmware settings: FreeBSD OPNsense
<118>Writing trust files...done.
<118>Scanning /usr/share/certs/untrusted for certificates...
<118>Scanning /usr/share/certs/trusted for certificates...
<118>Scanning /usr/local/share/certs for certificates...
<118>certctl: No changes to trust store were made.
<118>Writing trust bundles...done.
<118>Setting hostname: OPNsense.home
<118>Generating /etc/resolv.conf...done.
<118>Generating /etc/hosts...done.
<118>Configuring system logging...done.
<118>Configuring firewall.......
<6>pflog0: permanently promiscuous mode enabled
<118>done.
<118>Configuring hardware interfaces...done.
<118>Configuring loopback interface...done.
<118>Configuring LAGG interfaces...done.
<118>Configuring VLAN interfaces...
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Disabled
ax0: VLAN filtering Disabled
ax0: VLAN Stripping Disabled
<6>vlan0: changing name to 'vlan01'
ax0: Registering VLAN 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Disabled
ax0: VLAN filtering Disabled
ax0: VLAN Stripping Disabled
ax0: VLAN 6 already registered
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Disabled
ax0: VLAN filtering Disabled
ax0: VLAN Stripping Disabled
<118>done.
<118>Configuring LAN_2 interface...
<6>igc1: link state changed to DOWN
<118>done.
<118>Configuring LAN_3 interface...
<6>igc2: link state changed to DOWN
<118>done.
<118>Configuring LAN_4 interface...
<6>igc3: link state changed to DOWN
<118>done.
<118>Configuring LAN_SFP interface...
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
<118>done.
<118>Configuring WAN_RAW interface...
ax0: xgbe_config_sph_mode: SPH disabled in channel 0
ax0: xgbe_config_sph_mode: SPH disabled in channel 1
ax0: xgbe_config_sph_mode: SPH disabled in channel 2
ax0: xgbe_config_sph_mode: SPH disabled in channel 3
ax0: xgbe_config_sph_mode: SPH disabled in channel 4
ax0: xgbe_config_sph_mode: SPH disabled in channel 5
ax0: xgbe_config_sph_mode: SPH disabled in channel 6
ax0: xgbe_config_sph_mode: SPH disabled in channel 7
ax0: RSS Enabled
ax0: Receive checksum offload Disabled
ax0: VLAN filtering Disabled
ax0: VLAN Stripping Disabled
<118>done.
<118>Configuring LAN_MANAGEMENT interface...done.
<6>bridge0: Ethernet address: 58:9c:fc:10:ff:bb
<6>bridge0: link state changed to UP
<6>igc1: promiscuous mode enabled
<6>igc2: promiscuous mode enabled
<6>igc3: promiscuous mode enabled
<118>Configuring LAN_1_BRIDGE interface...done.
<118>Configuring WAN_FTTH interface...
<6>ng0: changing name to 'pppoe0'
<3>nd6_dad_timer: called with non-tentative address fe80:6::f690:eaff:fe01:2be5(ax1)
<118>done.
<118>Generating /etc/resolv.conf...done.
<118>Generating /etc/hosts...done.
<118>Configuring firewall..
<6>igc2: link state changed to UP
<118>.....done.
<118>Configuring OpenSSH...done.
<118>Starting web GUI...done.
<118>Setting up routes...
<6>igc3: link state changed to UP
<118>done.
<118>Starting DHCPv4 service...
ax1: Link is UP - 10Gbps/Full - flow control off
<6>ax1: link state changed to UP
<6>igc1: link state changed to UP
<118>done.
<118>Starting DHCPv6 service...done.
<118>Starting router advertisement service...done.
<118>Starting Unbound DNS...done.
<118>Configuring firewall.......done.
<118>Setting up gateway monitor...done.
<118>Syncing OpenVPN settings...done.
<118>Starting NTP service...done.
<118>Starting Unbound DNS...done.
<118>Starting power daemon...done.
<118>>>> Invoking start script 'newwanip'
<118>Reconfiguring IPv4 on pppoe0
<118>Reconfiguring IPv6 on pppoe0
<118>>>> Invoking start script 'freebsd'
<118>Starting monit.
<118>Starting Monit 5.34.4 daemon with http interface at [*]:2812
<118>Starting suricata.
<118>[33mInfo[0m: [32mconf-yaml-loader[0m: Including configuration file installed_rules.yaml.[0m
<118>[33mInfo[0m: [32mconf-yaml-loader[0m: Configuration node 'rule-files' redefined.[0m
<118>[33mInfo[0m: [32mconf-yaml-loader[0m: Including configuration file custom.yaml.[0m
<118>>>> Invoking start script 'syslog'
<118>>>> Invoking start script 'carp'
<118>>>> Invoking start script 'cron'
<118>Starting Cron: OK
<118>>>> Invoking start script 'openvpn'
<118>>>> Invoking start script 'sysctl'
<118>Service `sysctl' has been restarted.
<118>>>> Invoking start script 'beep'
<118>Root file system: zroot/ROOT/default
<118>Sun May 11 13:07:27 CEST 2025
<118>
<118>*** OPNsense.home: OPNsense 25.4 (amd64) ***
<118>
<118> LAN_1_BRIDGE (bridge0) -> v4: 192.168.3.1/24
<118> LAN_2 (igc1) ->
<118> LAN_3 (igc2) ->
<118> LAN_4 (igc3) ->
<118> LAN_MANAGEMENT (igc0) -> v4: 192.168.2.1/24
<118> LAN_SFP (ax1) -> v4: 192.168.1.1/24
<118> v6: 2a02:22a0:bbba:f900::1/64
<118> WAN_FTTH (pppoe0) -> v4/PPPoE: 77.61.56.117/32
<118> v6/DHCP6: fe80::f690:eaff:fe01:2be0%pppoe0/64
<118> WAN_RAW (ax0) ->
<118>
<118> HTTPS: sha256 FE D8 BE D2 C5 6F B1 15 0F C1 47 70 1B 57 C7 75
<118> B8 03 4C D7 E0 59 14 34 91 96 34 95 FC 40 39 F7
<118> SSH: SHA256 nKDcJMQ4iwjdJRyl0J8m2uKj52vQpergfcLuz1Eu8JM (ECDSA)
<118> SSH: SHA256 92s47heG5ihS5fzETP/iCTAnSng42anazcEKE8sw8qs (ED25519)
<118> SSH: SHA256 n7ax3CA2BMRgq16CrHNPdXgrdxXqkHq2VSEJVQ4YRJY (RSA)
753.564825 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
753.572054 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
753.579412 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
753.642053 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
754.529989 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
754.537218 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
754.544573 [ 852] iflib_netmap_config txr 8 rxr 8 txd 512 rxd 512 rbufsz 2048
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
ax1: xgbe_config_sph_mode: SPH disabled in channel 0
ax1: xgbe_config_sph_mode: SPH disabled in channel 1
ax1: xgbe_config_sph_mode: SPH disabled in channel 2
ax1: xgbe_config_sph_mode: SPH disabled in channel 3
ax1: xgbe_config_sph_mode: SPH disabled in channel 4
ax1: xgbe_config_sph_mode: SPH disabled in channel 5
ax1: xgbe_config_sph_mode: SPH disabled in channel 6
ax1: xgbe_config_sph_mode: SPH disabled in channel 7
ax1: RSS Enabled
ax1: Receive checksum offload Disabled
ax1: VLAN filtering Disabled
ax1: VLAN Stripping Disabled
928.859503 [4335] netmap_transmit ax1 full hwcur 508 hwtail 249 qlen 258
928.868149 [4335] netmap_transmit ax1 full hwcur 249 hwtail 507 qlen 253
973.166011 [4335] netmap_transmit ax1 full hwcur 350 hwtail 173 qlen 176
973.175904 [4335] netmap_transmit ax1 full hwcur 349 hwtail 96 qlen 252
985.986182 [4335] netmap_transmit ax1 full hwcur 441 hwtail 205 qlen 235
985.994987 [4335] netmap_transmit ax1 full hwcur 205 hwtail 440 qlen 276
986.003619 [4335] netmap_transmit ax1 full hwcur 440 hwtail 204 qlen 235
986.012394 [4335] netmap_transmit ax1 full hwcur 204 hwtail 439 qlen 276
492.649674 [4335] netmap_transmit ax1 full hwcur 56 hwtail 315 qlen 252
492.657344 [4335] netmap_transmit ax1 full hwcur 315 hwtail 55 qlen 259
828.986141 [4335] netmap_transmit ax1 full hwcur 203 hwtail 467 qlen 247
828.994780 [4335] netmap_transmit ax1 full hwcur 467 hwtail 202 qlen 264
829.003333 [4335] netmap_transmit ax1 full hwcur 202 hwtail 466 qlen 247
829.011930 [4335] netmap_transmit ax1 full hwcur 466 hwtail 201 qlen 264
850.105641 [4335] netmap_transmit ax1 full hwcur 111 hwtail 316 qlen 306
850.113997 [4335] netmap_transmit ax1 full hwcur 316 hwtail 110 qlen 205
852.217832 [4335] netmap_transmit ax1 full hwcur 30 hwtail 277 qlen 264
855.151827 [4335] netmap_transmit ax1 full hwcur 70 hwtail 273 qlen 308
855.160040 [4335] netmap_transmit ax1 full hwcur 273 hwtail 69 qlen 203
856.895949 [4335] netmap_transmit ax1 full hwcur 143 hwtail 339 qlen 315
856.904265 [4335] netmap_transmit ax1 full hwcur 339 hwtail 142 qlen 196
008.303903 [4335] netmap_transmit ax1 full hwcur 460 hwtail 166 qlen 293
008.311816 [4335] netmap_transmit ax1 full hwcur 166 hwtail 459 qlen 218
009.001869 [4335] netmap_transmit ax1 full hwcur 191 hwtail 460 qlen 242
009.009956 [4335] netmap_transmit ax1 full hwcur 460 hwtail 190 qlen 269
010.005918 [4335] netmap_transmit ax1 full hwcur 0 hwtail 263 qlen 248
010.013802 [4335] netmap_transmit ax1 full hwcur 263 hwtail 511 qlen 263
011.004942 [4335] netmap_transmit ax1 full hwcur 418 hwtail 119 qlen 298
011.012911 [4335] netmap_transmit ax1 full hwcur 119 hwtail 417 qlen 213
012.010986 [4335] netmap_transmit ax1 full hwcur 479 hwtail 248 qlen 230
012.018981 [4335] netmap_transmit ax1 full hwcur 248 hwtail 478 qlen 281
013.001791 [4335] netmap_transmit ax1 full hwcur 43 hwtail 268 qlen 286
013.009673 [4335] netmap_transmit ax1 full hwcur 268 hwtail 42 qlen 225
014.000517 [4335] netmap_transmit ax1 full hwcur 434 hwtail 177 qlen 256
014.008562 [4335] netmap_transmit ax1 full hwcur 177 hwtail 433 qlen 255
015.021614 [4335] netmap_transmit ax1 full hwcur 483 hwtail 208 qlen 274
015.029497 [4335] netmap_transmit ax1 full hwcur 208 hwtail 482 qlen 237
016.003537 [4335] netmap_transmit ax1 full hwcur 247 hwtail 2 qlen 244
016.011465 [4335] netmap_transmit ax1 full hwcur 2 hwtail 246 qlen 267
017.000876 [4335] netmap_transmit ax1 full hwcur 453 hwtail 220 qlen 232
017.008857 [4335] netmap_transmit ax1 full hwcur 220 hwtail 452 qlen 279
018.010871 [4335] netmap_transmit ax1 full hwcur 171 hwtail 416 qlen 266
018.018737 [4335] netmap_transmit ax1 full hwcur 416 hwtail 170 qlen 245
362.281942 [4335] netmap_transmit ax1 full hwcur 209 hwtail 446 qlen 274
362.289960 [4335] netmap_transmit ax1 full hwcur 446 hwtail 208 qlen 237
363.529076 [4335] netmap_transmit ax1 full hwcur 324 hwtail 47 qlen 276
363.536985 [4335] netmap_transmit ax1 full hwcur 47 hwtail 323 qlen 235
366.460250 [4335] netmap_transmit ax1 full hwcur 428 hwtail 148 qlen 279
366.468220 [4335] netmap_transmit ax1 full hwcur 148 hwtail 427 qlen 232
369.974385 [4335] netmap_transmit ax1 full hwcur 141 hwtail 419 qlen 233
369.983359 [4335] netmap_transmit ax1 full hwcur 419 hwtail 140 qlen 278
370.024022 [4335] netmap_transmit ax1 full hwcur 271 hwtail 37 qlen 233
370.032072 [4335] netmap_transmit ax1 full hwcur 37 hwtail 270 qlen 278
433.462913 [4335] netmap_transmit ax1 full hwcur 168 hwtail 428 qlen 251
433.471004 [4335] netmap_transmit ax1 full hwcur 428 hwtail 167 qlen 260
387.249757 [4335] netmap_transmit ax1 full hwcur 426 hwtail 164 qlen 261
387.380317 [4335] netmap_transmit ax1 full hwcur 229 hwtail 477 qlen 263
443.594023 [4335] netmap_transmit ax1 full hwcur 134 hwtail 386 qlen 259
452.670384 [4335] netmap_transmit ax1 full hwcur 42 hwtail 372 qlen 181
478.567483 [4335] netmap_transmit ax1 full hwcur 230 hwtail 470 qlen 271
576.560256 [4335] netmap_transmit ax1 full hwcur 309 hwtail 41 qlen 267
576.568238 [4335] netmap_transmit ax1 full hwcur 41 hwtail 308 qlen 244
968.493216 [4335] netmap_transmit ax1 full hwcur 62 hwtail 291 qlen 282
968.527476 [4335] netmap_transmit ax1 full hwcur 414 hwtail 115 qlen 298
979.697479 [4335] netmap_transmit ax1 full hwcur 374 hwtail 138 qlen 235
174.712890 [4335] netmap_transmit ax1 full hwcur 436 hwtail 184 qlen 251
174.724969 [4335] netmap_transmit ax1 full hwcur 435 hwtail 177 qlen 257
175.049257 [4335] netmap_transmit ax1 full hwcur 489 hwtail 193 qlen 295
175.057131 [4335] netmap_transmit ax1 full hwcur 193 hwtail 488 qlen 216
176.304467 [4335] netmap_transmit ax1 full hwcur 263 hwtail 22 qlen 240
176.619986 [4335] netmap_transmit ax1 full hwcur 504 hwtail 220 qlen 283
177.396394 [4335] netmap_transmit ax1 full hwcur 89 hwtail 320 qlen 280
480.190431 [4335] netmap_transmit ax1 full hwcur 143 hwtail 419 qlen 235
481.571473 [4335] netmap_transmit ax1 full hwcur 505 hwtail 258 qlen 246
513.891618 [4335] netmap_transmit ax1 full hwcur 233 hwtail 457 qlen 287
514.158551 [4335] netmap_transmit ax1 full hwcur 170 hwtail 424 qlen 257
514.167246 [4335] netmap_transmit ax1 full hwcur 424 hwtail 169 qlen 254
515.244044 [4335] netmap_transmit ax1 full hwcur 368 hwtail 97 qlen 270
516.019083 [4335] netmap_transmit ax1 full hwcur 477 hwtail 163 qlen 313
516.026953 [4335] netmap_transmit ax1 full hwcur 163 hwtail 476 qlen 198
517.169150 [4335] netmap_transmit ax1 full hwcur 312 hwtail 57 qlen 254
517.176953 [4335] netmap_transmit ax1 full hwcur 57 hwtail 311 qlen 257
519.188951 [4335] netmap_transmit ax1 full hwcur 321 hwtail 54 qlen 266
519.196745 [4335] netmap_transmit ax1 full hwcur 54 hwtail 320 qlen 245
535.951549 [4335] netmap_transmit ax1 full hwcur 353 hwtail 119 qlen 233
546.413557 [4335] netmap_transmit ax1 full hwcur 34 hwtail 306 qlen 239
549.063548 [4335] netmap_transmit ax1 full hwcur 138 hwtail 407 qlen 242
551.920398 [4335] netmap_transmit ax1 full hwcur 27 hwtail 242 qlen 296
553.079669 [4335] netmap_transmit ax1 full hwcur 217 hwtail 490 qlen 238
553.087756 [4335] netmap_transmit ax1 full hwcur 490 hwtail 216 qlen 273
579.465314 [4335] netmap_transmit ax1 full hwcur 244 hwtail 6 qlen 237
515.206019 [4335] netmap_transmit ax1 full hwcur 398 hwtail 148 qlen 249
407.897352 [4335] netmap_transmit ax1 full hwcur 417 hwtail 87 qlen 329
407.905111 [4335] netmap_transmit ax1 full hwcur 87 hwtail 416 qlen 182
408.001069 [4335] netmap_transmit ax1 full hwcur 256 hwtail 48 qlen 207
408.009114 [4335] netmap_transmit ax1 full hwcur 48 hwtail 255 qlen 304
409.016510 [4335] netmap_transmit ax1 full hwcur 141 hwtail 413 qlen 239
409.024639 [4335] netmap_transmit ax1 full hwcur 413 hwtail 140 qlen 272
410.006963 [4335] netmap_transmit ax1 full hwcur 274 hwtail 0 qlen 273
410.014800 [4335] netmap_transmit ax1 full hwcur 0 hwtail 273 qlen 238
411.004633 [4335] netmap_transmit ax1 full hwcur 148 hwtail 401 qlen 258
411.012692 [4335] netmap_transmit ax1 full hwcur 401 hwtail 147 qlen 253
412.002600 [4335] netmap_transmit ax1 full hwcur 66 hwtail 348 qlen 229
412.010660 [4335] netmap_transmit ax1 full hwcur 348 hwtail 65 qlen 282
413.003193 [4335] netmap_transmit ax1 full hwcur 413 hwtail 162 qlen 250
413.011286 [4335] netmap_transmit ax1 full hwcur 162 hwtail 412 qlen 261
414.009720 [4335] netmap_transmit ax1 full hwcur 30 hwtail 296 qlen 245
414.017736 [4335] netmap_transmit ax1 full hwcur 296 hwtail 29 qlen 266
415.012170 [4335] netmap_transmit ax1 full hwcur 261 hwtail 507 qlen 265
415.020240 [4335] netmap_transmit ax1 full hwcur 507 hwtail 260 qlen 246
416.002762 [4335] netmap_transmit ax1 full hwcur 72 hwtail 351 qlen 232
416.010699 [4335] netmap_transmit ax1 full hwcur 351 hwtail 71 qlen 279
417.009488 [4335] netmap_transmit ax1 full hwcur 31 hwtail 249 qlen 293
417.017331 [4335] netmap_transmit ax1 full hwcur 249 hwtail 30 qlen 218
808.117924 [4335] netmap_transmit ax1 full hwcur 418 hwtail 249 qlen 168
808.125089 [4335] netmap_transmit ax1 full hwcur 418 hwtail 249 qlen 168
809.001282 [4335] netmap_transmit ax1 full hwcur 334 hwtail 98 qlen 235
809.009330 [4335] netmap_transmit ax1 full hwcur 98 hwtail 333 qlen 276
810.008425 [4335] netmap_transmit ax1 full hwcur 413 hwtail 128 qlen 284
810.016401 [4335] netmap_transmit ax1 full hwcur 128 hwtail 412 qlen 227
811.001174 [4335] netmap_transmit ax1 full hwcur 62 hwtail 312 qlen 261
811.009129 [4335] netmap_transmit ax1 full hwcur 312 hwtail 61 qlen 250
812.008329 [4335] netmap_transmit ax1 full hwcur 110 hwtail 334 qlen 287
812.016224 [4335] netmap_transmit ax1 full hwcur 334 hwtail 109 qlen 224
813.005887 [4335] netmap_transmit ax1 full hwcur 505 hwtail 246 qlen 258
813.013993 [4335] netmap_transmit ax1 full hwcur 246 hwtail 504 qlen 253
814.001564 [4335] netmap_transmit ax1 full hwcur 24 hwtail 290 qlen 245
814.009580 [4335] netmap_transmit ax1 full hwcur 290 hwtail 23 qlen 266
815.010322 [4335] netmap_transmit ax1 full hwcur 83 hwtail 330 qlen 264
815.018291 [4335] netmap_transmit ax1 full hwcur 330 hwtail 82 qlen 247
816.001207 [4335] netmap_transmit ax1 full hwcur 162 hwtail 437 qlen 236
816.009210 [4335] netmap_transmit ax1 full hwcur 437 hwtail 161 qlen 275
817.027009 [4335] netmap_transmit ax1 full hwcur 455 hwtail 213 qlen 241
817.035109 [4335] netmap_transmit ax1 full hwcur 213 hwtail 454 qlen 270
818.007323 [4335] netmap_transmit ax1 full hwcur 335 hwtail 69 qlen 265
818.015234 [4335] netmap_transmit ax1 full hwcur 69 hwtail 334 qlen 246
960.665362 [4335] netmap_transmit ax1 full hwcur 199 hwtail 470 qlen 240
960.675001 [4335] netmap_transmit ax1 full hwcur 470 hwtail 198 qlen 271
222.768191 [4335] netmap_transmit ax1 full hwcur 82 hwtail 352 qlen 241
222.776185 [4335] netmap_transmit ax1 full hwcur 352 hwtail 81 qlen 270
204.973719 [4335] netmap_transmit ax1 full hwcur 204 hwtail 499 qlen 216
204.981853 [4335] netmap_transmit ax1 full hwcur 499 hwtail 203 qlen 295
205.003836 [4335] netmap_transmit ax1 full hwcur 201 hwtail 469 qlen 243
205.011897 [4335] netmap_transmit ax1 full hwcur 469 hwtail 200 qlen 268
206.001028 [4335] netmap_transmit ax1 full hwcur 47 hwtail 290 qlen 268
206.008844 [4335] netmap_transmit ax1 full hwcur 290 hwtail 46 qlen 243
207.008235 [4335] netmap_transmit ax1 full hwcur 507 hwtail 242 qlen 264
207.016257 [4335] netmap_transmit ax1 full hwcur 242 hwtail 506 qlen 247
208.009569 [4335] netmap_transmit ax1 full hwcur 406 hwtail 179 qlen 226
208.017725 [4335] netmap_transmit ax1 full hwcur 179 hwtail 405 qlen 285
209.001474 [4335] netmap_transmit ax1 full hwcur 61 hwtail 319 qlen 253
209.009432 [4335] netmap_transmit ax1 full hwcur 319 hwtail 60 qlen 258
210.000679 [4335] netmap_transmit ax1 full hwcur 16 hwtail 234 qlen 293
210.008391 [4335] netmap_transmit ax1 full hwcur 234 hwtail 15 qlen 218
211.004694 [4335] netmap_transmit ax1 full hwcur 464 hwtail 244 qlen 219
211.012860 [4335] netmap_transmit ax1 full hwcur 244 hwtail 463 qlen 292
212.006288 [4335] netmap_transmit ax1 full hwcur 462 hwtail 231 qlen 230
212.014393 [4335] netmap_transmit ax1 full hwcur 231 hwtail 461 qlen 281
213.000813 [4335] netmap_transmit ax1 full hwcur 144 hwtail 397 qlen 258
213.008869 [4335] netmap_transmit ax1 full hwcur 397 hwtail 143 qlen 253
214.001513 [4335] netmap_transmit ax1 full hwcur 186 hwtail 465 qlen 232
214.009606 [4335] netmap_transmit ax1 full hwcur 465 hwtail 185 qlen 279
215.003511 [4335] netmap_transmit ax1 full hwcur 311 hwtail 44 qlen 266
531.719991 [4335] netmap_transmit ax1 full hwcur 27 hwtail 351 qlen 187
725.014534 [4335] netmap_transmit ax1 full hwcur 199 hwtail 426 qlen 284
727.179601 [4335] netmap_transmit ax1 full hwcur 461 hwtail 207 qlen 253
833.994015 [4335] netmap_transmit ax1 full hwcur 424 hwtail 158 qlen 265
834.002525 [4335] netmap_transmit ax1 full hwcur 158 hwtail 423 qlen 246
846.133974 [4335] netmap_transmit ax1 full hwcur 260 hwtail 492 qlen 279
846.142444 [4335] netmap_transmit ax1 full hwcur 492 hwtail 259 qlen 232
856.521391 [4335] netmap_transmit ax1 full hwcur 104 hwtail 335 qlen 280
856.529831 [4335] netmap_transmit ax1 full hwcur 335 hwtail 103 qlen 231
892.836847 [4335] netmap_transmit ax1 full hwcur 49 hwtail 266 qlen 294
892.845155 [4335] netmap_transmit ax1 full hwcur 266 hwtail 48 qlen 217
903.195087 [4335] netmap_transmit ax1 full hwcur 132 hwtail 400 qlen 243
903.203701 [4335] netmap_transmit ax1 full hwcur 400 hwtail 131 qlen 268
913.554077 [4335] netmap_transmit ax1 full hwcur 151 hwtail 402 qlen 260
913.562400 [4335] netmap_transmit ax1 full hwcur 402 hwtail 150 qlen 251
918.724988 [4335] netmap_transmit ax1 full hwcur 155 hwtail 437 qlen 229
918.733695 [4335] netmap_transmit ax1 full hwcur 437 hwtail 154 qlen 282
923.916995 [4335] netmap_transmit ax1 full hwcur 333 hwtail 95 qlen 237
923.925526 [4335] netmap_transmit ax1 full hwcur 95 hwtail 332 qlen 274
948.097681 [4335] netmap_transmit ax1 full hwcur 506 hwtail 242 qlen 263
948.105974 [4335] netmap_transmit ax1 full hwcur 242 hwtail 505 qlen 248
949.238859 [4335] netmap_transmit ax1 full hwcur 476 hwtail 246 qlen 229
949.247512 [4335] netmap_transmit ax1 full hwcur 246 hwtail 475 qlen 282
872.364427 [4335] netmap_transmit ax1 full hwcur 331 hwtail 127 qlen 203
872.565639 [4335] netmap_transmit ax1 full hwcur 189 hwtail 461 qlen 239
146.486738 [4335] netmap_transmit ax1 full hwcur 267 hwtail 14 qlen 252
285.907985 [4335] netmap_transmit ax1 full hwcur 269 hwtail 39 qlen 229
285.918276 [4335] netmap_transmit ax1 full hwcur 233 hwtail 447 qlen 297
286.058920 [4335] netmap_transmit ax1 full hwcur 53 hwtail 297 qlen 267
286.066647 [4335] netmap_transmit ax1 full hwcur 297 hwtail 52 qlen 244
604.820896 [4335] netmap_transmit ax1 full hwcur 387 hwtail 76 qlen 310
604.828611 [4335] netmap_transmit ax1 full hwcur 76 hwtail 386 qlen 201
605.014139 [4335] netmap_transmit ax1 full hwcur 504 hwtail 213 qlen 290
605.022134 [4335] netmap_transmit ax1 full hwcur 213 hwtail 503 qlen 221
606.036590 [4335] netmap_transmit ax1 full hwcur 261 hwtail 506 qlen 266
606.044444 [4335] netmap_transmit ax1 full hwcur 506 hwtail 260 qlen 245
607.004224 [4335] netmap_transmit ax1 full hwcur 12 hwtail 268 qlen 255
607.012137 [4335] netmap_transmit ax1 full hwcur 268 hwtail 11 qlen 256
608.023740 [4335] netmap_transmit ax1 full hwcur 468 hwtail 229 qlen 238
608.031707 [4335] netmap_transmit ax1 full hwcur 229 hwtail 467 qlen 273
609.005357 [4335] netmap_transmit ax1 full hwcur 380 hwtail 150 qlen 229
609.013531 [4335] netmap_transmit ax1 full hwcur 150 hwtail 379 qlen 282
610.019289 [4335] netmap_transmit ax1 full hwcur 315 hwtail 36 qlen 278
610.027045 [4335] netmap_transmit ax1 full hwcur 36 hwtail 314 qlen 233
611.003379 [4335] netmap_transmit ax1 full hwcur 460 hwtail 210 qlen 249
611.011504 [4335] netmap_transmit ax1 full hwcur 210 hwtail 459 qlen 262
612.001298 [4335] netmap_transmit ax1 full hwcur 84 hwtail 311 qlen 284
612.009088 [4335] netmap_transmit ax1 full hwcur 311 hwtail 83 qlen 227
613.002851 [4335] netmap_transmit ax1 full hwcur 478 hwtail 184 qlen 293
613.010693 [4335] netmap_transmit ax1 full hwcur 184 hwtail 477 qlen 218
614.001514 [4335] netmap_transmit ax1 full hwcur 451 hwtail 181 qlen 269
614.009447 [4335] netmap_transmit ax1 full hwcur 181 hwtail 450 qlen 242
276.967727 [4335] netmap_transmit ax1 full hwcur 226 hwtail 444 qlen 293
276.976301 [4335] netmap_transmit ax1 full hwcur 444 hwtail 225 qlen 218
219.407245 [4335] netmap_transmit ax1 full hwcur 9 hwtail 241 qlen 279
219.415044 [4335] netmap_transmit ax1 full hwcur 241 hwtail 8 qlen 232
220.481058 [4335] netmap_transmit ax1 full hwcur 492 hwtail 278 qlen 213
004.818330 [4335] netmap_transmit ax1 full hwcur 172 hwtail 296 qlen 387
004.826003 [4335] netmap_transmit ax1 full hwcur 296 hwtail 171 qlen 124
005.036208 [4335] netmap_transmit ax1 full hwcur 31 hwtail 255 qlen 287
005.044084 [4335] netmap_transmit ax1 full hwcur 255 hwtail 30 qlen 224
006.005489 [4335] netmap_transmit ax1 full hwcur 356 hwtail 116 qlen 239
006.013572 [4335] netmap_transmit ax1 full hwcur 116 hwtail 355 qlen 272
007.003947 [4335] netmap_transmit ax1 full hwcur 363 hwtail 85 qlen 277
007.011732 [4335] netmap_transmit ax1 full hwcur 85 hwtail 362 qlen 234
008.002861 [4335] netmap_transmit ax1 full hwcur 230 hwtail 466 qlen 275
008.010855 [4335] netmap_transmit ax1 full hwcur 466 hwtail 229 qlen 236
009.019532 [4335] netmap_transmit ax1 full hwcur 37 hwtail 268 qlen 280
009.027442 [4335] netmap_transmit ax1 full hwcur 268 hwtail 36 qlen 231
010.004517 [4335] netmap_transmit ax1 full hwcur 60 hwtail 315 qlen 256
010.012365 [4335] netmap_transmit ax1 full hwcur 315 hwtail 59 qlen 255
011.001398 [4335] netmap_transmit ax1 full hwcur 124 hwtail 382 qlen 253
011.009483 [4335] netmap_transmit ax1 full hwcur 382 hwtail 123 qlen 258
012.010748 [4335] netmap_transmit ax1 full hwcur 494 hwtail 197 qlen 296
012.018753 [4335] netmap_transmit ax1 full hwcur 197 hwtail 493 qlen 215
013.011291 [4335] netmap_transmit ax1 full hwcur 220 hwtail 452 qlen 279
013.019145 [4335] netmap_transmit ax1 full hwcur 452 hwtail 219 qlen 232
014.003435 [4335] netmap_transmit ax1 full hwcur 364 hwtail 128 qlen 235
014.011544 [4335] netmap_transmit ax1 full hwcur 128 hwtail 363 qlen 276
651.480278 [4335] netmap_transmit ax1 full hwcur 428 hwtail 204 qlen 223
651.489341 [4335] netmap_transmit ax1 full hwcur 204 hwtail 427 qlen 288
404.176445 [4335] netmap_transmit ax1 full hwcur 163 hwtail 418 qlen 256
404.184461 [4335] netmap_transmit ax1 full hwcur 418 hwtail 162 qlen 255
405.011082 [4335] netmap_transmit ax1 full hwcur 160 hwtail 387 qlen 284
405.019131 [4335] netmap_transmit ax1 full hwcur 387 hwtail 159 qlen 227
406.009116 [4335] netmap_transmit ax1 full hwcur 310 hwtail 46 qlen 263
406.016964 [4335] netmap_transmit ax1 full hwcur 46 hwtail 309 qlen 248
407.003767 [4335] netmap_transmit ax1 full hwcur 148 hwtail 392 qlen 267
407.011851 [4335] netmap_transmit ax1 full hwcur 392 hwtail 147 qlen 244
408.018621 [4335] netmap_transmit ax1 full hwcur 355 hwtail 97 qlen 257
408.026625 [4335] netmap_transmit ax1 full hwcur 97 hwtail 354 qlen 254
409.002513 [4335] netmap_transmit ax1 full hwcur 509 hwtail 267 qlen 241
409.010651 [4335] netmap_transmit ax1 full hwcur 267 hwtail 508 qlen 270
410.001486 [4335] netmap_transmit ax1 full hwcur 364 hwtail 90 qlen 273
410.009384 [4335] netmap_transmit ax1 full hwcur 90 hwtail 363 qlen 238
411.018016 [4335] netmap_transmit ax1 full hwcur 104 hwtail 374 qlen 241
411.026079 [4335] netmap_transmit ax1 full hwcur 374 hwtail 103 qlen 270
412.010372 [4335] netmap_transmit ax1 full hwcur 177 hwtail 440 qlen 248
412.018526 [4335] netmap_transmit ax1 full hwcur 440 hwtail 176 qlen 263
413.000928 [4335] netmap_transmit ax1 full hwcur 121 hwtail 376 qlen 256
413.008981 [4335] netmap_transmit ax1 full hwcur 376 hwtail 120 qlen 255
414.001819 [4335] netmap_transmit ax1 full hwcur 324 hwtail 74 qlen 249
414.009794 [4335] netmap_transmit ax1 full hwcur 74 hwtail 323 qlen 262
771.313562 [4335] netmap_transmit ax1 full hwcur 386 hwtail 205 qlen 180
669.283386 [4335] netmap_transmit ax1 full hwcur 314 hwtail 56 qlen 257
726.280503 [4335] netmap_transmit ax1 full hwcur 79 hwtail 328 qlen 262
631.452841 [4335] netmap_transmit ax1 full hwcur 350 hwtail 41 qlen 308
631.461643 [4335] netmap_transmit ax1 full hwcur 41 hwtail 349 qlen 203
583.244842 [4335] netmap_transmit ax1 full hwcur 13 hwtail 286 qlen 238
583.252850 [4335] netmap_transmit ax1 full hwcur 286 hwtail 12 qlen 273
620.908878 [4335] netmap_transmit ax1 full hwcur 470 hwtail 204 qlen 265
620.917388 [4335] netmap_transmit ax1 full hwcur 204 hwtail 469 qlen 246
214.697170 [4335] netmap_transmit ax1 full hwcur 19 hwtail 254 qlen 276
214.705565 [4335] netmap_transmit ax1 full hwcur 254 hwtail 18 qlen 235
205.300943 [4335] netmap_transmit ax1 full hwcur 5 hwtail 231 qlen 285
205.308715 [4335] netmap_transmit ax1 full hwcur 231 hwtail 4 qlen 226
206.023950 [4335] netmap_transmit ax1 full hwcur 298 hwtail 17 qlen 280
206.031904 [4335] netmap_transmit ax1 full hwcur 17 hwtail 297 qlen 231
207.018953 [4335] netmap_transmit ax1 full hwcur 347 hwtail 99 qlen 247
207.026974 [4335] netmap_transmit ax1 full hwcur 99 hwtail 346 qlen 264
208.000883 [4335] netmap_transmit ax1 full hwcur 177 hwtail 457 qlen 231
208.009027 [4335] netmap_transmit ax1 full hwcur 457 hwtail 176 qlen 280
209.011475 [4335] netmap_transmit ax1 full hwcur 108 hwtail 353 qlen 266
209.019379 [4335] netmap_transmit ax1 full hwcur 353 hwtail 107 qlen 245
210.015739 [4335] netmap_transmit ax1 full hwcur 304 hwtail 42 qlen 261
210.023733 [4335] netmap_transmit ax1 full hwcur 42 hwtail 303 qlen 250
211.020125 [4335] netmap_transmit ax1 full hwcur 253 hwtail 5 qlen 247
211.028068 [4335] netmap_transmit ax1 full hwcur 5 hwtail 252 qlen 264
212.037890 [4335] netmap_transmit ax1 full hwcur 298 hwtail 32 qlen 265
212.045876 [4335] netmap_transmit ax1 full hwcur 32 hwtail 297 qlen 246
213.025183 [4335] netmap_transmit ax1 full hwcur 501 hwtail 262 qlen 238
213.033315 [4335] netmap_transmit ax1 full hwcur 262 hwtail 500 qlen 273
214.040631 [4335] netmap_transmit ax1 full hwcur 509 hwtail 272 qlen 236
214.048848 [4335] netmap_transmit ax1 full hwcur 272 hwtail 508 qlen 275
215.001929 [4335] netmap_transmit ax1 full hwcur 67 hwtail 293 qlen 285
215.009699 [4335] netmap_transmit ax1 full hwcur 293 hwtail 66 qlen 226
568.702995 [4335] netmap_transmit ax1 full hwcur 52 hwtail 300 qlen 263
568.711848 [4335] netmap_transmit ax1 full hwcur 300 hwtail 51 qlen 248
969.946772 [4335] netmap_transmit ax1 full hwcur 294 hwtail 41 qlen 252
kernel trap 12 with interrupts disabled
Fatal trap 12: page fault while in kernel mode
cpuid = 3; apic id = 03
fault virtual address = 0xd00040
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80c1ca00
stack pointer = 0x28:0xfffffe01197f7b40
frame pointer = 0x28:0xfffffe01197f7b70
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = resume, IOPL = 0
current process = 47832 (W#02-ax1^)
rdi: fffff800634012c0 rsi: fffff800634012a0 rdx: ffffffff8127173a
rcx: fffff80001ed7a80 r8: 0000000000000000 r9: fffffe011be5b000
rax: ffffffff81becc80 rbx: fffff80295275000 rbp: fffffe01197f7b70
r10: 000000000000015f r11: 0000000000000006 r12: fffff800634012c0
r13: 0000000000000000 r14: 0000000000000101 r15: 0000000000d00000
trap number = 12
panic: page fault
cpuid = 3
time = 1747781053
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01197f7830
vpanic() at vpanic+0x131/frame 0xfffffe01197f7960
panic() at panic+0x43/frame 0xfffffe01197f79c0
trap_fatal() at trap_fatal+0x40b/frame 0xfffffe01197f7a20
trap_pfault() at trap_pfault+0x46/frame 0xfffffe01197f7a70
calltrap() at calltrap+0x8/frame 0xfffffe01197f7a70
--- trap 0xc, rip = 0xffffffff80c1ca00, rsp = 0xfffffe01197f7b40, rbp = 0xfffffe01197f7b70 ---
sleepq_add() at sleepq_add+0x50/frame 0xfffffe01197f7b70
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0xb6/frame 0xfffffe01197f7bd0
seltdwait() at seltdwait+0x72/frame 0xfffffe01197f7c00
kern_poll_kfds() at kern_poll_kfds+0x4a7/frame 0xfffffe01197f7c90
kern_poll() at kern_poll+0x9d/frame 0xfffffe01197f7de0
sys_poll() at sys_poll+0x50/frame 0xfffffe01197f7e00
amd64_syscall() at amd64_syscall+0x10e/frame 0xfffffe01197f7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01197f7f30
--- syscall (209, FreeBSD ELF64, poll), rip = 0x82a9fd4da, rsp = 0x84711ae48, rbp = 0x84711ae70 ---
KDB: enter: panic
panic.txt0600001215013202675 7132 ustarrootwheelpage faultversion.txt0600007515013202675 7536 ustarrootwheelFreeBSD 14.2-RELEASE-p2 stable/25.4-n269702-2a564b0b6525 SMP
- My machine is already grounded
- I ran memtest (full 4/4 test) as well yesterday. Everything passes:
Hi all,
I'm facing a similar problem.
[392219] Fatal trap 12: page fault while in kernel mode [392219] cpuid = 0; apic id = 04 [392219] fault virtual address = 0x12900 [392219] fault code = supervisor write data, page not present [392219] instruction pointer = 0x20:0xffffffff810d6250 [392219] stack pointer = 0x0:0xfffffe00fc878b50 [392219] frame pointer = 0x0:0xfffffe00fc878b80 [392219] code segment = base 0x0, limit 0xfffff, type 0x1b [392219] = DPL 0, pres 1, long 1, def32 0, gran 1 [392219] processor eflags = interrupt enabled, resume, IOPL = 0 [392219] current process = 91262 (netstat) [392220] rdi: fffff8013f6c53e0 rsi: 0000000000010002 rdx: 00000000000128f0 [392220] rcx: fffff8005fd86008 r8: 0000000000012900 r9: 8000000000000000 [392220] rax: fffff8005fd86000 rbx: fffff8013f6c5398 rbp: fffffe00fc878b80 [392220] r10: 0000000000000020 r11: 0000000000000040 r12: fffff8013f6c53d8 [392220] r13: 0000000000000000 r14: fffff8005fd87228 r15: fffffe00fc878c10
I updated my system 4 day ago to version 25.7 from a old version (24.x). Before updating the system had an uptime of more than 300 days. Two hours after the upgrade the first crash. Since then 3 crashes.
Already tested and replaced the memory, no bug. Last crash with new memory.
At least for me I would expect the crashes are somehow connected to the new version (maybe OS version).
Searching for support and ideas.
Thanks
Stefan
Hi all,
I'm facing a similar problem.
[392219] Fatal trap 12: page fault while in kernel mode [392219] cpuid = 0; apic id = 04 [392219] fault virtual address = 0x12900 [392219] fault code = supervisor write data, page not present [392219] instruction pointer = 0x20:0xffffffff810d6250 [392219] stack pointer = 0x0:0xfffffe00fc878b50 [392219] frame pointer = 0x0:0xfffffe00fc878b80 [392219] code segment = base 0x0, limit 0xfffff, type 0x1b [392219] = DPL 0, pres 1, long 1, def32 0, gran 1 [392219] processor eflags = interrupt enabled, resume, IOPL = 0 [392219] current process = 91262 (netstat) [392220] rdi: fffff8013f6c53e0 rsi: 0000000000010002 rdx: 00000000000128f0 [392220] rcx: fffff8005fd86008 r8: 0000000000012900 r9: 8000000000000000 [392220] rax: fffff8005fd86000 rbx: fffff8013f6c5398 rbp: fffffe00fc878b80 [392220] r10: 0000000000000020 r11: 0000000000000040 r12: fffff8013f6c53d8 [392220] r13: 0000000000000000 r14: fffff8005fd87228 r15: fffffe00fc878c10
Is this all? I think I'm missing the rest of the kernel crash report. Can you share the whole output and maybe also look at /var/crash/textdump.tar.0?
Sorry for the delay, here the crash dump.
Not an expert, to my understanding the crash occoured in the service netstat. All crashes, nearly similar, just different runtimes and processes.
Info: After the last crash (3 days ago) I updated the microcode of the processor. Until now, the longest runtime after updating.
Thanks. I'm also no expert, but I have this issue for at least 1 year, without any solution from Opnsense/Deciso.
How to update the microcode of the processor? What commands did you executed? Thank you in advance.
I have seen, that the last bios update not includes the current Intel microcode (have a N100 CPU). From the change history, there were fixes for IDLE, power management, ... in the microcode. In addition many OS updates with my version step. That was the reason why I give it a try (hardware damage not my first choise, with a crash 30 minutes after the update)
How to update: I used the plugin from OPNsense. Has to be installed and is active after booting.
If it works could be checked: dmesg | grep -i micro
System still running without reboote, cross fingers
The N100 unfortunately is known for it's many issues I'm afraid. We have even seen examples where simple calculations lead to unbelievable results, but also seen cases where microcode updates froze the machine.
The crash reports in both cases don't look alike to be honest, @melroy89's case seems to be quite erratic, my best guess (after looking at multiple of these reports) is some hard to trigger bug in relation to netmap (Suricata in IPS mode)
Are you aware, if there were increasing problems with newer FreeBSD versions?
For my case, the system was rock stable with an older OPNsense version (older BSD release) and the problems started with the update.
I don't know, but if that's the case, you can always track https://bugs.freebsd.org
Are you aware, if there were increasing problems with newer FreeBSD versions?
This is impossible to say without a control group test using older microcode update versions on newer FreeBSD releases.
I've been dealing with this problem for a long time, I'd love to figure out a solution. I'm running OPNsense on bare metal on two different N305 mini PCs and currently an N100 mini PC. I've always had the OS installed on bare metal and never with proxmox nor on a VM. Whenever I run a perfectly stock install, the system won't crash.
If I install my traffic shaper (https://docs.opnsense.org/manual/how-tos/shaper_bufferbloat.html), zenarmor, or adguard home, then the system will crash with fatal trap 12 every week at the earliest and 3 weeks at the latest. I have tried reinstalls, full PC swaps, memtest, 3 different RAM sticks, a different SSD and nothing prevents the crashes except for not installing the plugins and leaving the install stock.
Frankly I have no idea what's going on at this point. I just want my router to work with my 3 plugins that I want to use.
[179935] Fatal trap 12: page fault while in kernel mode [179935] cpuid = 0; apic id = 00 [179935] fault virtual address = 0x0 [179935] fault code = supervisor write data, page not present [179935] instruction pointer = 0x20:0xffffffff80bf887d [179935] stack pointer = 0x28:0xfffffe00107aec00 [179935] frame pointer = 0x28:0xfffffe00107aec60 [179935] code segment = base 0x0, limit 0xfffff, type 0x1b [179935] = DPL 0, pres 1, long 1, def32 0, gran 1 [179935] processor eflags = resume, IOPL = 0 [179935] current process = 11 (idle: cpu0) [179935] rdi: fffff80250b1e0d0 rsi: fffff80017fac000 rdx: 0000000000000000 [179935] rcx: 0000000000000000 r8: 0000000000000080 r9: 00000000ffffffb5 [179935] rax: 0000000000000000 rbx: ffffffff83caf300 rbp: fffffe00107aec60 [179935] r10: 0000000000000001 r11: fffff800015d3000 r12: 0002bedf2c207613 [179935] r13: 0000000002bedf2d r14: 0002bedf1b2aca16 r15: 0002bedf3b000000 [179935] trap number = 12 [179935] panic: page fault [179935] cpuid = 0 [179935] time = 1754684232
[179935] KDB: stack backtrace: [179935] db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00107ae950 [179935] vpanic() at vpanic+0x161/frame 0xfffffe00107aea80 [179935] panic() at panic+0x43/frame 0xfffffe00107aeae0 [179935] trap_pfault() at trap_pfault+0x3da/frame 0xfffffe00107aeb30 [179935] calltrap() at calltrap+0x8/frame 0xfffffe00107aeb30 [179935] --- trap 0xc, rip = 0xffffffff80bf887d, rsp = 0xfffffe00107aec00, rbp = 0xfffffe00107aec60 --- [179935] callout_process() at callout_process+0x1ad/frame 0xfffffe00107aec60 [179935] handleevents() at handleevents+0x186/frame 0xfffffe00107aeca0 [179935] timercb() at timercb+0x250/frame 0xfffffe00107aecf0 [179935] lapic_handle_timer() at lapic_handle_timer+0xab/frame 0xfffffe00107aed10 [179935] Xtimerint() at Xtimerint+0xb1/frame 0xfffffe00107aed10 [179935] --- interrupt, rip = 0xffffffff810ab872, rsp = 0xfffffe00107aede0, rbp = 0xfffffe00107aedf0 --- [179935] cpu_idle() at cpu_idle+0xe2/frame 0xfffffe00107aedf0 [179935] sched_idletd() at sched_idletd+0x6c6/frame 0xfffffe00107aeef0 [179935] fork_exit() at fork_exit+0x81/frame 0xfffffe00107aef30 [179935] fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00107aef30 [179935] --- trap 0, rip = 0, rsp = 0, rbp = 0 --- [179935] KDB: enter: panic
The N100 unfortunately is known for it's many issues I'm afraid. We have even seen examples where simple calculations lead to unbelievable results, but also seen cases where microcode updates froze the machine.
The crash reports in both cases don't look alike to be honest, @melroy89's case seems to be quite erratic, my best guess (after looking at multiple of these reports) is some hard to trigger bug in relation to netmap (Suricata in IPS mode)
Is the N305 also known for a while bunch of issues that the N100 is? Is there a recommended CPU to use that's known to not have issues?
I wouldn't know, we don't use Intel CPU's ourselves, just noticed quiet some weirdness with the N100 which logic didn't really explain.
Not sure if it's only a CPU problem or a "compability" issue.
Have 3 identical boards (ITX - CPU on board). Originally all boards on the same bios version with the identical microcode.
- Windows 10 -> no problems
- Debian (last stable) -> no problems
- OPNSense 24.x -> no problems
- OPNSense 25.x -> instable (after update)
After the second crash I switched memory and board, even if I thought could not be the hardware (first crash 30 minutes after the update). Still unstable
Not sure if it is the BIOS, board, CPU for me it looks like the new version (OS, driver, ...) has a different usage profile of the hardware. Maybe other function, function calls, idle handling, higher or lower loads of the power regulators, ... If it is a general coding problem I would expect we should see mor of these crashes. Because the system is now up 5 days+ and the only change is the microcode, I would guess the new OS / drivers trigger some instability in the CPU improved by the microcode.
Not sure if I would call it fixed without knowing the problem. Maybe it is fixed or crashes next week.
I was able to find a few FreeBSD / N100 problems, but nothing describing a source of a common (or this explicit) problem.
In System, Settings, Tunables, I just set: hw.ibrs_disable=0 vm.pmap.pti=1 vm.pmap.pcid_enabled=0
https://forum.opnsense.org/index.php?topic=48343.msg244032#msg244032
Let's see what happens after 2-3 weeks
Thank's for the hint and link!
If I read it correct deactivate PCID or microcode. Lets see what's the final solution.
But one question left: I'm not able to add a tunable. To my unterstanding Optimisation = vm.pmap.pcid_enabled Value = 0 Save results in an error.
What I'm doing wrong?
Checked it: The setting is in the exported config. Looks like a bug. The gui is not able to show the tunabels -> just showing error
This would "explain" the change in behaviour from 25.1 to 25.7, but perhaps not the original issue reported here.
The irony is people have been complaining about sub-par speed from these settings, but apparently it has made (cheaper) hardware a lot more stable by accident than people would have appreciated in the first place. It's a strange world.
In System, Settings, Tunables, I just set: hw.ibrs_disable=0 vm.pmap.pti=1 vm.pmap.pcid_enabled=0
https://forum.opnsense.org/index.php?topic=48343.msg244032#msg244032
Let's see what happens after 2-3 weeks
Didn't help, just crashed again with these settings. I'm at such a loss here and I have no idea what to do to fix this. People who have zenarmor and a traffic shaper working with no problems, can you recommend me the hardware that you're using?