unexplained kernel panic

[lelemka0]

Important notices

Before you add a new report, we ask you kindly to acknowledge the following:

• [x] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
• [x] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

Describe the bug

I get kernel panics from time to time, I'm not sure what's causing this problem, it's been happening since I upgraded opnsense from 23.1.7_3 to 23.1.9. 2-3 times a day, after which the system will automatically restart, I didn't modify any configuration.

To Reproduce

In my case, after the upgrade, I'm not sure how to reproduce.

Expected behavior

no kernel panic

Relevant log files

2023-06-16T00:23:11 | Notice | kernel | ---<<BOOT>>--- |  
-- | -- | -- | -- | --
2023-06-16T00:23:11 | Notice | kernel | KDB: enter: panic |  
2023-06-16T00:23:11 | Notice | kernel | mi_startup() at mi_startup+0xdf/frame 0x24dc000 |  
2023-06-16T00:23:11 | Notice | kernel | --- trap 0x80d09200, rip = 0xffffffff80c311df, rsp = 0, rbp = 0x24dc000 --- |  
2023-06-16T00:23:11 | Notice | kernel | fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084252f30 |  
2023-06-16T00:23:11 | Notice | kernel | fork_exit() at fork_exit+0x7e/frame 0xfffffe0084252f30 |  
2023-06-16T00:23:11 | Notice | kernel | ithread_loop() at ithread_loop+0x25a/frame 0xfffffe0084252ef0 |  
2023-06-16T00:23:11 | Notice | kernel | vtnet_rx_vq_process() at vtnet_rx_vq_process+0xb7/frame 0xfffffe0084252e60 |  
2023-06-16T00:23:11 | Notice | kernel | vtnet_rxq_eof() at vtnet_rxq_eof+0x73e/frame 0xfffffe0084252e20 |  
2023-06-16T00:23:11 | Notice | kernel | ether_input() at ether_input+0x69/frame 0xfffffe0084252d60 |  
2023-06-16T00:23:11 | Notice | kernel | netisr_dispatch_src() at netisr_dispatch_src+0xb9/frame 0xfffffe0084252d00 |  
2023-06-16T00:23:11 | Notice | kernel | ether_nh_input() at ether_nh_input+0x35a/frame 0xfffffe0084252cb0 |  
2023-06-16T00:23:11 | Notice | kernel | ether_demux() at ether_demux+0x121/frame 0xfffffe0084252c50 |  
2023-06-16T00:23:11 | Notice | kernel | ether_input() at ether_input+0x69/frame 0xfffffe0084252c20 |
2023-06-16T00:23:11 | Notice | kernel | netisr_dispatch_src() at netisr_dispatch_src+0xb9/frame 0xfffffe0084252bc0 |  
2023-06-16T00:23:11 | Notice | kernel | ether_nh_input() at ether_nh_input+0x1f1/frame 0xfffffe0084252b70 |  
2023-06-16T00:23:11 | Notice | kernel | ng_ether_input() at ng_ether_input+0x4c/frame 0xfffffe0084252b10 |  
2023-06-16T00:23:11 | Notice | kernel | ng_snd_item() at ng_snd_item+0x28e/frame 0xfffffe0084252ae0 |  
2023-06-16T00:23:11 | Notice | kernel | ng_apply_item() at ng_apply_item+0x2bd/frame 0xfffffe0084252aa0 |  
2023-06-16T00:23:11 | Notice | kernel | ng_snd_item() at ng_snd_item+0x28e/frame 0xfffffe0084252a00 |  
2023-06-16T00:23:11 | Notice | kernel | ng_apply_item() at ng_apply_item+0x2bd/frame 0xfffffe00842529c0 |  
2023-06-16T00:23:11 | Notice | kernel | ng_ether_rcv_upper() at ng_ether_rcv_upper+0x8c/frame 0xfffffe0084252920 |  
2023-06-16T00:23:11 | Notice | kernel | ether_demux() at ether_demux+0x138/frame 0xfffffe0084252900 |  
2023-06-16T00:23:11 | Notice | kernel | netisr_dispatch_src() at netisr_dispatch_src+0xb9/frame 0xfffffe00842528d0 |  
2023-06-16T00:23:11 | Notice | kernel | ip6_input() at ip6_input+0x60f/frame 0xfffffe0084252880 |  
2023-06-16T00:23:11 | Notice | kernel | ip6_tryforward() at ip6_tryforward+0x2ce/frame 0xfffffe00842527a0 |  
2023-06-16T00:23:11 | Notice | kernel | pfil_run_hooks() at pfil_run_hooks+0x97/frame 0xfffffe0084252720 |  
2023-06-16T00:23:11 | Notice | kernel | pf_check6_out() at pf_check6_out+0x40/frame 0xfffffe00842526e0 |  
2023-06-16T00:23:11 | Notice | kernel | pf_test6() at pf_test6+0xfdb/frame 0xfffffe00842526b0 |  
2023-06-16T00:23:11 | Notice | kernel | pf_refragment6() at pf_refragment6+0x14f/frame 0xfffffe0084252540 |  
2023-06-16T00:23:11 | Notice | kernel | ip6_forward() at ip6_forward+0x62d/frame 0xfffffe00842524f0 |  
2023-06-16T00:23:11 | Notice | kernel | --- trap 0xc, rip = 0xffffffff80eb8dcd, rsp = 0xfffffe00842523d0, rbp = 0xfffffe00842524f0 --- |  
2023-06-16T00:23:11 | Notice | kernel | calltrap() at calltrap+0x8/frame 0xfffffe0084252300 |  
2023-06-16T00:23:11 | Notice | kernel | trap_pfault() at trap_pfault+0x4f/frame 0xfffffe0084252300 |  
2023-06-16T00:23:11 | Notice | kernel | trap_fatal() at trap_fatal+0x385/frame 0xfffffe00842522a0 |  
2023-06-16T00:23:11 | Notice | kernel | panic() at panic+0x43/frame 0xfffffe0084252240 |  
2023-06-16T00:23:11 | Notice | kernel | vpanic() at vpanic+0x17f/frame 0xfffffe00842521e0 |  
2023-06-16T00:23:11 | Notice | kernel | db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0084252190 |  
2023-06-16T00:23:11 | Notice | kernel | KDB: stack backtrace: |  
2023-06-16T00:23:11 | Notice | kernel | time = 1686874897 |  
2023-06-16T00:23:11 | Notice | kernel | cpuid = 2 |  
2023-06-16T00:23:11 | Notice | kernel | panic: page fault
2023-06-16T00:23:11 | Notice | kernel | trap number = 12 |  
2023-06-16T00:23:11 | Notice | kernel | current process = 12 (irq29: virtio_pci2) |  
2023-06-16T00:23:11 | Notice | kernel | processor eflags = interrupt enabled, resume, IOPL = 0 |  
2023-06-16T00:23:11 | Notice | kernel | = DPL 0, pres 1, long 1, def32 0, gran 1 |  
2023-06-16T00:23:11 | Notice | kernel | code segment = base 0x0, limit 0xfffff, type 0x1b |  
2023-06-16T00:23:11 | Notice | kernel | frame pointer = 0x28:0xfffffe00842524f0 |  
2023-06-16T00:23:11 | Notice | kernel | stack pointer = 0x28:0xfffffe00842523d0 |  
2023-06-16T00:23:11 | Notice | kernel | instruction pointer = 0x20:0xffffffff80eb8dcd |  
2023-06-16T00:23:11 | Notice | kernel | fault code = supervisor read data, page not present |  
2023-06-16T00:23:11 | Notice | kernel | fault virtual address = 0x10 |  
2023-06-16T00:23:11 | Notice | kernel | cpuid = 2; apic id = 02 |  
2023-06-16T00:23:11 | Notice | kernel | Fatal trap 12: page fault while in kernel mode |

Environment

OPNsense 23.1.9 - amd64, OpenSSL over Proxmox VE (i440fx cpu: host) Intel(R) Xeon(R) CPU E3-1265L v3 @ 2.50GHz (4 cores, 4 threads) Network VirtIO