bcachefs
bcachefs copied to clipboard
Published
20 hours ago •
koverstreet
koverstreet
IBT support [7a90ae891e4a]
Edit Kernel aborts mount with "Kernel BUG" traceback when IBT is enabled. Indirect Branch Tracking (IBT) was introduced in kernel 5.18 with 11+ gen Intel CPUs.
A workaround is to set ibt=off kernel parameter. Compiling with -fcf-protection=branch did not fix.
If this is an upstream issue, feel free to close.
Original text:
I moved my hard drives to a new PC and rebuilt the kernel with the exact same config as before. Got this kernel bug when I tried to mount. All 3 drives are readable with bcachefs show-super and dd, so they're not broken.
Dmesg output:
[ 295.327453] bcachefs: bch2_fs_open()
[ 295.327456] bcachefs: bch2_read_super()
[ 295.328878] bcachefs: bch2_read_super() ret 0
[ 295.328880] bcachefs: bch2_read_super()
[ 295.333755] bcachefs: bch2_read_super() ret 0
[ 295.333764] bcachefs: bch2_read_super()
[ 295.337459] bcachefs: bch2_read_super() ret 0
[ 295.337468] bcachefs: bch2_fs_alloc()
[ 295.391731] bcachefs: bch2_fs_journal_init()
[ 295.392003] bcachefs: bch2_fs_journal_init() ret 0
[ 295.392017] bcachefs: bch2_fs_btree_cache_init()
[ 295.392458] bcachefs: bch2_fs_btree_cache_init() ret 0
[ 295.392519] bcachefs: bch2_fs_encryption_init()
[ 295.392526] bcachefs: bch2_fs_encryption_init() ret 0
[ 295.392528] bcachefs: __bch2_fs_compress_init()
[ 295.392528] bcachefs: __bch2_fs_compress_init() ret 0
[ 295.392534] bcachefs: bch2_fs_fsio_init()
[ 295.392558] bcachefs: bch2_fs_fsio_init() ret 0
[ 295.392559] bcachefs: bch2_dev_alloc()
[ 295.393141] bcachefs: bch2_dev_alloc() ret 0
[ 295.393142] bcachefs: bch2_dev_alloc()
[ 295.393675] bcachefs: bch2_dev_alloc() ret 0
[ 295.393677] bcachefs: bch2_dev_alloc()
[ 295.394217] bcachefs: bch2_dev_alloc() ret 0
[ 295.394303] bcachefs: bch2_fs_alloc() ret 0
[ 295.394368] bcachefs (50acd022-b147-4ac2-a47a-36c9f0a239fb): recovering from clean shutdown, journal seq 9868016
[ 295.413759] traps: Missing ENDBR: 0xffffa0ea41109000
[ 295.413766] ------------[ cut here ]------------
[ 295.413768] kernel BUG at arch/x86/kernel/traps.c:252!
[ 295.413774] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
[ 295.413780] CPU: 14 PID: 3008 Comm: mount.bcachefs Not tainted 5.18.10-arch1-1-bcachefs-git-01448-g7a90ae891e4a #1 3c8770cc64cdfa21c17315a56a1134ce476a3d8e
[ 295.413788] Hardware name: Micro-Star International Co., Ltd. MS-7D25/PRO Z690-A WIFI DDR4(MS-7D25), BIOS 1.70 06/23/2022
[ 295.413790] RIP: 0010:exc_control_protection+0xc2/0xd0
[ 295.413796] Code: 8b 93 80 00 00 00 be f9 00 00 00 48 c7 c7 73 69 4a 86 e8 e1 23 43 ff e9 72 ff ff ff 48 c7 c7 5a 69 4a 86 e8 cb 51 fa ff 0f 0b <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 90 66 0f 1f 00 55 53 48 89
[ 295.413799] RSP: 0018:ffffa0ea4596f4b8 EFLAGS: 00010002
[ 295.413804] RAX: 0000000000000028 RBX: ffffa0ea4596f4d8 RCX: 0000000000000000
[ 295.413806] RDX: 0000000000000000 RSI: ffff8a0c903a16a0 RDI: ffff8a0c903a16a0
[ 295.413808] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffa0ea4596f2d8
[ 295.413809] R10: 0000000000000003 R11: ffff8a0cb07a9468 R12: 0000000000000000
[ 295.413811] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 295.413813] FS: 00007f4152c55d00(0000) GS:ffff8a0c90380000(0000) knlGS:0000000000000000
[ 295.413816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 295.413818] CR2: 00007ff8d549fd37 CR3: 000000011375c001 CR4: 0000000000f70ee0
[ 295.413820] PKRU: 55555554
[ 295.413822] Call Trace:
[ 295.413824] <TASK>
[ 295.413827] asm_exc_control_protection+0x22/0x30
[ 295.413831] RIP: 0010:0xffffa0ea41109000
[ 295.413835] Code: Unable to access opcode bytes at RIP 0xffffa0ea41108fd6.
[ 295.413837] RSP: 0018:ffffa0ea4596f588 EFLAGS: 00010297
[ 295.413839] RAX: ffffa0ea41109000 RBX: 0000000000000000 RCX: 0000000000000000
[ 295.413841] RDX: 0000000000000000 RSI: ffff8a05881000a0 RDI: ffffa0ea4596f5f0
[ 295.413843] RBP: ffffa0ea4596f6a0 R08: 0000000000000000 R09: 0000000000000016
[ 295.413845] R10: ffffa0ea4596f6c0 R11: ffff8a05881000a0 R12: ffff8a0588100088
[ 295.413846] R13: ffff8a056d200e00 R14: ffff8a0588100088 R15: ffff8a05881000a0
[ 295.413850] ? krealloc+0x86/0xc0
[ 295.413854] ? validate_bset_keys.constprop.0+0x113/0x7c0
[ 295.413860] ? mempool_alloc+0x86/0x1b0
[ 295.413864] ? bch2_btree_node_read_done+0x4c4/0x1300
[ 295.413867] ? bch2_btree_node_read_done+0x4c4/0x1300
[ 295.413872] ? btree_node_read_work+0x215/0x2f0
[ 295.413875] ? btree_node_read_work+0x215/0x2f0
[ 295.413878] ? bch2_btree_node_read+0x24a/0x4b0
[ 295.413881] ? bch2_btree_node_hash_insert+0x4c/0xb0
[ 295.413886] ? bch2_btree_root_read+0xf8/0x1e0
[ 295.413889] ? bch2_fs_recovery.cold+0x833/0x1830
[ 295.413894] ? get_page_from_freelist+0x13d5/0x1500
[ 295.413898] ? idr_alloc_u32+0xa3/0xe0
[ 295.413903] ? string_nocheck+0xb8/0xf0
[ 295.413907] ? prt_vprintf+0x1f3/0xa10
[ 295.413910] ? __kernfs_new_node+0x17f/0x1e0
[ 295.413914] ? __bch2_sb_field_resize+0x6f/0x100
[ 295.413919] ? __copy_super+0x1dd/0x210
[ 295.413923] ? bch2_fs_start+0x3fb/0x430
[ 295.413926] ? bch2_fs_open+0x584/0x600
[ 295.413930] ? bch2_mount+0x534/0x6c0
[ 295.413935] ? legacy_get_tree+0x28/0x50
[ 295.413938] ? vfs_get_tree+0x26/0xc0
[ 295.413941] ? path_mount+0x46b/0xac0
[ 295.413945] ? __x64_sys_mount+0x117/0x150
[ 295.413947] ? do_syscall_64+0x5c/0x90
[ 295.413950] ? exc_page_fault+0x74/0x170
[ 295.413953] ? entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 295.413957] </TASK>
[ 295.413959] Modules linked in: snd_seq_dummy snd_hrtimer snd_seq ccm intel_rapl_msr spi_nor iTCO_wdt intel_pmc_bxt ee1004 iTCO_vendor_support mtd mei_pxp mei_hdcp btusb btrtl btbcm btintel btmtk bluetooth ecdh_generic wmi_bmof mxm_wmi mousedev snd_usb_audio snd_usbmidi_lib snd_rawmidi snd_seq_device mc intel_rapl_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel crypto_simd cryptd rapl intel_cstate intel_uncore pcspkr iwlmvm snd_sof_pci_intel_tgl snd_sof_intel_hda_common mac80211 soundwire_intel soundwire_generic_allocation soundwire_cadence snd_sof_intel_hda snd_sof_pci libarc4 snd_sof_xtensa_dsp snd_sof snd_hda_codec_realtek snd_hda_codec_generic snd_sof_utils snd_soc_hdac_hda snd_hda_ext_core snd_soc_acpi_intel_match snd_soc_acpi soundwire_bus ledtrig_audio snd_soc_core iwlwifi snd_compress i2c_i801 spi_intel_pci ac97_bus spi_intel iwlmei i2c_smbus snd_pcm_dmaengine igc cfg80211
[ 295.414016] snd_hda_codec_hdmi mei_me mei amdgpu i915 snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec snd_hda_core snd_hwdep joydev snd_pcm gpu_sched snd_timer drm_ttm_helper drm_buddy ttm snd intel_gtt drm_dp_helper soundcore serial_multi_instantiate nct6683 rfkill coretemp tpm_crb wmi tpm_tis tpm_tis_core tpm video rng_core acpi_tad acpi_pad vfat fat mac_hid dm_multipath dm_mod fuse bpf_preload ip_tables x_tables ext4 crc16 mbcache jbd2 usbhid nvme crc32c_intel xhci_pci nvme_core xhci_pci_renesas
[ 295.414056] ---[ end trace 0000000000000000 ]---
[ 295.414058] RIP: 0010:exc_control_protection+0xc2/0xd0
[ 295.414061] Code: 8b 93 80 00 00 00 be f9 00 00 00 48 c7 c7 73 69 4a 86 e8 e1 23 43 ff e9 72 ff ff ff 48 c7 c7 5a 69 4a 86 e8 cb 51 fa ff 0f 0b <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 90 66 0f 1f 00 55 53 48 89
[ 295.414065] RSP: 0018:ffffa0ea4596f4b8 EFLAGS: 00010002
[ 295.414066] RAX: 0000000000000028 RBX: ffffa0ea4596f4d8 RCX: 0000000000000000
[ 295.414068] RDX: 0000000000000000 RSI: ffff8a0c903a16a0 RDI: ffff8a0c903a16a0
[ 295.414069] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffa0ea4596f2d8
[ 295.414071] R10: 0000000000000003 R11: ffff8a0cb07a9468 R12: 0000000000000000
[ 295.414072] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 295.414074] FS: 00007f4152c55d00(0000) GS:ffff8a0c90380000(0000) knlGS:0000000000000000
[ 295.414076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 295.414077] CR2: ffffa0ea41108fd6 CR3: 000000011375c001 CR4: 0000000000f70ee0
[ 295.414079] PKRU: 55555554
Version Linux v5.18.10 bcachefs commit 7a90ae891e4ad96fe2d665c88088730c98c4e79e bcachefs-tools commit bad0c8c50758b4447d529f61017c1a8c85976a3e
Generic info superblock info: bcachefs-general-info.txt
system info (that's changed): cpu: intel i7-12700k (alder lake) mb: MSI Pro z690-a wifi ddr4 boot drive: nvme-Samsung_SSD_970_EVO_Plus
Building kernel with bcachefs debug options yielded a slightly different call trace: bcachefs-5.18.10-g7a90ae891e4a-debug-trace.txt
Looks similar to this: https://github.com/umlaeute/v4l2loopback/issues/476
Ya, IBT is the culprit: booting with ibt=off worked. Similar problem reported here too, maybe we can see how they deal with it: https://github.com/NVIDIA/open-gpu-kernel-modules/issues/256