linux
linux copied to clipboard
raspberrypi
RPi4: WiFi client crashes often (brcmf_fw_crashed: Firmware has halted or crashed)
Describe the bug WiFi client stops working and does not recover (Cypress firmware crashes). This happens to my RPi4 almost every day and I must reboot to recover it. After reboot, it always works but will fail again sometime later that day (duration seems random). Raspbian is up to date with all upgrades as of 9/11/2020.
To reproduce Use WiFi client mode on RPi4.
Expected behaviour WiFi keeps working reliably.
Actual behaviour WiFi client stops functioning entirely.
System
-
Which model of Raspberry Pi? e.g. Pi3B+, PiZeroW Raspberry Pi 4 (4GB)
-
Which OS and version (
cat /etc/rpi-issue)? Raspbian GNU/Linux 10 -
Which firmware version (
vcgencmd version)? Aug 19 2020 17:38:16 Copyright (c) 2012 Broadcom version e90cba19a98a0d1f2ef086b9cafcbca00778f094 (clean) (release) (start) -
Which kernel version (
uname -a)? Linux raspberrypi 5.4.51-v7l+ #1333 SMP Mon Aug 10 16:51:40 BST 2020 armv7l GNU/Linux
Logs
[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 5.4.51-v7l+ (dom@buildbot) (gcc version 4.9.3 (crosstool-NG crosstool-ng-1.22.0-88-g8460611)) #1333 SMP Mon Aug 10 16:51:40 BST 2020
[ 0.000000] CPU: ARMv7 Processor [410fd083] revision 3 (ARMv7), cr=30c5383d
[ 0.000000] CPU: div instructions available: patching division code
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
[ 0.000000] OF: fdt: Machine model: Raspberry Pi 4 Model B Rev 1.2
[ 0.000000] Memory policy: Data cache writealloc
[ 0.000000] Reserved memory: created CMA memory pool at 0x000000001ec00000, size 256 MiB
[ 0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[ 0.000000] On node 0 totalpages: 1012736
[ 0.000000] DMA zone: 2304 pages used for memmap
[ 0.000000] DMA zone: 0 pages reserved
[ 0.000000] DMA zone: 196608 pages, LIFO batch:63
[ 0.000000] HighMem zone: 816128 pages, LIFO batch:63
[ 0.000000] percpu: Embedded 20 pages/cpu s49856 r8192 d23872 u81920
[ 0.000000] pcpu-alloc: s49856 r8192 d23872 u81920 alloc=20*4096
[ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1010432
[ 0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_headphones=1 video=HDMI-A-1:1920x1080M@60 smsc95xx.macaddr=DC:A6:32:84:15:CD vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000 console=ttyS0,115200 console=tty1 root=/dev/mmcblk0p7 rootfstype=ext4 elevator=deadline fsck.repair=yes rootwait quiet splash plymouth.ignore-serial-consoles
[ 0.000000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] software IO TLB: mapped [mem 0x17cc0000-0x1bcc0000] (64MB)
[ 0.000000] Memory: 3655620K/4050944K available (10240K kernel code, 725K rwdata, 2740K rodata, 2048K init, 853K bss, 133180K reserved, 262144K cma-reserved, 3264512K highmem)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[ 0.000000] ftrace: allocating 30051 entries in 59 pages
[ 0.000000] rcu: Hierarchical RCU implementation.
[ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] GIC: Using split EOI/Deactivate mode
[ 0.000000] random: get_random_bytes called from start_kernel+0x340/0x518 with crng_init=0
[ 0.000008] sched_clock: 32 bits at 1000kHz, resolution 1000ns, wraps every 2147483647500ns
[ 0.000024] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275 ns
[ 0.000103] bcm2835: system timer (irq = 17)
[ 0.000777] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
[ 0.000793] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
[ 0.000810] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
[ 0.000823] Switching to timer-based delay loop, resolution 18ns
[ 0.001072] Console: colour dummy device 80x30
[ 0.001105] printk: console [tty1] enabled
[ 0.001157] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=540000)
[ 0.001179] pid_max: default: 32768 minimum: 301
[ 0.001498] Mount-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.001522] Mountpoint-cache hash table entries: 2048 (order: 1, 8192 bytes, linear)
[ 0.002730] Disabling memory control group subsystem
[ 0.002835] CPU: Testing write buffer coherency: ok
[ 0.003334] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[ 0.004179] Setting up static identity map for 0x200000 - 0x20003c
[ 0.004371] rcu: Hierarchical SRCU implementation.
[ 0.005015] smp: Bringing up secondary CPUs ...
[ 0.006217] CPU1: thread -1, cpu 1, socket 0, mpidr 80000001
[ 0.007537] CPU2: thread -1, cpu 2, socket 0, mpidr 80000002
[ 0.008793] CPU3: thread -1, cpu 3, socket 0, mpidr 80000003
[ 0.008937] smp: Brought up 1 node, 4 CPUs
[ 0.008953] SMP: Total of 4 processors activated (432.00 BogoMIPS).
[ 0.008965] CPU: All CPU(s) started in HYP mode.
[ 0.008976] CPU: Virtualization extensions available.
[ 0.009745] devtmpfs: initialized
[ 0.023116] VFP support v0.3: implementor 41 architecture 3 part 40 variant 8 rev 0
[ 0.023366] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[ 0.023393] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[ 0.031390] pinctrl core: initialized pinctrl subsystem
[ 0.032474] NET: Registered protocol family 16
[ 0.036266] DMA: preallocated 1024 KiB pool for atomic coherent allocations
[ 0.038006] hw-breakpoint: found 5 (+1 reserved) breakpoint and 4 watchpoint registers.
[ 0.038020] hw-breakpoint: maximum watchpoint size is 8 bytes.
[ 0.038377] Serial: AMBA PL011 UART driver
[ 0.041818] bcm2835-mbox fe00b880.mailbox: mailbox enabled
[ 0.060902] raspberrypi-firmware soc:firmware: Attached to firmware from 2020-08-19 17:38, variant start
[ 0.070883] raspberrypi-firmware soc:firmware: Firmware hash is e90cba19a98a0d1f2ef086b9cafcbca00778f094
[ 0.124053] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
[ 0.128539] vgaarb: loaded
[ 0.129015] SCSI subsystem initialized
[ 0.129244] usbcore: registered new interface driver usbfs
[ 0.129328] usbcore: registered new interface driver hub
[ 0.129452] usbcore: registered new device driver usb
[ 0.131117] clocksource: Switched to clocksource arch_sys_counter
[ 0.883225] VFS: Disk quotas dquot_6.6.0
[ 0.883328] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[ 0.883510] FS-Cache: Loaded
[ 0.883716] CacheFiles: Loaded
[ 0.884638] simple-framebuffer 3e3cf000.framebuffer: framebuffer at 0x3e3cf000, 0x7f8000 bytes, mapped to 0x(ptrval)
[ 0.884656] simple-framebuffer 3e3cf000.framebuffer: format=a8r8g8b8, mode=1920x1080x32, linelength=7680
[ 0.885163] Console: switching to colour frame buffer device 240x67
[ 0.895860] simple-framebuffer 3e3cf000.framebuffer: fb0: simplefb registered!
[ 0.905794] thermal_sys: Registered thermal governor 'step_wise'
[ 0.906181] NET: Registered protocol family 2
[ 0.906918] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 6144 bytes, linear)
[ 0.906948] TCP established hash table entries: 8192 (order: 3, 32768 bytes, linear)
[ 0.907023] TCP bind hash table entries: 8192 (order: 4, 65536 bytes, linear)
[ 0.907100] TCP: Hash tables configured (established 8192 bind 8192)
[ 0.907248] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 0.907281] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[ 0.907534] NET: Registered protocol family 1
[ 0.908261] RPC: Registered named UNIX socket transport module.
[ 0.908274] RPC: Registered udp transport module.
[ 0.908286] RPC: Registered tcp transport module.
[ 0.908298] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.908320] PCI: CLS 0 bytes, default 64
[ 0.910182] hw perfevents: enabled with armv7_cortex_a15 PMU driver, 7 counters available
[ 0.912404] Initialise system trusted keyrings
[ 0.912632] workingset: timestamp_bits=14 max_order=20 bucket_order=6
[ 0.923453] FS-Cache: Netfs 'nfs' registered for caching
[ 0.924175] NFS: Registering the id_resolver key type
[ 0.924211] Key type id_resolver registered
[ 0.924224] Key type id_legacy registered
[ 0.924246] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[ 0.925355] Key type asymmetric registered
[ 0.925369] Asymmetric key parser 'x509' registered
[ 0.925535] bounce: pool size: 64 pages
[ 0.925582] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[ 0.925796] io scheduler mq-deadline registered
[ 0.925809] io scheduler kyber registered
[ 0.929608] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[ 0.929632] brcm-pcie fd500000.pcie: No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[ 0.929697] brcm-pcie fd500000.pcie: MEM 0x0600000000..0x0603ffffff -> 0x00f8000000
[ 0.929761] brcm-pcie fd500000.pcie: IB MEM 0x0000000000..0x00bfffffff -> 0x0000000000
[ 0.983246] brcm-pcie fd500000.pcie: link up, 5 GT/s x1 (SSC)
[ 0.983561] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[ 0.983578] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.983598] pci_bus 0000:00: root bus resource [mem 0x600000000-0x603ffffff] (bus address [0xf8000000-0xfbffffff])
[ 0.983656] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[ 0.983895] pci 0000:00:00.0: PME# supported from D0 D3hot
[ 0.987233] PCI: bus0: Fast back to back transfers disabled
[ 0.987254] pci 0000:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring
[ 0.987508] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
[ 0.987653] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
[ 0.988071] pci 0000:01:00.0: PME# supported from D0 D3cold
[ 0.991455] PCI: bus1: Fast back to back transfers disabled
[ 0.991474] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[ 0.991516] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[ 0.991538] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x600000fff 64bit]
[ 0.991619] pci 0000:00:00.0: PCI bridge to [bus 01]
[ 0.991642] pci 0000:00:00.0: bridge window [mem 0x600000000-0x6000fffff]
[ 0.991945] pcieport 0000:00:00.0: enabling device (0140 -> 0142)
[ 0.992182] pcieport 0000:00:00.0: PME: Signaling with IRQ 55
[ 0.992562] pcieport 0000:00:00.0: AER: enabled with IRQ 55
[ 0.992880] pci 0000:01:00.0: enabling device (0140 -> 0142)
[ 0.999596] iproc-rng200 fe104000.rng: hwrng registered
[ 0.999908] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[ 1.000538] vc-sm: Videocore shared memory driver
[ 1.001074] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
[ 1.013017] brd: module loaded
[ 1.025264] loop: module loaded
[ 1.026622] Loading iSCSI transport class v2.0-870.
[ 1.028598] libphy: Fixed MDIO Bus: probed
[ 1.029171] bcmgenet fd580000.ethernet: failed to get enet clock
[ 1.029190] bcmgenet fd580000.ethernet: GENET 5.0 EPHY: 0x0000
[ 1.029211] bcmgenet fd580000.ethernet: failed to get enet-wol clock
[ 1.029230] bcmgenet fd580000.ethernet: failed to get enet-eee clock
[ 1.029257] bcmgenet: Skipping UMAC reset
[ 1.041166] libphy: bcmgenet MII bus: probed
[ 1.121234] unimac-mdio unimac-mdio.-19: Broadcom UniMAC MDIO bus
[ 1.122276] usbcore: registered new interface driver r8152
[ 1.122357] usbcore: registered new interface driver lan78xx
[ 1.122427] usbcore: registered new interface driver smsc95xx
[ 1.122846] xhci_hcd 0000:01:00.0: xHCI Host Controller
[ 1.122881] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 1
[ 1.125155] xhci_hcd 0000:01:00.0: hcc params 0x002841eb hci version 0x100 quirks 0x0000001000000890
[ 1.126411] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[ 1.126428] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.126442] usb usb1: Product: xHCI Host Controller
[ 1.126457] usb usb1: Manufacturer: Linux 5.4.51-v7l+ xhci-hcd
[ 1.126471] usb usb1: SerialNumber: 0000:01:00.0
[ 1.127071] hub 1-0:1.0: USB hub found
[ 1.127162] hub 1-0:1.0: 1 port detected
[ 1.127709] xhci_hcd 0000:01:00.0: xHCI Host Controller
[ 1.127734] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 2
[ 1.127756] xhci_hcd 0000:01:00.0: Host supports USB 3.0 SuperSpeed
[ 1.128265] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04
[ 1.128282] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.128297] usb usb2: Product: xHCI Host Controller
[ 1.128311] usb usb2: Manufacturer: Linux 5.4.51-v7l+ xhci-hcd
[ 1.128325] usb usb2: SerialNumber: 0000:01:00.0
[ 1.128870] hub 2-0:1.0: USB hub found
[ 1.128948] hub 2-0:1.0: 4 ports detected
[ 1.130374] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[ 1.130640] dwc_otg: FIQ enabled
[ 1.130651] dwc_otg: NAK holdoff enabled
[ 1.130663] dwc_otg: FIQ split-transaction FSM enabled
[ 1.130677] Module dwc_common_port init
[ 1.131167] usbcore: registered new interface driver uas
[ 1.131274] usbcore: registered new interface driver usb-storage
[ 1.131482] mousedev: PS/2 mouse device common for all mice
[ 1.133538] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[ 1.136049] sdhci: Secure Digital Host Controller Interface driver
[ 1.136061] sdhci: Copyright(c) Pierre Ossman
[ 1.136632] mmc-bcm2835 fe300000.mmcnr: could not get clk, deferring probe
[ 1.137150] sdhci-pltfm: SDHCI platform and OF driver helper
[ 1.140915] ledtrig-cpu: registered to indicate activity on CPUs
[ 1.141280] hidraw: raw HID events driver (C) Jiri Kosina
[ 1.141458] usbcore: registered new interface driver usbhid
[ 1.141471] usbhid: USB HID core driver
[ 1.142503] vchiq: vchiq_init_state: slot_zero = (ptrval)
[ 1.144495] [vc_sm_connected_init]: start
[ 1.154597] [vc_sm_connected_init]: end - returning 0
[ 1.156653] Initializing XFRM netlink socket
[ 1.156691] NET: Registered protocol family 17
[ 1.156814] Key type dns_resolver registered
[ 1.157279] Registering SWP/SWPB emulation handler
[ 1.157632] registered taskstats version 1
[ 1.157650] Loading compiled-in X.509 certificates
[ 1.158158] Key type ._fscrypt registered
[ 1.158171] Key type .fscrypt registered
[ 1.168325] uart-pl011 fe201000.serial: cts_event_workaround enabled
[ 1.168396] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 29, base_baud = 0) is a PL011 rev2
[ 1.174408] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[ 1.175333] mmc-bcm2835 fe300000.mmcnr: mmc_debug:0 mmc_debug2:0
[ 1.175347] mmc-bcm2835 fe300000.mmcnr: DMA channel allocated
[ 1.226763] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[ 1.228400] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[ 1.230097] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[ 1.233071] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[ 1.234725] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[ 1.242326] mmc0: SDHCI controller on fe340000.emmc2 [fe340000.emmc2] using ADMA
[ 1.245126] of_cfs_init
[ 1.245243] of_cfs_init: OK
[ 1.246379] Waiting for root device /dev/mmcblk0p7...
[ 1.284069] random: fast init done
[ 1.315619] mmc1: new high speed SDIO card at address 0001
[ 1.349467] mmc0: new ultra high speed DDR50 SDHC card at address 0001
[ 1.350415] mmcblk0: mmc0:0001 EB1QT 29.8 GiB
[ 1.353683] mmcblk0: p1 p2 < p5 p6 p7 >
[ 1.373628] EXT4-fs (mmcblk0p7): mounted filesystem with ordered data mode. Opts: (null)
[ 1.373703] VFS: Mounted root (ext4 filesystem) readonly on device 179:7.
[ 1.378987] devtmpfs: mounted
[ 1.387094] Freeing unused kernel memory: 2048K
[ 1.411421] Run /sbin/init as init process
[ 1.491197] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[ 1.673771] usb 1-1: New USB device found, idVendor=2109, idProduct=3431, bcdDevice= 4.21
[ 1.673788] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[ 1.673803] usb 1-1: Product: USB2.0 Hub
[ 1.675839] hub 1-1:1.0: USB hub found
[ 1.676156] hub 1-1:1.0: 4 ports detected
[ 1.873316] systemd[1]: System time before build time, advancing clock.
[ 1.965408] NET: Registered protocol family 10
[ 1.966767] Segment Routing with IPv6
[ 1.999602] systemd[1]: systemd 241 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[ 2.000346] systemd[1]: Detected architecture arm.
[ 2.001353] usb 1-1.3: new full-speed USB device number 3 using xhci_hcd
[ 2.062313] systemd[1]: Set hostname to
Additional context I am reproducing this daily with a TP-Link Archer A7 router (5GHz)
Is it possible to test at 2,4G to see if that works OK? What sort of signal strength are you seeing - is it right on the edge? Does moving the Pi closer make the problem more or less common?
Looks like it is already using 2.4GHz (I thought it was using 5GHz since the LXDE WiFi panel control shows 5G and the router supports it). Signal strength is strong.
Here is the info from wpa_cli:
> signal_poll
RSSI=-51
LINKSPEED=24
NOISE=9999
FREQUENCY=2417
WIDTH=40 MHz
CENTER_FRQ1=2427
I'm having the same WIFI issues at the moment and I have to reboot the raspberry.
syslog:
Sep 29 18:42:59 rpi systemd[1]: Started Cleanup of Temporary Directories.
Sep 29 18:52:58 rpi kernel: [260835.693136] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Sep 29 19:17:01 rpi CRON[31988]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
kern.log:
Sep 29 06:25:03 rpi kernel: [215959.278512] Process accounting resumed
Sep 29 18:52:58 rpi kernel: [260835.693136] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed
Sep 29 20:19:50 rpi kernel: [266047.569262] ieee80211 phy0: brcmf_proto_bcdc_query_dcmd: brcmf_proto_bcdc_msg failed w/status -110
Sep 29 20:20:03 rpi kernel: [266060.769503] ieee80211 phy0: brcmf_proto_bcdc_query_dcmd: brcmf_proto_bcdc_msg failed w/status -110
Sep 30 06:25:03 rpi kernel: [302360.950984] Process accounting resumed
System: Raspberry Pi 4 Model B Rev 1.2, 2 GB variant Linux version 5.4.51-v7l+ (dom@buildbot) (gcc version 4.9.3 (crosstool-NG crosstool-ng-1.22.0-88-g8460611)) #1333 SMP Mon Aug 10 16:51:40 BST 2020 raspberrypi-firmware soc:firmware: Attached to firmware from 2020-09-02 21:13, variant start raspberrypi-firmware soc:firmware: Firmware hash is 4439d2aaa6c376a2d1ef4402f142e1cf4de37c43 brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
WIFI Router: TP-Link Archer C7
It's a bug with the IEEE 802.11r fast roaming implementation in the Wifi driver. Disabling fast roaming on my mesh router fixed this issue.
It's a bug with the IEEE 802.11r fast roaming implementation in the Wifi driver. Disabling fast roaming on my mesh router fixed this issue.
Indeed I have a mesh setup with several routers, but ieee80211r (Fast BSS transition) is not active. How did you come up with that? Do you have any tips how to find out the reason for the crashes in my setup?
I only have a single router, no mesh. I have also tried using separate SSIDs for 2.4GHz and 5GHz, so that the Pi would not switch between them and it didn't help.
On Wed, Oct 7, 2020 at 7:48 AM Chris [email protected] wrote:
It's a bug with the IEEE 802.11r fast roaming implementation in the Wifi driver. Disabling fast roaming on my mesh router fixed this issue.
Indeed I have a mesh setup with several routers, but ieee80211r (Fast BSS transition) is not active. How did you come up with that? Do you have any tips how to find out the reason for the crashes in my setup?
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/raspberrypi/linux/issues/3849#issuecomment-704911720, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAEVIQNZJ2L5EGBQY6XL7RLSJRPQNANCNFSM4RIKBSZQ .
Got the answer here: https://github.com/raspberrypi/linux/issues/1342#issuecomment-681948365 I've not had any wifi crashes anymore since disabling fast roaming on my TP-Link deco mesh. However I've also added an automatic reboot in my crontab whenever the gateway is unreachable, just in case.
I can't find any setting on my TP-Link Archer A7 to disable fast roaming, unfortunately. There is only a section for "OneMesh" configuration and it doesn't let you change anything, especially if you don't have other devices...so I don't have a way to test this.
Having the same issue here. Wifi is crashing on new RPi4 and the only way to recover is a reboot. As a Wi-fi AP, I am using Netgear Orbi.
[ 587.355859] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed [ 589.770561] brcmfmac: brcmf_sdio_bus_rxctl: resumed on timeout [ 589.771103] brcmfmac: brcmf_sdio_checkdied: firmware trap in dongle [ 589.771398] brcmfmac: dongle trap info: type 0x4 @ epc 0x0007a094 cpsr 0x6000019f spsr 0x600001bf sp 0x0025f888 lr 0x0007a093 pc 0x0007a094 offset 0x25f830 r0 0x00000036 r1 0x00000005 r2 0x00000000 r3 0x00000001 r4 0x002494d0 r5 0x00000000 r6 0x00249460 r7 0x00000004 [ 589.771423] ieee80211 phy0: brcmf_run_escan: error (-110) [ 589.771444] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) [ 649.771263] ieee80211 phy0: brcmf_run_escan: error (-110)
What does dmesg | grep Firmware: show, @freeforall2?
Anyone experiencing a crash like this, please download the new clm_blob file: https://drive.google.com/file/d/1J8DdbsrZcSkDYKUPsdy2RvncttSwQdBH/view?usp=sharing
Install it with:
pi@raspberrypi:~$ sudo mv /lib/firmware/brcm/brcmfmac43455-sdio.clm_blob{,.bak}
pi@raspberrypi:~$ sudo cp brcmfmac43456-sdio.clm_blob /lib/firmware/brcm/brcmfmac43455-sdio.clm_blob
[ yes - there is a rename from 43456 to 43455 in that copy ]
@pelwell here is the output :
[ 0.070883] raspberrypi-firmware soc:firmware: Firmware hash is 4439d2aaa6c376a2d1ef4402f142e1cf4de37c43 [ 5.383337] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Mar 23 2020 02:19:54 version 7.45.206 (r725000 CY) FWID 01-88ee44ea
Thanks - that is the most recent firmware we have. It's interesting that the location of the firmware crash is the same as in the OP. I'll flag it up to Cypress.
@pelwell Thanks ! Do you still suggest that I install the clm_blob you sent for testing ?
Cypress have provided another firmware to test. I suspect it's just a current build rather than one expected to solve the problem, but it's worth trying: https://drive.google.com/file/d/13u_Ipf6yUATl38HyVNiHG3H2BVxCzfkB/view?usp=sharing You'll need to rename it when instalingl it (and reboot afterwards):
pi@raspberrypi:~$ sudo mv /lib/firmware/brcm/brcmfmac43455-sdio.bin{,.bak}
pi@raspberrypi:~$ sudo cp cyfmac43455-sdio.bin /lib/firmware/brcm/brcmfmac43455-sdio.bin
@pelwell I installed the clm_blob you provided. I am going to monitor for 24 or 48 hours. If it doesn't fix the issue, I will install the new firmware. Let me know if it doesn't make sense and I should go with a different approach. Thanks !
There's now a dedicated test image Cypress would like you to run: https://drive.google.com/file/d/1ggSFL4YvPRkm0e-uYdrYWGG1TBEprtat/view?usp=sharing
Again, it will have to be renamed bcrmfmac43455-sdio.bin when installing it.
Please try it, and upload the logs for any failures you see.
@pelwell, thanks. So here is my feedback : I only installed the clm_blob you provided and it looks like it fixed the issue (no crash since 48h while before I had at least 1 crash per day). Question : What do you recommend as a next step ? Should I revert to the old clm_blob and install the last bcrmfmac43455-sdio.bin you provided ? or should I keep the clm_blob and it can be considered as the fix ?
The firmware shouldn't crash, no matter what, so if you are willing it would be nice to install the trial firmware, revert the blob and let it crash once (or perhaps it won't), grabbing the kernel log. After that you can apt update and sudo apt install firmware-brcm80211 to restore the new blob (we released it yesterday).
@pelwell before installing the trial firmware I decided to continue monitoring for an extra couple days. It actually just crashed ( with the clm_blob you provided still in place). You can find below the log (please tell me if you need more logs). What would you recommend at this stage ? should I revert the clm_blob to the original and install the trial firmware ? Thanks for your help !
Dec 4 21:16:05 raspberrypi kernel: [253847.841829] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed Dec 4 21:16:07 raspberrypi kernel: [253850.279910] brcmfmac: brcmf_sdio_bus_rxctl: resumed on timeout Dec 4 21:16:07 raspberrypi kernel: [253850.280473] brcmfmac: brcmf_sdio_checkdied: firmware trap in dongle Dec 4 21:16:07 raspberrypi kernel: [253850.280764] brcmfmac: dongle trap info: type 0x4 @ epc 0x0007a094 Dec 4 21:16:07 raspberrypi kernel: [253850.280764] cpsr 0x6000019f spsr 0x600001bf sp 0x0025f888 Dec 4 21:16:07 raspberrypi kernel: [253850.280764] lr 0x0007a093 pc 0x0007a094 offset 0x25f830 Dec 4 21:16:07 raspberrypi kernel: [253850.280764] r0 0x00000036 r1 0x00000005 r2 0x00000000 r3 0x00000001 Dec 4 21:16:07 raspberrypi kernel: [253850.280764] r4 0x002494d0 r5 0x00000000 r6 0x00249460 r7 0x00000004 Dec 4 21:16:07 raspberrypi kernel: [253850.280792] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 4 21:16:07 raspberrypi kernel: [253850.280813] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110)
I can confirm that I have the same issue as well still with the new firmware
Run the new firmware with brcmfmac.debug=0x100000 in cmdline.txt, and when it crashes upload the output from dmesg.
@pelwell - thanks. I installed the trial firmware and I set brcmfmac.debug=0x100000. I will send you syslog output when it crashes.
@pelwell please find below the log (crash at 05:13)- don't hesitate if you need anything else from my side. Thanks
Dec 7 05:12:48 raspberrypi kernel: [168150.183606] brcmfmac: CONSOLE: 167750.419 wlc_rrm_timer: state upd to 5 Dec 7 05:12:48 raspberrypi kernel: [168150.183621] brcmfmac: CONSOLE: 167750.419 wl0: wlc_rrm_timer: WAIT_STOP_TRAFFIC, 0 ms until measurement, waiting for PS announcement Dec 7 05:12:48 raspberrypi kernel: [168150.183634] brcmfmac: CONSOLE: 167750.419 wlc_rrm_begin, state upd to 4 Dec 7 05:12:48 raspberrypi kernel: [168150.183646] brcmfmac: CONSOLE: 167750.419 wlc_rrm_begin: calling wlc_set_chanspec Dec 7 05:12:48 raspberrypi kernel: [168150.183661] brcmfmac: CONSOLE: 167750.420 wlc_rrm_begin_scan: duration: 100, channel num: 1, bssid: ff:ff:ff:ff:ff:ff Dec 7 05:12:49 raspberrypi kernel: [168150.613547] brcmfmac: CONSOLE: 167750.522 wlc_rrm_bcnreq_scancb: state: 7, status: 0 Dec 7 05:12:49 raspberrypi kernel: [168150.613562] brcmfmac: CONSOLE: 167750.522 wlc_rrm_bcnreq_scancb: scan count: 0 Dec 7 05:12:49 raspberrypi kernel: [168150.613575] brcmfmac: CONSOLE: 167750.532 wlc_rrm_meas_end: return to the home channel Dec 7 05:12:49 raspberrypi kernel: [168150.613588] brcmfmac: CONSOLE: 167750.533 wlc_rrm_report_11k: scan results count = 0 Dec 7 05:13:07 raspberrypi kernel: [168168.633999] brcmfmac: CONSOLE: 167768.820 wl0.0: wlc_rrm_timer: WAIT_STOP_TRAFFIC, entering PS mode for off channel measurement Dec 7 05:13:07 raspberrypi kernel: [168168.634015] brcmfmac: CONSOLE: 167768.821 wlc_rrm_timer: state upd to 5 Dec 7 05:13:07 raspberrypi kernel: [168168.634030] brcmfmac: CONSOLE: 167768.821 wl0: wlc_rrm_timer: WAIT_STOP_TRAFFIC, 0 ms until measurement, waiting for PS announcement Dec 7 05:13:07 raspberrypi kernel: [168168.634042] brcmfmac: CONSOLE: 167768.821 wlc_rrm_begin, state upd to 4 Dec 7 05:13:07 raspberrypi kernel: [168168.634055] brcmfmac: CONSOLE: 167768.821 wlc_rrm_begin: calling wlc_set_chanspec Dec 7 05:13:07 raspberrypi kernel: [168168.634071] brcmfmac: CONSOLE: 167768.823 wlc_rrm_begin_scan: duration: 100, channel num: 1, bssid: ff:ff:ff:ff:ff:ff Dec 7 05:13:07 raspberrypi kernel: [168168.693940] brcmfmac: CONSOLE: 67768.883 sp+1e8 0000018b Dec 7 05:13:07 raspberrypi kernel: [168168.693954] brcmfmac: CONSOLE: 167768.883 sp+200 0000018d Dec 7 05:13:07 raspberrypi kernel: [168168.693967] brcmfmac: CONSOLE: 167768.883 sp+20c 00022cf7 Dec 7 05:13:07 raspberrypi kernel: [168168.693979] brcmfmac: CONSOLE: 167768.883 sp+21c 001a6291 Dec 7 05:13:07 raspberrypi kernel: [168168.693990] brcmfmac: CONSOLE: 167768.883 sp+270 00000335 Dec 7 05:13:07 raspberrypi kernel: [168168.767812] ieee80211 phy0: brcmf_fw_crashed: Firmware has halted or crashed Dec 7 05:13:09 raspberrypi kernel: [168171.183635] brcmfmac: brcmf_sdio_bus_rxctl: resumed on timeout Dec 7 05:13:09 raspberrypi kernel: [168171.184053] brcmfmac: brcmf_sdio_checkdied: firmware trap in dongle Dec 7 05:13:09 raspberrypi kernel: [168171.184341] brcmfmac: dongle trap info: type 0x4 @ epc 0x001e85c6 Dec 7 05:13:09 raspberrypi kernel: [168171.184341] cpsr 0x6000019f spsr 0x600001bf sp 0x0025f888 Dec 7 05:13:09 raspberrypi kernel: [168171.184341] lr 0x001e85c7 pc 0x001e85c6 offset 0x25f830 Dec 7 05:13:09 raspberrypi kernel: [168171.184341] r0 0x0000003f r1 0x00000005 r2 0x00000000 r3 0x00000001 Dec 7 05:13:09 raspberrypi kernel: [168171.184341] r4 0x002494ac r5 0x00000000 r6 0x0024943c r7 0x00000004 Dec 7 05:13:09 raspberrypi kernel: [168171.184368] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:13:09 raspberrypi kernel: [168171.184387] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:14:09 raspberrypi kernel: [168231.184859] brcmfmac: brcmf_sdio_bus_rxctl: resumed on timeout Dec 7 05:14:09 raspberrypi kernel: [168231.185288] brcmfmac: brcmf_sdio_checkdied: firmware trap in dongle Dec 7 05:14:09 raspberrypi kernel: [168231.185578] brcmfmac: dongle trap info: type 0x4 @ epc 0x001e85c6 Dec 7 05:14:09 raspberrypi kernel: [168231.185578] cpsr 0x6000019f spsr 0x600001bf sp 0x0025f888 Dec 7 05:14:09 raspberrypi kernel: [168231.185578] lr 0x001e85c7 pc 0x001e85c6 offset 0x25f830 Dec 7 05:14:09 raspberrypi kernel: [168231.185578] r0 0x0000003f r1 0x00000005 r2 0x00000000 r3 0x00000001 Dec 7 05:14:09 raspberrypi kernel: [168231.185578] r4 0x002494ac r5 0x00000000 r6 0x0024943c r7 0x00000004 Dec 7 05:14:09 raspberrypi kernel: [168231.185603] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:14:09 raspberrypi kernel: [168231.185623] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:15:09 raspberrypi kernel: [168291.186121] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:15:09 raspberrypi kernel: [168291.186147] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:16:09 raspberrypi kernel: [168351.187333] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:16:09 raspberrypi kernel: [168351.187355] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:17:01 raspberrypi CRON[9031]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly) Dec 7 05:17:09 raspberrypi kernel: [168411.188524] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:17:09 raspberrypi kernel: [168411.188548] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:18:09 raspberrypi kernel: [168471.189710] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:18:09 raspberrypi kernel: [168471.189733] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110) Dec 7 05:19:09 raspberrypi kernel: [168531.190900] ieee80211 phy0: brcmf_run_escan: error (-110) Dec 7 05:19:09 raspberrypi kernel: [168531.190924] ieee80211 phy0: brcmf_cfg80211_scan: scan error (-110)
In a remarkably quick turnaround there's a test firmware with a possible fix: https://drive.google.com/file/d/1YOvhSmyCmQkoF9vcsRDD5oxFkj0VGuM7/view?usp=sharing (It will have to be renamed and installed as before).
@pelwell thanks ! it was very quick ! I installed the test firmware. I will monitor for a few days and let you know the results. Just one thing : at some point, I reverted to the old clm_blob. Do you confirm that I shouldn't touch it for now. Or should I update it ? Thanks