firmware-lenovo
firmware-lenovo copied to clipboard
Failed ME Firmware on Lenovo T14s Gen 2
I recently had unsuccessful firmware update from my Fedora box on Lenovo T14s Gen2.
The update didn't went through and now whenever I reboot the system, I get into the attempt update which always fails. Showing messages:
" Reading ME Firmware...Please do not power off! 18% Complete" " Failed to recover ME Firmware..."
Eventually it fails around 60% of update.
Here is some info:
[root@fedora fw]# fwupdmgr get-updates
Devices with no available firmware updates:
• ELAN0676:00 04F3:3195
• USB2.0 Hub
• USB2.0 Hub
• USB3.1 Hub
• USB3.1 Hub
• Integrated Camera
• MSP430
• Prometheus IOTA Config
• ThinkPad Thunderbolt 3 Dock
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI dbx
• Unifying Receiver
Devices with the latest available firmware version:
• Intel Management Engine
• Micron <>
• Prometheus
20WNS1F63S
│
├─Embedded Controller:
│ │ Device ID: 2292ae5236790b47884e37cf162dcf23bfcd1c60
│ │ Summary: UEFI ESRT device
│ │ Current version: 0.1.35
│ │ Minimum Version: 0.1.35
│ │ Vendor: Lenovo (DMI:LENOVO)
│ │ Update State: Success
│ │ GUID: e6c0d74d-98a2-489b-920d-f8e8c9418cb3
│ │ Device Flags: • Internal device
│ │ • Updatable
│ │ • System requires external power source
│ │ • Supported on remote server
│ │ • Needs a reboot after installation
│ │ • Device is usable for the duration of the update
│ │
│ └─ThinkPad T14s Gen 2 / X13 Gen 2:
│ New version: 0.1.38
│ Remote ID: lvfs
│ Release ID: 12076
│ Summary: Lenovo ThinkPad T14s Gen 2 / X13 Gen 2 Embedded Controller Firmware
│ License: Proprietary
│ Size: 767.3 kB
│ Created: 2021-05-27
│ Vendor: Lenovo
│ Release Flags: • Is upgrade
│ Description:
│ Embedded Controller Firmware N35HT38W version 1.38. The computer will be restarted automatically after updating EC completely. Do NOT turn off your computer or remove the AC adapter while the update is in progress
│
└─System Firmware:
│ Device ID: a45df35ac0e948ee180fe216a5f703f32dda163f
│ Summary: UEFI ESRT device
│ Current version: 0.1.41
│ Vendor: Lenovo (DMI:LENOVO)
│ Update State: Success
│ GUIDs: 363864c7-1a44-4247-ae16-f2315d3855ea
│ 230c8b18-8d9b-53ec-838b-6cfc0383493a ← main-system-firmware
│ Device Flags: • Internal device
│ • Updatable
│ • System requires external power source
│ • Supported on remote server
│ • Needs a reboot after installation
│ • Cryptographic hash verification is available
│ • Device is usable for the duration of the update
│
├─ThinkPad T14s Gen 2i / X13 Gen 2i:
│ New version: 0.1.44
│ Remote ID: lvfs
│ Release ID: 12405
│ Summary: Lenovo ThinkPad T14s Gen 2i / X13 Gen 2i System Firmware
│ License: Proprietary
│ Size: 18.3 MB
│ Created: 2021-05-11
│ Vendor: Lenovo
│ Release Flags: • Is upgrade
│ Description:
│ Lenovo ThinkPad T14s Gen2 /ThinkPad X13 Gen2 System Firmware Version 1.44
│
│ The computer will be restarted automatically after updating BIOS completely . Do NOT turn off your computer or remove the AC adaptor while update is in progress.
│
│ • Updated the E-Labeling applcation to version 5.0.0.30.
│ • Supported 5.15-5.35 GHz band in Indonesia.
│
└─ThinkPad T14s Gen 2i / X13 Gen 2i:
New version: 0.1.43
Remote ID: lvfs
Release ID: 11577
Summary: Lenovo ThinkPad T14s Gen 2i / X13 Gen 2i System Firmware
License: Proprietary
Size: 18.3 MB
Created: 2021-05-11
Vendor: Lenovo
Release Flags: • Is upgrade
Description:
The computer will be restarted automatically after updating BIOS completely . Do NOT turn off your computer or remove the AC adaptor while update is in progress.
• Update includes a security fix.
• Changed power LED Sleep mode behavior when system is going to Modern Standby.
• Fixed an issue where device firmware update via Windows Update failed when OPAL management software is installed.
• Fixed an issue where unlock message isn't correct after sign out in Windows,after check "Require user to press Ctrl+Alt+Delete".
[root@fedora fw]# fwupdate -i
Information for the update status entry 0:
Information Version: 7
Firmware GUID: {363864c7-1a44-4247-ae16-f2315d3855ea}
Capsule Flags: 0x00000000x
Hardware Instance: 0
Update Status: attempt-update
Capsule File Path: /EFI/fedora/fw/fwupd-363864c7-1a44-4247-ae16-f2315d3855ea.cap
Information for the update status entry 2:
Information Version: 7
Firmware GUID: {e6c0d74d-98a2-489b-920d-f8e8c9418cb3}
Capsule Flags: 0x00000000x
Hardware Instance: 0
Update Status: attempt-update
Capsule File Path: /EFI/fedora/fw/fwupd-e6c0d74d-98a2-489b-920d-f8e8c9418cb3.cap
[root@fedora fw]# ls -l
total 18664
-rwx------. 1 root root 18335664 May 15 12:24 fwupd-363864c7-1a44-4247-ae16-f2315d3855ea.cap
-rwx------. 1 root root 771440 May 15 12:24 fwupd-e6c0d74d-98a2-489b-920d-f8e8c9418cb3.cap
Additionally to that, the audio stopped working as well - the internal speakers or audio over hdmi. I would say it could be issue of the SOF drivers.
Any idea how to revert it?
@hughsie hey, reading through the issues below, I can say I had exactly the same experience.
https://github.com/fwupd/firmware-lenovo/issues/131 https://github.com/fwupd/firmware-lenovo/issues/129
The screen was black and a lot noise from the fan. Hit the power button to force off, then started again. It didn't start at the beginning, juts glowing power indicator. After couple of tries, it booted back, but now shows Failed to recover the ME...
ewww - that sounds nasty. I've raised internal ticket LO-1732 requesting feedback from the FW team
ewww - that sounds nasty. I've raised internal ticket LO-1732 requesting feedback from the FW team
Hey Mark, I've reached out to Lenovo Support if there is way to revert it back. We tried the reset button at the bottom of the PC, unfortunately it didn't help.
I am just curious if this might fix it: ~~https://pcsupport.lenovo.com/ca/en/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20xf-20xg/downloads/driver-list/component?name=BIOS%2FUEFI~~
update - correct link https://pcsupport.lenovo.com/ca/en/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20wm-20wn/downloads/driver-list/component?name=BIOS%2FUEFI
That particular link won't help as you've linked to the AMD variant :)
The updates for the Intel version are here: https://pcsupport.lenovo.com/ca/en/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20wm-20wn/downloads/driver-list/
But I'd be really hesitant to mess with it until we get guidance from the FW team as to what went wrong. I've never seen a BIOS/EC update mess up the ME (there are plenty of failed ME updates - but they've happened when updating the ME)
Hopefully we can get some guidance to the next steps.
Same problem here with a T15 Gen 2 on Ubuntu 22.04. I thought the problem was my encrypted drive setup, and secure boot. But retried with disabled secure boot, and a clean install of Ubuntu without the encrypted drive, and got to the same result. Is there perhaps a way to disable the message at boot?
@vwalek for the audio I solved with #2 here https://www.linuxuprising.com/2018/06/fix-no-sound-dummy-output-issue-in.html
Same problem here with a T15 Gen 2 on Ubuntu 22.04. I thought the problem was my encrypted drive setup, and secure boot. But retried with disabled secure boot, and a clean install of Ubuntu without the encrypted drive, and got to the same result. Is there perhaps a way to disable the message at boot?
@vwalek for the audio I solved with #2 here https://www.linuxuprising.com/2018/06/fix-no-sound-dummy-output-issue-in.html
Did you reinstall the system and it went back to normal? Like you are not getting this failed message at the boot?
@mrhpearson any news?
Same problem here with a T15 Gen 2 on Ubuntu 22.04. I thought the problem was my encrypted drive setup, and secure boot. But retried with disabled secure boot, and a clean install of Ubuntu without the encrypted drive, and got to the same result. Is there perhaps a way to disable the message at boot? @vwalek for the audio I solved with #2 here https://www.linuxuprising.com/2018/06/fix-no-sound-dummy-output-issue-in.html
Did you reinstall the system and it went back to normal? Like you are not getting this failed message at the boot?
Sorry for the confusion. With a fresh Ubuntu install nothing changed for me. I forced the reinstall of the firmware updates but still with the message at startup.
@makaai - did you try the bootable BIOS upgrade image?
https://pcsupport.lenovo.com/ca/en/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20wm-20wn/downloads/driver-list/
@makaai - did you try the bootable BIOS upgrade image?
https://pcsupport.lenovo.com/ca/en/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20wm-20wn/downloads/driver-list/
Not yet (also I'd need the one for the T15 in my case). I was hoping to get at least the message disabled from startup in the meanwhile.
@makaai same here :) I am waiting for the team to reply what to do next. Really what would be great is to get rid of the message, or force to reset the attempt for update and just continue.
Feedback from FW team:
Could the fail system successfully boot to linux when have the fail ? If ok, could customer re-install the MEFW LVfs file by local update, to see if can recover it.
https://pcsupport.lenovo.com/us/zh/products/laptops-and-netbooks/thinkpad-t-series-laptops/thinkpad-t14s-gen-2-type-20wm-20wn/downloads/driver-list/component?name=%E6%99%B6%E7%89%87%E7%B5%84
After download the files (n35rk01.cab for Corporate system, n35rl01.cab for Consumer system), run below command to local update (for Corporate system):
fwupdmgr --allow-older --allow-reinstall install n35rk01.cab
(Note - easiest way to check which FW you need is probably to stop in the BIOS setup screen (F1 during early boot) and see what version is reported there)
Hi Mark, could you share with me the .cab file link for a Lenovo t15 gen 2 type 20W4? Many thanks
I've requested from the FW team
(n35rk01.cab for Corporate system, n35rl01.cab for Consumer system),
Hi Mark, will try it. Just quick question, how would you define which is Corporate or Consumer? I just want to verify. Thx
(update):
Ok, running the dmidecode
and looking for SKU shows the right one.
# dmidecode | grep SKU
Could the fail system successfully boot to linux when have the fail ?
Yes, I can successfully boot to the linux.
@makaai - could you send me an email (markpearson at lenovo dot com) and I'll forward the FW files for the T15
@vwalek - this is whether your system is vPro (corporate) or not (consumer). Looks like you figured it out :) Thanks for the note.
@vwalek - this is whether your system is vPro (corporate) or not (consumer). Looks like you figured it out :) Thanks for the note.
Thx @mrhpearson. Yeah, it would be great to add it to the README notes, so people can check which system they have. https://download.lenovo.com/pccbbs/mobiles/n35rk01w.txt
@mrhpearson Great news! It worked and the message is gone.
Just couple of hints that could be mentioned:
- the file's name is actually
n35rk01w.cab
for Corporate system - to install the package you need to set
OnlyTrusted=false
in/etc/fwupd/daemon.conf
- the installation went ok and asked to reset the system.
- the system rebooted to the message again
Failed to recover ME firmware...
- in about 10-20 seconds the
fwudp-efi 1.3
message showed on left corner - nothing else was shown, thinking it didn't work
- after around 5-6 minutes another line poped up
Resetting system
- after that, the system booted normally, fixing also the audio issues.
Thank you for fixing the issue! @mrhpearson++
Awesome - that's good news. That 5-6 minute wait completely sucks when that happens with nothing to show progress.
Glad you're up and running again. I'll let the FW team know
Hi @mrhpearson any news oh the T15 files? Thanks
No update - I've sent another request for them
Hi @makaai - I now have the T15 files. If you can email me (markpearson at lenovo dot com) I'll send you the link to them Thanks Mark
Thanks @mrhpearson that fixed it for me too!
I'm having the same experience as https://github.com/fwupd/firmware-lenovo/issues/226#issuecomment-1128272230 (didn't boot, forced power-off, now "Failed to recover ME Firmware" and re-upgrading firmware doesn't help).
Is there a set of instructions to be followed to get this working?
# dmidecode | grep SKU
SKU Number: LENOVO_MT_20W0_BU_Think_FM_ThinkPad T14 Gen 2i
... on Ubuntu 22.04.
I'm looking into downloading the .cab files.
How do I know if my notebook is Corporate or Consumer?
I have had the same issue as above and followed the procedure in https://github.com/fwupd/firmware-lenovo/issues/226#issuecomment-1136307239
My MC firmware version (in BIOS) was 15.0.41.2142
The biggest problem was that I didn't know how to figure out if my laptop was Corporate or Consumer.
I just installed Consumer and it turned out it works fine.
Hey there. new here. I am going to make my own thread on this as I am being plagued by this right now. And find it insane that lenovo hasn't issued a recall on these machines given all the issues- screen flicker, charging completely quits until bios update, and now this- bricking of the laptops from a damn update that Lenovo is pushing out over Lenovo system update.
I have had this happen to 5 computers in my fleet already. within 2 months of having them...
I was under the impression that this only happens if you update IME first before updating the BIOS. But I have a machine that I was testing this whole flashing of external monitors when on a TB4 dock. I basically updated everything but the IME and GPU. Then today I decided to update the IME- mind you the BIOS was already updated. As soon as i did, now im getting a black screen boot loop. which led me to this post.
I just tried booting to a linux flash drive, and it will not boot into it. so i dont think this will help me at all. although i will say I have no idea how to find these CAB files. all i get is the exe from the link posted. and when i extract the files from that, there is no CAB files.
I am almost to the point where I want to sound the alarm and return my entire fleet. Lenovo has been so silent about this and I've spent the last 2 months compiling all this data on these issues.
- laptop ceases to charge AT ALL. which then requires you to update the bios. but you cant use the system update tool to do this because that requires power. the EXE does not. however if you get too low battery you run the risk of bricking.
- The screen flicker and/or monitors going off/on when you are using 2 monitors on a TB4 or TB3 dock. all firmware and drivers updated. still happens.
- this insane bricking of a laptop if you install the IME drivers using system update. and in the notes I now see that it says you should disable bitlocker. that is insanity to have to do such a manual thing in a corporate environment. then worry about re-enabling it and updating your BL codes in AD manually. Not only that but if lenovo is saying disable bitlocker or else it will be bricked, then whyTF are they allowing this to be pushed out using system update?
sorry for the rant here. but I dont think i have dealt with anything so horrid that almost feels criminal to not recall.
I am experiencing almost exactly the same scenario described by @vwalek but unfortunately, after downloading the right CAB for my hardware (LENOVO_MT_20W1_BU_Think_FM_ThinkPad T14 Gen 2i) and running the fwupdmgr re-installation, the behavior is still the same. The "Reading ME Firmware...Please do not power off!" and the "Failed to recover ME Firmware..." messages persists.
@mrhpearson do you have any other tip I can try? I also tried the bootable USB drive FW installation also. No luck. All my restarts take ages and I can't seem to have the sound enable properly in Linux (I am an experienced user).
@pkese did you manage to solve your issue?
Thanks in advance.
Similar issue with my p15 gen2 #250 Same as @grobz re-flashing does not work unfortunately.
Tagging @ChiWei-Chen for this one. Afraid I've lost track of where we are with the ME FW update issues...
@grobz , @kleops9 , thanks for reporting this issue. Could you open a separate ticket for T14 Gen2 and P15 Gen2 provide more detailed information? We need to address this with separate FW team. Thanks!
- fwupdmgr update --show-all (if possible)
- system firmware version and Intel Management Engine firmware version in BIOS main page
- OS and fwupdmgr version