13.1 rc1 will not load

[AllardKatan]

trafficstars

Describe the issue you are experiencing

I am trying to upgrade to the 13.1. rc version for beta testing but I don't get it to load. See also my comments in 'discussion' but I guess that wasn't the place for it? The short of it: when I attempt to upgrade, the system simply boots back up in the existing 12.4 Three consecutive upgrade attempts put me into 'rescue mode'

What operating system image do you use?

ova (for Virtual Machines)

What version of Home Assistant Operating System is installed?

12.4

Did the problem occur after upgrading the Operating System?

Yes

Hardware details

Host OS: Linux Mint 22. Hypervisor: Virtualbox 7.0.16. USB devices: sonoff zigbee dongle 'e', USB ssd drive (passthrough enabled in Virtualbox but not physically connected).

Steps to reproduce the issue

1. Click 'install' on the upgrade pop-up in OR type os upgrade in the CLI

...

Anything in the Supervisor logs that might be useful for us?

2024-08-19 17:44:34.129 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-audio with version 2023.12.0
2024-08-19 17:44:34.176 INFO (MainThread) [supervisor.plugins.audio] Starting Audio plugin
2024-08-19 17:44:35.131 INFO (MainThread) [supervisor.docker.audio] Starting Audio ghcr.io/home-assistant/amd64-hassio-audio with version 2023.12.0 - 172.30.32.4
2024-08-19 17:44:35.164 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-observer with version 2023.06.0
2024-08-19 17:44:35.221 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/amd64-hassio-multicast with version 2024.03.0
2024-08-19 17:44:35.267 INFO (MainThread) [supervisor.plugins.multicast] Starting Multicast plugin
2024-08-19 17:44:35.888 INFO (MainThread) [supervisor.docker.multicast] Starting Multicast ghcr.io/home-assistant/amd64-hassio-multicast with version 2024.03.0 - Host
2024-08-19 17:44:35.898 INFO (MainThread) [supervisor.homeassistant.secrets] Loaded 1 Home Assistant secrets
2024-08-19 17:44:35.933 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/home-assistant/qemux86-64-homeassistant with version 2024.8.2
2024-08-19 17:44:36.108 INFO (MainThread) [supervisor.os.manager] Detect Home Assistant Operating System 12.4 / BootSlot A
2024-08-19 17:44:37.031 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/core repository
2024-08-19 17:44:37.031 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/9074a9fa repository
2024-08-19 17:44:37.031 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/cebe7a76 repository
2024-08-19 17:44:37.034 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/65f67727 repository
2024-08-19 17:44:37.036 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/5c53de3b repository
2024-08-19 17:44:37.043 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/d5369777 repository
2024-08-19 17:44:37.053 INFO (MainThread) [supervisor.store.git] Loading add-on /data/addons/git/a0d7b954 repository
2024-08-19 17:44:37.774 INFO (MainThread) [supervisor.store] Loading add-ons from store: 83 all - 83 new - 0 remove
2024-08-19 17:44:37.871 INFO (MainThread) [supervisor.addons.manager] Found 7 installed add-ons
2024-08-19 17:44:37.919 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-configurator with version 5.8.0
2024-08-19 17:44:37.937 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-mosquitto with version 6.4.1
2024-08-19 17:44:37.956 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-samba with version 12.3.2
2024-08-19 17:44:37.974 INFO (MainThread) [supervisor.docker.interface] Attaching to homeassistant/amd64-addon-ssh with version 9.14.0
2024-08-19 17:44:38.003 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/esphome/esphome-hassio with version 2023.12.9
2024-08-19 17:44:38.025 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/hassio-addons/vscode/amd64 with version 5.15.0
2024-08-19 17:44:38.040 INFO (MainThread) [supervisor.docker.interface] Attaching to ghcr.io/sabeechen/hassio-google-drive-backup-amd64 with version 0.112.1
2024-08-19 17:44:38.499 INFO (MainThread) [supervisor.backups.manager] Found 3 backup files
2024-08-19 17:44:38.515 INFO (MainThread) [supervisor.discovery] Loaded 2 messages
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.ingress] Loaded 0 ingress sessions
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state setup
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.resolution.checks.base] Run check for detached_addon_removed/addon
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.resolution.checks.base] Run check for detached_addon_missing/addon
2024-08-19 17:44:38.516 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.jobs] 'ResolutionFixup.run_autofix' blocked from execution, system is not running - setup
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state setup
2024-08-19 17:44:38.517 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-19 17:44:38.518 INFO (MainThread) [__main__] Running Supervisor
2024-08-19 17:44:38.537 INFO (MainThread) [supervisor.os.manager] Rauc: A - marked slot kernel.0 as good
2024-08-19 17:44:38.615 INFO (MainThread) [supervisor.addons.manager] Phase 'initialize' starting 0 add-ons
2024-08-19 17:44:38.647 INFO (MainThread) [supervisor.addons.manager] Phase 'system' starting 1 add-ons
2024-08-19 17:44:39.714 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-mosquitto with version 6.4.1
2024-08-19 17:44:44.717 INFO (MainThread) [supervisor.addons.manager] Phase 'services' starting 4 add-ons
2024-08-19 17:44:44.798 INFO (MainThread) [supervisor.services.modules.mqtt] Set core_mosquitto as service provider for mqtt
2024-08-19 17:44:45.195 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-samba with version 12.3.2
2024-08-19 17:44:46.000 INFO (MainThread) [supervisor.api.middleware.security] /network/info access from core_samba
2024-08-19 17:44:46.109 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on homeassistant/amd64-addon-ssh with version 9.14.0
2024-08-19 17:44:46.948 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/esphome/esphome-hassio with version 2023.12.9
2024-08-19 17:44:48.065 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/hassio-addons/vscode/amd64 with version 5.15.0
2024-08-19 17:44:56.279 INFO (MainThread) [supervisor.auth] Auth request from 'core_mosquitto' for 'mosq'
2024-08-19 17:44:56.283 INFO (MainThread) [supervisor.auth] Home Assistant not running, checking cache
2024-08-19 17:45:18.192 INFO (MainThread) [supervisor.core] Start Home Assistant Core
2024-08-19 17:45:18.216 INFO (SyncWorker_3) [supervisor.docker.manager] Starting homeassistant
2024-08-19 17:45:18.544 INFO (MainThread) [supervisor.homeassistant.core] Wait until Home Assistant is ready
2024-08-19 17:45:25.995 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state startup
2024-08-19 17:45:25.995 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-19 17:45:28.597 INFO (MainThread) [supervisor.homeassistant.api] Updated Home Assistant API token
2024-08-19 17:45:28.608 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='NOT_RUNNING', offline_db_migration=False)
2024-08-19 17:45:59.351 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='STARTING', offline_db_migration=False)
2024-08-19 17:46:04.372 INFO (MainThread) [supervisor.homeassistant.core] Home Assistant Core state changed to APIState(core_state='RUNNING', offline_db_migration=False)
2024-08-19 17:46:04.372 INFO (MainThread) [supervisor.homeassistant.core] Detect a running Home Assistant instance
2024-08-19 17:46:04.372 INFO (MainThread) [supervisor.addons.manager] Phase 'application' starting 1 add-ons
2024-08-19 17:46:05.448 INFO (MainThread) [supervisor.docker.addon] Starting Docker add-on ghcr.io/sabeechen/hassio-google-drive-backup-amd64 with version 0.112.1
2024-08-19 17:46:07.493 INFO (MainThread) [supervisor.api.middleware.security] /core/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.513 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.526 INFO (MainThread) [supervisor.api.middleware.security] /mounts access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.536 INFO (MainThread) [supervisor.api.middleware.security] /addons access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.652 INFO (MainThread) [supervisor.api.middleware.security] /supervisor/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.657 INFO (MainThread) [supervisor.api.middleware.security] /backups access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.660 INFO (MainThread) [supervisor.api.middleware.security] /backups/d2279fb3/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.666 INFO (MainThread) [supervisor.api.middleware.security] /backups/1c248b74/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:07.671 INFO (MainThread) [supervisor.api.middleware.security] /backups/7a5116ee/info access from cebe7a76_hassio_google_drive_backup
2024-08-19 17:46:10.522 INFO (MainThread) [supervisor.misc.tasks] All core tasks are scheduled
2024-08-19 17:46:10.525 INFO (MainThread) [supervisor.core] Supervisor is up and running
2024-08-19 17:46:10.525 INFO (MainThread) [supervisor.host.info] Updating local host information
2024-08-19 17:46:10.527 INFO (MainThread) [supervisor.updater] Fetching update data from https://version.home-assistant.io/beta.json
2024-08-19 17:46:10.528 INFO (MainThread) [supervisor.resolution.check] Starting system checks with state running
2024-08-19 17:46:10.529 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_failed/dns_server
2024-08-19 17:46:10.559 INFO (MainThread) [supervisor.resolution.checks.base] Run check for docker_config/system
2024-08-19 17:46:10.559 INFO (MainThread) [supervisor.resolution.checks.base] Run check for trust/supervisor
2024-08-19 17:46:10.584 INFO (MainThread) [supervisor.resolution.checks.base] Run check for multiple_data_disks/system
2024-08-19 17:46:10.585 INFO (MainThread) [supervisor.resolution.checks.base] Run check for security/core
2024-08-19 17:46:10.585 INFO (MainThread) [supervisor.resolution.checks.base] Run check for ipv4_connection_problem/system
2024-08-19 17:46:10.586 INFO (MainThread) [supervisor.resolution.checks.base] Run check for free_space/system
2024-08-19 17:46:10.588 INFO (MainThread) [supervisor.resolution.checks.base] Run check for no_current_backup/system
2024-08-19 17:46:10.589 INFO (MainThread) [supervisor.resolution.checks.base] Run check for dns_server_ipv6_error/dns_server
2024-08-19 17:46:10.613 INFO (MainThread) [supervisor.resolution.checks.base] Run check for pwned/addon
2024-08-19 17:46:10.721 INFO (MainThread) [supervisor.resolution.checks.base] Run check for disabled_data_disk/system
2024-08-19 17:46:10.721 INFO (MainThread) [supervisor.resolution.check] System checks complete
2024-08-19 17:46:10.721 INFO (MainThread) [supervisor.resolution.evaluate] Starting system evaluation with state running
2024-08-19 17:46:11.219 INFO (MainThread) [supervisor.resolution.evaluate] System evaluation complete
2024-08-19 17:46:11.219 INFO (MainThread) [supervisor.resolution.fixup] Starting system autofix at state running
2024-08-19 17:46:11.219 INFO (MainThread) [supervisor.resolution.fixup] System autofix complete
2024-08-19 17:46:11.359 INFO (MainThread) [supervisor.host.services] Updating service information
2024-08-19 17:46:11.371 INFO (MainThread) [supervisor.host.network] Updating local network information
2024-08-19 17:46:11.573 INFO (MainThread) [supervisor.host.sound] Updating PulseAudio information
2024-08-19 17:46:11.585 INFO (MainThread) [supervisor.host.manager] Host information reload completed

Anything in the Host logs that might be useful for us?

(not available)

System information

No response

Additional information

I can't seem to find the log file that holds the full set of messages that appear on boot (bootlog, I guess that is called) That may contain useful information but it's not in the 'host' log. Where is that located, or is it not stored?

[sairon]

Right, there's no information about the issue in these logs. The messages shown at boot are the host logs, but by default the log contains only 100 last lines. You can try running ha host logs -n2000 -b-1 to get more lines and logs from the previous boot, by adjusting the -b parameter you can go back in time (-b0is the current boot). By appending something like > /mnt/data/supervisor/homeassistant/hostlogs.txt, you can save the output to the HA configuration folder and download it from there.

If the error happens after mounting the data disk, it should be persisted, but if it happens early in the boot, it may be empty. In that case watching VirtualBox console to determine where it fails would be needed as the first step.

[AllardKatan]

I did another attempt to upgrade through the UI, and it came back up again as 12.4. This is the log file: hostlogs.txt I don't think this is useful? Unless I'm reading it wrong the first line already indicates that this is not the 13.1 version. The -1 log showed information about an earlier boot.

[AllardKatan]

I will take a look at the console when I am at home, I can't do that from here. Everything flashes by real fast though, too fast to read sometimes. I'll see if I can use a screengrabber to record it, unless you know of a better trick.

[sairon]

OVA also logs the kernel buffer to the ttyS0 serial console, you can enable logging to file in VM settings. e.g. like this:

[AllardKatan]

OK, I stopped the VM using the ACPI shutdown command, changed the settings to reflect your screenshot above, then restarted the VM. It booted normally into 12.4. Then I typed 'os update' into the terminal CLI. It restarted but ended up in 'rescue mode'. I got a prompt and typed 'exit'. Then in booted back up normally in 12.4. Logfile is attached. I don't know what to look for of course, but is that 'not found' message right at the start expected?

haos.log

[sairon]

It restarted but ended up in 'rescue mode'. I got a prompt and typed 'exit'. Then in booted back up normally in 12.4.

I don't see any attempt to boot to OS 13 in that log. Can you check manually select the other boot slot in the boot loader before it boots automatically?

Logfile is attached. I don't know what to look for of course, but is that 'not found' message right at the start expected?

That's okay, it's the emulated firmware's attempt to boot from optical drive that doesn't exist.

[AllardKatan]

Okay, I'm not quite sure what happened, but it seems the problems is fixed with the 13.1 release :-) . I wasn't aware the release was already done. I did the update a few moments ago from the console. The first attempt it selected slot B (okay=1 , try =1), and since things were weird before I selected the other slot (A, ok=1, try=0). That booted int o 12.4, so I did another os update , and selected slot B ('try =2') . Then I was a bit surprised to see that A: I was now on 13.1 without an rc suffix and B: the logfile was empty. I had cleared the contents and saved the logfile before starting this procedure but contrary to earlier attempts there was nothing added to the file. Anyway, the problem seems to have been fixed, which is good.

[AllardKatan]

Well, I didn't say ALL issues were resolved. But since in my case the system still started, and the problem only occurred in the beta release, I think yours is a different issue and should be reported as such.

Devoman71 @.***> schreef op 22 augustus 2024 04:39:37 CEST:

I have just broken my live enstance by applying OS 13..1 so the issue seems not resolved as it's not booting up. I'm using a generic Intel machine. I will have to rebuild from my backups and I will not use OS 13,1

-- Reply to this email directly or view it on GitHub: https://github.com/home-assistant/operating-system/issues/3545#issuecomment-2303564963 You are receiving this because you modified the open/close state.

Message ID: @.***>

[AllardKatan]

Well, it seems I have to reopen this issue. I rebooted my VM today, and to my great surprise it booted back up in OS 12.4! I had a notification badge for upgrading both OS (to 13.1) and core (to 8.3 from 8.2). I started with the core update, but that resulted in a very long wait with nothing happening except the instance going offline. I could not even shut it down from the Virtualbox manager app, had to kill it from the host OS. I have no idea what happened, the instance probably booted from another slot that still had 12.4 in it? After killing the VM I could start it again and it booted back into 12.4. I don't have too much time right now to tinker, but if there are any tests I can do let me know

[AllardKatan]

I tried installing a clean 13.1 and a backup of my system. 13.1 installs just fine with all settings the same as the current VM. Backup of the 12.4 OS/8.2 core system can be restored to that installation no problem (backup doesn't change OS of course, so then it is 13.1os/8.2 core. At least one manual restart resulted in no problems. Running the update to 8.3 core made the VM freeze again, again requiring a kill from the guest OS to shut it down. Really strange.

[github-actions[bot]]

There hasn't been any activity on this issue recently. To keep our backlog manageable we have to clean old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant OS version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.