Upgrade from 2024 to 2025 results in errors

[adambabik]

trafficstars

I was following the official instruction, but this process results in an error.

Firstly, updating the deb repo does not work fully:

# sudo apt-get update
Hit:1 http://ports.ubuntu.com/ubuntu-ports jammy InRelease
Hit:2 http://ports.ubuntu.com/ubuntu-ports jammy-updates InRelease
Hit:3 http://ports.ubuntu.com/ubuntu-ports jammy-backports InRelease
Hit:4 http://ports.ubuntu.com/ubuntu-ports jammy-security InRelease
Get:5 https://downloads.scylladb.com/downloads/scylla/deb/debian-ubuntu/scylladb-2025.1 stable InRelease [7550 B]
Err:5 https://downloads.scylladb.com/downloads/scylla/deb/debian-ubuntu/scylladb-2025.1 stable InRelease
  The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A43E06657BAC99E3
Reading package lists... Done
W: GPG error: https://downloads.scylladb.com/downloads/scylla/deb/debian-ubuntu/scylladb-2025.1 stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY A43E06657BAC99E3
E: The repository 'https://downloads.scylladb.com/downloads/scylla/deb/debian-ubuntu/scylladb-2025.1 stable InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

After handling this using this script, I managed to get apt-get update working.

Secondly, executing apt-get dist-upgrade scylla does not result in exit code 0. The same goes for apt-get install scylla=2025.1.1-*, which is used in ScyllaDB Cloud.

# earlier logs redacted

Setting up libexpat1:arm64 (2.4.7-1ubuntu0.6) ...
dpkg: dependency problems prevent configuration of scylla-enterprise-node-exporter:
 scylla-node-exporter (2025.1.1-0.20250407.1a896169dca9-1) breaks scylla-enterprise-node-exporter (<< 2025.1.0~) and is unpacked but not configured.
  Version of scylla-enterprise-node-exporter to be configured is 2024.2.7-0.20250328.fac446a4a10b-1.

dpkg: error processing package scylla-enterprise-node-exporter (--configure):
 dependency problems - leaving unconfigured
dpkg: dependency problems prevent configuration of scylla-enterprise-conf:
 scylla-conf (2025.1.1-0.20250407.1a896169dca9-1) breaks scylla-enterprise-conf (<< 2025.1.0~) and is unpacked but not configured.
  Version of scylla-enterprise-conf to be configured is 2024.2.7-0.20250328.fac446a4a10b-1.

dpkg: error processing package scylla-enterprise-conf (--configure):
 dependency problems - leaving unconfigured
Setting up scylla-python3 (2025.1.1-0.20250407.1a896169dca9-1) ...
Setting up scylla-node-exporter (2025.1.1-0.20250407.1a896169dca9-1) ...
Installing new version of config file /etc/default/scylla-node-exporter ...
Setting up scylla-conf (2025.1.1-0.20250407.1a896169dca9-1) ...
Installing new version of config file /etc/scylla/scylla.yaml ...
dpkg: dependency problems prevent configuration of scylla-enterprise-cqlsh:
 scylla-cqlsh (2025.1.1-0.20250407.1a896169dca9-1) breaks scylla-enterprise-cqlsh (<< 2025.1.0~) and is unpacked but not configured.
  Version of scylla-enterprise-cqlsh to be configured is 2024.2.7-0.20250328.fac446a4a10b-1.

dpkg: error processing package scylla-enterprise-cqlsh (--configure):
 dependency problems - leaving unconfigured
Setting up systemd (249.11-0ubuntu3.15) ...
Setting up scylla-kernel-conf (2025.1.1-0.20250407.1a896169dca9-1) ...
sysctl: setting key "vm.swappiness", ignoring: Read-only file system
sysctl: setting key "vm.vfs_cache_pressure", ignoring: Read-only file system
sysctl: setting key "fs.inotify.max_user_instances", ignoring: Read-only file system
sysctl: setting key "fs.aio-max-nr", ignoring: Read-only file system
sysctl: setting key "fs.file-max", ignoring: Read-only file system
sysctl: setting key "fs.nr_open", ignoring: Read-only file system
sysctl: setting key "kernel.perf_event_paranoid", ignoring: Read-only file system
Setting up systemd-timesyncd (249.11-0ubuntu3.15) ...
Setting up scylla-cqlsh (2025.1.1-0.20250407.1a896169dca9-1) ...
dpkg: dependency problems prevent configuration of scylla-enterprise-kernel-conf:
 scylla-kernel-conf (2025.1.1-0.20250407.1a896169dca9-1) breaks scylla-enterprise-kernel-conf (<< 2025.1.0~) and is installed.
  Version of scylla-enterprise-kernel-conf to be configured is 2024.2.7-0.20250328.fac446a4a10b-1.

dpkg: error processing package scylla-enterprise-kernel-conf (--configure):
 dependency problems - leaving unconfigured
Setting up scylla-server (2025.1.1-0.20250407.1a896169dca9-1) ...
Installing new version of config file /etc/bash_completion.d/nodetool-completion ...
scylla:x:106:108::/var/lib/scylla:/usr/sbin/nologin
scylla:x:108:
Setting up scylla (2025.1.1-0.20250407.1a896169dca9-1) ...
Processing triggers for dbus (1.12.20-2ubuntu4.1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.9) ...
Errors were encountered while processing:
 scylla-enterprise-node-exporter
 scylla-enterprise-conf
 scylla-enterprise-cqlsh
 scylla-enterprise-kernel-conf
E: Sub-process /usr/bin/dpkg returned an error code (1)
# echo $?
100
# scylla --version
2025.1.1-0.20250407.1a896169dca9

As you can see in the last line, the new version of scylla is installed, but it was not fully successful. Consecutive runs result in the same error.

What's expected

A script that upgrades ScyllaDB from 2024 to 2025 without any errors (exit code is 0) and it's idempotent.

[roydahan]

Is it ARM machine?

(I see this "Setting up libexpat1:arm64 (2.4.7-1ubuntu0.6) ..")

In that case, there is a known issue (should be also in docs that in Arm on ubuntu 22 (I think) you must do reinstall.

[yaronkaikov]

Closed via https://github.com/scylladb/scylladb/issues/23012