uyuni icon indicating copy to clipboard operation
uyuni copied to clipboard

No Acess after update to uyuni-server 2024-03

Open hsh-it opened this issue 10 months ago • 7 comments

Problem description

After update i cant access web ui and did not get a response

uyuni:/var/log/rhn # spacewalk-service status
● mgr-check-payg.service - Check and install payg billing service.
     Loaded: loaded (/usr/lib/systemd/system/mgr-check-payg.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:04 CEST; 16min ago
    Process: 19421 ExecStart=/usr/sbin/spacewalk-startup-helper check-billing-service (code=exited, status=0/SUCCESS)
   Main PID: 19421 (code=exited, status=0/SUCCESS)

● uyuni-update-config.service - Uyuni update config
     Loaded: loaded (/usr/lib/systemd/system/uyuni-update-config.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:04 CEST; 16min ago
    Process: 19423 ExecStart=/usr/sbin/uyuni-update-config (code=exited, status=0/SUCCESS)
   Main PID: 19423 (code=exited, status=0/SUCCESS)

● uyuni-check-database.service - Uyuni check database
     Loaded: loaded (/usr/lib/systemd/system/uyuni-check-database.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:06 CEST; 15min ago
    Process: 19444 ExecStart=/usr/sbin/spacewalk-startup-helper check-database (code=exited, status=0/SUCCESS)
   Main PID: 19444 (code=exited, status=0/SUCCESS)

● tomcat.service - Apache Tomcat Web Application Container
     Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/tomcat.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:13:06 CEST; 15min ago
   Main PID: 19567 (java)
      Tasks: 96 (limit: 576)
     CGroup: /system.slice/tomcat.service
             └─ 19567 /usr/lib64/jvm/jre/bin/java -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory -ea -Xms256m -Xmx1G -Djava.awt.headless=true -Dorg.xml.sax.driver=com.redhat.rhn…

● spacewalk-wait-for-tomcat.service - Spacewalk wait for tomcat
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-tomcat.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:38 CEST; 15min ago
    Process: 19568 ExecStart=/usr/sbin/spacewalk-startup-helper wait-for-tomcat (code=exited, status=0/SUCCESS)
   Main PID: 19568 (code=exited, status=0/SUCCESS)

● salt-master.service - The Salt Master Server
     Loaded: loaded (/usr/lib/systemd/system/salt-master.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/salt-master.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:13:06 CEST; 15min ago
       Docs: man:salt-master(1)
             file:///usr/share/doc/salt/html/contents.html
             https://docs.saltproject.io/en/latest/contents.html
   Main PID: 19565 (salt-master)
      Tasks: 62
     CGroup: /system.slice/salt-master.service
             ├─ 19565 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19804 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19805 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19809 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19810 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19811 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19812 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19814 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19815 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19816 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19818 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19819 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19829 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19830 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19831 /usr/bin/python3 /usr/bin/salt-master
             ├─ 19832 /usr/bin/python3 /usr/bin/salt-master
             └─ 19833 /usr/bin/python3 /usr/bin/salt-master

● salt-api.service - The Salt API
     Loaded: loaded (/usr/lib/systemd/system/salt-api.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/salt-api.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:13:06 CEST; 15min ago
       Docs: man:salt-api(1)
             file:///usr/share/doc/salt/html/contents.html
             https://docs.saltproject.io/en/latest/contents.html
   Main PID: 19560 (salt-api)
      Tasks: 104 (limit: 4915)
     CGroup: /system.slice/salt-api.service
             ├─ 19560 /usr/bin/python3 /usr/bin/salt-api
             └─ 19644 /usr/bin/python3 /usr/bin/salt-api

● spacewalk-wait-for-salt.service - Make sure that salt is started before httpd
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-salt.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:06 CEST; 15min ago
    Process: 19566 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
   Main PID: 19566 (code=exited, status=0/SUCCESS)

● apache2.service - The Apache Webserver
     Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/apache2.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:13:38 CEST; 15min ago
   Main PID: 22236 (httpd-prefork)
     Status: "Processing requests..."
      Tasks: 73
     CGroup: /system.slice/apache2.service
             ├─ 22236 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22251 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22252 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22253 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22254 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22255 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22383 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22577 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22580 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22581 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22582 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22583 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22584 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22585 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22950 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 22980 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23206 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23207 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23208 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23220 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23221 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23222 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23223 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23224 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23225 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23226 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23275 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23324 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23339 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23341 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23357 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23359 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23360 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23413 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23454 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23462 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23463 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23511 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23512 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23513 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23521 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23524 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23539 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23563 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23565 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23568 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23578 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23597 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23621 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23623 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23628 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23632 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23635 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23638 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23652 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23709 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23795 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23803 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23810 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23815 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23819 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23859 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23864 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23869 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23873 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23898 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23920 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23944 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23948 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23992 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 23998 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             ├─ 24000 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…
             └─ 24004 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" -…

● rhn-search.service - Spacewalk search engine
     Loaded: loaded (/usr/lib/systemd/system/rhn-search.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/rhn-search.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:13:38 CEST; 15min ago
   Main PID: 22242 (rhn-search)
      Tasks: 83 (limit: 4915)
     CGroup: /system.slice/rhn-search.service
             ├─ 22242 /bin/sh /usr/sbin/rhn-search
             └─ 22259 /usr/bin/java -Djava.library.path=/usr/lib:/usr/lib64:/usr/lib/gcj/postgresql-jdbc:/usr/lib64/gcj/postgresql-jdbc -classpath "/usr/share/rhn/search/lib/*:/usr/share/rhn/classes:/usr/shar…

● cobblerd.service - Cobbler Helper Daemon
     Loaded: loaded (/usr/lib/systemd/system/cobblerd.service; enabled; vendor preset: disabled)
     Active: active (running) since Mon 2024-04-22 13:13:07 CEST; 15min ago
   Main PID: 19558 (cobblerd)
      Tasks: 6 (limit: 4915)
     CGroup: /system.slice/cobblerd.service
             └─ 19558 /usr/bin/python3 -s /usr/bin/cobblerd -F

● taskomatic.service - Taskomatic
     Loaded: loaded (/usr/lib/systemd/system/taskomatic.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/taskomatic.service.d
             └─override.conf
     Active: active (running) since Mon 2024-04-22 13:17:11 CEST; 11min ago
   Main PID: 23035 (taskomatic)
      Tasks: 151 (limit: 4915)
     CGroup: /system.slice/taskomatic.service
             ├─ 23035 /bin/sh /usr/sbin/taskomatic
             └─ 23039 /usr/bin/java -Djava.library.path=/usr/lib:/usr/lib64 -classpath "/usr/share/rhn/classes:/usr/share/rhn/lib/spacewalk-asm.jar:/usr/share/rhn/lib/rhn.jar:/usr/share/rhn/lib/java-branding.…

● spacewalk-wait-for-taskomatic.service - Spacewalk wait for taskomatic
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-taskomatic.service; static)
     Active: active (exited) since Mon 2024-04-22 13:13:41 CEST; 15min ago
    Process: 22256 ExecStart=/usr/sbin/spacewalk-startup-helper wait-for-taskomatic (code=exited, status=0/SUCCESS)
   Main PID: 22256 (code=exited, status=0/SUCCESS)

● salt-secrets-config.service - Configures secrets between salt-master and other services
     Loaded: loaded (/usr/lib/systemd/system/salt-secrets-config.service; static)
    Drop-In: /usr/lib/systemd/system/salt-secrets-config.service.d
             └─override.conf
     Active: active (exited) since Mon 2024-04-22 13:13:04 CEST; 16min ago
    Process: 19422 ExecStart=/usr/bin/salt-secrets-config.py (code=exited, status=0/SUCCESS)
   Main PID: 19422 (code=exited, status=0/SUCCESS)

● mgr-websockify.service - TCP to WebSocket proxy
     Loaded: loaded (/usr/lib/systemd/system/mgr-websockify.service; static)
     Active: active (running) since Mon 2024-04-22 13:13:06 CEST; 15min ago
    Process: 19559 ExecStartPre=/usr/bin/sh -c grep secret_key /etc/rhn/rhn.conf | tr -d ' ' | cut -f2 -d '=' | perl -ne 's/([0-9a-f]{2})/print chr hex $1/gie' > /etc/rhn/websockify.key (code=exited, status=0/SUCCESS)
   Main PID: 19569 (websockify)
      Tasks: 8 (limit: 4915)
     CGroup: /system.slice/mgr-websockify.service
             └─ 19569 /usr/bin/python3 /usr/bin/websockify --token-plugin JWTTokenApi --token-source /etc/rhn/websockify.key localhost:8050

● cobbler-refresh-mkloaders.service - Refresh Cobbler bootloaders
     Loaded: loaded (/usr/lib/systemd/system/cobbler-refresh-mkloaders.service; static)
    Drop-In: /usr/lib/systemd/system/cobbler-refresh-mkloaders.service.d
             └─override.conf
     Active: active (exited) since Mon 2024-04-22 13:13:40 CEST; 15min ago
    Process: 22249 ExecStart=/usr/bin/cobbler mkloaders (code=exited, status=0/SUCCESS)
   Main PID: 22249 (code=exited, status=0/SUCCESS)
● spacewalk.target - Spacewalk
     Loaded: loaded (/usr/lib/systemd/system/spacewalk.target; enabled; vendor preset: disabled)
     Active: active since Mon 2024-04-22 13:17:11 CEST; 11min ago
uyuni:/var/log/rhn #

Steps to reproduce

I follow https://www.uyuni-project.org/uyuni-docs/en/uyuni/installation-and-upgrade/server-minor-upgrade-uyuni.html

spacewalk-service stop

zypper ref
zypper up
zypper install Uyuni-Server-release
spacewalk-service start

Uyuni version

Retrieving repository 'Update repository with updates from SUSE Linux Enterprise 15' metadata .............................................................................................................[done]
Building repository 'Update repository with updates from SUSE Linux Enterprise 15' cache ..................................................................................................................[done]
Loading repository data...
Reading installed packages...


Information for package Uyuni-Server-release:
---------------------------------------------
Repository     : uyuni-server-stable
Name           : Uyuni-Server-release
Version        : 2024.03-230900.214.6.uyuni3
Arch           : x86_64
Vendor         : obs://build.opensuse.org/systemsmanagement:Uyuni
Support Level  : Level 3
Installed Size : 1.4 KiB
Installed      : Yes
Status         : up-to-date
Source package : Uyuni-Server-release-2024.03-230900.214.6.uyuni3.src
Summary        : Uyuni Server
Description    :
    Uyuni lets you efficiently manage physical, virtual,
    and cloud-based Linux systems. It provides automated and cost-effective
    configuration and software management, asset management, and system
    provisioning.

Uyuni proxy version (if used)

No response

Useful logs

rhn_web_ui.log:
2024-04-22 13:09:46,620 [main] WARN  com.redhat.rhn.manager.satellite.UpgradeCommand - got upgrade task: upgrade_satellite_all_systems_sync_all
2024-04-22 13:13:19,356 [main] WARN  com.redhat.rhn.manager.satellite.UpgradeCommand - got upgrade task: upgrade_satellite_all_systems_sync_all

tail -n 100 rhn_taskomatic_daemon.log
2024-04-22 09:45:00,027 [DefaultQuartzScheduler_Worker-12] INFO  com.redhat.rhn.taskomatic.task.SessionCleanup - 58 stale session(s) deleted
2024-04-22 10:00:00,026 [DefaultQuartzScheduler_Worker-7] INFO  com.redhat.rhn.taskomatic.task.SessionCleanup - 121 stale session(s) deleted
2024-04-22 10:01:00,038 [DefaultQuartzScheduler_Worker-5] INFO  com.redhat.rhn.taskomatic.task.SystemOverviewUpdateQueue - In the queue: 83
2024-04-22 12:27:13,096 [DefaultQuartzScheduler_Worker-10] INFO  com.redhat.rhn.taskomatic.task.SessionCleanup - 714 stale session(s) deleted
2024-04-22 12:28:00,076 [DefaultQuartzScheduler_Worker-20] INFO  com.redhat.rhn.taskomatic.task.SystemOverviewUpdateQueue - In the queue: 83
2024-04-22 12:32:13,074 [DefaultQuartzScheduler_Worker-2] INFO  com.redhat.rhn.taskomatic.task.SessionCleanup - 32 stale session(s) deleted
2024-04-22 12:32:13,157 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing session-cleanup-default, found 1 runs in the future.
2024-04-22 12:32:13,414 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing mgr-forward-registration-default, found 1 runs in the future.
2024-04-22 12:32:13,462 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing package-cleanup-default, found 1 runs in the future.
2024-04-22 12:32:13,504 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing kickstartfile-sync-default, found 1 runs in the future.
2024-04-22 12:32:13,555 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing update-payg-default, found 2 runs in the future.
2024-04-22 12:32:13,597 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing errata-cache-default, found 2 runs in the future.
2024-04-22 12:32:13,652 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing ssh-service-default, found 2 runs in the future.
2024-04-22 12:32:13,705 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing system-overview-update-queue-default, found 1 runs in the future.
2024-04-22 12:32:13,743 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing kickstart-cleanup-default, found 1 runs in the future.
2024-04-22 12:32:13,809 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing cobbler-sync-default, found 1 runs in the future.
2024-04-22 12:32:13,852 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing channel-repodata-default, found 1 runs in the future.
2024-04-22 12:35:40,575 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing errata-cache-default, found 2 runs in the future.
2024-04-22 12:35:40,652 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing ssh-service-default, found 1 runs in the future.
2024-04-22 12:35:40,712 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing system-overview-update-queue-default, found 1 runs in the future.
2024-04-22 12:35:40,792 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing cobbler-sync-default, found 1 runs in the future.
2024-04-22 12:35:40,862 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing channel-repodata-default, found 1 runs in the future.
2024-04-22 12:35:40,904 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing auto-errata-default, found 1 runs in the future.
2024-04-22 13:09:55,569 [DefaultQuartzScheduler_Worker-13] INFO  com.redhat.rhn.taskomatic.task.SessionCleanup - 177 stale session(s) deleted
2024-04-22 13:09:56,246 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing errata-queue-default, found 1 runs in the future.
2024-04-22 13:09:56,316 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing session-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:56,580 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing minion-checkin-default, found 1 runs in the future.
2024-04-22 13:09:56,612 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing update-system-overview-default, found 1 runs in the future.
2024-04-22 13:09:56,647 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing uuid-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:56,685 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing mgr-forward-registration-default, found 1 runs in the future.
2024-04-22 13:09:56,720 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing package-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:56,768 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing update-payg-default, found 2 runs in the future.
2024-04-22 13:09:56,794 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing payg-dimension-computation-default, found 1 runs in the future.
2024-04-22 13:09:56,836 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing errata-cache-default, found 2 runs in the future.
2024-04-22 13:09:56,863 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing ssh-service-default, found 1 runs in the future.
2024-04-22 13:09:56,904 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing system-overview-update-queue-default, found 1 runs in the future.
2024-04-22 13:09:56,943 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing kickstart-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:56,976 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing reboot-action-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:57,005 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing minion-action-chain-cleanup-default, found 1 runs in the future.
2024-04-22 13:09:57,047 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing channel-repodata-default, found 1 runs in the future.
2024-04-22 13:09:57,072 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Reinitializing auto-errata-default, found 1 runs in the future.
2024-04-22 13:09:57,370 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Number of interrupted runs: 2
2024-04-22 13:10:00,203 [DefaultQuartzScheduler_Worker-11] INFO  com.redhat.rhn.taskomatic.task.SystemOverviewUpdateQueue - In the queue: 83
2024-04-22 13:11:00,332 [DefaultQuartzScheduler_Worker-15] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131110 already exists
2024-04-22 13:12:00,149 [DefaultQuartzScheduler_Worker-20] ERROR com.redhat.rhn.taskomatic.TaskoJob - Unable to run task
org.quartz.ObjectAlreadyExistsException: Unable to store Job : 'DEFAULT.cobbler-sync-default-retry20240422131210', because one already exists with this identification.
        at org.quartz.impl.jdbcjobstore.JobStoreSupport.storeJob(JobStoreSupport.java:1113) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreSupport$2.executeVoid(JobStoreSupport.java:1067) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreSupport$VoidTransactionCallback.execute(JobStoreSupport.java:3765) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreSupport$VoidTransactionCallback.execute(JobStoreSupport.java:3763) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreSupport.executeInNonManagedTXLock(JobStoreSupport.java:3849) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreTX.executeInLock(JobStoreTX.java:93) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.jdbcjobstore.JobStoreSupport.storeJobAndTrigger(JobStoreSupport.java:1063) ~[quartz-2.3.0.jar:?]
        at org.quartz.core.QuartzScheduler.scheduleJob(QuartzScheduler.java:855) ~[quartz-2.3.0.jar:?]
        at org.quartz.impl.StdScheduler.scheduleJob(StdScheduler.java:249) ~[quartz-2.3.0.jar:?]
        at com.redhat.rhn.taskomatic.TaskoQuartzHelper.rescheduleJob(TaskoQuartzHelper.java:180) ~[rhn.jar:?]
        at com.redhat.rhn.taskomatic.TaskoJob.rescheduleBunchFromTask(TaskoJob.java:230) ~[rhn.jar:?]
        at com.redhat.rhn.taskomatic.TaskoJob.runTemplate(TaskoJob.java:179) ~[rhn.jar:?]
        at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:145) ~[rhn.jar:?]
        at org.quartz.core.JobRunShell.run(JobRunShell.java:202) ~[quartz-2.3.0.jar:?]
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) ~[quartz-2.3.0.jar:?]
2024-04-22 13:13:00,220 [DefaultQuartzScheduler_Worker-5] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131310 already exists
2024-04-22 13:13:46,807 [Thread-41] WARN  com.redhat.rhn.taskomatic.core.SchedulerKernel - Number of interrupted runs: 2
2024-04-22 13:14:00,150 [DefaultQuartzScheduler_Worker-7] INFO  com.redhat.rhn.taskomatic.task.SystemOverviewUpdateQueue - In the queue: 10
2024-04-22 13:15:00,144 [DefaultQuartzScheduler_Worker-8] INFO  com.redhat.rhn.taskomatic.task.SystemOverviewUpdateQueue - In the queue: 1
2024-04-22 13:15:00,167 [DefaultQuartzScheduler_Worker-6] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131510 already exists
2024-04-22 13:16:00,218 [DefaultQuartzScheduler_Worker-9] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131610 already exists
2024-04-22 13:17:00,130 [DefaultQuartzScheduler_Worker-14] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131710 already exists
2024-04-22 13:19:00,151 [DefaultQuartzScheduler_Worker-4] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422131910 already exists
2024-04-22 13:20:00,135 [DefaultQuartzScheduler_Worker-20] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132010 already exists
2024-04-22 13:21:00,149 [DefaultQuartzScheduler_Worker-14] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132110 already exists
2024-04-22 13:22:00,078 [DefaultQuartzScheduler_Worker-9] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132210 already exists
2024-04-22 13:23:00,115 [DefaultQuartzScheduler_Worker-4] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132310 already exists
2024-04-22 13:24:00,131 [DefaultQuartzScheduler_Worker-16] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132410 already exists
2024-04-22 13:25:00,100 [DefaultQuartzScheduler_Worker-12] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132510 already exists
2024-04-22 13:26:00,102 [DefaultQuartzScheduler_Worker-9] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132610 already exists
2024-04-22 13:27:00,099 [DefaultQuartzScheduler_Worker-2] WARN  com.redhat.rhn.taskomatic.TaskoQuartzHelper - Retry trigger DEFAULT.cobbler-sync-default-retry20240422132710 already exists

Additional information

$ curl -k uyuni.domain

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
  "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
<title>Service unavailable!</title>
<link rev="made" href="mailto:%5bno%20address%20given%5d" />
<style type="text/css"><!--/*--><![CDATA[/*><!--*/
    body { color: #000000; background-color: #FFFFFF; }
    a:link { color: #0000CC; }
    p, address {margin-left: 3em;}
    span {font-size: smaller;}
/*]]>*/--></style>
</head>

<body>
<h1>Service unavailable!</h1>
<p>


    The server is temporarily unable to service your
    request due to maintenance downtime or capacity
    problems. Please try again later.

</p>
<p>
If you think this is a server error, please contact
the <a href="mailto:%5bno%20address%20given%5d">webmaster</a>.

</p>

<h2>Error 503</h2>
<address>
  <a href="/">uyuni.domain.com</a><br />
  <span>Apache</span>
</address>
</body>
</html>

hsh-it avatar Apr 22 '24 11:04 hsh-it

Due to your services output above (apache2's status is "Processing requests...") I'd suggest

  1. checking on apache2 systemctl status apache2.service: Does it actually restarted the webserver?
  2. checking the ports ss -tulpn: Does the Uyuni server listen on ports 443/80 with the correct process?

cFabij avatar Apr 25 '24 11:04 cFabij

Thx for feedback. uyuni:~ # systemctl status apache2.service

● apache2.service - The Apache Webserver
     Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/apache2.service.d
             └─override.conf
     Active: active (running) since Tue 2024-04-30 11:09:48 CEST; 1min 43s ago
   Main PID: 12733 (httpd-prefork)
     Status: "Processing requests..."
      Tasks: 14
     CGroup: /system.slice/apache2.service
             ├─ 12733 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13001 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13002 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13003 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13006 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13007 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 13364 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16411 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16443 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16444 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16477 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16821 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             ├─ 16824 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->
             └─ 16849 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf" -C "Include /etc/apache2/sysconfig.d//global.conf" ->

Apr 30 11:09:48 uyuni systemd[1]: Starting The Apache Webserver...
Apr 30 11:09:48 uyuni start_apache2[12733]: [Tue Apr 30 11:09:48.433588 2024] [alias:warn] [pid 12733] AH00671: The Alias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 26 will probably never >
Apr 30 11:09:48 uyuni start_apache2[12733]: [Tue Apr 30 11:09:48.433664 2024] [alias:warn] [pid 12733] AH00671: The ScriptAlias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 40 will probably >
Apr 30 11:09:48 uyuni systemd[1]: Started The Apache Webserver.
lines 1-28/28 (END)

uyuni:~ # ss -tulpn

Netid                  State                   Recv-Q                  Send-Q                                         Local Address:Port                                      Peer Address:Port
Process
udp                    UNCONN                  0                       0                                                    0.0.0.0:40533                                          0.0.0.0:*
 users:(("rsyslogd",pid=1534,fd=7))
udp                    UNCONN                  0                       0                                                  127.0.0.1:323                                            0.0.0.0:*
 users:(("chronyd",pid=1541,fd=5))
udp                    UNCONN                  0                       0                                                          *:69                                                   *:*
 users:(("systemd",pid=1,fd=64))
udp                    UNCONN                  0                       0                                                      [::1]:323                                               [::]:*
 users:(("chronyd",pid=1541,fd=6))
tcp                    LISTEN                  0                       100                                                127.0.0.1:8050                                           0.0.0.0:*
 users:(("websockify",pid=1953,fd=3))
tcp                    LISTEN                  0                       128                                                  0.0.0.0:22                                             0.0.0.0:*
 users:(("sshd",pid=1576,fd=5))
tcp                    LISTEN                  0                       30                                                 127.0.0.1:9080                                           0.0.0.0:*
 users:(("salt-api",pid=2047,fd=10))
tcp                    LISTEN                  0                       834                                                  0.0.0.0:5432                                           0.0.0.0:*
 users:(("postgres",pid=1588,fd=6))
tcp                    LISTEN                  0                       1000                                                 0.0.0.0:4505                                           0.0.0.0:*
 users:(("salt-master",pid=2604,fd=35))
tcp                    LISTEN                  0                       100                                                127.0.0.1:25                                             0.0.0.0:*
 users:(("master",pid=1719,fd=13))
tcp                    LISTEN                  0                       1000                                                 0.0.0.0:4506                                           0.0.0.0:*
 users:(("salt-master",pid=2717,fd=51))
tcp                    LISTEN                  0                       5                                                  127.0.0.1:25151                                          0.0.0.0:*
 users:(("cobblerd",pid=1939,fd=4))
tcp                    LISTEN                  0                       128                                                  0.0.0.0:60005                                          0.0.0.0:*
 users:(("sshd",pid=1576,fd=3))
tcp                    LISTEN                  0                       128                                                     [::]:22                                                [::]:*
 users:(("sshd",pid=1576,fd=6))
tcp                    LISTEN                  0                       834                                                     [::]:5432                                              [::]:*
 users:(("postgres",pid=1588,fd=7))
tcp                    LISTEN                  0                       100                                                    [::1]:25                                                [::]:*
 users:(("master",pid=1719,fd=14))
tcp                    LISTEN                  0                       4096                                                       *:443                                                  *:*
 users:(("httpd-prefork",pid=17047,fd=6),("httpd-prefork",pid=17023,fd=6),("httpd-prefork",pid=17018,fd=6),("httpd-prefork",pid=17015,fd=6),("httpd-prefork",pid=17001,fd=6),("httpd-prefork",pid=16996,fd=6),("httpd-prefork",pid=16993,fd=6),("httpd-prefork",pid=16960,fd=6),("httpd-prefork",pid=16942,fd=6),("httpd-prefork",pid=16940,fd=6),("httpd-prefork",pid=16849,fd=6),("httpd-prefork",pid=16824,fd=6),("httpd-prefork",pid=16821,fd=6),("httpd-prefork",pid=16477,fd=6),("httpd-prefork",pid=16444,fd=6),("httpd-prefork",pid=16443,fd=6),("httpd-prefork",pid=16411,fd=6),("httpd-prefork",pid=13364,fd=6),("httpd-prefork",pid=13007,fd=6),("httpd-prefork",pid=13006,fd=6),("httpd-prefork",pid=13003,fd=6),("httpd-prefork",pid=13002,fd=6),("httpd-prefork",pid=13001,fd=6),("httpd-prefork",pid=12733,fd=6))
tcp                    LISTEN                  0                       4096                                                       *:10050                                                *:*
 users:(("zabbix_agent2",pid=1521,fd=9))
tcp                    LISTEN                  0                       128                                                     [::]:60005                                             [::]:*
 users:(("sshd",pid=1576,fd=4))
tcp                    LISTEN                  16                      100                                                    [::1]:8009                                              [::]:*
 users:(("java",pid=1948,fd=49))
tcp                    LISTEN                  0                       100                                       [::ffff:127.0.0.1]:8009                                                 *:*
 users:(("java",pid=1948,fd=46))
tcp                    LISTEN                  0                       50                                        [::ffff:127.0.0.1]:2828                                                 *:*
 users:(("java",pid=13008,fd=87))
tcp                    LISTEN                  0                       50                                        [::ffff:127.0.0.1]:2829                                                 *:*
 users:(("java",pid=13022,fd=161))
tcp                    LISTEN                  0                       4096                                                       *:80                                                   *:*
 users:(("httpd-prefork",pid=17047,fd=4),("httpd-prefork",pid=17023,fd=4),("httpd-prefork",pid=17018,fd=4),("httpd-prefork",pid=17015,fd=4),("httpd-prefork",pid=17001,fd=4),("httpd-prefork",pid=16996,fd=4),("httpd-prefork",pid=16993,fd=4),("httpd-prefork",pid=16960,fd=4),("httpd-prefork",pid=16942,fd=4),("httpd-prefork",pid=16940,fd=4),("httpd-prefork",pid=16849,fd=4),("httpd-prefork",pid=16824,fd=4),("httpd-prefork",pid=16821,fd=4),("httpd-prefork",pid=16477,fd=4),("httpd-prefork",pid=16444,fd=4),("httpd-prefork",pid=16443,fd=4),("httpd-prefork",pid=16411,fd=4),("httpd-prefork",pid=13364,fd=4),("httpd-prefork",pid=13007,fd=4),("httpd-prefork",pid=13006,fd=4),("httpd-prefork",pid=13003,fd=4),("httpd-prefork",pid=13002,fd=4),("httpd-prefork",pid=13001,fd=4),("httpd-prefork",pid=12733,fd=4))
tcp                    LISTEN                  0                       100                                       [::ffff:127.0.0.1]:8080                                                 *:*
 users:(("java",pid=1948,fd=50))

tail /var/log/apache2/error.log

tail: cannot open '/var/log/apache2/error.log' for reading: No such file or directory
uyuni:~ # tail /var/log/rhn/rhn_web_ui.log
        at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52) ~[tomcat-coyote.jar:9.0.85]
        at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) ~[tomcat-util.jar:9.0.85]
        at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) ~[tomcat-util.jar:9.0.85]
        at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) ~[tomcat-util.jar:9.0.85]
        at java.lang.Thread.run(Thread.java:829) ~[?:?]
Caused by: java.lang.NoSuchMethodException: com.redhat.rhn.frontend.action.systems.duplicate.DuplicateSystemsCompareAction.<init>()
        at java.lang.Class.getConstructor0(Class.java:3349) ~[?:?]
        at java.lang.Class.newInstance(Class.java:556) ~[?:?]
        ... 49 more
2024-04-30 11:09:40,987 [main] WARN  com.redhat.rhn.manager.satellite.UpgradeCommand - got upgrade task: upgrade_satellite_all_systems_sync_all

uyuni:~ # spacewalk-service stop

Shutting down spacewalk services...
Done.
uyuni:~ # zypper ref
Retrieving repository 'Update repository of openSUSE Backports' metadata ..................................................................................................................................[done]
Building repository 'Update repository of openSUSE Backports' cache .......................................................................................................................................[done]
Repository 'Non-OSS Repository' is up to date.
Repository 'Haupt-Repository' is up to date.
Retrieving repository 'Update repository with updates from SUSE Linux Enterprise 15' metadata .............................................................................................................[done]
Building repository 'Update repository with updates from SUSE Linux Enterprise 15' cache ..................................................................................................................[done]
Repository 'Quell-Repository' is up to date.
Retrieving repository 'Hauptaktualisierungs-Repository' metadata ..........................................................................................................................................[done]
Building repository 'Hauptaktualisierungs-Repository' cache ...............................................................................................................................................[done]
Retrieving repository 'Aktualisierungs-Repository (Nicht-Open-Source-Software)' metadata ..................................................................................................................[done]
Building repository 'Aktualisierungs-Repository (Nicht-Open-Source-Software)' cache .......................................................................................................................[done]
Repository 'Project used to release critical patches between releases (openSUSE_Leap_15.4)' is up to date.
Retrieving repository 'uyuni-server-stable' metadata ......................................................................................................................................................[done]
Building repository 'uyuni-server-stable' cache ...........................................................................................................................................................[done]
Retrieving repository 'Zabbix Official Repository' metadata ...............................................................................................................................................[done]
Building repository 'Zabbix Official Repository' cache ....................................................................................................................................................[done]
All repositories have been refreshed.

uyuni:~ # zypper up

Loading repository data...
Reading installed packages...

The following 2 package updates will NOT be installed:
  Uyuni-Server-release cobbler

The following product update will NOT be installed:
  "Uyuni Server"

The following 275 packages are going to be upgraded:
  aaa_base aaa_base-extras apache-commons-daemon apache-commons-dbcp apache-commons-pool2 audit autofs bind-utils byte-buddy byte-buddy-dep ca-certificates checkmedia cobbler coreutils coreutils-doc
  coreutils-lang cups cups-client cups-config cups-filters curl dracut dracut-mkinitrd-deprecated drools dwz ehcache expat fence-agents geronimo-annotation-1_0-api geronimo-jta-1_1-api geronimo-stax-1_0-api
  ghostscript ghostscript-x11 glibc glibc-devel glibc-extra glibc-lang glibc-locale glibc-locale-base gnutls golang-github-QubitProducts-exporter_exporter golang-github-lusitaniae-apache_exporter grub2
  grub2-i386-pc grub2-snapper-plugin grub2-systemd-sleep-plugin grub2-x86_64-efi hibernate-commons-annotations hibernate-types hibernate5-c3p0 hibernate5-core hibernate5-ehcache hwdata ical4j jade4j jctools
  jetty-client jetty-http jetty-io jetty-security jetty-server jetty-servlet jetty-util jetty-util-ajax jetty-webapp jetty-xml jose4j jpa-api kie-api kie-soup kpartx krb5 less libLLVM15 libatomic1 libaudit1
  libauparse0 libavahi-client3 libavahi-common3 libavahi-glib1 libblkid1 libcares2 libcups2 libcupscgi1 libcupsimage2 libcupsmime1 libcupsppdc1 libcurl4 libexpat1 libfdisk1 libgcc_s1 libgfortran5 libgif7
  libgnutls30 libgomp1 libitm1 libjasper4 liblsan0 libltdl7 libmaxminddb0 libmediacheck6 libmetalink3 libmount1 libmpath0 libncurses6 libnghttp2-14 libopenblas_pthreads0 libpolkit-agent-1-0
  libpolkit-gobject-1-0 libpython3_6m1_0 libquadmath0 libsmartcols1 libssh-config libssh2-1 libssh4 libstdc++6 libtcnative-1-0 libtiff5 libuuid1 libuv1 libvirt-client libvirt-libs libyui-ncurses-pkg16
  libyui-ncurses16 libyui16 libzypp login_defs lucene multipath-tools mvel2 ncurses-utils netty nscd openssh openssh-clients openssh-common openssh-server optaplanner pam-config patterns-uyuni_server
  perl-Bootloader pgjdbc-ng pkexec polkit postgresql-jdbc prometheus-client-java prometheus-jmx_exporter prometheus-jmx_exporter-tomcat prometheus-postgres_exporter pxe-default-image-opensuse15 python3
  python3-PyJWT python3-PyNaCl python3-attrs python3-base python3-bind python3-curses python3-dbm python3-idna python3-more-itertools python3-netifaces python3-pyserial python3-rpm
  python3-spacewalk-client-tools quartz release-notes-uyuni rpm rpm-build salt-netapi-client samba-client-libs samba-libs samba-libs-python3 sed sed-lang shadow shim sitemesh smdba spacecmd spacewalk-admin
  spacewalk-backend spacewalk-backend-app spacewalk-backend-applet spacewalk-backend-config-files spacewalk-backend-config-files-common spacewalk-backend-config-files-tool spacewalk-backend-iss
  spacewalk-backend-iss-export spacewalk-backend-package-push-server spacewalk-backend-server spacewalk-backend-sql spacewalk-backend-sql-postgresql spacewalk-backend-tools spacewalk-backend-xml-export-libs
  spacewalk-backend-xmlrpc spacewalk-base spacewalk-base-minimal spacewalk-base-minimal-config spacewalk-branding spacewalk-client-tools spacewalk-config spacewalk-html spacewalk-java spacewalk-java-config
  spacewalk-java-lib spacewalk-java-postgresql spacewalk-search spacewalk-setup spacewalk-taskomatic spacewalk-utils spark-core spark-template-jade statistics subscription-matcher sudo sudo-plugin-python
  supportutils susemanager susemanager-schema susemanager-schema-utility susemanager-sls susemanager-sync-data susemanager-tools system-group-audit systemd-default-settings
  systemd-default-settings-branding-openSUSE systemd-presets-common-SUSE systemd-rpm-macros terminfo terminfo-base terminfo-iterm terminfo-screen tftp timezone timezone-java tomcat tomcat-el-3_0-api
  tomcat-jsp-2_3-api tomcat-lib tomcat-servlet-4_0-api tomcat-taglibs-standard-1_2_5 ucode-intel util-linux util-linux-lang util-linux-systemd uyuni-base-common uyuni-base-server uyuni-docs_en
  uyuni-docs_en-pdf uyuni-reportdb-schema vim vim-data vim-data-common wget wget-lang wicked wicked-service woodstox xen-libs xmlsec yast2 yast2-logs yast2-network yast2-packager yast2-pkg-bindings yast2-theme
  zabbix-agent zabbix-agent2 zabbix-agent2-plugin-mongodb zabbix-agent2-plugin-postgresql zabbix-get zabbix-sender zypper zypper-log zypper-needs-restarting

The following pattern is going to be upgraded:
  uyuni_server

The following 6 NEW packages are going to be installed:
  glassfish-activation kernel-default-5.14.21-150500.55.52.1 kernel-default-extra-5.14.21-150500.55.52.1 kernel-default-optional-5.14.21-150500.55.52.1 libabsl2308_0_0 libprotobuf-lite25_1_0

The following package requires a system reboot:
  kernel-default-5.14.21-150500.55.52.1

275 packages to upgrade, 6 new.
Overall download size: 638.5 MiB. Already cached: 0 B. After the operation, additional 213.4 MiB will be used.

    Note: System reboot required.
Continue? [y/n/v/...? shows all options] (y): y

Second one: zypper up

Loading repository data...
Reading installed packages...

The following 2 package updates will NOT be installed:
  Uyuni-Server-release cobbler

The following product update will NOT be installed:
  "Uyuni Server"
Nothing to do.

uyuni:~ # zypper install Uyuni-Server-release

Loading repository data...
Reading installed packages...
'Uyuni-Server-release' is already installed.
No update candidate for 'Uyuni-Server-release-2024.03-230900.214.6.uyuni3.x86_64'. The highest available version is already installed.
Resolving package dependencies...
Nothing to do.
uyuni:~ # reboot

uyuni:~ # ss -tulpn | grep -E ':(80|443)\s'

tcp   LISTEN 0      4096                    *:80               *:*    users:(("httpd-prefork",pid=5299,fd=4),("httpd-prefork",pid=5298,fd=4),("httpd-prefork",pid=5297,fd=4),("httpd-prefork",pid=5266,fd=4),("httpd-prefork",pid=5265,fd=4),("httpd-prefork",pid=5264,fd=4),("httpd-prefork",pid=5238,fd=4),("httpd-prefork",pid=5237,fd=4),("httpd-prefork",pid=5206,fd=4),("httpd-prefork",pid=5178,fd=4),("httpd-prefork",pid=5153,fd=4),("httpd-prefork",pid=5121,fd=4),("httpd-prefork",pid=5120,fd=4),("httpd-prefork",pid=5118,fd=4),("httpd-prefork",pid=5100,fd=4),("httpd-prefork",pid=5075,fd=4),("httpd-prefork",pid=5071,fd=4),("httpd-prefork",pid=5068,fd=4),("httpd-prefork",pid=5048,fd=4),("httpd-prefork",pid=5024,fd=4),("httpd-prefork",pid=5015,fd=4),("httpd-prefork",pid=4997,fd=4),("httpd-prefork",pid=4964,fd=4),("httpd-prefork",pid=4930,fd=4),("httpd-prefork",pid=4925,fd=4),("httpd-prefork",pid=4860,fd=4),("httpd-prefork",pid=4829,fd=4),("httpd-prefork",pid=4482,fd=4),("httpd-prefork",pid=4312,fd=4),("httpd-prefork",pid=4311,fd=4),("httpd-prefork",pid=4309,fd=4),("httpd-prefork",pid=4308,fd=4),("httpd-prefork",pid=4307,fd=4),("httpd-prefork",pid=4154,fd=4))
tcp   LISTEN 0      4096                    *:443              *:*    users:(("httpd-prefork",pid=5299,fd=6),("httpd-prefork",pid=5298,fd=6),("httpd-prefork",pid=5297,fd=6),("httpd-prefork",pid=5266,fd=6),("httpd-prefork",pid=5265,fd=6),("httpd-prefork",pid=5264,fd=6),("httpd-prefork",pid=5238,fd=6),("httpd-prefork",pid=5237,fd=6),("httpd-prefork",pid=5206,fd=6),("httpd-prefork",pid=5178,fd=6),("httpd-prefork",pid=5153,fd=6),("httpd-prefork",pid=5121,fd=6),("httpd-prefork",pid=5120,fd=6),("httpd-prefork",pid=5118,fd=6),("httpd-prefork",pid=5100,fd=6),("httpd-prefork",pid=5075,fd=6),("httpd-prefork",pid=5071,fd=6),("httpd-prefork",pid=5068,fd=6),("httpd-prefork",pid=5048,fd=6),("httpd-prefork",pid=5024,fd=6),("httpd-prefork",pid=5015,fd=6),("httpd-prefork",pid=4997,fd=6),("httpd-prefork",pid=4964,fd=6),("httpd-prefork",pid=4930,fd=6),("httpd-prefork",pid=4925,fd=6),("httpd-prefork",pid=4860,fd=6),("httpd-prefork",pid=4829,fd=6),("httpd-prefork",pid=4482,fd=6),("httpd-prefork",pid=4312,fd=6),("httpd-prefork",pid=4311,fd=6),("httpd-prefork",pid=4309,fd=6),("httpd-prefork",pid=4308,fd=6),("httpd-prefork",pid=4307,fd=6),("httpd-prefork",pid=4154,fd=6))
uyuni:~ #

I don't understand it because I couldn't find any errors during the installation and update. The services also seem to be running.

hsh-it avatar Apr 30 '24 09:04 hsh-it

The apache2 service is running but it seems to have issues (hence error code 503).

I would try to reload the config (systemctl reload apache2) and/or restart the server (maybe check zypper needs-rebooting beforehand but restart nonetheless).

cFabij avatar Apr 30 '24 12:04 cFabij

I tried that too. Apache2 was restarted and I also restarted the system several times. I have now imported a backup / snapshot so that the server is running again Unfortunately, I cannot recognize any error. But it must be on my side, otherwise many more would have the problem.

hsh-it avatar Apr 30 '24 13:04 hsh-it

Hello,

I'm experiencing exactly the same problem after upgrading from version 2024.02 to 2024.03.

It seems to be linked to cobbler, which is unable to authenticate itself.

In cobbler.log, I have this:

[Thread-8] 2024-04-30T11:40:00 - INFO | Exception value: 'login failed (taskomatic_user)'
[Thread-8] 2024-04-30T11:40:00 - INFO | Exception Info:
  File "/usr/lib/python3.6/site-packages/cobbler/remote.py", line 3753, in _dispatch
    return method_handle(*params)

  File "/usr/lib/python3.6/site-packages/cobbler/remote.py", line 3513, in login
    utils.die("login failed (%s)" % login_user)

  File "/usr/lib/python3.6/site-packages/cobbler/utils.py", line 102, in die
    raise CX(msg)

[Thread-11] 2024-04-30T11:40:10 - ERROR | Error while checking authentication token.
[Thread-11] 2024-04-30T11:40:10 - INFO | Exception occurred: <class 'xmlrpc.client.ProtocolError'>
[Thread-11] 2024-04-30T11:40:10 - INFO | Exception value: <ProtocolError for server.domain/rpc/api: 500 Internal Server Error>
[Thread-11] 2024-04-30T11:40:10 - INFO | Exception Info:
  File "/usr/lib/python3.6/site-packages/cobbler/modules/authentication/spacewalk.py", line 49, in __check_auth_token
    return xmlrpc_client.auth.checkAuthToken(username, password)

  File "/usr/lib64/python3.6/xmlrpc/client.py", line 1112, in __call__
    return self.__send(self.__name, args)

  File "/usr/lib64/python3.6/xmlrpc/client.py", line 1452, in __request
    verbose=self.__verbose

  File "/usr/lib64/python3.6/xmlrpc/client.py", line 1154, in request
    return self.single_request(host, handler, request_body, verbose)

  File "/usr/lib64/python3.6/xmlrpc/client.py", line 1187, in single_request
    dict(resp.getheaders())

Is it possible to temporary disable cobbler to ensure that's the root cause ?

fenrilou avatar Apr 30 '24 13:04 fenrilou

can you run the following greps and return the result:

grep uyuni /etc/cobbler/settings.yaml
grep redhat_management_server /etc/cobbler/settings.yaml

rjmateus avatar Apr 30 '24 16:04 rjmateus

In my case, both commands return the expected servername

apt-dmz-uyuni:~ # grep uyuni /etc/cobbler/settings.yaml
redhat_management_server: apt-dmz-uyuni.company.local
server: apt-dmz-uyuni.company.local
You have new mail in /var/spool/mail/root
apt-dmz-uyuni:~ # grep redhat_management_server /etc/cobbler/settings.yaml
redhat_management_server: apt-dmz-uyuni.company.local

fgbona avatar Apr 30 '24 22:04 fgbona

Same here. I get the expected value. Looks difficult to solve

hsh-it avatar May 02 '24 06:05 hsh-it

Can you now run the command: rpm -qa | grep cobbler

Just in case, can you add this property to the end of the file /etc/cobbler/settings.yaml

uyuni_authentication_endpoint: http://apt-dmz-uyuni.company.local

rjmateus avatar May 02 '24 12:05 rjmateus

I tried another approach. Here's what I did:

uyuni:~ # zypper up
Loading repository data...
Reading installed packages...

The following 2 package updates will NOT be installed:
  Uyuni-Server-release cobbler

The following product update will NOT be installed:
  "Uyuni Server"

The following 284 packages are going to be upgraded:
  aaa_base aaa_base-extras apache-commons-daemon apache-commons-dbcp apache-commons-pool2 audit autofs bind-utils byte-buddy byte-buddy-dep ca-certificates
  checkmedia cobbler coreutils coreutils-doc coreutils-lang cups cups-client cups-config cups-filters curl dracut dracut-mkinitrd-deprecated drools dwz
  ehcache expat fence-agents geronimo-annotation-1_0-api geronimo-jta-1_1-api geronimo-stax-1_0-api ghostscript ghostscript-x11 glibc glibc-devel
  glibc-extra glibc-lang glibc-locale glibc-locale-base gnutls golang-github-QubitProducts-exporter_exporter golang-github-lusitaniae-apache_exporter
  golang-github-prometheus-node_exporter grub2 grub2-i386-pc grub2-snapper-plugin grub2-systemd-sleep-plugin grub2-x86_64-efi hibernate-commons-annotations
  hibernate-types hibernate5-c3p0 hibernate5-core hibernate5-ehcache hwdata ical4j jade4j java-11-openjdk java-11-openjdk-headless jctools jetty-client
  jetty-http jetty-io jetty-security jetty-server jetty-servlet jetty-util jetty-util-ajax jetty-webapp jetty-xml jose4j jpa-api kie-api kie-soup kpartx
  krb5 less libLLVM15 libatomic1 libaudit1 libauparse0 libavahi-client3 libavahi-common3 libavahi-glib1 libblkid1 libcares2 libcups2 libcupscgi1
  libcupsimage2 libcupsmime1 libcupsppdc1 libcurl4 libexpat1 libfdisk1 libgcc_s1 libgfortran5 libgif7 libgnutls30 libgomp1 libitm1 libjasper4 liblsan0
  libltdl7 libmaxminddb0 libmediacheck6 libmetalink3 libmount1 libmpath0 libncurses6 libnghttp2-14 libopenblas_pthreads0 libpolkit-agent-1-0
  libpolkit-gobject-1-0 libpython3_6m1_0 libquadmath0 libsemanage1 libsmartcols1 libssh-config libssh2-1 libssh4 libstdc++6 libtcnative-1-0 libtiff5
  libuuid1 libuv1 libvirt-client libvirt-libs libyui-ncurses-pkg16 libyui-ncurses16 libyui16 libzypp login_defs lucene multipath-tools mvel2 mybatis
  ncurses-utils netty nscd openssh openssh-clients openssh-common openssh-server optaplanner pam-config patterns-uyuni_server perl-Bootloader pgjdbc-ng
  pkexec polkit postgresql-jdbc prometheus-client-java prometheus-jmx_exporter prometheus-jmx_exporter-tomcat prometheus-postgres_exporter
  pxe-default-image-opensuse15 python3 python3-PyJWT python3-PyNaCl python3-attrs python3-base python3-bind python3-curses python3-dbm python3-idna
  python3-more-itertools python3-netifaces python3-pyserial python3-rpm python3-salt python3-spacewalk-client-tools quartz release-notes-uyuni rpm rpm-build
  salt salt-api salt-master salt-netapi-client samba-client-libs samba-libs samba-libs-python3 sed sed-lang shadow shim sitemesh smdba spacecmd
  spacewalk-admin spacewalk-backend spacewalk-backend-app spacewalk-backend-applet spacewalk-backend-config-files spacewalk-backend-config-files-common
  spacewalk-backend-config-files-tool spacewalk-backend-iss spacewalk-backend-iss-export spacewalk-backend-package-push-server spacewalk-backend-server
  spacewalk-backend-sql spacewalk-backend-sql-postgresql spacewalk-backend-tools spacewalk-backend-xml-export-libs spacewalk-backend-xmlrpc spacewalk-base
  spacewalk-base-minimal spacewalk-base-minimal-config spacewalk-branding spacewalk-client-tools spacewalk-config spacewalk-html spacewalk-java
  spacewalk-java-config spacewalk-java-lib spacewalk-java-postgresql spacewalk-search spacewalk-setup spacewalk-taskomatic spacewalk-utils spark-core
  spark-template-jade statistics subscription-matcher sudo sudo-plugin-python supportutils susemanager susemanager-schema susemanager-schema-utility
  susemanager-sls susemanager-sync-data susemanager-tools system-group-audit systemd-default-settings systemd-default-settings-branding-openSUSE
  systemd-presets-common-SUSE systemd-rpm-macros terminfo terminfo-base terminfo-iterm terminfo-screen tftp timezone timezone-java tomcat tomcat-el-3_0-api
  tomcat-jsp-2_3-api tomcat-lib tomcat-servlet-4_0-api tomcat-taglibs-standard-1_2_5 ucode-intel util-linux util-linux-lang util-linux-systemd
  uyuni-base-common uyuni-base-server uyuni-docs_en uyuni-docs_en-pdf uyuni-reportdb-schema vim vim-data vim-data-common wget wget-lang wicked
  wicked-service woodstox xen-libs xmlsec yast2 yast2-logs yast2-network yast2-packager yast2-pkg-bindings yast2-theme zabbix-agent zabbix-agent2
  zabbix-agent2-plugin-mongodb zabbix-agent2-plugin-postgresql zabbix-get zabbix-sender zypper zypper-log zypper-needs-restarting

The following pattern is going to be upgraded:
  uyuni_server

The following 6 NEW packages are going to be installed:
  glassfish-activation kernel-default-5.14.21-150500.55.59.1 kernel-default-extra-5.14.21-150500.55.59.1 kernel-default-optional-5.14.21-150500.55.59.1
  libabsl2308_0_0 libprotobuf-lite25_1_0

The following package requires a system reboot:
  kernel-default-5.14.21-150500.55.59.1

284 packages to upgrade, 6 new.
Overall download size: 696.2 MiB. Already cached: 0 B. After the operation, additional 213.3 MiB will be used.

    Note: System reboot required.
Continue? [y/n/v/...? shows all options] (y):

After That i update uyuni-Server

uyuni:~ # zypper install Uyuni-Server-release
Retrieving repository 'Update repository with updates from SUSE Linux Enterprise 15' metadata ........................................................[done]
Building repository 'Update repository with updates from SUSE Linux Enterprise 15' cache .............................................................[done]
Loading repository data...
Reading installed packages...
Resolving package dependencies...

The following package is going to be upgraded:
  Uyuni-Server-release

The following product is going to be upgraded:
  Uyuni Server  2024.02-0 -> 2024.03-0

The following product is going to change vendor:
  Uyuni Server  openSUSE -> obs://build.opensuse.org/systemsmanagement:Uyuni

1 package to upgrade.
Overall download size: 8.7 KiB. Already cached: 0 B. No additional space will be used or freed after the operation.

Backend:  classic_rpmtrans
Continue? [y/n/v/...? shows all options] (y): y
Retrieving: Uyuni-Server-release-2024.03-230900.214.6.uyuni3.x86_64 (uyuni-server-stable)                                               (1/1),   8.7 KiB
Retrieving: Uyuni-Server-release-2024.03-230900.214.6.uyuni3.x86_64.rpm ..............................................................................[done]

Checking for file conflicts: .........................................................................................................................[done]
(1/1) Installing: Uyuni-Server-release-2024.03-230900.214.6.uyuni3.x86_64 ............................................................................[done]
There are running programs which still use files and libraries deleted or updated by recent upgrades. They should be restarted to benefit from the latest updates. Run 'zypper ps -s' to list these programs.

Since the last system boot core libraries or services have been updated.
Reboot is suggested to ensure that your system benefits from these updates.
uyuni:~ #

Now it reboot the System

uyuni:~ # spacewalk-service status
● mgr-check-payg.service - Check and install payg billing service.
     Loaded: loaded (/usr/lib/systemd/system/mgr-check-payg.service; static)
     Active: active (exited) since Tue 2024-05-07 11:29:28 CEST; 2min 55s ago
    Process: 911 ExecStart=/usr/sbin/spacewalk-startup-helper check-billing-service (code=exited, status=0/SUCCESS)
   Main PID: 911 (code=exited, status=0/SUCCESS)

● uyuni-update-config.service - Uyuni update config
     Loaded: loaded (/usr/lib/systemd/system/uyuni-update-config.service; static)
     Active: active (exited) since Tue 2024-05-07 11:29:38 CEST; 2min 45s ago
    Process: 1604 ExecStart=/usr/sbin/uyuni-update-config (code=exited, status=0/SUCCESS)
   Main PID: 1604 (code=exited, status=0/SUCCESS)

● uyuni-check-database.service - Uyuni check database
     Loaded: loaded (/usr/lib/systemd/system/uyuni-check-database.service; static)
     Active: active (exited) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
    Process: 1616 ExecStart=/usr/sbin/spacewalk-startup-helper check-database (code=exited, status=0/SUCCESS)
   Main PID: 1616 (code=exited, status=0/SUCCESS)

● tomcat.service - Apache Tomcat Web Application Container
     Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/tomcat.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
   Main PID: 1965 (java)
      Tasks: 96 (limit: 576)
     CGroup: /system.slice/tomcat.service
             └─ 1965 /usr/lib64/jvm/jre/bin/java -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory -ea -Xms256m -Xmx1G -Djava.a…

● spacewalk-wait-for-tomcat.service - Spacewalk wait for tomcat
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-tomcat.service; static)
     Active: active (exited) since Tue 2024-05-07 11:30:27 CEST; 1min 56s ago
    Process: 1966 ExecStart=/usr/sbin/spacewalk-startup-helper wait-for-tomcat (code=exited, status=0/SUCCESS)
   Main PID: 1966 (code=exited, status=0/SUCCESS)

● salt-master.service - The Salt Master Server
     Loaded: loaded (/usr/lib/systemd/system/salt-master.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/salt-master.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
       Docs: man:salt-master(1)
             file:///usr/share/doc/salt/html/contents.html
             https://docs.saltproject.io/en/latest/contents.html
   Main PID: 1959 (salt-master)
      Tasks: 62
     CGroup: /system.slice/salt-master.service
             ├─ 1959 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2240 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2241 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2244 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2245 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2246 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2247 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2249 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2250 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2251 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2252 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2253 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2254 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2265 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2266 /usr/bin/python3 /usr/bin/salt-master
             ├─ 2267 /usr/bin/python3 /usr/bin/salt-master
             └─ 2268 /usr/bin/python3 /usr/bin/salt-master

● salt-api.service - The Salt API
     Loaded: loaded (/usr/lib/systemd/system/salt-api.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/salt-api.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
       Docs: man:salt-api(1)
             file:///usr/share/doc/salt/html/contents.html
             https://docs.saltproject.io/en/latest/contents.html
   Main PID: 1958 (salt-api)
      Tasks: 104 (limit: 4915)
     CGroup: /system.slice/salt-api.service
             ├─ 1958 /usr/bin/python3 /usr/bin/salt-api
             └─ 2054 /usr/bin/python3 /usr/bin/salt-api

● spacewalk-wait-for-salt.service - Make sure that salt is started before httpd
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-salt.service; static)
     Active: active (exited) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
    Process: 1960 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
   Main PID: 1960 (code=exited, status=0/SUCCESS)

● apache2.service - The Apache Webserver
     Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/apache2.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:30:27 CEST; 1min 56s ago
   Main PID: 14365 (httpd-prefork)
     Status: "Processing requests..."
      Tasks: 17
     CGroup: /system.slice/apache2.service
             ├─ 14365 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14626 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14627 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14628 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14629 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14631 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 14864 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16472 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16478 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16479 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16725 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16736 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16757 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16759 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16762 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             ├─ 16770 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…
             └─ 16772 /usr/sbin/httpd-prefork -DSYSCONFIG -DSSL -DISSUSE -C "PidFile /run/httpd.pid" -C "Include /etc/apache2/sysconfig.d//loadmodule.conf"…

● rhn-search.service - Spacewalk search engine
     Loaded: loaded (/usr/lib/systemd/system/rhn-search.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/rhn-search.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:30:27 CEST; 1min 56s ago
   Main PID: 14620 (rhn-search)
      Tasks: 83 (limit: 4915)
     CGroup: /system.slice/rhn-search.service
             ├─ 14620 /bin/sh /usr/sbin/rhn-search
             └─ 14633 /usr/bin/java -Djava.library.path=/usr/lib:/usr/lib64:/usr/lib/gcj/postgresql-jdbc:/usr/lib64/gcj/postgresql-jdbc -classpath "/usr/sh…

● cobblerd.service - Cobbler Helper Daemon
     Loaded: loaded (/usr/lib/systemd/system/cobblerd.service; enabled; vendor preset: disabled)
     Active: active (running) since Tue 2024-05-07 11:29:59 CEST; 2min 24s ago
   Main PID: 1956 (cobblerd)
      Tasks: 3 (limit: 4915)
     CGroup: /system.slice/cobblerd.service
             └─ 1956 /usr/bin/python3 -s /usr/bin/cobblerd -F

● taskomatic.service - Taskomatic
     Loaded: loaded (/usr/lib/systemd/system/taskomatic.service; enabled; vendor preset: disabled)
    Drop-In: /usr/lib/systemd/system/taskomatic.service.d
             └─override.conf
     Active: active (running) since Tue 2024-05-07 11:30:27 CEST; 1min 56s ago
   Main PID: 14621 (taskomatic)
      Tasks: 151 (limit: 4915)
     CGroup: /system.slice/taskomatic.service
             ├─ 14621 /bin/sh /usr/sbin/taskomatic
             └─ 14638 /usr/bin/java -Djava.library.path=/usr/lib:/usr/lib64 -classpath "/usr/share/rhn/classes:/usr/share/rhn/lib/spacewalk-asm.jar:/usr/sh…

● spacewalk-wait-for-taskomatic.service - Spacewalk wait for taskomatic
     Loaded: loaded (/usr/lib/systemd/system/spacewalk-wait-for-taskomatic.service; static)
     Active: active (exited) since Tue 2024-05-07 11:30:30 CEST; 1min 53s ago
    Process: 14630 ExecStart=/usr/sbin/spacewalk-startup-helper wait-for-taskomatic (code=exited, status=0/SUCCESS)
   Main PID: 14630 (code=exited, status=0/SUCCESS)

● salt-secrets-config.service - Configures secrets between salt-master and other services
     Loaded: loaded (/usr/lib/systemd/system/salt-secrets-config.service; static)
    Drop-In: /usr/lib/systemd/system/salt-secrets-config.service.d
             └─override.conf
     Active: active (exited) since Tue 2024-05-07 11:29:31 CEST; 2min 52s ago
    Process: 913 ExecStart=/usr/bin/salt-secrets-config.py (code=exited, status=0/SUCCESS)
   Main PID: 913 (code=exited, status=0/SUCCESS)

● mgr-websockify.service - TCP to WebSocket proxy
     Loaded: loaded (/usr/lib/systemd/system/mgr-websockify.service; static)
     Active: active (running) since Tue 2024-05-07 11:29:54 CEST; 2min 29s ago
    Process: 1957 ExecStartPre=/usr/bin/sh -c grep secret_key /etc/rhn/rhn.conf | tr -d ' ' | cut -f2 -d '=' | perl -ne 's/([0-9a-f]{2})/print chr hex $1/gie' > /etc/rhn/websockify.key (code=exited, status=0/SUCCESS)
   Main PID: 1967 (websockify)
      Tasks: 8 (limit: 4915)
     CGroup: /system.slice/mgr-websockify.service
             └─ 1967 /usr/bin/python3 /usr/bin/websockify --token-plugin JWTTokenApi --token-source /etc/rhn/websockify.key localhost:8050

● cobbler-refresh-mkloaders.service - Refresh Cobbler bootloaders
     Loaded: loaded (/usr/lib/systemd/system/cobbler-refresh-mkloaders.service; static)
    Drop-In: /usr/lib/systemd/system/cobbler-refresh-mkloaders.service.d
             └─override.conf
     Active: active (exited) since Tue 2024-05-07 11:30:30 CEST; 1min 53s ago
    Process: 14623 ExecStart=/usr/bin/cobbler mkloaders (code=exited, status=0/SUCCESS)
   Main PID: 14623 (code=exited, status=0/SUCCESS)
● spacewalk.target - Spacewalk
     Loaded: loaded (/usr/lib/systemd/system/spacewalk.target; enabled; vendor preset: disabled)
     Active: active since Tue 2024-05-07 11:30:30 CEST; 1min 53s ago
uyuni:~ #
uyuni_authentication_endpoint: http://uyuni.domain.com
uyuni:~ # grep redhat_management_server /etc/cobbler/settings.yaml
redhat_management_server: uyuni.domain.com
uyuni:~ #

cobbler.log

[Daemon] 2024-05-07T11:29:57 - INFO | running: ['/usr/sbin/selinuxenabled']
[Daemon] 2024-05-07T11:29:57 - INFO | received on stdout:
[Daemon] 2024-05-07T11:29:57 - INFO | Automigration NOT executed
[Daemon] 2024-05-07T11:29:57 - INFO | python3-hivex not found. If you need Automatic Windows Installation support, please install.
[Daemon] 2024-05-07T11:29:59 - INFO | 11 breeds and 131 OS versions read from the signature file
[Daemon] 2024-05-07T11:29:59 - INFO | Cobbler startup completed  in 6.108752965927124 seconds
[Thread-4] 2024-05-07T11:30:27 - INFO | REMOTE start_task(Create bootable bootloader images); event_id(2024-05-07_113027_mkloaders); user(?)
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | ipxe directory did not exist. Please adjust the "bootloaders_ipxe_folder". Bailing out of iPXE setup!
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | syslinux version 4 detected! Skip making symlink of "ldlinux.c32" file!
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | GRUB2 modules directory for arch "IA64" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | GRUB2 modules directory for arch "aarch64" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | GRUB2 modules directory for arch "arm" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | GRUB2 modules directory for arch "arm64-efi" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:29 - INFO | Successfully built bootloader for arch "i386-efi"!
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:30 - INFO | Successfully built bootloader for arch "i386-pc-pxe"!
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:30 - INFO | GRUB2 modules directory for arch "i686" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:30 - INFO | GRUB2 modules directory for arch "powerpc-ieee1275" did no exist. Skipping GRUB2 creation
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:30 - INFO | Successfully built bootloader for arch "x86_64-efi"!
[2024-05-07_113027_mkloaders] 2024-05-07T11:30:30 - INFO | ### TASK COMPLETE ###
uyuni:~ #

cat /var/log/tomcat/catalina.out

tomcat-9.0.87 RPM installed
07-May-2024 11:29:57.043 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Server Version:        Apache Tomcat/9.0.87
07-May-2024 11:29:57.048 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Apr 5 2024 12:00:00 UTC
07-May-2024 11:29:57.049 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.87.0
07-May-2024 11:29:57.049 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
07-May-2024 11:29:57.049 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            5.14.21-150500.55.59-default
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Architektur:           amd64
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/lib64/jvm/java-11-openjdk-11
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           11.0.23+9-suse-150000.3.113.1-x8664
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Hersteller:        Oracle Corporation
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /usr/share/tomcat
07-May-2024 11:29:57.050 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/share/tomcat
07-May-2024 11:29:57.087 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djavax.sql.DataSource.Factory=org.apache.commons.dbcp.BasicDataSourceFactory
07-May-2024 11:29:57.087 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -ea
07-May-2024 11:29:57.087 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms256m
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx1G
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.xml.sax.driver=com.redhat.rhn.frontend.xmlrpc.util.RhnSAXParser
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dnet.sf.ehcache.skipUpdateCheck=true
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-exports=java.annotation/javax.annotation.security=ALL-UNNAMED
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.annotation/javax.annotation.security=ALL-UNNAMED
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/share/tomcat
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.endorsed.dirs=
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/var/cache/tomcat/temp
07-May-2024 11:29:57.088 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties
07-May-2024 11:29:57.089 INFORMATION [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
07-May-2024 11:29:57.423 INFORMATION [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.38] using APR version [1.6.3].
07-May-2024 11:29:57.424 INFORMATION [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true].
07-May-2024 11:29:57.424 INFORMATION [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
07-May-2024 11:29:57.428 INFORMATION [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1l-fips  24 Aug 2021 SUSE release 150500.17.25.1]
07-May-2024 11:29:57.899 INFORMATION [main] org.apache.coyote.AbstractProtocol.init Initialisiere ProtocolHandler["ajp-nio-127.0.0.1-8009"]
07-May-2024 11:29:57.924 INFORMATION [main] org.apache.coyote.AbstractProtocol.init Initialisiere ProtocolHandler["ajp-nio-0:0:0:0:0:0:0:1-8009"]
07-May-2024 11:29:57.925 INFORMATION [main] org.apache.coyote.AbstractProtocol.init Initialisiere ProtocolHandler["http-nio-127.0.0.1-8080"]
07-May-2024 11:29:57.927 INFORMATION [main] org.apache.catalina.startup.Catalina.load Server initialization in [1231] milliseconds
07-May-2024 11:29:58.313 INFORMATION [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
07-May-2024 11:29:58.313 INFORMATION [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.87]
07-May-2024 11:29:58.351 INFORMATION [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploye Web-Applikations-Verzeichnis [/usr/share/susemanager/www/tomcat/webapps/rhn]
07-May-2024 11:30:07.477 INFORMATION [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.

journalctl -u apache2

May 07 11:30:27 uyuni systemd[1]: Starting The Apache Webserver...
May 07 11:30:27 uyuni start_apache2[14365]: [Tue May 07 11:30:27.532128 2024] [alias:warn] [pid 14365] AH00671: The Alias directive in /etc/apache2/conf.d/>
May 07 11:30:27 uyuni start_apache2[14365]: [Tue May 07 11:30:27.532225 2024] [alias:warn] [pid 14365] AH00671: The ScriptAlias directive in /etc/apache2/c>
May 07 11:30:27 uyuni systemd[1]: Started The Apache Webserver.

I have now repeated the process several times and cannot find any errors. The output from Cobbler is also correct. The correct url is returned.

But as soon as I try to call uyuni I get the answer: ERR_CONNECTION_REFUSED

Since I can't find anything in the logs, I'm back to where I was at the beginning.

hsh-it avatar May 07 '24 09:05 hsh-it

apache log

[Tue May 07 11:42:24.034623 2024] [alias:warn] [pid 21058] AH00671: The Alias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 26 will probably never match because it overlaps an earlier Alias.
[Tue May 07 11:42:24.034739 2024] [alias:warn] [pid 21058] AH00671: The ScriptAlias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 40 will probably never match because it overlaps an earlier ScriptAlias.
uyuni:~ # curl -v http://localhost
*   Trying 127.0.0.1:80...
* Connected to localhost (127.0.0.1) port 80 (#0)
> GET / HTTP/1.1
> Host: localhost
> User-Agent: curl/8.0.1
> Accept: */*
>
^C # >> no answer 
uyuni:~ # curl -v --insecure https://localhost
*   Trying 127.0.0.1:443...
* Connected to localhost (127.0.0.1) port 443 (#0)
* ALPN: offers h2,http/1.1
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* TLSv1.3 (IN), TLS handshake, Certificate (11):
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
* TLSv1.3 (IN), TLS handshake, Finished (20):
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN: server accepted http/1.1
* Server certificate:
*  subject: C=DE; ST=; O=  GmbH; OU=Technik; CN=uyuni.domain.com; [email protected]
*  start date: Apr 23 09:51:41 2023 GMT
*  expire date: Apr 27 09:51:41 2033 GMT
*  issuer: C=DE; ST= ; L= ; O=HSH GmbH; OU=Technik; CN=uyuni.domain.com
*  SSL certificate verify result: unable to get local issuer certificate (20), continuing anyway.
* using HTTP/1.1
> GET / HTTP/1.1
> Host: localhost
> User-Agent: curl/8.0.1
> Accept: */*
>
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing

There is a successful connection but the server is not responding.

hsh-it avatar May 07 '24 09:05 hsh-it

So I was debugging this, and I was unable to find the root cause. However, if you run the following set of commands it may solve the issue. All the commands are safe to run, and will not touch any data. Run than in order:

  • spacewalk-service stop
  • rcapache2 start
  • rctomcat start
  • spacewalk-service start

rjmateus avatar May 07 '24 14:05 rjmateus

It worked! Thank you!

uyuni:~ # rcapache2 start
uyuni:~ # rctomcat start
uyuni:~ # spacewalk-service start
Starting spacewalk services...
  Checking DB schema and running DB schema upgrade if needed. This may take a while.
  Call the following command to see progress: journalctl -f -u uyuni-check-database.service
Done.
uyuni:~ #

Do you know what the problem was and why it works now?

hsh-it avatar May 08 '24 06:05 hsh-it

Different solution for me worked changing stapling settings in /etc/apache2/vhosts.d/vhost-ssl.conf: SSLUseStapling off

kluchoslaw avatar May 08 '24 09:05 kluchoslaw

Same problem here after Updating from 2024.02 to 2024.05. Your fix doesn't work.

[Tue May 07 11:42:24.034623 2024] [alias:warn] [pid 21058] AH00671: The Alias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 26 will probably never match because it overlaps an earlier Alias.
[Tue May 07 11:42:24.034739 2024] [alias:warn] [pid 21058] AH00671: The ScriptAlias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 40 will probably never match because it overlaps an earlier ScriptAlias.

I find that strange. These lines define an alias for CGI Sources, but the directory doesn't exist.

vega82 avatar May 23 '24 05:05 vega82

please reopen issue. it makes no sense to create another ticket.

vega82 avatar May 23 '24 05:05 vega82

I'm not sure about the rules here, I'm reopening. If this is wrong I apologize. but I see it similarly, it seems to be the same problem.

hsh-it avatar May 23 '24 07:05 hsh-it

Same problem here after Updating from 2024.02 to 2024.05. Your fix doesn't work.

[Tue May 07 11:42:24.034623 2024] [alias:warn] [pid 21058] AH00671: The Alias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 26 will probably never match because it overlaps an earlier Alias.
[Tue May 07 11:42:24.034739 2024] [alias:warn] [pid 21058] AH00671: The ScriptAlias directive in /etc/apache2/conf.d/zz-spacewalk-www.conf at line 40 will probably never match because it overlaps an earlier ScriptAlias.

I find that strange. These lines define an alias for CGI Sources, but the directory doesn't exist.

The warn lines from apache are very likely not the problem. I have them as well and I had no problems after updating to 2024.03.

cFabij avatar May 23 '24 09:05 cFabij

Uyuni seems to be running, all processstates are running, but Webgui isn't reachable. Rollback the VM and reapply the update results in the same problem again and again.

vega82 avatar May 23 '24 13:05 vega82

Did you checked new browser or STRG/cmd+F5 ? I had the same or a similar problem: After the update I only saw a blank page in the WEB ui. I then tested Opera and it worked.

I then deleted the cache and it worked. Sure, it seems like a typical IT response to a customer, but this time it worked for me.

If the services are running and you can't find any errors, you need to start solving the OSI model of Layer 8

hsh-it avatar May 23 '24 14:05 hsh-it

Hey. We are debugging and working on a solution for it. We should have new soon.

rjmateus avatar May 23 '24 14:05 rjmateus