charm-helpers icon indicating copy to clipboard operation
charm-helpers copied to clipboard

assess_status: hook tool failure result in Traceback and error state

Open fnordahl opened this issue 6 years ago • 0 comments

Not sure how common this situation is, but it might be worth to probe if improved error handling is in order.

2018-08-22 04:16:53 DEBUG juju.worker.uniter.remotestate watcher.go:530 update status timer triggered
2018-08-22 04:16:53 DEBUG juju.worker.uniter resolver.go:133 no operations in progress; waiting for changes
2018-08-22 04:16:53 DEBUG juju.worker.uniter.operation executor.go:59 running operation run update-status hook
2018-08-22 04:16:53 DEBUG juju.machinelock machinelock.go:156 acquire machine lock for uniter (run update-status hook)
2018-08-22 04:16:53 DEBUG juju.machinelock machinelock.go:166 machine lock acquired for uniter (run update-status hook)
2018-08-22 04:16:53 DEBUG juju.worker.uniter.operation executor.go:90 preparing operation "run update-status hook"
2018-08-22 04:16:53 DEBUG juju.worker.uniter.operation executor.go:90 executing operation "run update-status hook"
2018-08-22 04:16:53 DEBUG worker.uniter.jujuc server.go:181 running hook tool "config-get"
2018-08-22 04:16:54 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:54 INFO juju-log Registered config file: /etc/keystone/keystone.conf
2018-08-22 04:16:54 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:54 INFO juju-log Registered config file: /etc/keystone/logging.conf
2018-08-22 04:16:54 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:54 INFO juju-log Registered config file: /etc/haproxy/haproxy.cfg
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/keystone/policy.json
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/cron.d/keystone-token-flush
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/cron.d/keystone-fernet-rotate-sync
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/apache2/sites-enabled/wsgi-openstack-api.conf
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Registered config file: /etc/memcached.conf
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log Hardening function 'install'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log Hardening function 'config_changed'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log Hardening function 'config_changed_postupgrade'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log Hardening function 'upgrade_charm'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log Hardening function 'update_status'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 DEBUG juju-log No hardening applied to 'update_status'
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:55 INFO juju-log Updating status.
2018-08-22 04:16:55 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-get"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-list"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-get"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:56 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-ids"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-list"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:57 INFO juju-log Configuring Keystone to use a random admin token.
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:57 INFO juju-log Loading a previously generated admin token from /var/lib/keystone/keystone.token
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "unit-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "unit-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:57 DEBUG worker.uniter.jujuc server.go:181 running hook tool "relation-get"
2018-08-22 04:16:57 DEBUG update-status ERROR no relation id specified
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:58 INFO juju-log HAProxy context is incomplete, this unit has no peers.
2018-08-22 04:16:58 DEBUG update-status none
2018-08-22 04:16:58 DEBUG update-status none
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:58 INFO juju-log Configuring Keystone to use a random admin token.
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:58 INFO juju-log Loading a previously generated admin token from /var/lib/keystone/keystone.token
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:58 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:59 INFO juju-log Configuring Keystone to use a random admin token.
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "juju-log"
2018-08-22 04:16:59 INFO juju-log Loading a previously generated admin token from /var/lib/keystone/keystone.token
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "leader-get"
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:16:59 DEBUG worker.uniter.jujuc server.go:181 running hook tool "network-get"
2018-08-22 04:17:00 DEBUG juju.api monitor.go:35 RPC connection died
2018-08-22 04:17:00 DEBUG juju.rpc server.go:325 error closing codec: write tcp 252.0.17.1:39720->252.0.9.1:17070: write: broken pipe
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "log-sender" manifold worker stopped: cannot send log message: tls: use of closed connection
2018-08-22 04:17:00 ERROR juju.worker.dependency engine.go:548 "log-sender" manifold worker returned unexpected error: cannot send log message: tls: use of closed connection
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:550 stack trace:
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "upgrader" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 ERROR juju.worker.dependency engine.go:548 "upgrader" manifold worker returned unexpected error: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:550 stack trace:
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "migration-inactive-flag" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 ERROR juju.worker.dependency engine.go:548 "migration-inactive-flag" manifold worker returned unexpected error: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:550 stack trace:
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "api-caller" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 ERROR juju.worker.dependency engine.go:548 "api-caller" manifold worker returned unexpected error: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:550 stack trace:
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "logging-config-updater" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "meter-status" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "proxy-config-updater" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "migration-minion" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.uniter runlistener.go:120 juju-run listener stopping
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "hook-retry-strategy" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "api-address-updater" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "upgrader" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.uniter runlistener.go:139 juju-run listener stopped
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "log-sender" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "migration-inactive-flag" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-collect" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "leadership-tracker" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "charm-dir" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-sender" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-spool" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-collect" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-sender" manifold worker stopped: <nil>
2018-08-22 04:17:00 DEBUG update-status Traceback (most recent call last):
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/update-status", line 819, in <module>
2018-08-22 04:17:00 DEBUG update-status     main()
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/update-status", line 815, in main
2018-08-22 04:17:00 DEBUG update-status     assess_status(CONFIGS)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keystone_utils.py", line 1824, in assess_status
2018-08-22 04:17:00 DEBUG update-status     assess_status_func(configs)()
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1409, in _assess_status_func
2018-08-22 04:17:00 DEBUG update-status     state, message = _determine_os_workload_status(*args, **kwargs)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 812, in _determine_os_workload_status
2018-08-22 04:17:00 DEBUG update-status     configs, required_interfaces)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 866, in _ows_check_generic_interfaces
2018-08-22 04:17:00 DEBUG update-status     required_interfaces)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1147, in incomplete_relation_data
2018-08-22 04:17:00 DEBUG update-status     complete_ctxts = configs.complete_contexts()
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 351, in complete_contexts
2018-08-22 04:17:00 DEBUG update-status     for i in six.itervalues(self.templates)]
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 127, in complete_contexts
2018-08-22 04:17:00 DEBUG update-status     self.context()
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 112, in context
2018-08-22 04:17:00 DEBUG update-status     _ctxt = context()
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/keystone_context.py", line 204, in __call__
2018-08-22 04:17:00 DEBUG update-status     resolve_address(ADMIN),
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/contrib/openstack/ip.py", line 177, in resolve_address
2018-08-22 04:17:00 DEBUG update-status     resolved_address = network_get_primary_address(binding)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/core/hookenv.py", line 952, in inner_translate_exc2
2018-08-22 04:17:00 DEBUG update-status     return f(*args, **kwargs)
2018-08-22 04:17:00 DEBUG update-status   File "/var/lib/juju/agents/unit-keystone-0/charm/hooks/charmhelpers/core/hookenv.py", line 1147, in network_get_primary_address
2018-08-22 04:17:00 DEBUG update-status     stderr=subprocess.STDOUT).decode('UTF-8').strip()
2018-08-22 04:17:00 DEBUG update-status   File "/usr/lib/python2.7/subprocess.py", line 223, in check_output
2018-08-22 04:17:00 DEBUG update-status     raise CalledProcessError(retcode, cmd, output=output)
2018-08-22 04:17:00 DEBUG update-status subprocess.CalledProcessError: Command '['network-get', '--primary-address', 'admin']' returned non-zero exit status 1
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "upgrader" manifold worker stopped: "api-caller" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "proxy-config-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-spool" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "hook-retry-strategy" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-sender" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "log-sender" manifold worker stopped: "api-caller" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "api-address-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "logging-config-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "charm-dir" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "upgrade-steps-runner" manifold worker stopped: "api-caller" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "leadership-tracker" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "migration-inactive-flag" manifold worker stopped: "api-caller" not running: dependency not available
2018-08-22 04:17:00 ERROR juju.worker.uniter.operation runhook.go:115 hook "update-status" failed: exit status 1
2018-08-22 04:17:00 DEBUG juju.machinelock machinelock.go:180 machine lock released for uniter (run update-status hook)
2018-08-22 04:17:00 DEBUG juju.worker.uniter.operation executor.go:74 lock released
2018-08-22 04:17:00 INFO juju.worker.uniter uniter.go:397 unit "keystone/0" shutting down: (re)starting watcher: connection is shut down
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: codec.ReadHeader error: error receiving message: read tcp 252.0.17.1:39720->252.0.9.1:17070: read: connection reset by peer
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "metric-collect" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "migration-minion" manifold worker stopped: "api-caller" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "meter-status" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:00 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.apicaller connect.go:112 connecting with current password
2018-08-22 04:17:03 DEBUG juju.api apiclient.go:872 successfully dialed "wss://10.5.0.9:17070/model/beb7b09c-f7ac-40f8-83bf-8129af6225c4/api"
2018-08-22 04:17:03 INFO juju.api apiclient.go:599 connection established to "wss://10.5.0.9:17070/model/beb7b09c-f7ac-40f8-83bf-8129af6225c4/api"
2018-08-22 04:17:03 DEBUG juju.api apiclient.go:872 successfully dialed "wss://252.0.9.1:17070/model/beb7b09c-f7ac-40f8-83bf-8129af6225c4/api"
2018-08-22 04:17:03 DEBUG juju.worker.apicaller connect.go:155 connected
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "api-caller" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "migration-minion" manifold worker started
2018-08-22 04:17:03 INFO juju.worker.migrationminion worker.go:116 migration phase is now: NONE
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "metric-sender" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "hook-retry-strategy" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "upgrader" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "log-sender" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "proxy-config-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "logging-config-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "api-address-updater" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "leadership-tracker" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "meter-status" manifold worker stopped: "migration-inactive-flag" not running: dependency not available
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "upgrade-steps-runner" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "upgrade-steps-runner" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "migration-inactive-flag" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "meter-status" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "proxy-config-updater" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "api-address-updater" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "charm-dir" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "metric-collect" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "metric-spool" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "metric-sender" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "metric-collect" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.logger logger.go:43 initial log config: "<root>=DEBUG;unit=DEBUG"
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "logging-config-updater" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.logger logger.go:92 logger setup
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "leadership-tracker" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.leadership tracker.go:130 keystone/0 making initial claim for keystone leadership
2018-08-22 04:17:03 DEBUG juju.worker.proxyupdater proxyupdater.go:168 applying in-process legacy proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"10.5.0.9,127.0.0.1,252.0.9.1,::1,localhost", AutoNoProxy:""}
2018-08-22 04:17:03 DEBUG juju.worker.proxyupdater proxyupdater.go:188 saving new legacy proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"10.5.0.9,127.0.0.1,252.0.9.1,::1,localhost", AutoNoProxy:""}
2018-08-22 04:17:03 DEBUG juju.worker.proxyupdater proxyupdater.go:252 new apt proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"127.0.0.1,::1,localhost", AutoNoProxy:""}
2018-08-22 04:17:03 INFO juju.worker.upgrader upgrader.go:139 abort check blocked until version event received
2018-08-22 04:17:03 INFO juju.worker.upgrader upgrader.go:145 unblocking abort check
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "metric-sender" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "hook-retry-strategy" manifold worker started
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:501 "uniter" manifold worker stopped: <nil>
2018-08-22 04:17:03 DEBUG juju.worker.meterstatus connected.go:88 got meter status change signal from watcher
2018-08-22 04:17:03 DEBUG juju.network network.go:507 no lxc bridge addresses to filter for machine
2018-08-22 04:17:03 DEBUG juju.network network.go:543 cannot get "lxdbr0" addresses: route ip+net: no such network interface (ignoring)
2018-08-22 04:17:03 DEBUG juju.network network.go:543 cannot get "virbr0" addresses: route ip+net: no such network interface (ignoring)
2018-08-22 04:17:03 DEBUG juju.network network.go:492 including address local-cloud:10.5.0.9 for machine
2018-08-22 04:17:03 DEBUG juju.network network.go:492 including address local-fan:252.0.9.1 for machine
2018-08-22 04:17:03 DEBUG juju.network network.go:492 including address local-machine:127.0.0.1 for machine
2018-08-22 04:17:03 DEBUG juju.network network.go:492 including address local-machine:::1 for machine
2018-08-22 04:17:03 DEBUG juju.network network.go:561 addresses after filtering: [local-cloud:10.5.0.9 local-fan:252.0.9.1 local-machine:127.0.0.1 local-machine:::1]
2018-08-22 04:17:03 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:88 updating API hostPorts to [[10.5.0.9:17070 252.0.9.1:17070 127.0.0.1:17070 [::1]:17070]]
2018-08-22 04:17:03 DEBUG juju.agent agent.go:578 API server address details [["10.5.0.9:17070" "252.0.9.1:17070" "127.0.0.1:17070" "[::1]:17070"]] written to agent config as ["10.5.0.9:17070" "252.0.9.1:17070"]
2018-08-22 04:17:03 DEBUG juju.worker.proxyupdater proxyupdater.go:168 applying in-process legacy proxy settings proxy.Settings{Http:"", Https:"", Ftp:"", NoProxy:"10.5.0.9,127.0.0.1,252.0.9.1,::1,localhost", AutoNoProxy:""}
2018-08-22 04:17:03 INFO juju.worker.leadership tracker.go:199 keystone/0 promoted to leadership of keystone
2018-08-22 04:17:03 INFO juju.worker.upgrader upgrader.go:178 desired agent binary version: 2.5-beta1
2018-08-22 04:17:03 DEBUG juju.worker.dependency engine.go:483 "uniter" manifold worker started
2018-08-22 04:17:04 INFO juju.agent.tools symlinks.go:20 ensure jujuc symlinks in /var/lib/juju/tools/unit-keystone-0
2018-08-22 04:17:04 INFO juju.agent.tools symlinks.go:40 was a symlink, now looking at /var/lib/juju/tools/2.5-beta1-bionic-amd64
2018-08-22 04:17:04 DEBUG juju.agent.tools symlinks.go:44 jujud path /var/lib/juju/tools/2.5-beta1-bionic-amd64/jujud
2018-08-22 04:17:04 INFO juju.worker.uniter.relation relations.go:495 joining relation "keystone:cluster"
2018-08-22 04:17:04 INFO juju.worker.upgrader upgrader.go:178 desired agent binary version: 2.5-beta1
2018-08-22 04:17:04 INFO juju.worker.uniter.relation relations.go:531 joined relation "keystone:cluster"
2018-08-22 04:17:04 INFO juju.worker.upgrader upgrader.go:178 desired agent binary version: 2.5-beta1
2018-08-22 04:17:04 INFO juju.worker.uniter.relation relations.go:495 joining relation "keystone:shared-db mysql:shared-db"
2018-08-22 04:17:04 INFO juju.worker.uniter.relation relations.go:531 joined relation "keystone:shared-db mysql:shared-db"
2018-08-22 04:17:04 INFO juju.worker.upgrader upgrader.go:178 desired agent binary version: 2.5-beta1
2018-08-22 04:17:04 DEBUG juju.worker.uniter uniter.go:579 starting juju-run listener on unix:/var/lib/juju/agents/unit-keystone-0/run.socket
2018-08-22 04:17:04 DEBUG juju.worker.uniter runlistener.go:107 juju-run listener running
2018-08-22 04:17:04 INFO juju.worker.uniter uniter.go:197 unit "keystone/0" started
2018-08-22 04:17:04 INFO juju.worker.uniter uniter.go:236 hooks are retried false
2018-08-22 04:17:04 INFO juju.worker.upgrader upgrader.go:178 desired agent binary version: 2.5-beta1
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:431 got address change: ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:402 got application change
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:451 got action change: [] ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:471 got storage change: [] ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:422 got upgrade series change
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:441 got leader settings change: ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:375 got config change: ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:461 got relations change: ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:392 got unit change
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:481 got update status interval change: ok=true
2018-08-22 04:17:04 DEBUG juju.worker.uniter.remotestate watcher.go:375 got config change: ok=true
2018-08-22 04:17:04 INFO juju.worker.uniter resolver.go:112 awaiting error resolution for "update-status" hook
2018-08-22 04:17:04 DEBUG juju.worker.uniter agent.go:20 [AGENT-STATUS] error: hook failed: "update-status"
2018-08-22 04:17:04 DEBUG juju.worker.dependency engine.go:483 "metric-collect" manifold worker started

fnordahl avatar Aug 22 '18 06:08 fnordahl