charts icon indicating copy to clipboard operation
charts copied to clipboard
verified publisher icon bitnami

[bitnami/rabbitmq] Rabbitmq pod error HTTP access denied: user 'user' - invalid credentials

Open sachinmane1983 opened this issue 1 year ago • 6 comments

Name and Version

rabbitmq-12.0.0

What architecture are you using?

None

What steps will reproduce the bug?

Upgrading grafana and grafana oncall helm chart from grafana "version": "6.43.0", to "7.3.8" grafana oncall 1.1.0 to 1.3.118

Are you using any custom parameters or values?

rabbitmq:
  enabled: true
  auth:
    user: user
    existingPasswordSecret: grafana-oncall-rabbitmq
    existingErlangSecret: grafana-oncall-rabbitmq
    resources:
    limits:
      cpu: 400m
      memory: 500Mi
    requests:
      cpu: 200m
      memory: 200Mi
broker:
  type: rabbitmq        

externalRabbitmq:
  host:
  port:
  user:
  password:
  protocol:
  vhost:
  existingSecret:
  passwordKey: ""
  usernameKey: ""

I checked password is correct while login into rabbitmq pod and authenticating with user id its shows success message

What is the expected behavior?

Rabbitmq pod should work

What do you see instead?

2024-04-16 14:43:05.511255+00:00 [warning] <0.875.0> HTTP access denied: user 'user' - invalid credentials
2024-04-16 14:43:25.593843+00:00 [warning] <0.892.0> HTTP access denied: user 'user' - invalid credentials
2024-04-16 14:43:35.506533+00:00 [warning] <0.901.0> HTTP access denied: user 'user' - invalid credentials
2024-04-16 14:43:35.512524+00:00 [warning] <0.903.0> HTTP access denied: user 'user' - invalid credentials

sachinmane1983 avatar Apr 16 '24 14:04 sachinmane1983

Hi,

Any reason for not upgrading to version 14.x.x?

javsalgar avatar Apr 18 '24 12:04 javsalgar

rabbitmq-12.0.0

you mean rabbitmq-14.0.0?

sachinmane1983 avatar Apr 18 '24 12:04 sachinmane1983

Yes, that chart version

javsalgar avatar Apr 18 '24 14:04 javsalgar

used rabbitmq-14.0.0 but still same issue

sachinmane1983 avatar Apr 24 '24 08:04 sachinmane1983

So, if I understand correctly, you are able to authenticate with user user when entering the pod but the probe is failing because of incorrect credentials, is that correct?

javsalgar avatar Apr 25 '24 07:04 javsalgar

We observed that with chart v14, rabbitmq startup takes few minutes (3-4 minutes). During this time, livenessprobe fails and rabbitmq is restarted. It messes up credential database. Workaround with setting initialDelaySeconds of liveness probe to few minutes seem to help.

tomasz-torcz-airspace-intelligence avatar May 07 '24 09:05 tomasz-torcz-airspace-intelligence

Same here. I've incresed initialDelaySeconds up to 300, but with the same result:

[38;5;6mrabbitmq [38;5;5m22:19:33.15 [0m[38;5;2mINFO [0m ==> 
[38;5;6mrabbitmq [38;5;5m22:19:33.15 [0m[38;5;2mINFO [0m ==> [1mWelcome to the Bitnami rabbitmq container[0m
[38;5;6mrabbitmq [38;5;5m22:19:33.15 [0m[38;5;2mINFO [0m ==> Subscribe to project updates by watching [1mhttps://github.com/bitnami/containers[0m
[38;5;6mrabbitmq [38;5;5m22:19:33.15 [0m[38;5;2mINFO [0m ==> Submit issues and feature requests at [1mhttps://github.com/bitnami/containers/issues[0m
[38;5;6mrabbitmq [38;5;5m22:19:33.20 [0m[38;5;2mINFO [0m ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit [1mhttps://bitnami.com/enterprise[0m
[38;5;6mrabbitmq [38;5;5m22:19:33.20 [0m[38;5;2mINFO [0m ==> 
[38;5;6mrabbitmq [38;5;5m22:19:33.20 [0m[38;5;2mINFO [0m ==> ** Starting RabbitMQ setup **
[38;5;6mrabbitmq [38;5;5m22:19:33.22 [0m[38;5;2mINFO [0m ==> Validating settings in RABBITMQ_* env vars..
[38;5;6mrabbitmq [38;5;5m22:19:33.23 [0m[38;5;2mINFO [0m ==> Initializing RabbitMQ...
[38;5;6mrabbitmq [38;5;5m22:19:33.31 [0m[38;5;2mINFO [0m ==> Persisted data detected. Restoring...
[38;5;6mrabbitmq [38;5;5m22:19:33.31 [0m[38;5;2mINFO [0m ==> No custom scripts in /docker-entrypoint-initdb.d
[38;5;6mrabbitmq [38;5;5m22:19:33.32 [0m[38;5;2mINFO [0m ==> ** RabbitMQ setup finished! **

[38;5;6mrabbitmq [38;5;5m22:19:33.33 [0m[38;5;2mINFO [0m ==> ** Starting RabbitMQ **
2024-05-21 22:19:39.911835+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-05-21 22:19:39.917118+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-05-21 22:19:39.917843+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-05-21 22:19:39.923637+00:00 [info] <0.254.0> ra: starting system quorum_queues
2024-05-21 22:19:39.923691+00:00 [info] <0.254.0> starting Ra system: quorum_queues in directory: /opt/bitnami/rabbitmq/.rabbitmq/mnesia/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local/quorum/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local
2024-05-21 22:19:40.027930+00:00 [info] <0.268.0> ra system 'quorum_queues' running pre init for 0 registered servers
2024-05-21 22:19:40.034222+00:00 [info] <0.269.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2024-05-21 22:19:40.104849+00:00 [notice] <0.274.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2024-05-21 22:19:40.125034+00:00 [info] <0.254.0> ra: starting system coordination
2024-05-21 22:19:40.125105+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /opt/bitnami/rabbitmq/.rabbitmq/mnesia/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local/coordination/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local
2024-05-21 22:19:40.129722+00:00 [info] <0.282.0> ra system 'coordination' running pre init for 1 registered servers
2024-05-21 22:19:40.144866+00:00 [info] <0.283.0> ra: meta data store initialised for system coordination. 1 record(s) recovered
2024-05-21 22:19:40.145102+00:00 [notice] <0.288.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2024-05-21 22:19:40.156153+00:00 [info] <0.254.0> ra: starting system coordination
2024-05-21 22:19:40.156210+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /opt/bitnami/rabbitmq/.rabbitmq/mnesia/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local/coordination/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local
2024-05-21 22:19:40.319782+00:00 [info] <0.254.0> Waiting for Khepri leader for 30000 ms, 9 retries left
2024-05-21 22:19:40.337459+00:00 [info] <0.254.0> Khepri leader elected
2024-05-21 22:19:40.871508+00:00 [notice] <0.293.0> RabbitMQ metadata store: candidate -> leader in term: 7 machine version: 0
2024-05-21 22:19:41.430052+00:00 [info] <0.254.0> 
2024-05-21 22:19:41.430052+00:00 [info] <0.254.0>  Starting RabbitMQ 3.13.2 on Erlang 26.2.5 [jit]
2024-05-21 22:19:41.430052+00:00 [info] <0.254.0>  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2024-05-21 22:19:41.430052+00:00 [info] <0.254.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com

  ##  ##      RabbitMQ 3.13.2
  ##  ##
  ##########  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
  ######  ##
  ##########  Licensed under the MPL 2.0. Website: https://rabbitmq.com

  Erlang:      26.2.5 [jit]
  TLS Library: OpenSSL - OpenSSL 3.0.11 19 Sep 2023
  Release series support status: supported

  Doc guides:  https://www.rabbitmq.com/docs
  Support:     https://www.rabbitmq.com/docs/contact
  Tutorials:   https://www.rabbitmq.com/tutorials
  Monitoring:  https://www.rabbitmq.com/docs/monitoring
  Upgrading:   https://www.rabbitmq.com/docs/upgrade

  Logs: <stdout>

  Config file(s): /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf

  Starting broker...2024-05-21 22:19:41.431180+00:00 [info] <0.254.0> 
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  node           : rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  home dir       : /opt/bitnami/rabbitmq/.rabbitmq
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  config file(s) : /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  cookie hash    : n9w5Mzfk9SePRpWHqM6VKQ==
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  log(s)         : <stdout>
2024-05-21 22:19:41.431180+00:00 [info] <0.254.0>  data dir       : /opt/bitnami/rabbitmq/.rabbitmq/mnesia/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local
2024-05-21 22:19:42.322297+00:00 [info] <0.254.0> Running boot step pre_boot defined by app rabbit
2024-05-21 22:19:42.322447+00:00 [info] <0.254.0> Running boot step rabbit_global_counters defined by app rabbit
2024-05-21 22:19:42.322833+00:00 [info] <0.254.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2024-05-21 22:19:42.322959+00:00 [info] <0.254.0> Running boot step rabbit_core_metrics defined by app rabbit
2024-05-21 22:19:42.323362+00:00 [info] <0.254.0> Running boot step rabbit_alarm defined by app rabbit
2024-05-21 22:19:42.330933+00:00 [info] <0.397.0> Memory high watermark set to 12837 MiB (13461115699 bytes) of 32093 MiB (33652789248 bytes) total
2024-05-21 22:19:42.333098+00:00 [info] <0.399.0> Enabling free disk space monitoring (disk free space: 8331014144, total memory: 33652789248)
2024-05-21 22:19:42.333147+00:00 [info] <0.399.0> Disk free limit set to 50MB
2024-05-21 22:19:42.334390+00:00 [info] <0.254.0> Running boot step code_server_cache defined by app rabbit
2024-05-21 22:19:42.334458+00:00 [info] <0.254.0> Running boot step file_handle_cache defined by app rabbit
2024-05-21 22:19:42.402565+00:00 [info] <0.402.0> Limiting to approx 1048479 file handles (943629 sockets)
2024-05-21 22:19:42.402762+00:00 [info] <0.403.0> FHC read buffering: OFF
2024-05-21 22:19:42.402801+00:00 [info] <0.403.0> FHC write buffering: ON
2024-05-21 22:19:42.403123+00:00 [info] <0.254.0> Running boot step worker_pool defined by app rabbit
2024-05-21 22:19:42.403181+00:00 [info] <0.343.0> Will use 8 processes for default worker pool
2024-05-21 22:19:42.403209+00:00 [info] <0.343.0> Starting worker pool 'worker_pool' with 8 processes in it
2024-05-21 22:19:42.403642+00:00 [info] <0.254.0> Running boot step database defined by app rabbit
2024-05-21 22:19:42.403934+00:00 [info] <0.254.0> Peer discovery: configured backend: rabbit_peer_discovery_k8s
2024-05-21 22:19:42.405047+00:00 [info] <0.254.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2024-05-21 22:19:42.409261+00:00 [info] <0.254.0> Successfully synced tables from a peer
2024-05-21 22:19:42.422178+00:00 [info] <0.254.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2024-05-21 22:19:42.422280+00:00 [info] <0.254.0> Successfully synced tables from a peer
2024-05-21 22:19:42.422560+00:00 [info] <0.254.0> Peer discovery: will register with peer discovery backend rabbit_peer_discovery_k8s
2024-05-21 22:19:42.914531+00:00 [info] <0.254.0> Running boot step tracking_metadata_store defined by app rabbit
2024-05-21 22:19:42.914698+00:00 [info] <0.427.0> Setting up a table for connection tracking on this node: tracked_connection
2024-05-21 22:19:42.914768+00:00 [info] <0.427.0> Setting up a table for per-vhost connection counting on this node: tracked_connection_per_vhost
2024-05-21 22:19:42.914858+00:00 [info] <0.427.0> Setting up a table for per-user connection counting on this node: tracked_connection_per_user
2024-05-21 22:19:42.914906+00:00 [info] <0.427.0> Setting up a table for channel tracking on this node: tracked_channel
2024-05-21 22:19:42.914995+00:00 [info] <0.427.0> Setting up a table for channel tracking on this node: tracked_channel_per_user
2024-05-21 22:19:42.915100+00:00 [info] <0.254.0> Running boot step networking_metadata_store defined by app rabbit
2024-05-21 22:19:42.915190+00:00 [info] <0.254.0> Running boot step feature_flags defined by app rabbit
2024-05-21 22:19:42.915361+00:00 [info] <0.254.0> Running boot step codec_correctness_check defined by app rabbit
2024-05-21 22:19:42.915416+00:00 [info] <0.254.0> Running boot step external_infrastructure defined by app rabbit
2024-05-21 22:19:42.915496+00:00 [info] <0.254.0> Running boot step rabbit_event defined by app rabbit
2024-05-21 22:19:42.915649+00:00 [info] <0.254.0> Running boot step rabbit_registry defined by app rabbit
2024-05-21 22:19:42.915757+00:00 [info] <0.254.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2024-05-21 22:19:42.915872+00:00 [info] <0.254.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2024-05-21 22:19:42.915971+00:00 [info] <0.254.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2024-05-21 22:19:42.916061+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2024-05-21 22:19:42.916170+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2024-05-21 22:19:42.916228+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2024-05-21 22:19:42.916278+00:00 [info] <0.254.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2024-05-21 22:19:42.916334+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2024-05-21 22:19:42.916384+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2024-05-21 22:19:42.916446+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2024-05-21 22:19:42.916511+00:00 [info] <0.254.0> Running boot step rabbit_priority_queue defined by app rabbit
2024-05-21 22:19:42.916545+00:00 [info] <0.254.0> Priority queues enabled, real BQ is rabbit_variable_queue
2024-05-21 22:19:42.916623+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2024-05-21 22:19:42.916686+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2024-05-21 22:19:42.916760+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_random defined by app rabbit
2024-05-21 22:19:42.916814+00:00 [info] <0.254.0> Running boot step kernel_ready defined by app rabbit
2024-05-21 22:19:42.916847+00:00 [info] <0.254.0> Running boot step ldap_pool defined by app rabbitmq_auth_backend_ldap
2024-05-21 22:19:42.916918+00:00 [info] <0.343.0> Starting worker pool 'ldap_pool' with 64 processes in it
2024-05-21 22:19:42.919978+00:00 [info] <0.254.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2024-05-21 22:19:42.920119+00:00 [info] <0.254.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2024-05-21 22:19:42.923491+00:00 [info] <0.501.0> epmd monitor knows us, inter-node communication (distribution) port: 25672
2024-05-21 22:19:42.923607+00:00 [info] <0.254.0> Running boot step guid_generator defined by app rabbit
2024-05-21 22:19:42.935271+00:00 [info] <0.254.0> Running boot step rabbit_node_monitor defined by app rabbit
2024-05-21 22:19:42.935699+00:00 [info] <0.505.0> Starting rabbit_node_monitor (in autoheal mode)
2024-05-21 22:19:42.935820+00:00 [info] <0.254.0> Running boot step delegate_sup defined by app rabbit
2024-05-21 22:19:42.936459+00:00 [info] <0.254.0> Running boot step rabbit_memory_monitor defined by app rabbit
2024-05-21 22:19:42.936675+00:00 [info] <0.254.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2024-05-21 22:19:42.936768+00:00 [info] <0.254.0> Running boot step core_initialized defined by app rabbit
2024-05-21 22:19:42.936811+00:00 [info] <0.254.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2024-05-21 22:19:42.936896+00:00 [info] <0.254.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2024-05-21 22:19:42.936956+00:00 [info] <0.254.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2024-05-21 22:19:42.937042+00:00 [info] <0.254.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2024-05-21 22:19:42.948424+00:00 [info] <0.254.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2024-05-21 22:19:42.948821+00:00 [info] <0.254.0> Running boot step rabbit_policies defined by app rabbit
2024-05-21 22:19:42.949088+00:00 [info] <0.254.0> Running boot step rabbit_policy defined by app rabbit
2024-05-21 22:19:42.949141+00:00 [info] <0.254.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2024-05-21 22:19:42.949184+00:00 [info] <0.254.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2024-05-21 22:19:42.949248+00:00 [info] <0.254.0> Running boot step rabbit_quorum_queue defined by app rabbit
2024-05-21 22:19:42.949347+00:00 [info] <0.254.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2024-05-21 22:19:42.949446+00:00 [info] <0.254.0> Running boot step rabbit_vhost_limit defined by app rabbit
2024-05-21 22:19:42.949516+00:00 [info] <0.254.0> Running boot step rabbit_federation_parameters defined by app rabbitmq_federation
2024-05-21 22:19:42.949599+00:00 [info] <0.254.0> Running boot step rabbit_federation_supervisor defined by app rabbitmq_federation
2024-05-21 22:19:43.003968+00:00 [info] <0.254.0> Running boot step rabbit_federation_queue defined by app rabbitmq_federation
2024-05-21 22:19:43.004189+00:00 [info] <0.254.0> Running boot step rabbit_federation_upstream_exchange defined by app rabbitmq_federation
2024-05-21 22:19:43.004270+00:00 [info] <0.254.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2024-05-21 22:19:43.004331+00:00 [info] <0.254.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2024-05-21 22:19:43.004375+00:00 [info] <0.254.0> Management plugin: using rates mode 'basic'
2024-05-21 22:19:43.004662+00:00 [info] <0.254.0> Running boot step recovery defined by app rabbit
2024-05-21 22:19:43.015320+00:00 [info] <0.555.0> Making sure data directory '/opt/bitnami/rabbitmq/.rabbitmq/mnesia/rabbit@monitoring-rabbitmq-0.monitoring-rabbitmq-headless.monitoring.svc.cluster.local/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2024-05-21 22:19:43.025179+00:00 [info] <0.555.0> Starting message stores for vhost '/'
2024-05-21 22:19:43.025372+00:00 [info] <0.564.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2024-05-21 22:19:43.027149+00:00 [info] <0.555.0> Started message store of type transient for vhost '/'
2024-05-21 22:19:43.027339+00:00 [info] <0.568.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2024-05-21 22:19:43.028946+00:00 [info] <0.555.0> Started message store of type persistent for vhost '/'
2024-05-21 22:19:43.103281+00:00 [info] <0.555.0> Recovering 9 queues of type rabbit_classic_queue took 87ms
2024-05-21 22:19:43.103373+00:00 [info] <0.555.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2024-05-21 22:19:43.103472+00:00 [info] <0.555.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2024-05-21 22:19:43.107778+00:00 [info] <0.254.0> Running boot step empty_db_check defined by app rabbit
2024-05-21 22:19:43.107824+00:00 [info] <0.254.0> Will not seed default virtual host and user: have definitions to load...
2024-05-21 22:19:43.107877+00:00 [info] <0.254.0> Running boot step rabbit_observer_cli defined by app rabbit
2024-05-21 22:19:43.107962+00:00 [info] <0.254.0> Running boot step rabbit_looking_glass defined by app rabbit
2024-05-21 22:19:43.108011+00:00 [info] <0.254.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2024-05-21 22:19:43.108159+00:00 [info] <0.254.0> Running boot step background_gc defined by app rabbit
2024-05-21 22:19:43.108252+00:00 [info] <0.254.0> Running boot step routing_ready defined by app rabbit
2024-05-21 22:19:43.108279+00:00 [info] <0.254.0> Running boot step pre_flight defined by app rabbit
2024-05-21 22:19:43.108312+00:00 [info] <0.254.0> Running boot step notify_cluster defined by app rabbit
2024-05-21 22:19:43.108348+00:00 [info] <0.254.0> Running boot step networking defined by app rabbit
2024-05-21 22:19:43.108437+00:00 [info] <0.254.0> Running boot step rabbit_quorum_queue_periodic_membership_reconciliation defined by app rabbit
2024-05-21 22:19:43.108701+00:00 [info] <0.254.0> Running boot step definition_import_worker_pool defined by app rabbit
2024-05-21 22:19:43.108774+00:00 [info] <0.343.0> Starting worker pool 'definition_import_pool' with 8 processes in it
2024-05-21 22:19:43.109422+00:00 [info] <0.254.0> Running boot step cluster_name defined by app rabbit
2024-05-21 22:19:43.109499+00:00 [info] <0.254.0> Setting cluster name to 'monitoring-rabbitmq' as configured
2024-05-21 22:19:43.113335+00:00 [info] <0.254.0> Running boot step direct_client defined by app rabbit
2024-05-21 22:19:43.113424+00:00 [info] <0.254.0> Running boot step rabbit_federation_exchange defined by app rabbitmq_federation
2024-05-21 22:19:43.113620+00:00 [info] <0.254.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2024-05-21 22:19:43.113727+00:00 [info] <0.676.0> Resetting node maintenance status
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0> Deprecated features: `management_metrics_collection`: Feature `management_metrics_collection` is deprecated.
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0> By default, this feature can still be used for now.
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0> Its use will not be permitted by default in a future minor RabbitMQ version and the feature will be removed from a future major RabbitMQ version; actual versions to be determined.
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0> To continue using this feature when it is not permitted by default, set the following parameter in your configuration:
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0>     "deprecated_features.permit.management_metrics_collection = true"
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0> To test RabbitMQ as if the feature was removed, set this in your configuration:
2024-05-21 22:19:43.122305+00:00 [warning] <0.699.0>     "deprecated_features.permit.management_metrics_collection = false"
2024-05-21 22:19:47.403099+00:00 [info] <0.736.0> Management plugin: HTTP (non-TLS) listener started on port 15672
2024-05-21 22:19:47.403267+00:00 [info] <0.766.0> Statistics database started.
2024-05-21 22:19:47.403338+00:00 [info] <0.765.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2024-05-21 22:19:47.410078+00:00 [info] <0.781.0> Peer discovery: enabling node cleanup (will only log warnings). Check interval: 10 seconds.
2024-05-21 22:19:47.410555+00:00 [warning] <0.792.0> LDAP plugin loaded, but rabbit_auth_backend_ldap is not in the list of auth_backends. LDAP auth will not work.
2024-05-21 22:19:47.412845+00:00 [info] <0.800.0> Prometheus metrics: HTTP (non-TLS) listener started on port 9419
2024-05-21 22:19:47.412960+00:00 [info] <0.676.0> Ready to start client connection listeners
2024-05-21 22:19:47.414635+00:00 [info] <0.844.0> started TCP listener on [::]:5672
 completed with 9 plugins.
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0> Server startup complete; 9 plugins started.
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_prometheus
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_federation
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_auth_backend_ldap
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_peer_discovery_k8s
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_peer_discovery_common
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_management
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_management_agent
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * rabbitmq_web_dispatch
2024-05-21 22:19:47.530713+00:00 [info] <0.676.0>  * oauth2_client
2024-05-21 22:19:47.610430+00:00 [info] <0.9.0> Time to start RabbitMQ: 13572 ms
2024-05-21 22:20:01.346229+00:00 [warning] <0.849.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:20:31.354234+00:00 [warning] <0.854.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:20:59.716841+00:00 [warning] <0.859.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:21:01.345980+00:00 [warning] <0.861.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:21:31.348459+00:00 [warning] <0.875.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:22:01.347981+00:00 [warning] <0.885.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:22:12.720157+00:00 [warning] <0.888.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:22:31.358400+00:00 [warning] <0.892.0> HTTP access denied: user 'admin' - invalid credentials
2024-05-21 22:23:01.349004+00:00 [warning] <0.898.0> HTTP access denied: user 'admin' - invalid credentials

My config is really simple:

rabbitmq:
  auth:
    username: admin
    existingPasswordSecret: *existingSecret
    existingSecretPasswordKey: oncall-rabbitmq-password
  livenessProbe:
    initialDelaySeconds: 300

I've tryed to change the password of user 'admin' but get this message:

I have no name!@monitoring-rabbitmq-0:/$ rabbitmqctl change_password admin XXXX
Changing password for user "admin" ...
Error:
User "admin" does not exist

But if I try to change the password to the user 'user' I have no errors:

I have no name!@monitoring-rabbitmq-0:/$ rabbitmqctl change_password user XXXX
Changing password for user "user" ...

So, my new config is:

rabbitmq:
  auth:
    username: user
    existingPasswordSecret: *existingSecret
    existingSecretPasswordKey: oncall-rabbitmq-password

So the issue is that the Values.auth.user doesn't change the user in container.

eirisdg avatar May 21 '24 22:05 eirisdg

Hi,

If the issue has to do with a slow startup, make sure that you have set the resources section.

javsalgar avatar May 23 '24 08:05 javsalgar

The issue is not about startup time, is about the user created

El jue, 23 may 2024, 10:08, Javier J. Salmerón-García < @.***> escribió:

Hi,

If the issue has to do with a slow startup, make sure that you have set the resources section.

— Reply to this email directly, view it on GitHub https://github.com/bitnami/charts/issues/25191#issuecomment-2126490668, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABI6O27SZ77TZ2WHEMNC5RTZDWPYXAVCNFSM6AAAAABGJQ3XNSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRWGQ4TANRWHA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

eirisdg avatar May 23 '24 08:05 eirisdg

I see that it was detecting persisted data, could you ensure it is a clean installation?

javsalgar avatar May 24 '24 08:05 javsalgar

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

github-actions[bot] avatar Jun 09 '24 01:06 github-actions[bot]

Make sure to delete all PVC's if you reinstall the Chart: I had the same issue, while using the chart in my development area. After multiple changes to my Helm Chart (with this Chart as a Sub Chart) i faced this issue all the time, even after reinstalling the chart. Turns out to be an issue with the PVC's, since these are not deleted if you uninstall the chart. After removing them and reinstalling the chart, i was no longer facing the issue with the invalid user credentials.

focus-17 avatar Jun 14 '24 14:06 focus-17

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.

github-actions[bot] avatar Jun 20 '24 01:06 github-actions[bot]