st2
st2 copied to clipboard
StackStorm
helm installs stackstorm-ha, mongo prompts the following error
System version and kubernetes version
# cat /etc/redhat-release
CentOS Linux release 7.9.2009 (Core)
# kubectl version
Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.8", GitCommit:"fd5d41537aee486160ad9b5356a9d82363273721", GitTreeState:"clean", BuildDate:"2021-02-17T12:41:51Z", GoVersion:"go1.15.8", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.8", GitCommit:"fd5d41537aee486160ad9b5356a9d82363273721", GitTreeState:"clean", BuildDate:"2021-02-17T12:33:08Z", GoVersion:"go1.15.8", Compiler:"gc", Platform:"linux/amd64"}
Charts version
# cat Chart.yaml
apiVersion: v2
appVersion: "3.6"
dependencies:
- condition: rabbitmq.enabled
name: rabbitmq
repository: https://charts.bitnami.com/bitnami
version: 8.0.2
- condition: mongodb.enabled
name: mongodb
repository: https://charts.bitnami.com/bitnami
version: 10.0.1
- condition: external-dns.enabled
name: external-dns
repository: https://charts.bitnami.com/bitnami
version: 4.0.0
- condition: redis.enabled
name: redis
repository: https://charts.bitnami.com/bitnami
version: 12.3.2
description: StackStorm K8s Helm Chart, optimized for running StackStorm in HA environment.
home: https://stackstorm.com/
icon: https://landscape.cncf.io/logos/stack-storm.svg
keywords:
- st2
- stackstorm
- devops
- SRE
- automation
- chatops
- event-driven
- auto-remediation
- IFTTT
- HA
maintainers:
- email: [email protected]
name: Eugen Cusmaunsa
url: https://github.com/armab
name: stackstorm-ha
version: 0.80.0
helm installs stackstorm-ha, mongo prompts the following error
2022-01-10 14:39:16,766 INFO [-] Using Python: 3.6.9 (/opt/stackstorm/st2/bin/python)
2022-01-10 14:39:16,767 INFO [-] Using fs encoding: utf-8, default encoding: utf-8, locale: en_US.UTF-8, LANG env variable: en_US.UTF-8, PYTHONIOENCODING env variable: notset
2022-01-10 14:39:16,767 INFO [-] Using config files: /etc/st2/st2.conf,/etc/st2/st2.docker.conf,/etc/st2/st2.user.conf
2022-01-10 14:39:16,768 INFO [-] Using logging config: /etc/st2/logging.actionrunner.conf
2022-01-10 14:39:16,768 INFO [-] Using coordination driver: redis
2022-01-10 14:39:16,768 INFO [-] Using metrics driver: noop
2022-01-10 14:39:16,791 INFO [-] Connecting to database "st2" @ "stackstorm-mongodb-0.stackstorm-mongodb-headless:27017,stackstorm-mongodb-1.stackstorm-mongodb-headless:27017,stackstorm-mongodb-2.stackstorm-mongodb-headless:27017 (replica set)" as user "st2-admin".
2022-01-10 14:39:19,801 ERROR [-] Failed to connect to database "st2" @ "stackstorm-mongodb-0.stackstorm-mongodb-headless:27017,stackstorm-mongodb-1.stackstorm-mongodb-headless:27017,stackstorm-mongodb-2.stackstorm-mongodb-headless:27017 (replica set)" as user "st2-admin": No replica set members found yet, Timeout: 3.0s, Topology Description: <TopologyDescription id: 61dc4514ce477e1b34d7fef7, topology_type: ReplicaSetNoPrimary, servers: [<ServerDescription ('stackstorm-mongodb-0.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-1.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-2.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>]>
2022-01-10 14:39:19,802 ERROR [-] (PID=1) Worker quit due to exception.
Traceback (most recent call last):
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2actions/cmd/actionrunner.py", line 98, in main
_setup()
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2actions/cmd/actionrunner.py", line 58, in _setup
capabilities=capabilities,
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/service_setup.py", line 249, in setup
db_setup()
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/database_setup.py", line 55, in db_setup
connection = db_init.db_setup_with_retry(**db_cfg)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/persistence/db_init.py", line 93, in db_setup_with_retry
ssl_match_hostname=ssl_match_hostname,
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/persistence/db_init.py", line 58, in db_func_with_retry
return retrying_obj.call(db_func, *args, **kwargs)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 206, in call
return attempt.get(self._wrap_exception)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 247, in get
six.reraise(self.value[0], self.value[1], self.value[2])
File "/opt/stackstorm/st2/lib/python3.6/site-packages/six.py", line 696, in reraise
raise value
File "/opt/stackstorm/st2/lib/python3.6/site-packages/retrying.py", line 200, in call
attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 251, in db_setup
ssl_match_hostname=ssl_match_hostname,
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 213, in _db_connect
raise e
File "/opt/stackstorm/st2/lib/python3.6/site-packages/st2common/models/db/__init__.py", line 204, in _db_connect
connection.admin.command("ping")
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/database.py", line 737, in command
read_preference, session) as (sock_info, slave_ok):
File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
return next(self.gen)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/mongo_client.py", line 1325, in _socket_for_reads
server = self._select_server(read_preference, session)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/mongo_client.py", line 1278, in _select_server
server = topology.select_server(server_selector)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 243, in select_server
address))
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 200, in select_servers
selector, server_timeout, address)
File "/opt/stackstorm/st2/lib/python3.6/site-packages/pymongo/topology.py", line 217, in _select_servers_loop
(self._error_message(selector), timeout, self.description))
pymongo.errors.ServerSelectionTimeoutError: No replica set members found yet, Timeout: 3.0s, Topology Description: <TopologyDescription id: 61dc4514ce477e1b34d7fef7, topology_type: ReplicaSetNoPrimary, servers: [<ServerDescription ('stackstorm-mongodb-0.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-1.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>, <ServerDescription ('stackstorm-mongodb-2.stackstorm-mongodb-headless', 27017) server_type: Unknown, rtt: None>]>
Just curious did you check if mongodb with its volume(s) already active/provisioned and ready to accept connections? Also, was this one off or it prevents successful completion of StackStorm deployment process every time?
Just curious did you check if
mongodbwith its volume(s) already active/provisioned and ready to accept connections? Also, was this one off or it prevents successful completion of StackStorm deployment process every time?
mongo logs and pod status
>>> get pvc -n stackstorm
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
data-stackstorm-rabbitmq-0 Bound pvc-381b86ff-b381-4b4b-a945-f4c4da59d2ab 8Gi RWO openebs-hostpath 17m
data-stackstorm-rabbitmq-1 Bound pvc-a7dd93a4-df7d-4584-a28b-592e0766521a 8Gi RWO openebs-hostpath 12m
data-stackstorm-rabbitmq-2 Bound pvc-7846301b-fd35-44a4-ab57-98c4d6817324 8Gi RWO openebs-hostpath 12m
datadir-stackstorm-mongodb-0 Bound pvc-bcbd437d-b6c9-462a-baf8-f6040feb2dda 8Gi RWO openebs-hostpath 17m
datadir-stackstorm-mongodb-1 Bound pvc-84bc2140-452f-452c-8764-e9466407e066 8Gi RWO openebs-hostpath 13m
datadir-stackstorm-mongodb-2 Bound pvc-3dae01a8-267f-4da8-a48c-5e39c955056a 8Gi RWO openebs-hostpath 13m
redis-data-stackstorm-redis-node-0 Bound pvc-c96ca4ac-cc5f-47c2-b805-98052dd0004d 8Gi RWO openebs-hostpath 17m
redis-data-stackstorm-redis-node-1 Bound pvc-1f751c4c-8911-452a-8bb9-c8794f71439a 8Gi RWO openebs-hostpath 13m
redis-data-stackstorm-redis-node-2 Bound pvc-456c40bd-6862-4542-b764-88578af4b8e2 8Gi RWO openebs-hostpath 12m
>>> get pv
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS REASON AGE
pvc-1f751c4c-8911-452a-8bb9-c8794f71439a 8Gi RWO Delete Bound stackstorm/redis-data-stackstorm-redis-node-1 openebs-hostpath 20m
pvc-381b86ff-b381-4b4b-a945-f4c4da59d2ab 8Gi RWO Delete Bound stackstorm/data-stackstorm-rabbitmq-0 openebs-hostpath 22m
pvc-3dae01a8-267f-4da8-a48c-5e39c955056a 8Gi RWO Delete Bound stackstorm/datadir-stackstorm-mongodb-2 openebs-hostpath 21m
pvc-456c40bd-6862-4542-b764-88578af4b8e2 8Gi RWO Delete Bound stackstorm/redis-data-stackstorm-redis-node-2 openebs-hostpath 20m
pvc-7846301b-fd35-44a4-ab57-98c4d6817324 8Gi RWO Delete Bound stackstorm/data-stackstorm-rabbitmq-2 openebs-hostpath 19m
pvc-84bc2140-452f-452c-8764-e9466407e066 8Gi RWO Delete Bound stackstorm/datadir-stackstorm-mongodb-1 openebs-hostpath 21m
pvc-a7dd93a4-df7d-4584-a28b-592e0766521a 8Gi RWO Delete Bound stackstorm/data-stackstorm-rabbitmq-1 openebs-hostpath 20m
pvc-bcbd437d-b6c9-462a-baf8-f6040feb2dda 8Gi RWO Delete Bound stackstorm/datadir-stackstorm-mongodb-0 openebs-hostpath 23m
pvc-c96ca4ac-cc5f-47c2-b805-98052dd0004d 8Gi RWO Delete Bound stackstorm/redis-data-stackstorm-redis-node-0 openebs-hostpath 23m
>>> get pod -n stackstorm
NAME READY STATUS RESTARTS AGE
stackstorm-job-st2-apikey-load-8t7fc 0/1 Init:1/3 0 7m48s
stackstorm-mongodb-0 1/1 Running 0 7m49s
stackstorm-mongodb-1 1/1 Running 0 3m58s
stackstorm-mongodb-2 1/1 Running 0 3m44s
stackstorm-rabbitmq-0 1/1 Running 0 7m49s
stackstorm-rabbitmq-1 1/1 Running 0 2m59s
stackstorm-rabbitmq-2 1/1 Running 0 2m20s
stackstorm-redis-node-0 2/2 Running 0 7m49s
stackstorm-redis-node-1 2/2 Running 0 3m18s
stackstorm-redis-node-2 2/2 Running 0 3m8s
stackstorm-st2actionrunner-698f747fb6-pqs77 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2api-76f4d47dd6-tlb9d 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2auth-66ff6ccd44-jz48b 0/1 CrashLoopBackOff 4 7m48s
stackstorm-st2chatops-79b477ff84-chqtk 1/1 Running 0 7m49s
stackstorm-st2client-76bc84bb6f-l2r7d 1/1 Running 0 7m49s
stackstorm-st2garbagecollector-5787b8997f-2w25f 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2notifier-68fbc44b54-t2hx4 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2rulesengine-64fb7cc876-5lzz8 0/1 CrashLoopBackOff 4 7m48s
stackstorm-st2scheduler-6c57f76999-xcbzr 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2sensorcontainer-6f5b467686-xxcdb 0/1 Error 4 7m48s
stackstorm-st2stream-69fc49f547-7bj84 0/1 CrashLoopBackOff 4 7m49s
stackstorm-st2timersengine-868db79948-zbcxs 0/1 CrashLoopBackOff 4 7m48s
stackstorm-st2web-688568565f-jhztq 1/1 Running 0 7m49s
stackstorm-st2workflowengine-7d9ff8759-jhpp6 0/1 CrashLoopBackOff 4 7m49s
>>> logs -n stackstorm stackstorm-mongodb-0
Advertised Hostname: stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local
Pod name matches initial primary pod name, configuring node as a primary
mongodb 04:59:22.66
mongodb 04:59:22.66 Welcome to the Bitnami mongodb container
mongodb 04:59:22.66 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-mongodb
mongodb 04:59:22.66 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-mongodb/issues
mongodb 04:59:22.66
mongodb 04:59:22.66 INFO ==> ** Starting MongoDB setup **
mongodb 04:59:22.69 INFO ==> Validating settings in MONGODB_* env vars...
mongodb 04:59:22.70 INFO ==> Initializing MongoDB...
mongodb 04:59:22.72 INFO ==> Deploying MongoDB from scratch...
mongodb 04:59:23.47 INFO ==> Creating users...
mongodb 04:59:23.47 INFO ==> Creating root user...
MongoDB shell version v4.0.27
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("7e6091f2-dfc0-48d8-9d42-47ceef23ce43") }
MongoDB server version: 4.0.27
Successfully added user: {
"user" : "root",
"roles" : [
{
"role" : "root",
"db" : "admin"
}
]
}
bye
mongodb 04:59:23.59 INFO ==> Creating user 'st2-admin'...
MongoDB shell version v4.0.27
connecting to: mongodb://127.0.0.1:27017/?gssapiServiceName=mongodb
Implicit session: session { "id" : UUID("cb6ea13d-4374-419c-a480-996bc8f3953c") }
MongoDB server version: 4.0.27
Successfully added user: {
"user" : "st2-admin",
"roles" : [
{
"role" : "readWrite",
"db" : "st2"
}
]
}
bye
mongodb 04:59:23.72 INFO ==> Users created
mongodb 04:59:23.72 INFO ==> Writing keyfile for replica set authentication...
mongodb 04:59:23.74 INFO ==> Configuring MongoDB replica set...
mongodb 04:59:23.75 INFO ==> Stopping MongoDB...
mongodb 04:59:25.97 INFO ==> Configuring MongoDB primary node
mongodb 04:59:26.12 INFO ==> Stopping MongoDB...
mongodb 04:59:28.14 INFO ==> Enabling authentication...
mongodb 04:59:28.16 INFO ==> ** MongoDB setup finished! **
mongodb 04:59:28.19 INFO ==> ** Starting MongoDB **
2022-01-11T04:59:28.212+0000 I CONTROL [main] ***** SERVER RESTARTED *****
2022-01-11T04:59:28.215+0000 I CONTROL [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] MongoDB starting : pid=1 port=27017 dbpath=/bitnami/mongodb/data/db 64-bit host=stackstorm-mongodb-0
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] db version v4.0.27
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] git version: d47b151b55f286546e7c7c98888ae0577856ca20
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.1.0l 10 Sep 2019
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] allocator: tcmalloc
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] modules: none
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] build environment:
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] distmod: debian92
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] distarch: x86_64
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] target_arch: x86_64
2022-01-11T04:59:28.231+0000 I CONTROL [initandlisten] options: { config: "/opt/bitnami/mongodb/conf/mongodb.conf", net: { bindIpAll: true, ipv6: false, port: 27017, unixDomainSocket: { enabled: true, pathPrefix: "/opt/bitnami/mongodb/tmp" } }, processManagement: { fork: false, pidFilePath: "/opt/bitnami/mongodb/tmp/mongodb.pid" }, replication: { enableMajorityReadConcern: true, replSetName: "rs0" }, security: { authorization: "enabled", keyFile: "/opt/bitnami/mongodb/conf/keyfile" }, setParameter: { enableLocalhostAuthBypass: "false" }, storage: { dbPath: "/bitnami/mongodb/data/db", directoryPerDB: false, journal: { enabled: true } }, systemLog: { destination: "file", logAppend: true, logRotate: "reopen", path: "/opt/bitnami/mongodb/logs/mongodb.log", quiet: false, verbosity: 0 } }
2022-01-11T04:59:28.231+0000 I STORAGE [initandlisten] Detected data files in /bitnami/mongodb/data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2022-01-11T04:59:28.231+0000 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=23531M,cache_overflow=(file_max=0M),session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),statistics_log=(wait=0),verbose=(recovery_progress),
2022-01-11T04:59:29.007+0000 I STORAGE [initandlisten] WiredTiger message [1641877169:7263][1:0x7f0f1de1f080], txn-recover: Main recovery loop: starting at 2/45952 to 3/256
2022-01-11T04:59:29.007+0000 I STORAGE [initandlisten] WiredTiger message [1641877169:7712][1:0x7f0f1de1f080], txn-recover: Recovering log 2 through 3
2022-01-11T04:59:29.072+0000 I STORAGE [initandlisten] WiredTiger message [1641877169:72531][1:0x7f0f1de1f080], txn-recover: Recovering log 3 through 3
2022-01-11T04:59:29.127+0000 I STORAGE [initandlisten] WiredTiger message [1641877169:127187][1:0x7f0f1de1f080], txn-recover: Set global recovery timestamp: 61dd0eae00000008
2022-01-11T04:59:29.135+0000 I RECOVERY [initandlisten] WiredTiger recoveryTimestamp. Ts: Timestamp(1641877166, 8)
2022-01-11T04:59:29.136+0000 I STORAGE [initandlisten] Triggering the first stable checkpoint. Initial Data: Timestamp(1641877166, 8) PrevStable: Timestamp(0, 0) CurrStable: Timestamp(1641877166, 8)
2022-01-11T04:59:29.137+0000 I STORAGE [initandlisten] Starting to check the table logging settings for existing WiredTiger tables
2022-01-11T04:59:29.139+0000 I STORAGE [initandlisten] Starting OplogTruncaterThread local.oplog.rs
2022-01-11T04:59:29.139+0000 I STORAGE [initandlisten] The size storer reports that the oplog contains 7 records totaling to 1323 bytes
2022-01-11T04:59:29.139+0000 I STORAGE [initandlisten] Scanning the oplog to determine where to place markers for truncation
2022-01-11T04:59:29.140+0000 I STORAGE [initandlisten] WiredTiger record store oplog processing took 0ms
2022-01-11T04:59:29.143+0000 I CONTROL [initandlisten]
2022-01-11T04:59:29.143+0000 I CONTROL [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2022-01-11T04:59:29.143+0000 I CONTROL [initandlisten] ** We suggest setting it to 'never'
2022-01-11T04:59:29.143+0000 I CONTROL [initandlisten]
2022-01-11T04:59:29.150+0000 I STORAGE [initandlisten] Finished adjusting the table logging settings for existing WiredTiger tables
2022-01-11T04:59:29.151+0000 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/bitnami/mongodb/data/db/diagnostic.data'
2022-01-11T04:59:29.156+0000 I REPL [initandlisten] Rollback ID is 1
2022-01-11T04:59:29.157+0000 I REPL [initandlisten] Recovering from stable timestamp: Timestamp(1641877166, 8) (top of oplog: { ts: Timestamp(1641877166, 8), t: 1 }, appliedThrough: { ts: Timestamp(0, 0), t: -1 }, TruncateAfter: Timestamp(0, 0))
2022-01-11T04:59:29.157+0000 I REPL [initandlisten] Starting recovery oplog application at the stable timestamp: Timestamp(1641877166, 8)
2022-01-11T04:59:29.157+0000 I REPL [initandlisten] No oplog entries to apply for recovery. Start point is at the top of the oplog.
2022-01-11T04:59:29.158+0000 I REPL [replexec-0] New replica set config in use: { _id: "rs0", version: 1, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:29.158+0000 I REPL [replexec-0] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:29.158+0000 I REPL [replexec-0] transition to STARTUP2 from STARTUP
2022-01-11T04:59:29.158+0000 I REPL [replexec-0] Starting replication storage threads
2022-01-11T04:59:29.159+0000 I NETWORK [initandlisten] waiting for connections on port 27017
2022-01-11T04:59:29.159+0000 I REPL [replexec-0] transition to RECOVERING from STARTUP2
2022-01-11T04:59:29.159+0000 I NETWORK [LogicalSessionCacheRefresh] Starting new replica set monitor for rs0/stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:29.159+0000 I REPL [replexec-0] Starting replication fetcher thread
2022-01-11T04:59:29.159+0000 I ASIO [ReplicaSetMonitor-TaskExecutor] Connecting to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:29.159+0000 I REPL [replexec-0] Starting replication applier thread
2022-01-11T04:59:29.159+0000 I REPL [replexec-0] Starting replication reporter thread
2022-01-11T04:59:29.159+0000 I REPL [rsSync-0] Starting oplog application
2022-01-11T04:59:29.160+0000 I REPL [rsSync-0] transition to SECONDARY from RECOVERING
2022-01-11T04:59:29.160+0000 I NETWORK [listener] connection accepted from 100.64.0.30:43444 #2 (1 connection now open)
2022-01-11T04:59:29.160+0000 I REPL [rsSync-0] conducting a dry run election to see if we could be elected. current term: 1
2022-01-11T04:59:29.160+0000 I REPL [replexec-0] dry election run succeeded, running for election in term 2
2022-01-11T04:59:29.161+0000 I NETWORK [conn2] received client metadata from 100.64.0.30:43444 conn2: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] election succeeded, assuming primary role in term 2
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] transition to PRIMARY from SECONDARY
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] Resetting sync source to empty, which was :27017
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] Entering primary catch-up mode.
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] Exited primary catch-up mode.
2022-01-11T04:59:29.162+0000 I REPL [replexec-0] Stopping replication producer
2022-01-11T04:59:29.162+0000 I REPL [ReplBatcher] Oplog buffer has been drained in term 2
2022-01-11T04:59:29.162+0000 I REPL [rsSync-0] transition to primary complete; database writes are now permitted
2022-01-11T04:59:29.174+0000 I ACCESS [conn2] Successfully authenticated as principal __system on local from client 100.64.0.30:43444
2022-01-11T04:59:29.174+0000 I NETWORK [LogicalSessionCacheRefresh] stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 detected as new replica set primary for rs0; Old primary was :27017
2022-01-11T04:59:29.174+0000 I NETWORK [listener] connection accepted from 100.64.0.30:43448 #5 (2 connections now open)
2022-01-11T04:59:29.174+0000 I NETWORK [listener] connection accepted from 100.64.0.30:43450 #6 (3 connections now open)
2022-01-11T04:59:29.175+0000 I NETWORK [conn5] received client metadata from 100.64.0.30:43448 conn5: { driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.175+0000 I NETWORK [LogicalSessionCacheRefresh] Successfully connected to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (1 connections now open to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 with a 0 second timeout)
2022-01-11T04:59:29.175+0000 I NETWORK [conn6] received client metadata from 100.64.0.30:43450 conn6: { driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.175+0000 I NETWORK [LogicalSessionCacheReap] Successfully connected to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (2 connections now open to stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 with a 0 second timeout)
2022-01-11T04:59:29.175+0000 I ACCESS [conn5] Successfully authenticated as principal __system on local from client 100.64.0.30:43448
2022-01-11T04:59:29.175+0000 I ACCESS [conn6] Successfully authenticated as principal __system on local from client 100.64.0.30:43450
2022-01-11T04:59:29.466+0000 I NETWORK [listener] connection accepted from 100.64.0.15:42589 #7 (4 connections now open)
2022-01-11T04:59:29.467+0000 I NETWORK [conn7] end connection 100.64.0.15:42589 (3 connections now open)
2022-01-11T04:59:29.508+0000 I NETWORK [listener] connection accepted from 100.64.0.17:44225 #8 (4 connections now open)
2022-01-11T04:59:29.509+0000 I NETWORK [conn8] end connection 100.64.0.17:44225 (3 connections now open)
2022-01-11T04:59:29.525+0000 I NETWORK [listener] connection accepted from 100.64.0.13:38489 #9 (4 connections now open)
2022-01-11T04:59:29.525+0000 I NETWORK [conn9] end connection 100.64.0.13:38489 (3 connections now open)
2022-01-11T04:59:29.729+0000 I NETWORK [listener] connection accepted from 127.0.0.1:49980 #10 (4 connections now open)
2022-01-11T04:59:29.730+0000 I NETWORK [conn10] received client metadata from 127.0.0.1:49980 conn10: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:29.733+0000 I NETWORK [conn10] end connection 127.0.0.1:49980 (3 connections now open)
2022-01-11T04:59:30.284+0000 I NETWORK [listener] connection accepted from 100.64.0.24:46753 #11 (4 connections now open)
2022-01-11T04:59:30.285+0000 I NETWORK [conn11] end connection 100.64.0.24:46753 (3 connections now open)
2022-01-11T04:59:30.719+0000 I NETWORK [listener] connection accepted from 100.64.0.19:41847 #12 (4 connections now open)
2022-01-11T04:59:30.719+0000 I NETWORK [conn12] end connection 100.64.0.19:41847 (3 connections now open)
2022-01-11T04:59:32.271+0000 I NETWORK [listener] connection accepted from 100.64.0.16:44399 #13 (4 connections now open)
2022-01-11T04:59:32.271+0000 I NETWORK [conn13] end connection 100.64.0.16:44399 (3 connections now open)
2022-01-11T04:59:32.654+0000 I NETWORK [listener] connection accepted from 100.64.0.26:38533 #14 (4 connections now open)
2022-01-11T04:59:32.654+0000 I NETWORK [conn14] end connection 100.64.0.26:38533 (3 connections now open)
2022-01-11T04:59:33.238+0000 I NETWORK [listener] connection accepted from 100.64.0.12:40339 #15 (4 connections now open)
2022-01-11T04:59:33.238+0000 I NETWORK [conn15] end connection 100.64.0.12:40339 (3 connections now open)
2022-01-11T04:59:33.900+0000 I NETWORK [listener] connection accepted from 100.64.0.27:41197 #16 (4 connections now open)
2022-01-11T04:59:33.900+0000 I NETWORK [conn16] end connection 100.64.0.27:41197 (3 connections now open)
2022-01-11T04:59:34.381+0000 I NETWORK [listener] connection accepted from 100.64.0.11:42613 #17 (4 connections now open)
2022-01-11T04:59:34.381+0000 I NETWORK [conn17] end connection 100.64.0.11:42613 (3 connections now open)
2022-01-11T04:59:35.149+0000 I NETWORK [listener] connection accepted from 100.64.0.28:45321 #18 (4 connections now open)
2022-01-11T04:59:35.149+0000 I NETWORK [conn18] end connection 100.64.0.28:45321 (3 connections now open)
2022-01-11T04:59:35.470+0000 I NETWORK [listener] connection accepted from 100.64.0.25:37463 #19 (4 connections now open)
2022-01-11T04:59:35.470+0000 I NETWORK [conn19] end connection 100.64.0.25:37463 (3 connections now open)
2022-01-11T04:59:38.490+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57900 #20 (4 connections now open)
2022-01-11T04:59:38.490+0000 I NETWORK [conn20] end connection 100.64.0.34:57900 (3 connections now open)
2022-01-11T04:59:38.550+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57902 #21 (4 connections now open)
2022-01-11T04:59:38.551+0000 I NETWORK [conn21] received client metadata from 100.64.0.34:57902 conn21: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.583+0000 I ACCESS [conn21] Successfully authenticated as principal root on admin from client 100.64.0.34:57902
2022-01-11T04:59:38.590+0000 I NETWORK [conn21] end connection 100.64.0.34:57902 (3 connections now open)
2022-01-11T04:59:38.651+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57904 #22 (4 connections now open)
2022-01-11T04:59:38.653+0000 I NETWORK [conn22] received client metadata from 100.64.0.34:57904 conn22: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.682+0000 I ACCESS [conn22] Successfully authenticated as principal root on admin from client 100.64.0.34:57904
2022-01-11T04:59:38.687+0000 I NETWORK [conn22] end connection 100.64.0.34:57904 (3 connections now open)
2022-01-11T04:59:38.747+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57908 #23 (4 connections now open)
2022-01-11T04:59:38.748+0000 I NETWORK [conn23] received client metadata from 100.64.0.34:57908 conn23: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.777+0000 I ACCESS [conn23] Successfully authenticated as principal root on admin from client 100.64.0.34:57908
2022-01-11T04:59:38.783+0000 I NETWORK [conn23] end connection 100.64.0.34:57908 (3 connections now open)
2022-01-11T04:59:38.843+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57912 #24 (4 connections now open)
2022-01-11T04:59:38.844+0000 I NETWORK [conn24] received client metadata from 100.64.0.34:57912 conn24: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.872+0000 I ACCESS [conn24] Successfully authenticated as principal root on admin from client 100.64.0.34:57912
2022-01-11T04:59:38.877+0000 I NETWORK [conn24] end connection 100.64.0.34:57912 (3 connections now open)
2022-01-11T04:59:38.937+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57918 #25 (4 connections now open)
2022-01-11T04:59:38.939+0000 I NETWORK [conn25] received client metadata from 100.64.0.34:57918 conn25: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:38.968+0000 I ACCESS [conn25] Successfully authenticated as principal root on admin from client 100.64.0.34:57918
2022-01-11T04:59:38.973+0000 I REPL [conn25] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 2, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", priority: 0.0, votes: 0.0, _id: 1.0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:38.988+0000 I REPL [conn25] replSetReconfig config object with 2 members parses ok
2022-01-11T04:59:38.988+0000 I REPL [replexec-1] New replica set config in use: { _id: "rs0", version: 2, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: {}, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:38.988+0000 I REPL [replexec-1] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:38.988+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:38.990+0000 I REPL [replexec-0] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state STARTUP
2022-01-11T04:59:38.991+0000 I NETWORK [conn25] end connection 100.64.0.34:57918 (3 connections now open)
2022-01-11T04:59:38.991+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57924 #28 (4 connections now open)
2022-01-11T04:59:38.991+0000 I NETWORK [conn28] received client metadata from 100.64.0.34:57924 conn28: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.004+0000 I ACCESS [conn28] Successfully authenticated as principal __system on local from client 100.64.0.34:57924
2022-01-11T04:59:39.006+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57926 #29 (5 connections now open)
2022-01-11T04:59:39.006+0000 I ACCESS [conn29] Successfully authenticated as principal __system on local from client 100.64.0.34:57926
2022-01-11T04:59:39.006+0000 I NETWORK [conn29] end connection 100.64.0.34:57926 (4 connections now open)
2022-01-11T04:59:39.055+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57930 #30 (5 connections now open)
2022-01-11T04:59:39.056+0000 I NETWORK [conn30] received client metadata from 100.64.0.34:57930 conn30: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.060+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57932 #31 (6 connections now open)
2022-01-11T04:59:39.060+0000 I NETWORK [conn31] received client metadata from 100.64.0.34:57932 conn31: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.062+0000 I ACCESS [conn31] Successfully authenticated as principal __system on local from client 100.64.0.34:57932
2022-01-11T04:59:39.063+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57934 #32 (7 connections now open)
2022-01-11T04:59:39.064+0000 I NETWORK [conn32] received client metadata from 100.64.0.34:57934 conn32: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.064+0000 I ACCESS [conn32] Successfully authenticated as principal __system on local from client 100.64.0.34:57934
2022-01-11T04:59:39.085+0000 I ACCESS [conn30] Successfully authenticated as principal root on admin from client 100.64.0.34:57930
2022-01-11T04:59:39.091+0000 I NETWORK [conn30] end connection 100.64.0.34:57930 (6 connections now open)
2022-01-11T04:59:39.157+0000 I NETWORK [listener] connection accepted from 100.64.0.34:57946 #33 (7 connections now open)
2022-01-11T04:59:39.159+0000 I NETWORK [conn33] received client metadata from 100.64.0.34:57946 conn33: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.188+0000 I ACCESS [conn33] Successfully authenticated as principal root on admin from client 100.64.0.34:57946
2022-01-11T04:59:39.193+0000 I NETWORK [conn33] end connection 100.64.0.34:57946 (6 connections now open)
2022-01-11T04:59:39.738+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50160 #34 (7 connections now open)
2022-01-11T04:59:39.739+0000 I NETWORK [conn34] received client metadata from 127.0.0.1:50160 conn34: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:39.742+0000 I NETWORK [conn34] end connection 127.0.0.1:50160 (6 connections now open)
2022-01-11T04:59:40.990+0000 I REPL [replexec-2] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:44.064+0000 I NETWORK [conn31] end connection 100.64.0.34:57932 (5 connections now open)
2022-01-11T04:59:44.257+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58028 #35 (6 connections now open)
2022-01-11T04:59:44.259+0000 I NETWORK [conn35] received client metadata from 100.64.0.34:58028 conn35: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:44.293+0000 I ACCESS [conn35] Successfully authenticated as principal root on admin from client 100.64.0.34:58028
2022-01-11T04:59:44.985+0000 I NETWORK [conn35] end connection 100.64.0.34:58028 (5 connections now open)
2022-01-11T04:59:45.059+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58036 #36 (6 connections now open)
2022-01-11T04:59:45.060+0000 I NETWORK [conn36] received client metadata from 100.64.0.34:58036 conn36: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.090+0000 I ACCESS [conn36] Successfully authenticated as principal root on admin from client 100.64.0.34:58036
2022-01-11T04:59:45.098+0000 I REPL [conn36] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 3, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:45.100+0000 I REPL [conn36] replSetReconfig config object with 2 members parses ok
2022-01-11T04:59:45.101+0000 I REPL [replexec-2] New replica set config in use: { _id: "rs0", version: 3, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:45.101+0000 I REPL [replexec-2] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:45.102+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58040 #38 (7 connections now open)
2022-01-11T04:59:45.103+0000 I ACCESS [conn38] Successfully authenticated as principal __system on local from client 100.64.0.34:58040
2022-01-11T04:59:45.103+0000 I NETWORK [conn38] end connection 100.64.0.34:58040 (6 connections now open)
2022-01-11T04:59:45.396+0000 I COMMAND [conn32] command local.oplog.rs command: find { find: "oplog.rs", limit: 1, sort: { $natural: 1 }, projection: { ts: 1, t: 1 }, $readPreference: { mode: "secondaryPreferred" }, $clusterTime: { clusterTime: Timestamp(1641877185, 1), signature: { hash: BinData(0, 0000000000000000000000000000000000000000), keyId: 0 } }, $db: "local" } planSummary: COLLSCAN keysExamined:0 docsExamined:1 cursorExhausted:1 numYields:1 nreturned:1 reslen:248 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } storage:{} protocol:op_msg 246ms
2022-01-11T04:59:45.396+0000 I NETWORK [conn36] end connection 100.64.0.34:58036 (5 connections now open)
2022-01-11T04:59:45.417+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58050 #39 (6 connections now open)
2022-01-11T04:59:45.417+0000 I NETWORK [conn39] received client metadata from 100.64.0.34:58050 conn39: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.418+0000 I ACCESS [conn39] Successfully authenticated as principal __system on local from client 100.64.0.34:58050
2022-01-11T04:59:45.462+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58052 #40 (7 connections now open)
2022-01-11T04:59:45.463+0000 I NETWORK [conn40] received client metadata from 100.64.0.34:58052 conn40: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:45.494+0000 I ACCESS [conn40] Successfully authenticated as principal root on admin from client 100.64.0.34:58052
2022-01-11T04:59:45.668+0000 I NETWORK [conn40] end connection 100.64.0.34:58052 (6 connections now open)
2022-01-11T04:59:46.736+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58078 #41 (7 connections now open)
2022-01-11T04:59:46.738+0000 I NETWORK [conn41] received client metadata from 100.64.0.34:58078 conn41: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:46.772+0000 I ACCESS [conn41] Successfully authenticated as principal root on admin from client 100.64.0.34:58078
2022-01-11T04:59:46.778+0000 I NETWORK [conn41] end connection 100.64.0.34:58078 (6 connections now open)
2022-01-11T04:59:47.843+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58096 #42 (7 connections now open)
2022-01-11T04:59:47.845+0000 I NETWORK [conn42] received client metadata from 100.64.0.34:58096 conn42: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:47.874+0000 I ACCESS [conn42] Successfully authenticated as principal root on admin from client 100.64.0.34:58096
2022-01-11T04:59:47.880+0000 I NETWORK [conn42] end connection 100.64.0.34:58096 (6 connections now open)
2022-01-11T04:59:48.399+0000 I NETWORK [conn39] end connection 100.64.0.34:58050 (5 connections now open)
2022-01-11T04:59:48.400+0000 I NETWORK [conn28] end connection 100.64.0.34:57924 (4 connections now open)
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] dropping unhealthy pooled connection to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] after drop, pool was empty, going to spawn some connections
2022-01-11T04:59:49.101+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.101+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.101+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I REPL_HB [replexec-0] Error in heartbeat (requestId: 27) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.102+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I REPL_HB [replexec-2] Error in heartbeat (requestId: 28) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.102+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:49.103+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I REPL_HB [replexec-0] Error in heartbeat (requestId: 29) to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.34:27017) :: caused by :: Connection refused
2022-01-11T04:59:49.103+0000 I REPL [replexec-0] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state RS_DOWN
2022-01-11T04:59:49.744+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50340 #43 (5 connections now open)
2022-01-11T04:59:49.746+0000 I NETWORK [conn43] received client metadata from 127.0.0.1:50340 conn43: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:49.749+0000 I NETWORK [conn43] end connection 127.0.0.1:50340 (4 connections now open)
2022-01-11T04:59:50.419+0000 I NETWORK [conn32] end connection 100.64.0.34:57934 (3 connections now open)
2022-01-11T04:59:50.905+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58164 #44 (4 connections now open)
2022-01-11T04:59:50.918+0000 I ACCESS [conn44] Successfully authenticated as principal __system on local from client 100.64.0.34:58164
2022-01-11T04:59:50.918+0000 I NETWORK [conn44] end connection 100.64.0.34:58164 (3 connections now open)
2022-01-11T04:59:50.920+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58166 #45 (4 connections now open)
2022-01-11T04:59:50.920+0000 I NETWORK [conn45] received client metadata from 100.64.0.34:58166 conn45: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:50.921+0000 I ACCESS [conn45] Successfully authenticated as principal __system on local from client 100.64.0.34:58166
2022-01-11T04:59:51.103+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:51.118+0000 I REPL [replexec-2] Member stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:52.599+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45392 #47 (5 connections now open)
2022-01-11T04:59:52.599+0000 I NETWORK [conn47] end connection 100.64.0.36:45392 (4 connections now open)
2022-01-11T04:59:52.655+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45396 #48 (5 connections now open)
2022-01-11T04:59:52.657+0000 I NETWORK [conn48] received client metadata from 100.64.0.36:45396 conn48: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.686+0000 I ACCESS [conn48] Successfully authenticated as principal root on admin from client 100.64.0.36:45396
2022-01-11T04:59:52.692+0000 I NETWORK [conn48] end connection 100.64.0.36:45396 (4 connections now open)
2022-01-11T04:59:52.757+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45398 #49 (5 connections now open)
2022-01-11T04:59:52.758+0000 I NETWORK [conn49] received client metadata from 100.64.0.36:45398 conn49: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.787+0000 I ACCESS [conn49] Successfully authenticated as principal root on admin from client 100.64.0.36:45398
2022-01-11T04:59:52.792+0000 I NETWORK [conn49] end connection 100.64.0.36:45398 (4 connections now open)
2022-01-11T04:59:52.852+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45406 #50 (5 connections now open)
2022-01-11T04:59:52.853+0000 I NETWORK [conn50] received client metadata from 100.64.0.36:45406 conn50: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.881+0000 I ACCESS [conn50] Successfully authenticated as principal root on admin from client 100.64.0.36:45406
2022-01-11T04:59:52.886+0000 I NETWORK [conn50] end connection 100.64.0.36:45406 (4 connections now open)
2022-01-11T04:59:52.949+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45408 #51 (5 connections now open)
2022-01-11T04:59:52.950+0000 I NETWORK [conn51] received client metadata from 100.64.0.36:45408 conn51: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:52.979+0000 I ACCESS [conn51] Successfully authenticated as principal root on admin from client 100.64.0.36:45408
2022-01-11T04:59:52.984+0000 I NETWORK [conn51] end connection 100.64.0.36:45408 (4 connections now open)
2022-01-11T04:59:53.048+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45410 #52 (5 connections now open)
2022-01-11T04:59:53.050+0000 I NETWORK [conn52] received client metadata from 100.64.0.36:45410 conn52: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.090+0000 I ACCESS [conn52] Successfully authenticated as principal root on admin from client 100.64.0.36:45410
2022-01-11T04:59:53.095+0000 I REPL [conn52] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 4, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", priority: 0.0, votes: 0.0, _id: 2.0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:53.110+0000 I REPL [conn52] replSetReconfig config object with 3 members parses ok
2022-01-11T04:59:53.110+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:53.111+0000 I REPL [replexec-2] New replica set config in use: { _id: "rs0", version: 4, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 0.0, tags: {}, slaveDelay: 0, votes: 0 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:53.111+0000 I REPL [replexec-2] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:53.111+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T04:59:53.112+0000 I CONNPOOL [Replication] Ending idle connection to host stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 because the pool meets constraints; 1 connections to that host remain open
2022-01-11T04:59:53.113+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58220 #57 (6 connections now open)
2022-01-11T04:59:53.113+0000 I REPL [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state STARTUP
2022-01-11T04:59:53.113+0000 I ACCESS [conn57] Successfully authenticated as principal __system on local from client 100.64.0.34:58220
2022-01-11T04:59:53.114+0000 I NETWORK [conn57] end connection 100.64.0.34:58220 (5 connections now open)
2022-01-11T04:59:53.114+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45422 #58 (6 connections now open)
2022-01-11T04:59:53.114+0000 I NETWORK [conn58] received client metadata from 100.64.0.36:45422 conn58: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.115+0000 I NETWORK [conn52] end connection 100.64.0.36:45410 (5 connections now open)
2022-01-11T04:59:53.138+0000 I ACCESS [conn58] Successfully authenticated as principal __system on local from client 100.64.0.36:45422
2022-01-11T04:59:53.140+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45426 #59 (6 connections now open)
2022-01-11T04:59:53.140+0000 I ACCESS [conn59] Successfully authenticated as principal __system on local from client 100.64.0.36:45426
2022-01-11T04:59:53.141+0000 I NETWORK [conn59] end connection 100.64.0.36:45426 (5 connections now open)
2022-01-11T04:59:53.177+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45436 #60 (6 connections now open)
2022-01-11T04:59:53.178+0000 I NETWORK [conn60] received client metadata from 100.64.0.36:45436 conn60: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.207+0000 I ACCESS [conn60] Successfully authenticated as principal root on admin from client 100.64.0.36:45436
2022-01-11T04:59:53.213+0000 I NETWORK [conn60] end connection 100.64.0.36:45436 (5 connections now open)
2022-01-11T04:59:53.278+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45442 #61 (6 connections now open)
2022-01-11T04:59:53.279+0000 I NETWORK [conn61] received client metadata from 100.64.0.36:45442 conn61: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.311+0000 I ACCESS [conn61] Successfully authenticated as principal root on admin from client 100.64.0.36:45442
2022-01-11T04:59:53.311+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45444 #62 (7 connections now open)
2022-01-11T04:59:53.311+0000 I NETWORK [conn62] received client metadata from 100.64.0.36:45444 conn62: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.312+0000 I ACCESS [conn62] Successfully authenticated as principal __system on local from client 100.64.0.36:45444
2022-01-11T04:59:53.314+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45446 #63 (8 connections now open)
2022-01-11T04:59:53.314+0000 I NETWORK [conn63] received client metadata from 100.64.0.36:45446 conn63: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.314+0000 I ACCESS [conn63] Successfully authenticated as principal __system on local from client 100.64.0.36:45446
2022-01-11T04:59:53.317+0000 I NETWORK [conn61] end connection 100.64.0.36:45442 (7 connections now open)
2022-01-11T04:59:53.922+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58294 #64 (8 connections now open)
2022-01-11T04:59:53.922+0000 I NETWORK [conn64] received client metadata from 100.64.0.34:58294 conn64: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.923+0000 I ACCESS [conn64] Successfully authenticated as principal __system on local from client 100.64.0.34:58294
2022-01-11T04:59:53.924+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58296 #65 (9 connections now open)
2022-01-11T04:59:53.924+0000 I NETWORK [conn65] received client metadata from 100.64.0.34:58296 conn65: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:53.925+0000 I ACCESS [conn65] Successfully authenticated as principal __system on local from client 100.64.0.34:58296
2022-01-11T04:59:54.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50524 #66 (10 connections now open)
2022-01-11T04:59:54.731+0000 I NETWORK [conn66] received client metadata from 127.0.0.1:50524 conn66: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:54.734+0000 I NETWORK [conn66] end connection 127.0.0.1:50524 (9 connections now open)
2022-01-11T04:59:55.113+0000 I REPL [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T04:59:58.383+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45646 #67 (10 connections now open)
2022-01-11T04:59:58.384+0000 I NETWORK [conn67] received client metadata from 100.64.0.36:45646 conn67: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.413+0000 I ACCESS [conn67] Successfully authenticated as principal root on admin from client 100.64.0.36:45646
2022-01-11T04:59:58.418+0000 I NETWORK [conn67] end connection 100.64.0.36:45646 (9 connections now open)
2022-01-11T04:59:58.485+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45648 #68 (10 connections now open)
2022-01-11T04:59:58.486+0000 I NETWORK [conn68] received client metadata from 100.64.0.36:45648 conn68: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.517+0000 I ACCESS [conn68] Successfully authenticated as principal root on admin from client 100.64.0.36:45648
2022-01-11T04:59:58.523+0000 I REPL [conn68] replSetReconfig admin command received from client; new config: { _id: "rs0", version: 5, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:58.526+0000 I REPL [conn68] replSetReconfig config object with 3 members parses ok
2022-01-11T04:59:58.528+0000 I REPL [replexec-1] New replica set config in use: { _id: "rs0", version: 5, protocolVersion: 1, writeConcernMajorityJournalDefault: true, members: [ { _id: 0, host: "stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 5.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 1, host: "stackstorm-mongodb-1.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 }, { _id: 2, host: "stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017", arbiterOnly: false, buildIndexes: true, hidden: false, priority: 1.0, tags: {}, slaveDelay: 0, votes: 1 } ], settings: { chainingAllowed: true, heartbeatIntervalMillis: 2000, heartbeatTimeoutSecs: 10, electionTimeoutMillis: 10000, catchUpTimeoutMillis: -1, catchUpTakeoverDelayMillis: 30000, getLastErrorModes: {}, getLastErrorDefaults: { w: 1, wtimeout: 0 }, replicaSetId: ObjectId('61dd0eaecb021c59d26df584') } }
2022-01-11T04:59:58.528+0000 I REPL [replexec-1] This node is stackstorm-mongodb-0.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 in the config
2022-01-11T04:59:58.529+0000 I NETWORK [listener] connection accepted from 100.64.0.34:58454 #71 (11 connections now open)
2022-01-11T04:59:58.530+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45656 #72 (12 connections now open)
2022-01-11T04:59:58.530+0000 I ACCESS [conn71] Successfully authenticated as principal __system on local from client 100.64.0.34:58454
2022-01-11T04:59:58.530+0000 I NETWORK [conn71] end connection 100.64.0.34:58454 (11 connections now open)
2022-01-11T04:59:58.530+0000 I ACCESS [conn72] Successfully authenticated as principal __system on local from client 100.64.0.36:45656
2022-01-11T04:59:58.531+0000 I NETWORK [conn68] end connection 100.64.0.36:45648 (10 connections now open)
2022-01-11T04:59:58.531+0000 I NETWORK [conn72] end connection 100.64.0.36:45656 (9 connections now open)
2022-01-11T04:59:58.596+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45662 #73 (10 connections now open)
2022-01-11T04:59:58.597+0000 I NETWORK [conn73] received client metadata from 100.64.0.36:45662 conn73: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:58.625+0000 I ACCESS [conn73] Successfully authenticated as principal root on admin from client 100.64.0.36:45662
2022-01-11T04:59:58.630+0000 I NETWORK [conn73] end connection 100.64.0.36:45662 (9 connections now open)
2022-01-11T04:59:59.701+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45686 #74 (10 connections now open)
2022-01-11T04:59:59.702+0000 I NETWORK [conn74] received client metadata from 100.64.0.36:45686 conn74: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:59.732+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50698 #75 (11 connections now open)
2022-01-11T04:59:59.734+0000 I NETWORK [conn75] received client metadata from 127.0.0.1:50698 conn75: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T04:59:59.737+0000 I ACCESS [conn74] Successfully authenticated as principal root on admin from client 100.64.0.36:45686
2022-01-11T04:59:59.737+0000 I NETWORK [conn75] end connection 127.0.0.1:50698 (10 connections now open)
2022-01-11T04:59:59.745+0000 I NETWORK [conn74] end connection 100.64.0.36:45686 (9 connections now open)
2022-01-11T05:00:00.809+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45706 #76 (10 connections now open)
2022-01-11T05:00:00.811+0000 I NETWORK [conn76] received client metadata from 100.64.0.36:45706 conn76: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:00.847+0000 I ACCESS [conn76] Successfully authenticated as principal root on admin from client 100.64.0.36:45706
2022-01-11T05:00:00.854+0000 I NETWORK [conn76] end connection 100.64.0.36:45706 (9 connections now open)
2022-01-11T05:00:01.533+0000 I NETWORK [conn63] end connection 100.64.0.36:45446 (8 connections now open)
2022-01-11T05:00:01.533+0000 I NETWORK [conn62] end connection 100.64.0.36:45444 (7 connections now open)
2022-01-11T05:00:01.534+0000 I NETWORK [conn58] end connection 100.64.0.36:45422 (6 connections now open)
2022-01-11T05:00:02.528+0000 I CONNPOOL [Replication] dropping unhealthy pooled connection to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.528+0000 I CONNPOOL [Replication] after drop, pool was empty, going to spawn some connections
2022-01-11T05:00:02.528+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.529+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I REPL_HB [replexec-0] Error in heartbeat (requestId: 67) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.529+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.530+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I REPL_HB [replexec-4] Error in heartbeat (requestId: 68) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.530+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:02.531+0000 I ASIO [Replication] Failed to connect to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 - HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I CONNPOOL [Replication] Dropping all pooled connections to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 due to HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I REPL_HB [replexec-3] Error in heartbeat (requestId: 69) to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017, response status: HostUnreachable: Error connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 (100.64.0.36:27017) :: caused by :: Connection refused
2022-01-11T05:00:02.531+0000 I REPL [replexec-3] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state RS_DOWN
2022-01-11T05:00:02.908+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45774 #77 (7 connections now open)
2022-01-11T05:00:02.921+0000 I ACCESS [conn77] Successfully authenticated as principal __system on local from client 100.64.0.36:45774
2022-01-11T05:00:02.921+0000 I NETWORK [conn77] end connection 100.64.0.36:45774 (6 connections now open)
2022-01-11T05:00:02.936+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45778 #78 (7 connections now open)
2022-01-11T05:00:02.937+0000 I NETWORK [conn78] received client metadata from 100.64.0.36:45778 conn78: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:02.937+0000 I ACCESS [conn78] Successfully authenticated as principal __system on local from client 100.64.0.36:45778
2022-01-11T05:00:04.531+0000 I ASIO [Replication] Connecting to stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017
2022-01-11T05:00:04.545+0000 I REPL [replexec-4] Member stackstorm-mongodb-2.stackstorm-mongodb-headless.stackstorm.svc.cluster.local:27017 is now in state SECONDARY
2022-01-11T05:00:04.722+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50824 #80 (8 connections now open)
2022-01-11T05:00:04.723+0000 I NETWORK [conn80] received client metadata from 127.0.0.1:50824 conn80: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:04.726+0000 I NETWORK [conn80] end connection 127.0.0.1:50824 (7 connections now open)
2022-01-11T05:00:09.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50936 #81 (8 connections now open)
2022-01-11T05:00:09.732+0000 I NETWORK [conn81] received client metadata from 127.0.0.1:50936 conn81: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.735+0000 I NETWORK [conn81] end connection 127.0.0.1:50936 (7 connections now open)
2022-01-11T05:00:09.939+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45934 #82 (8 connections now open)
2022-01-11T05:00:09.939+0000 I NETWORK [conn82] received client metadata from 100.64.0.36:45934 conn82: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.940+0000 I ACCESS [conn82] Successfully authenticated as principal __system on local from client 100.64.0.36:45934
2022-01-11T05:00:09.942+0000 I NETWORK [listener] connection accepted from 100.64.0.36:45936 #83 (9 connections now open)
2022-01-11T05:00:09.942+0000 I NETWORK [conn83] received client metadata from 100.64.0.36:45936 conn83: { driver: { name: "NetworkInterfaceTL", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:09.943+0000 I ACCESS [conn83] Successfully authenticated as principal __system on local from client 100.64.0.36:45936
2022-01-11T05:00:14.724+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51028 #84 (10 connections now open)
2022-01-11T05:00:14.726+0000 I NETWORK [conn84] received client metadata from 127.0.0.1:51028 conn84: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:14.729+0000 I NETWORK [conn84] end connection 127.0.0.1:51028 (9 connections now open)
2022-01-11T05:00:19.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51118 #85 (10 connections now open)
2022-01-11T05:00:19.732+0000 I NETWORK [conn85] received client metadata from 127.0.0.1:51118 conn85: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:19.735+0000 I NETWORK [conn85] end connection 127.0.0.1:51118 (9 connections now open)
2022-01-11T05:00:24.727+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51220 #86 (10 connections now open)
2022-01-11T05:00:24.729+0000 I NETWORK [conn86] received client metadata from 127.0.0.1:51220 conn86: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:24.732+0000 I NETWORK [conn86] end connection 127.0.0.1:51220 (9 connections now open)
2022-01-11T05:00:29.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51324 #87 (10 connections now open)
2022-01-11T05:00:29.730+0000 I NETWORK [conn87] received client metadata from 127.0.0.1:51324 conn87: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:29.733+0000 I NETWORK [conn87] end connection 127.0.0.1:51324 (9 connections now open)
2022-01-11T05:00:34.737+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51440 #88 (10 connections now open)
2022-01-11T05:00:34.738+0000 I NETWORK [conn88] received client metadata from 127.0.0.1:51440 conn88: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:34.742+0000 I NETWORK [conn88] end connection 127.0.0.1:51440 (9 connections now open)
2022-01-11T05:00:39.725+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51560 #89 (10 connections now open)
2022-01-11T05:00:39.726+0000 I NETWORK [conn89] received client metadata from 127.0.0.1:51560 conn89: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:39.730+0000 I NETWORK [conn89] end connection 127.0.0.1:51560 (9 connections now open)
2022-01-11T05:00:44.735+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51678 #90 (10 connections now open)
2022-01-11T05:00:44.737+0000 I NETWORK [conn90] received client metadata from 127.0.0.1:51678 conn90: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:44.741+0000 I NETWORK [conn90] end connection 127.0.0.1:51678 (9 connections now open)
2022-01-11T05:00:49.723+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51792 #91 (10 connections now open)
2022-01-11T05:00:49.725+0000 I NETWORK [conn91] received client metadata from 127.0.0.1:51792 conn91: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:49.728+0000 I NETWORK [conn91] end connection 127.0.0.1:51792 (9 connections now open)
2022-01-11T05:00:54.723+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51912 #92 (10 connections now open)
2022-01-11T05:00:54.725+0000 I NETWORK [conn92] received client metadata from 127.0.0.1:51912 conn92: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:54.728+0000 I NETWORK [conn92] end connection 127.0.0.1:51912 (9 connections now open)
2022-01-11T05:00:59.737+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52016 #93 (10 connections now open)
2022-01-11T05:00:59.738+0000 I NETWORK [conn93] received client metadata from 127.0.0.1:52016 conn93: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:00:59.741+0000 I NETWORK [conn93] end connection 127.0.0.1:52016 (9 connections now open)
2022-01-11T05:01:04.721+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52122 #94 (10 connections now open)
2022-01-11T05:01:04.723+0000 I NETWORK [conn94] received client metadata from 127.0.0.1:52122 conn94: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:04.726+0000 I NETWORK [conn94] end connection 127.0.0.1:52122 (9 connections now open)
2022-01-11T05:01:09.736+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52246 #95 (10 connections now open)
2022-01-11T05:01:09.737+0000 I NETWORK [conn95] received client metadata from 127.0.0.1:52246 conn95: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:09.740+0000 I NETWORK [conn95] end connection 127.0.0.1:52246 (9 connections now open)
2022-01-11T05:01:14.749+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52344 #96 (10 connections now open)
2022-01-11T05:01:14.750+0000 I NETWORK [conn96] received client metadata from 127.0.0.1:52344 conn96: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:14.753+0000 I NETWORK [conn96] end connection 127.0.0.1:52344 (9 connections now open)
2022-01-11T05:01:19.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52446 #97 (10 connections now open)
2022-01-11T05:01:19.729+0000 I NETWORK [conn97] received client metadata from 127.0.0.1:52446 conn97: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:19.733+0000 I NETWORK [conn97] end connection 127.0.0.1:52446 (9 connections now open)
2022-01-11T05:01:24.751+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52544 #98 (10 connections now open)
2022-01-11T05:01:24.753+0000 I NETWORK [conn98] received client metadata from 127.0.0.1:52544 conn98: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:24.756+0000 I NETWORK [conn98] end connection 127.0.0.1:52544 (9 connections now open)
2022-01-11T05:01:29.732+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52648 #99 (10 connections now open)
2022-01-11T05:01:29.733+0000 I NETWORK [conn99] received client metadata from 127.0.0.1:52648 conn99: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:29.736+0000 I NETWORK [conn99] end connection 127.0.0.1:52648 (9 connections now open)
2022-01-11T05:01:34.737+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52738 #100 (10 connections now open)
2022-01-11T05:01:34.739+0000 I NETWORK [conn100] received client metadata from 127.0.0.1:52738 conn100: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:34.742+0000 I NETWORK [conn100] end connection 127.0.0.1:52738 (9 connections now open)
2022-01-11T05:01:39.737+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52844 #101 (10 connections now open)
2022-01-11T05:01:39.739+0000 I NETWORK [conn101] received client metadata from 127.0.0.1:52844 conn101: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:39.742+0000 I NETWORK [conn101] end connection 127.0.0.1:52844 (9 connections now open)
2022-01-11T05:01:44.739+0000 I NETWORK [listener] connection accepted from 127.0.0.1:52942 #102 (10 connections now open)
2022-01-11T05:01:44.741+0000 I NETWORK [conn102] received client metadata from 127.0.0.1:52942 conn102: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:44.743+0000 I NETWORK [conn102] end connection 127.0.0.1:52942 (9 connections now open)
2022-01-11T05:01:49.738+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53032 #103 (10 connections now open)
2022-01-11T05:01:49.739+0000 I NETWORK [conn103] received client metadata from 127.0.0.1:53032 conn103: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:49.742+0000 I NETWORK [conn103] end connection 127.0.0.1:53032 (9 connections now open)
2022-01-11T05:01:54.733+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53120 #104 (10 connections now open)
2022-01-11T05:01:54.734+0000 I NETWORK [conn104] received client metadata from 127.0.0.1:53120 conn104: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:54.737+0000 I NETWORK [conn104] end connection 127.0.0.1:53120 (9 connections now open)
2022-01-11T05:01:59.739+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53210 #105 (10 connections now open)
2022-01-11T05:01:59.740+0000 I NETWORK [conn105] received client metadata from 127.0.0.1:53210 conn105: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:01:59.743+0000 I NETWORK [conn105] end connection 127.0.0.1:53210 (9 connections now open)
2022-01-11T05:02:04.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53302 #106 (10 connections now open)
2022-01-11T05:02:04.731+0000 I NETWORK [conn106] received client metadata from 127.0.0.1:53302 conn106: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:04.734+0000 I NETWORK [conn106] end connection 127.0.0.1:53302 (9 connections now open)
2022-01-11T05:02:09.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53406 #107 (10 connections now open)
2022-01-11T05:02:09.729+0000 I NETWORK [conn107] received client metadata from 127.0.0.1:53406 conn107: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:09.732+0000 I NETWORK [conn107] end connection 127.0.0.1:53406 (9 connections now open)
2022-01-11T05:02:14.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53504 #108 (10 connections now open)
2022-01-11T05:02:14.731+0000 I NETWORK [conn108] received client metadata from 127.0.0.1:53504 conn108: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:14.734+0000 I NETWORK [conn108] end connection 127.0.0.1:53504 (9 connections now open)
2022-01-11T05:02:19.726+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53598 #109 (10 connections now open)
2022-01-11T05:02:19.728+0000 I NETWORK [conn109] received client metadata from 127.0.0.1:53598 conn109: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:19.730+0000 I NETWORK [conn109] end connection 127.0.0.1:53598 (9 connections now open)
2022-01-11T05:02:24.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53688 #110 (10 connections now open)
2022-01-11T05:02:24.730+0000 I NETWORK [conn110] received client metadata from 127.0.0.1:53688 conn110: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:24.733+0000 I NETWORK [conn110] end connection 127.0.0.1:53688 (9 connections now open)
2022-01-11T05:02:29.734+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53778 #111 (10 connections now open)
2022-01-11T05:02:29.735+0000 I NETWORK [conn111] received client metadata from 127.0.0.1:53778 conn111: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:29.738+0000 I NETWORK [conn111] end connection 127.0.0.1:53778 (9 connections now open)
2022-01-11T05:02:34.727+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53868 #112 (10 connections now open)
2022-01-11T05:02:34.729+0000 I NETWORK [conn112] received client metadata from 127.0.0.1:53868 conn112: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:34.731+0000 I NETWORK [conn112] end connection 127.0.0.1:53868 (9 connections now open)
2022-01-11T05:02:39.731+0000 I NETWORK [listener] connection accepted from 127.0.0.1:53974 #113 (10 connections now open)
2022-01-11T05:02:39.733+0000 I NETWORK [conn113] received client metadata from 127.0.0.1:53974 conn113: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:39.736+0000 I NETWORK [conn113] end connection 127.0.0.1:53974 (9 connections now open)
2022-01-11T05:02:44.727+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54072 #114 (10 connections now open)
2022-01-11T05:02:44.728+0000 I NETWORK [conn114] received client metadata from 127.0.0.1:54072 conn114: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:44.731+0000 I NETWORK [conn114] end connection 127.0.0.1:54072 (9 connections now open)
2022-01-11T05:02:49.726+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54170 #115 (10 connections now open)
2022-01-11T05:02:49.727+0000 I NETWORK [conn115] received client metadata from 127.0.0.1:54170 conn115: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:49.730+0000 I NETWORK [conn115] end connection 127.0.0.1:54170 (9 connections now open)
2022-01-11T05:02:54.736+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54258 #116 (10 connections now open)
2022-01-11T05:02:54.737+0000 I NETWORK [conn116] received client metadata from 127.0.0.1:54258 conn116: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:54.740+0000 I NETWORK [conn116] end connection 127.0.0.1:54258 (9 connections now open)
2022-01-11T05:02:59.727+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54356 #117 (10 connections now open)
2022-01-11T05:02:59.728+0000 I NETWORK [conn117] received client metadata from 127.0.0.1:54356 conn117: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:02:59.731+0000 I NETWORK [conn117] end connection 127.0.0.1:54356 (9 connections now open)
2022-01-11T05:03:04.730+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54444 #118 (10 connections now open)
2022-01-11T05:03:04.732+0000 I NETWORK [conn118] received client metadata from 127.0.0.1:54444 conn118: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:04.735+0000 I NETWORK [conn118] end connection 127.0.0.1:54444 (9 connections now open)
2022-01-11T05:03:09.733+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54548 #119 (10 connections now open)
2022-01-11T05:03:09.734+0000 I NETWORK [conn119] received client metadata from 127.0.0.1:54548 conn119: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:09.737+0000 I NETWORK [conn119] end connection 127.0.0.1:54548 (9 connections now open)
2022-01-11T05:03:14.723+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54644 #120 (10 connections now open)
2022-01-11T05:03:14.724+0000 I NETWORK [conn120] received client metadata from 127.0.0.1:54644 conn120: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:14.728+0000 I NETWORK [conn120] end connection 127.0.0.1:54644 (9 connections now open)
2022-01-11T05:03:19.724+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54746 #121 (10 connections now open)
2022-01-11T05:03:19.725+0000 I NETWORK [conn121] received client metadata from 127.0.0.1:54746 conn121: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:19.728+0000 I NETWORK [conn121] end connection 127.0.0.1:54746 (9 connections now open)
2022-01-11T05:03:24.721+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54848 #122 (10 connections now open)
2022-01-11T05:03:24.723+0000 I NETWORK [conn122] received client metadata from 127.0.0.1:54848 conn122: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:24.726+0000 I NETWORK [conn122] end connection 127.0.0.1:54848 (9 connections now open)
2022-01-11T05:03:29.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:54940 #123 (10 connections now open)
2022-01-11T05:03:29.729+0000 I NETWORK [conn123] received client metadata from 127.0.0.1:54940 conn123: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:29.732+0000 I NETWORK [conn123] end connection 127.0.0.1:54940 (9 connections now open)
2022-01-11T05:03:34.722+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55032 #124 (10 connections now open)
2022-01-11T05:03:34.723+0000 I NETWORK [conn124] received client metadata from 127.0.0.1:55032 conn124: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:34.726+0000 I NETWORK [conn124] end connection 127.0.0.1:55032 (9 connections now open)
2022-01-11T05:03:39.735+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55140 #125 (10 connections now open)
2022-01-11T05:03:39.736+0000 I NETWORK [conn125] received client metadata from 127.0.0.1:55140 conn125: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:39.739+0000 I NETWORK [conn125] end connection 127.0.0.1:55140 (9 connections now open)
2022-01-11T05:03:44.732+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55240 #126 (10 connections now open)
2022-01-11T05:03:44.733+0000 I NETWORK [conn126] received client metadata from 127.0.0.1:55240 conn126: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:44.736+0000 I NETWORK [conn126] end connection 127.0.0.1:55240 (9 connections now open)
2022-01-11T05:03:49.744+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55344 #127 (10 connections now open)
2022-01-11T05:03:49.746+0000 I NETWORK [conn127] received client metadata from 127.0.0.1:55344 conn127: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:49.750+0000 I NETWORK [conn127] end connection 127.0.0.1:55344 (9 connections now open)
2022-01-11T05:03:54.731+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55444 #128 (10 connections now open)
2022-01-11T05:03:54.732+0000 I NETWORK [conn128] received client metadata from 127.0.0.1:55444 conn128: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:54.735+0000 I NETWORK [conn128] end connection 127.0.0.1:55444 (9 connections now open)
2022-01-11T05:03:59.728+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55540 #129 (10 connections now open)
2022-01-11T05:03:59.729+0000 I NETWORK [conn129] received client metadata from 127.0.0.1:55540 conn129: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:03:59.732+0000 I NETWORK [conn129] end connection 127.0.0.1:55540 (9 connections now open)
2022-01-11T05:04:04.720+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55628 #130 (10 connections now open)
2022-01-11T05:04:04.721+0000 I NETWORK [conn130] received client metadata from 127.0.0.1:55628 conn130: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:04.724+0000 I NETWORK [conn130] end connection 127.0.0.1:55628 (9 connections now open)
2022-01-11T05:04:09.734+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55730 #131 (10 connections now open)
2022-01-11T05:04:09.735+0000 I NETWORK [conn131] received client metadata from 127.0.0.1:55730 conn131: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:09.739+0000 I NETWORK [conn131] end connection 127.0.0.1:55730 (9 connections now open)
2022-01-11T05:04:14.727+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55826 #132 (10 connections now open)
2022-01-11T05:04:14.728+0000 I NETWORK [conn132] received client metadata from 127.0.0.1:55826 conn132: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:14.731+0000 I NETWORK [conn132] end connection 127.0.0.1:55826 (9 connections now open)
2022-01-11T05:04:19.732+0000 I NETWORK [listener] connection accepted from 127.0.0.1:55926 #133 (10 connections now open)
2022-01-11T05:04:19.734+0000 I NETWORK [conn133] received client metadata from 127.0.0.1:55926 conn133: { application: { name: "MongoDB Shell" }, driver: { name: "MongoDB Internal Client", version: "4.0.27" }, os: { type: "Linux", name: "PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 4.18.0-305.19.1.el8_4.x86_64" } }
2022-01-11T05:04:19.737+0000 I NETWORK [conn133] end connection 127.0.0.1:55926 (9 connections now open)
I do not have access to 1.19 kubernetes to be able to verify this. But could you please verify the service has the headless service created and configured correctly. Since this looks to be a connectivity issue, I wonder if that is not configured correctly.
- Ensure the headless service is exists/enabled
- Ensure 3 endpoints are showing IP and Ports
kubectl get services
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
kubernetes ClusterIP 172.20.0.1 <none> 443/TCP 119d
st2-staging-mongodb-headless ClusterIP None <none> 27017/TCP 118d
kubectl describe service st2-staging-mongodb-headless
Name: st2-staging-mongodb-headless
Namespace: default
Labels: app.kubernetes.io/component=mongodb
app.kubernetes.io/instance=st2-staging
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=mongodb
helm.sh/chart=mongodb-10.0.1
Annotations: meta.helm.sh/release-name: st2-staging
meta.helm.sh/release-namespace: default
Selector: app.kubernetes.io/component=mongodb,app.kubernetes.io/instance=st2-staging,app.kubernetes.io/name=mongodb
Type: ClusterIP
IP Family Policy: SingleStack
IP Families: IPv4
IP: None
IPs: None
Port: mongodb 27017/TCP
TargetPort: mongodb/TCP
Endpoints: 10.138.241.85:27017,10.138.242.83:27017,10.138.243.90:27017
Session Affinity: None
Events: <none>
I do not have access to
1.19kubernetes to be able to verify this. But could you please verify theservicehas the headless service created and configured correctly. Since this looks to be a connectivity issue, I wonder if that is not configured correctly.
- Ensure the headless service is exists/enabled
- Ensure 3 endpoints are showing IP and Ports
>>> get svc -n stackstorm-system
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
stackstorm-mongodb-headless ClusterIP None <none> 27017/TCP 9m5s
stackstorm-rabbitmq ClusterIP 10.96.0.64 <none> 5672/TCP,4369/TCP,25672/TCP,15672/TCP 9m5s
stackstorm-rabbitmq-headless ClusterIP None <none> 4369/TCP,5672/TCP,25672/TCP,15672/TCP 9m5s
stackstorm-redis ClusterIP 10.96.2.168 <none> 6379/TCP,26379/TCP 9m5s
stackstorm-redis-headless ClusterIP None <none> 6379/TCP,26379/TCP 9m5s
stackstorm-st2api ClusterIP 10.96.1.23 <none> 9101/TCP 9m5s
stackstorm-st2auth ClusterIP 10.96.1.114 <none> 9100/TCP 9m5s
stackstorm-st2chatops ClusterIP 10.96.0.165 <none> 8081/TCP 9m5s
stackstorm-st2stream ClusterIP 10.96.0.131 <none> 9102/TCP 9m5s
stackstorm-st2web NodePort 10.96.2.241 <none> 80:31470/TCP 9m5s
>>> describe svc -n stackstorm-system stackstorm-mongodb-headless
Name: stackstorm-mongodb-headless
Namespace: stackstorm-system
Labels: app.kubernetes.io/component=mongodb
app.kubernetes.io/instance=stackstorm
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=mongodb
helm.sh/chart=mongodb-10.0.1
Annotations: meta.helm.sh/release-name: stackstorm
meta.helm.sh/release-namespace: stackstorm-system
Selector: app.kubernetes.io/component=mongodb,app.kubernetes.io/instance=stackstorm,app.kubernetes.io/name=mongodb
Type: ClusterIP
IP: None
Port: mongodb 27017/TCP
TargetPort: mongodb/TCP
Endpoints: 100.64.0.30:27017,100.64.0.38:27017,100.64.0.40:27017
Session Affinity: None
Events: <none>
>>> get pod -n stackstorm-system -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
stackstorm-job-st2-apikey-load-j6hb7 0/1 Init:1/3 0 11m 100.64.0.26 0110cfe94989 <none> <none>
stackstorm-mongodb-0 1/1 Running 0 11m 100.64.0.30 0110cfe94989 <none> <none>
stackstorm-mongodb-1 1/1 Running 0 6m28s 100.64.0.38 0110cfe94989 <none> <none>
stackstorm-mongodb-2 1/1 Running 0 6m 100.64.0.40 0110cfe94989 <none> <none>
stackstorm-rabbitmq-0 1/1 Running 0 11m 100.64.0.29 0110cfe94989 <none> <none>
stackstorm-rabbitmq-1 1/1 Running 0 6m59s 100.64.0.34 0110cfe94989 <none> <none>
stackstorm-rabbitmq-2 1/1 Running 0 6m32s 100.64.0.36 0110cfe94989 <none> <none>
stackstorm-redis-node-0 2/2 Running 0 11m 100.64.0.32 0110cfe94989 <none> <none>
stackstorm-redis-node-1 2/2 Running 0 5m8s 100.64.0.42 0110cfe94989 <none> <none>
stackstorm-redis-node-2 2/2 Running 0 4m54s 100.64.0.44 0110cfe94989 <none> <none>
stackstorm-st2actionrunner-5fd4f58667-wkhfv 0/1 CrashLoopBackOff 5 11m 100.64.0.21 0110cfe94989 <none> <none>
stackstorm-st2api-7ccb6fbf99-4zw9b 0/1 CrashLoopBackOff 5 11m 100.64.0.16 0110cfe94989 <none> <none>
stackstorm-st2auth-6c7b9d84b9-2nqq8 0/1 CrashLoopBackOff 5 11m 100.64.0.24 0110cfe94989 <none> <none>
stackstorm-st2chatops-79b477ff84-kh8rq 1/1 Running 0 11m 100.64.0.12 0110cfe94989 <none> <none>
stackstorm-st2client-6dcc69f474-8vk8b 1/1 Running 0 11m 100.64.0.25 0110cfe94989 <none> <none>
stackstorm-st2garbagecollector-5787b8997f-tjjmn 0/1 CrashLoopBackOff 5 11m 100.64.0.27 0110cfe94989 <none> <none>
stackstorm-st2notifier-68fbc44b54-vz7k8 0/1 CrashLoopBackOff 5 11m 100.64.0.14 0110cfe94989 <none> <none>
stackstorm-st2rulesengine-5fbb49b944-fnd75 0/1 CrashLoopBackOff 5 11m 100.64.0.17 0110cfe94989 <none> <none>
stackstorm-st2scheduler-744459f594-mff7g 0/1 CrashLoopBackOff 5 11m 100.64.0.23 0110cfe94989 <none> <none>
stackstorm-st2sensorcontainer-7d65b8f8f-46dv7 0/1 CrashLoopBackOff 5 11m 100.64.0.28 0110cfe94989 <none> <none>
stackstorm-st2stream-69fc49f547-kpp79 0/1 CrashLoopBackOff 5 11m 100.64.0.19 0110cfe94989 <none> <none>
stackstorm-st2timersengine-868db79948-ww5z7 0/1 CrashLoopBackOff 5 11m 100.64.0.11 0110cfe94989 <none> <none>
stackstorm-st2web-688568565f-76269 1/1 Running 0 11m 100.64.0.13 0110cfe94989 <none> <none>
stackstorm-st2workflowengine-7c5b87456f-828h5 0/1 CrashLoopBackOff 5 11m 100.64.0.20 0110cfe94989 <none> <none>
>>>
Thanks for contributing to this issue. As it has been 90 days since the last activity, we are automatically marking is as stale. If this issue is not relevant or applicable anymore (problem has been fixed in a new version or similar), please close the issue or let us know so we can close it. On the contrary, if the issue is still relevant, there is nothing you need to do, but if you have any additional details or context which would help us when working on this issue, please include it as a comment to this issue.
![stale[bot] avatar](https://avatars.githubusercontent.com/in/1724?v=4 "Published by a pub.dev verified publisher"){kind=small}
