Usage in GitLab not working

Open hogklint opened this issue 3 years ago • 7 comments

Hi,

I see issues such as https://github.com/testcontainers/testcontainers-python/issues/43, https://github.com/testcontainers/testcontainers-python/issues/25, https://github.com/testcontainers/testcontainers-python/pull/154 and the gitlab-ci.yml in the gitlab branch indicating that testcontainers should be working in the GitLab CI. Can someone confirm if this is still true? Looks like the last testrun on the testcontainers-python-project was two years ago (https://gitlab.com/tillahoffmann/testcontainers-python/-/pipelines/140551456).

I use a file very similar config to the on in the gitlab branch (also tried all variations I can think of)

variables:
    DOCKER_DRIVER: overlay2
    DOCKER_TLS_CERTDIR: ""
    DOCKER_HOST: "tcp://docker:2375"

services:
- name: docker:dind
  command: ["--tls=false"]

tests_testcontainer:
  image: "python:3.9"
  script:
    - pip install pytest~=7.0.1 testcontainers[kafka]~=3.5.3
    - pytest --log-cli-level=debug -s -v test_testcontainers.py

With this test

import logging
from testcontainers.kafka import KafkaContaine
LOG = logging.getLogger(__name__)

def test_containers():
    LOG.info("test_containers 1")
    with KafkaContainer() as kafka_server:
        LOG.info("test_containers 2")
        assert kafka_server
        LOG.info("test_containers 3")
    LOG.info("test_containers 4")

But it hangs on the with-line waiting for the container to be created. It looks like it's communicating fine with the docker daemon but for some reason nothing more happens. Creating a container using the docker cli tool works fine when done in .gitlab-ci.yml or with subprocess inside python.

Does someone understand what's goning on? Any help is greatly appreciated.

Expand for test log output

$ pytest --log-cli-level=debug -s -v test_testcontainers.py
============================= test session starts ==============================
platform linux -- Python 3.9.12, pytest-7.0.1, pluggy-1.0.0 -- /usr/local/bin/python
cachedir: .pytest_cache
rootdir: /builds, configfile: pyproject.toml
collecting ... collected 1 item
test_testcontainers.py::test_containers 
-------------------------------- live log call ---------------------------------
INFO     test_testcontainers:test_testcontainers.py:9 test_containers 1
DEBUG    docker.utils.config:config.py:21 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
DEBUG    docker.utils.config:config.py:28 No config file found
DEBUG    docker.utils.config:config.py:21 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
DEBUG    docker.utils.config:config.py:28 No config file found
DEBUG    urllib3.connectionpool:connectionpool.py:228 Starting new HTTP connection (1): docker:2375
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /version HTTP/1.1" 200 811
Pulling image confluentinc/cp-kafka:5.4.3
INFO     testcontainers.core.container:container.py:51 Pulling image confluentinc/cp-kafka:5.4.3
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "POST /v1.41/containers/create HTTP/1.1" 404 57
DEBUG    docker.auth:auth.py:39 Looking for auth config
DEBUG    docker.auth:auth.py:41 No auth config in memory - loading from filesystem
DEBUG    docker.utils.config:config.py:21 Trying paths: ['/root/.docker/config.json', '/root/.dockercfg']
DEBUG    docker.utils.config:config.py:28 No config file found
DEBUG    docker.auth:auth.py:240 Looking for auth entry for 'docker.io'
DEBUG    docker.auth:auth.py:251 No entry found
DEBUG    docker.auth:auth.py:56 No auth config found
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "POST /v1.41/images/create?tag=5.4.3&fromImage=confluentinc%2Fcp-kafka HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/images/confluentinc/cp-kafka:5.4.3/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "POST /v1.41/containers/create HTTP/1.1" 201 88
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "POST /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/start HTTP/1.1" 204 0
Container started: 8dbc8cbfbc
INFO     testcontainers.core.container:container.py:62 Container started: 8dbc8cbfbc
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1650
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1650
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "PUT /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/archive?path=%2F HTTP/1.1" 200 0
Waiting to be ready...
INFO     testcontainers.core.waiting_utils:waiting_utils.py:46 Waiting to be ready...
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1650
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1650
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1641
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1642
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/8dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7/json HTTP/1.1" 200 None
DEBUG    urllib3.connectionpool:connectionpool.py:456 http://docker:2375 "GET /v1.41/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22id%22%3A+%5B%228dbc8cbfbc2fd063d21fa1725536ab766372580f829415f0748177a2a78952e7%22%5D%7D HTTP/1.1" 200 1646
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-closed
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name connections-created
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name select-time
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name io-time
DEBUG    kafka.client:client_async.py:374 Initiating connection to node bootstrap-0 at 172.18.0.1:49153
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name request-latency
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-sent
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.bytes-received
DEBUG    kafka.metrics.metrics:metrics.py:156 Added sensor with name node-bootstrap-0.latency
DEBUG    kafka.conn:conn.py:368 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 None]>: creating new socket
DEBUG    kafka.conn:conn.py:374 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <disconnected> [IPv4 ('172.18.0.1', 49153)]>: setting socket option (6, 1, 1)
INFO     kafka.conn:conn.py:380 <BrokerConnection node_id=bootstrap-0 host=172.18.0.1:49153 <connecting> [IPv4 ('172.18.0.1', 49153)]>: connecting to 172.18.0.1:49153 [('172.18.0.1', 49153) IPv4]
INFO     kafka.conn:conn.py:1205 Probing node bootstrap-0 broker version
ERROR: Job failed: execution took longer than 3m0s seconds

May 16 '22 19:05 hogklint

Testing on gitlab CI is rather difficult because of this issue. In short, gitlab cannot run CI on forks which means every change would first have to be pushed onto a branch in the main repository. I don't expect to pick it up again until the issue is resolved.

May 20 '22 19:05 tillahoffmann

I modified the test to have greater control over the container setup.

import logging
import socket
import time

from kafka import KafkaConsumer
from kafka.errors import KafkaError, NoBrokersAvailable, UnrecognizedBrokerVersion
from testcontainers.kafka import KafkaContainer

LOG = logging.getLogger(__name__)


def test_containers():
    kc = KafkaContainer()
    command = f'sh -c "while [ ! -f {KafkaContainer.TC_START_SCRIPT} ]; do sleep 0.1; done; bash {KafkaContainer.TC_START_SCRIPT}"'
    kc.with_command(command)
    super(type(kc), kc).start()
    kc.tc_start()
    if True:
        my_connect(kc)
    else:
        time.sleep(20)
        socket_test(kc)


def socket_test(kc):
    try:
        s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
        s.settimeout(60)
        s.connect((kc.get_container_host_ip(), int(kc.get_exposed_port(kc.port_to_expose))))
    except Exception:
        LOG.exception("socket error")


TRANSIENT_EXCEPTIONS = (
    TimeoutError,
    ConnectionError,
    UnrecognizedBrokerVersion,
    NoBrokersAvailable,
    KafkaError,
    ValueError,
)


def my_connect(kc):
    for i in range(20):
        try:
            bootstrap_server = kc.get_bootstrap_server()
            LOG.info("my_connect bootstrap_server: %s", bootstrap_server)
            consumer = KafkaConsumer(group_id="test", bootstrap_servers=[bootstrap_server])
            if not consumer.topics():
                raise KafkaError("Unable to connect with kafka container!")
            return
        except TRANSIENT_EXCEPTIONS:
            LOG.exception("my_connect failed")
        time.sleep(2)

When my_connect is called the error is

ERROR    test_testcontainers:test_testcontainers.py:172 my_connect failed
Traceback (most recent call last):
  File "/builds/dkinternal/heimdall-be/test_testcontainers.py", line 166, in my_connect
    consumer = KafkaConsumer(group_id="test", bootstrap_servers=[bootstrap_server])
  File "/usr/local/lib/python3.9/site-packages/kafka/consumer/group.py", line 356, in __init__
    self._client = KafkaClient(metrics=self._metrics, **self.config)
  File "/usr/local/lib/python3.9/site-packages/kafka/client_async.py", line 244, in __init__
    self.config['api_version'] = self.check_version(timeout=check_timeout)
  File "/usr/local/lib/python3.9/site-packages/kafka/client_async.py", line 927, in check_version
    raise Errors.NoBrokersAvailable()
kafka.errors.NoBrokersAvailable: NoBrokersAvailable

socket_test gives a timeout

ERROR    test_testcontainers:test_testcontainers.py:62 socket error
Traceback (most recent call last):
  File "/builds/dkinternal/heimdall-be/test_testcontainers.py", line 55, in socket_test
    s.connect((kc.get_container_host_ip(), int(kc.get_exposed_port(kc.port_to_expose))))
socket.timeout: timed out

I've extracted the Kafka container logs and found no issues. The listening IP and port listed in the log are the same as generated by testcontainers' get_bootstrap_server. It appears to me that the test container and the Kafka container cannot reach each other.

I tried setting FF_NETWORK_PER_BUILD but it made no difference. I have the feeling it only affects services listed in .gitlab-ci.yaml.

May 21 '22 14:05 hogklint

This gitlab runner issue seems relevant. Some conflicting reports on whether it works or not. https://gitlab.com/gitlab-org/gitlab-runner/-/issues/3251

May 23 '22 10:05 hogklint

I just got the PostgreSQL container running it GitLab using Docker-in-Docker and the following fix for the container:

class FixedPostgresContainer(PostgresContainer):
    """
    This class fixes a bug that the PostgresContainer does not start if docker runs on a dedicated host
    (DOCKER_HOST is set).
    See: https://github.com/testcontainers/testcontainers-python/issues/217
    """
    def get_connection_url(self, host=None) -> str:
        if host is None:
            host = self.get_docker_client().host()
        return super().get_connection_url(host)

Then just use FixedPostgresContainer instead of PostgresContainer.

For me the container was trying to connect to Postgres on a local socket and did not respect the DOCKER_HOST variable. Maybe it would make sense to add this fix to the postgres container.

Aug 17 '22 10:08 jakobbraun

Interesting, @jakobbraun. Do you know why this resolves the issue? It seems to me like the fixed version should give the same result. In particular, the call sequence is as follows (in the unfixed version).

https://github.com/testcontainers/testcontainers-python/blob/b4ccb972e9edcc2289cce7fb66524d3f4865b7fb/testcontainers/postgres.py#L56-L62

So host is passed as is (still None) to ...

https://github.com/testcontainers/testcontainers-python/blob/b4ccb972e9edcc2289cce7fb66524d3f4865b7fb/testcontainers/core/generic.py#L38-L50

Because host is still None we end up calling ...

https://github.com/testcontainers/testcontainers-python/blob/b4ccb972e9edcc2289cce7fb66524d3f4865b7fb/testcontainers/core/container.py#L84-L102

But that also returns self.get_docker_client().host(), the same as the fixed version. Any idea what I'm missing?

Aug 18 '22 02:08 tillahoffmann

Ok, now I found the time to take a clother look. (Don't wonder that I changed the github account. Now it's my company account but still me.) You're right. I jsut accidentially fixed the problem. The line you mentioned is also perfectly fine. The issue is the if inside_container() condition: This is true since we are in a contaiener. Insdie the condition we then return something else then the value of host.

My "fix" did not use this method and therefore did work.

I just noticed that the code inside the condition does not fit to the comment. The comment sais:

otherwise fall back to detected host address

But the code falls back on the gateway_ip .

Aug 26 '22 10:08 hpsjakob

Would you mind trying this snippet just to check that we have a valid host variable?

class FixedPostgresContainer(PostgresContainer):
    """
    This class fixes a bug that the PostgresContainer does not start if docker runs on a dedicated host
    (DOCKER_HOST is set).
    See: https://github.com/testcontainers/testcontainers-python/issues/217
    """
    def get_connection_url(self, host=None) -> str:
        if host is None:
            host = self.get_docker_client().host()
            assert host
        return super().get_connection_url(host)

Aug 30 '22 14:08 tillahoffmann

For what it's worth, the fix @jakobbraun suggested also seems to work for the MySqlContainer:

class FixedMySqlContainer(MySqlContainer):
    def get_connection_url(self, host=None) -> str:
        if host is None:
            host = self.get_docker_client().host()
        return super()._create_connection_url(dialect="mysql+pymysql",
                                              username=self.MYSQL_USER,
                                              password=self.MYSQL_PASSWORD,
                                              db_name=self.MYSQL_DATABASE,
                                              port=self.port_to_expose,
                                              host=host)

Also tested this locally, that seems to work fine too.

Building further upon what @hpsjakob said:

Ok, now I found the time to take a clother look. (Don't wonder that I changed the github account. Now it's my company account but still me.) You're right. I jsut accidentially fixed the problem. The line you mentioned is also perfectly fine. The issue is the if inside_container() condition: This is true since we are in a contaiener. Insdie the condition we then return something else then the value of host.

IMO, this seems exactly right. Some test in Gitlab show that self.get_docker_client().host() is going to resolve to "docker" when "DOCKER_HOST" is set to "tcp://docker:2375". The gateway and the bridge ip of the started container are always going to differ from the ip of the "docker:dind" service, given that the service is started as a separate container.

I might be oversimplifying here, but isn't a check for whether "DOCKER_HOST" is set enough for determining at least the docker-in-docker situations?

Nov 02 '22 20:11 Duchadian

@tillahoffmann , tested functioning in Gitlab with the workaround present in the latest version (i.e. 3.7.1). Seems like it is resolved, and this issue can be closed.

Dec 07 '22 14:12 Duchadian

Nice, thanks for the update.

Dec 07 '22 15:12 tillahoffmann