[bitnami/kafka] Kafka configuration parameters is NULL,

[vladimircape]

Name and Version

bitnami/kafka:3.6.2

What architecture are you using?

amd64

What steps will reproduce the bug?

environment:
  # KRaft settings
  - KAFKA_CFG_NODE_ID=2
  - KAFKA_CFG_PROCESS_ROLES=controller,broker
  - KAFKA_CFG_CONTROLLER_QUORUM_VOTERS=0@kafka-0:9093,1@kafka-1:9093,2@kafka-2:9093
  - KAFKA_KRAFT_CLUSTER_ID=abcdefghijklmnopqrstuv
  # Listeners
  - KAFKA_CFG_LISTENERS=PLAINTEXT://:9092,CONTROLLER://:9093,EXTERNAL://:9096
  - KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://:9092,EXTERNAL://${HOST_IP}:9096
  - KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=PLAINTEXT:PLAINTEXT,CONTROLLER:PLAINTEXT,EXTERNAL:PLAINTEXT
  - KAFKA_CFG_CONTROLLER_LISTENER_NAMES=CONTROLLER
  - KAFKA_CFG_INTER_BROKER_LISTENER_NAME=PLAINTEXT
  # Clustering
  - KAFKA_CFG_OFFSETS_TOPIC_REPLICATION_FACTOR=3
  - KAFKA_CFG_TRANSACTION_STATE_LOG_REPLICATION_FACTOR=3
  - KAFKA_CFG_TRANSACTION_STATE_LOG_MIN_ISR=2
  - KAFKA_CFG_MAX_REQUEST_SIZE=16777216
  - KAFKA_CFG_MAX_MESSAGE_BYTES=16777216
  - KAFKA_CFG_MAX_PARTITION_FETCH_BYTES=16777216
  - KAFKA_CFG_MESSAGE_MAX_BYTES=16777216
  - KAFKA_CFG_REPLICA_FETCH_MAX_BYTES=16777216
  - FETCH_MESSAGE_MAX_BYTES=16777216
  - KAFKA_CFG_FETCH_MESSAGE_MAX_BYTES=16777216

What is the expected behavior?

/opt/bitnami/kafka/bin/kafka-configs.sh to see applied values

What do you see instead?

server.properties|producer.properties] has the right value. But the output of /opt/bitnami/kafka/bin/kafka-configs.sh is still: max.request.size=null

fetch.message.max.bytes=null sensitive=true synonyms={STATIC_BROKER_CONFIG:fetch.message.max.bytes=null} max.message.bytes=null sensitive=true synonyms={STATIC_BROKER_CONFIG:max.message.bytes=null} max.partition.fetch.bytes=null sensitive=true synonyms={STATIC_BROKER_CONFIG:max.partition.fetch.bytes=null} max.request.size=null sensitive=true synonyms={STATIC_BROKER_CONFIG:max.request.size=null}

Additional information

No response

[juan131]

Hi @vladimircape

Could you please share the container logs? It'd be great if you could add the environment variable BITNAMI_DEBUG=true to increase the verbosity.

[github-actions[bot]]

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

[kapyaar]

Hi, May I add a similar issue that I am facing?

I am trying to test the log retention settings to make it delete older messages. For the test, I want to delete messages after 20 seconds. I am using the the following yml in docker.

services:
  php:
    build:
      context: .
      dockerfile: Dockerfile
    working_dir: /var/www/html/
    ports:
      - 8000:80
      - 8443:443
  
  zookeeper:
    image: 'bitnami/zookeeper:latest'
    ports:
      - 2181:2181
    environment:
      - ALLOW_ANONYMOUS_LOGIN=yes

  kafka:
    image: 'bitnami/kafka:latest'
    ports:
      - 9092:9092
    environment:
      KAFKA_ADVERTISED_HOST_NAME: kafka
      KAFKA_CREATE_TOPICS: "test:1:1:delete --config=retention.ms=20000"
      # KAFKA_CREATE_TOPICS: "test:1:1"
      KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
      KAFKA_LOG_RETENTION_MS: 20000
      KAFKA_LOG_ROLL_MS: 10000
      KAFKA_LOG_RETENTION_CHECK_INTERVAL_MS: 5000
      KAFKA_LOG_CLEANUP_POLICY: delete
      KAFKA_LOG_CLEANER_DELETE_RETENTION_MS: 5000
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    depends_on:
      - zookeeper

With this setting, I would expect that If I run a consumer to consume from the beginning, after 20 seconds, the consumer should not see this message. But it does.

So, Took a look at /opt/bitnami/kafka/bin$ kafka-configs.sh --bootstrap-server kafka:9092 --entity-type topics --entity-name test --describe --all

And the values look like default settings. Am I doing something wrong?

[kapyaar]

OK, my bad. It turns out the variable names need to have an _CFG. I was using an old example which did not reflect this change. Even on docker hub, while the example yml shows this change, the section that talks about "Customizable Environmental Variables" still lists them without the _CFG.

[github-actions[bot]]

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.