datahub-actions configurations do not provide parameters for connection details

[manuschillerdev]

Describe the bug the config files under https://github.com/datahub-project/datahub/tree/master/docker/datahub-actions/config currently do not offer parameters to configure connection details like SSL-settings for kafka.

The container also can not work with JKS files as the Java services, it needs PEM or PKCS12.

As am example, I'd expect to see parameters in this section in the executor.yaml file:

name: ${DATAHUB_ACTIONS_INGESTION_EXECUTOR_CONSUMER_GROUP_ID:-ingestion_executor}
source:
  type: "kafka"
  config:
    connection:
      bootstrap: ${KAFKA_BOOTSTRAP_SERVER:-localhost:9092}
      schema_registry_url: ${SCHEMA_REGISTRY_URL:-http://localhost:8081}
+    consumer_config:
+      security.protocol: ${KAFKA_PROPERTIES_SECURITY_PROTOCOL}
+      ssl.ca.location: ${KAFKA_PROPERTIES_SSL_CA_LOCATION}
+      ssl.certificate.location: ${KAFKA_PROPERTIES_SSL_CERTIFICATE_LOCATION}
+      ssl.key.location: ${KAFKA_PROPERTIES_SSL_KEY_LOCATION}
    topic_routes:
      mcl: ${METADATA_CHANGE_LOG_VERSIONED_TOPIC_NAME:-MetadataChangeLog_Versioned_v1}
      pe: ${PLATFORM_EVENT_TOPIC_NAME:-PlatformEvent_v1}

To Reproduce

1. configure an external kafka instance secured using SSL
2. check the connection of the datahub-actions container

Expected behavior As a datahub-admin, I want to be able to set the kafka connection settings globally for the datahub-actions container.

Container

• Version v1.2.0.1

Additional context related to

• https://github.com/acryldata/datahub-helm/issues/601
• https://datahubspace.slack.com/archives/CUMUWQU66/p1750891008412709
• https://github.com/datahub-project/datahub/issues/5706

[joaquinmenchaca-bit]

This issue is almost 4 years old.

Related issues: https://github.com/datahub-project/datahub/issues/4287 https://github.com/datahub-project/datahub/issues/5786 https://github.com/acryldata/datahub-helm/issues/601 https://github.com/datahub-project/datahub/issues/5706