KAFKA-18053 Clean up topology config
Pull request to implement KIP-1138, which aims to address several issues related to the configuration application process in Kafka Streams.
This PR has multiple goals:
-
Deprecate
TopologyConfigin favor ofStreamsConfig. -
Deprecate
StreamsBuilder#build(StreamsConfig)and encourage users to pass configurations via theStreamsBuilderconstructor instead. -
Deprecate constructors in
StreamsBuilderand Topology that accept aTopologyConfig, replacing them with constructors that accept a Properties or Map. -
Improve misconfiguration detection by:
- Throwing an exception if a topology-specific config is set in
StreamsConfigbut not applied to the topology. - Logging a warning if a topology-specific config is set in both places but has different values.
- Throwing an exception if a topology-specific config is set in
KIP is still under discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1138%3A+Clean+up+TopologyConfig+and+API+for+supplying+configs+needed+by+the+topology
KIP is still under discussion: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1138%3A+Clean+up+TopologyConfig+and+API+for+supplying+configs+needed+by+the+topology
@mjsax The KIP is voted since june: https://lists.apache.org/[email protected]:2025-6:KIP-1138 Do I have to update the status ?
Ah. Never mind than. -- Please update the status to "accepted" :) Thanks.
This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the PR has merge conflicts, update it with the latest from the base branch.
If you are having difficulty finding a reviewer, please reach out on the [mailing list](https://kafka.apache.org/contact).
If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.