Extend Compose setup and e2e tests with multiple Kafka providers

[nscuro]

Description

Extends the Compose setup, which previously solely relied on Redpanda, with Apache Kafka and Tansu. Defaults to Apache Kafka (native) in accordance with #854. While a Tansu setup is added, Tansu can not yet be used with Hyades. It runs into errors when the API server tries to produce to it.

Extends e2e tests to support testing again different Kafka providers. Currently supported are Apache Kafka, Apache Kafka native, and Redpanda. Tansu will be added once it's functional.

To enable all of the above, the create-topics.sh script had to be modified to use official Kafka CLI tools (i.e. kafka-topics.sh) instead of the Redpanda CLI. The official tooling uses the Kafka API and is thus provider-independent.

Addressed Issue

Relates to #854

Additional Details

N/A

Checklist

• [x] I have read and understand the contributing guidelines
• ~This PR fixes a defect, and I have provided tests to verify that the fix is effective~
• [x] This PR implements an enhancement, and I have provided tests to verify that it works as intended
• ~This PR introduces changes to the database model, and I have updated the migration changelog accordingly~
• ~This PR introduces new or alters existing behavior, and I have updated the documentation accordingly~

[codacy-production[bot]]

Coverage summary from Codacy

See diff coverage on Codacy

Coverage variation	Diff coverage
:white_check_mark: +18.32% (target: -1.00%)	:white_check_mark: ∅ (target: 70.00%)

Coverage variation details

	Coverable lines	Covered lines	Coverage
Common ancestor commit (f26e179339f8d1b303789599c35aa0697df7bfa7)	201	132	65.67%
Head commit (35dac0af92876480e36bb6a3c55e9dae18d56f90)	6892 (+6691)	5789 (+5657)	84.00% (+18.32%)

Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: <coverage of head commit> - <coverage of common ancestor commit>

Diff coverage details

	Coverable lines	Covered lines	Diff coverage
Pull request (#1547)	0	0	∅ (not applicable)

Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: <covered lines added or modified>/<coverable lines added or modified> * 100%

See your quality gate settings    Change summary preferences

_{Codacy stopped sending the deprecated coverage status on June 5th, 2024. Learn more}

[nscuro]

Abandoning this. We'll work towards removing Kafka entirely instead.