strimzi-kafka-operator icon indicating copy to clipboard operation
strimzi-kafka-operator copied to clipboard

Published 20 hours ago • verified publisher icon strimzi

[ST] default builders for plain/tls internal clients

Open henryZrncik opened this issue 1 year ago • 2 comments

Type of change

  • Refactoring

Description

Changes described by files:

TestConstants and TestStorage

Concerned mainly with new fields (added for smooth work with continuous clients)

  • continuousProducerName (All 3 same as their basic counterparts but with extra suffix)
  • continuousConsumerName
  • continuousTopicName
  • continuousMessageCount (300 in comparison to 100)

ClientUtils

public static KafkaClientsBuilder getDefaultContinuousClientBuilder(TestStorage testStorage) { and public static KafkaClientsBuilder getDefaultBasicClientBuilder(TestStorage testStorage) added for their respective usage their differ in what params of testorage are used here but mostly with number of meesages and wait between them.

as these clients are basically hello world (used to be called that way) i put there also bootstrap address for plain text port. there is additionaly namespace and default user which are there for completness.

Any of them can be changed and as can be seen in specific tests they sometimes are which makes it visible what is actually important about given producer/consumer.

additional helper method waitForContinuousClientSuccess which waits specifically for continuous clients.

<specific>ST classes

changes include:

  • replacing Environment.TEST_SUITE_NAMESPACE with testStorage atlernative.
  • removal of unncessary names for producer and consumers espcially with prefixes continuous or <random> if not needed
  • some continuous client time and message shortening due to very long waiting just for message sending
  • slight refactors and removals of unnecessary methods.

henryZrncik avatar Feb 08 '24 01:02 henryZrncik

/azp run regression

see-quick avatar Feb 08 '24 08:02 see-quick

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Feb 08 '24 08:02 azure-pipelines[bot]

/azp run regression

im-konge avatar Feb 27 '24 20:02 im-konge

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Feb 27 '24 20:02 azure-pipelines[bot]

@strimzi-ci run tests --testcase=RackAwarenessST --profile=all --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Feb 28 '24 22:02 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Feb 28 '24 22:02 strimzi-ci

:heavy_check_mark: Test Summary :heavy_check_mark:

TEST_PROFILE: all GROUPS: TEST_CASE: RackAwarenessST TOTAL: 3 PASS: 3 FAIL: 0 SKIP: 0 BUILD_NUMBER: 9 OCP_VERSION: 4.15 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 5 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

strimzi-ci avatar Feb 28 '24 23:02 strimzi-ci

@strimzi-ci run tests --profile=all --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Feb 29 '24 10:02 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Feb 29 '24 10:02 strimzi-ci

:x: Test Summary :x:

TEST_PROFILE: all GROUPS: TEST_CASE: TOTAL: 191 PASS: 150 FAIL: 38 SKIP: 3 BUILD_NUMBER: 10 OCP_VERSION: 4.15 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 5 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

:heavy_exclamation_mark: Test Failures :heavy_exclamation_mark:

  • testCorsForbidden in io.strimzi.systemtest.bridge.HttpBridgeCorsST
  • testSendSimpleMessage in io.strimzi.systemtest.bridge.HttpBridgeST
  • testReceiveSimpleMessageTlsScramSha in io.strimzi.systemtest.bridge.HttpBridgeScramShaST
  • testReceiveSimpleMessageTls in io.strimzi.systemtest.bridge.HttpBridgeTlsST
  • testKafkaQuotasPluginIntegration in io.strimzi.systemtest.kafka.QuotasST
  • testKafkaZookeeperAndKafkaConnectWithJMX in io.strimzi.systemtest.metrics.JmxST
  • io.strimzi.systemtest.metrics.MetricsST
  • testKafkaMirrorMaker2ConnectorsState in io.strimzi.systemtest.mirrormaker.MirrorMaker2ST
  • testScaleMirrorMakerUpAndDownToZero in io.strimzi.systemtest.mirrormaker.MirrorMakerST
  • testMultipleCOsInDifferentNamespaces in io.strimzi.systemtest.operators.MultipleClusterOperatorsST
  • testPauseReconciliationInKafkaRebalanceAndTopic in io.strimzi.systemtest.operators.ReconciliationST
  • testAddingAndRemovingJbodVolumes in io.strimzi.systemtest.rollingupdate.AlternativeReconcileTriggersST
  • testNPWhenOperatorIsInDifferentNamespaceThanOperand in io.strimzi.systemtest.security.NetworkPoliciesST
  • testAutoReplaceAllCaKeysTriggeredByAnno in io.strimzi.systemtest.security.SecurityST
  • io.strimzi.systemtest.security.oauth.OauthAuthorizationST
  • io.strimzi.systemtest.security.oauth.OauthPasswordGrantsST
  • io.strimzi.systemtest.security.oauth.OauthPlainST
  • io.strimzi.systemtest.security.oauth.OauthScopeST
  • io.strimzi.systemtest.security.oauth.OauthTlsST
  • testDrainCleanerWithComponents in io.strimzi.systemtest.specific.DrainCleanerST
  • testKafkaClusterUpgrade in io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST
  • testDowngradeStrimziVersion testDowngradeStrimziVersion-HEAD-0.39.0 in io.strimzi.systemtest.upgrade.kraft.KRaftStrimziDowngradeST
  • testUpgradeAcrossVersionsWithNoKafkaVersion in io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST

Re-run command: @strimzi-ci run tests --profile=all --testcase=io.strimzi.systemtest.bridge.HttpBridgeCorsST#testCorsForbidden,io.strimzi.systemtest.bridge.HttpBridgeST#testSendSimpleMessage,io.strimzi.systemtest.bridge.HttpBridgeScramShaST#testReceiveSimpleMessageTlsScramSha,io.strimzi.systemtest.bridge.HttpBridgeTlsST#testReceiveSimpleMessageTls,io.strimzi.systemtest.kafka.QuotasST#testKafkaQuotasPluginIntegration,io.strimzi.systemtest.metrics.JmxST#testKafkaZookeeperAndKafkaConnectWithJMX,io.strimzi.systemtest.metrics.MetricsST,io.strimzi.systemtest.mirrormaker.MirrorMaker2ST#testKafkaMirrorMaker2ConnectorsState,io.strimzi.systemtest.mirrormaker.MirrorMakerST#testScaleMirrorMakerUpAndDownToZero,io.strimzi.systemtest.operators.MultipleClusterOperatorsST#testMultipleCOsInDifferentNamespaces,io.strimzi.systemtest.operators.ReconciliationST#testPauseReconciliationInKafkaRebalanceAndTopic,io.strimzi.systemtest.rollingupdate.AlternativeReconcileTriggersST#testAddingAndRemovingJbodVolumes,io.strimzi.systemtest.security.NetworkPoliciesST#testNPWhenOperatorIsInDifferentNamespaceThanOperand,io.strimzi.systemtest.security.SecurityST#testAutoReplaceAllCaKeysTriggeredByAnno,io.strimzi.systemtest.security.oauth.OauthAuthorizationST,io.strimzi.systemtest.security.oauth.OauthPasswordGrantsST,io.strimzi.systemtest.security.oauth.OauthPlainST,io.strimzi.systemtest.security.oauth.OauthScopeST,io.strimzi.systemtest.security.oauth.OauthTlsST,io.strimzi.systemtest.specific.DrainCleanerST#testDrainCleanerWithComponents,io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST#testKafkaClusterUpgrade,io.strimzi.systemtest.upgrade.kraft.KRaftStrimziDowngradeST#testDowngradeStrimziVersion testDowngradeStrimziVersion-HEAD-0.39.0,io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST#testUpgradeAcrossVersionsWithNoKafkaVersion

strimzi-ci avatar Mar 01 '24 08:03 strimzi-ci

@strimzi-ci run tests --profile=all --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Mar 04 '24 08:03 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Mar 04 '24 08:03 strimzi-ci

:x: Test Summary :x:

TEST_PROFILE: all GROUPS: TEST_CASE: TOTAL: 191 PASS: 153 FAIL: 35 SKIP: 3 BUILD_NUMBER: 14 OCP_VERSION: 4.15 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 5 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

:heavy_exclamation_mark: Test Failures :heavy_exclamation_mark:

  • testCorsForbidden in io.strimzi.systemtest.bridge.HttpBridgeCorsST
  • testReceiveSimpleMessage in io.strimzi.systemtest.bridge.HttpBridgeST
  • testReceiveSimpleMessageTlsScramSha in io.strimzi.systemtest.bridge.HttpBridgeScramShaST
  • testReceiveSimpleMessageTls in io.strimzi.systemtest.bridge.HttpBridgeTlsST
  • testKafkaQuotasPluginIntegration in io.strimzi.systemtest.kafka.QuotasST
  • testKafkaZookeeperAndKafkaConnectWithJMX in io.strimzi.systemtest.metrics.JmxST
  • io.strimzi.systemtest.metrics.MetricsST
  • testKMM2RollAfterSecretsCertsUpdateTLS in io.strimzi.systemtest.mirrormaker.MirrorMaker2ST
  • testScaleMirrorMakerUpAndDownToZero in io.strimzi.systemtest.mirrormaker.MirrorMakerST
  • testMultipleCOsInDifferentNamespaces in io.strimzi.systemtest.operators.MultipleClusterOperatorsST
  • testNPGenerationEnvironmentVariable in io.strimzi.systemtest.security.NetworkPoliciesST
  • testAutoReplaceAllCaKeysTriggeredByAnno in io.strimzi.systemtest.security.SecurityST
  • io.strimzi.systemtest.security.oauth.OauthAuthorizationST
  • io.strimzi.systemtest.security.oauth.OauthPasswordGrantsST
  • io.strimzi.systemtest.security.oauth.OauthPlainST
  • io.strimzi.systemtest.security.oauth.OauthScopeST
  • io.strimzi.systemtest.security.oauth.OauthTlsST
  • testDrainCleanerWithComponents in io.strimzi.systemtest.specific.DrainCleanerST
  • testKafkaClusterUpgrade in io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST
  • testDowngradeStrimziVersion testDowngradeStrimziVersion-HEAD-0.39.0 in io.strimzi.systemtest.upgrade.kraft.KRaftStrimziDowngradeST
  • testUpgradeAcrossVersionsWithNoKafkaVersion in io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST

Re-run command: @strimzi-ci run tests --profile=all --testcase=io.strimzi.systemtest.bridge.HttpBridgeCorsST#testCorsForbidden,io.strimzi.systemtest.bridge.HttpBridgeST#testReceiveSimpleMessage,io.strimzi.systemtest.bridge.HttpBridgeScramShaST#testReceiveSimpleMessageTlsScramSha,io.strimzi.systemtest.bridge.HttpBridgeTlsST#testReceiveSimpleMessageTls,io.strimzi.systemtest.kafka.QuotasST#testKafkaQuotasPluginIntegration,io.strimzi.systemtest.metrics.JmxST#testKafkaZookeeperAndKafkaConnectWithJMX,io.strimzi.systemtest.metrics.MetricsST,io.strimzi.systemtest.mirrormaker.MirrorMaker2ST#testKMM2RollAfterSecretsCertsUpdateTLS,io.strimzi.systemtest.mirrormaker.MirrorMakerST#testScaleMirrorMakerUpAndDownToZero,io.strimzi.systemtest.operators.MultipleClusterOperatorsST#testMultipleCOsInDifferentNamespaces,io.strimzi.systemtest.security.NetworkPoliciesST#testNPGenerationEnvironmentVariable,io.strimzi.systemtest.security.SecurityST#testAutoReplaceAllCaKeysTriggeredByAnno,io.strimzi.systemtest.security.oauth.OauthAuthorizationST,io.strimzi.systemtest.security.oauth.OauthPasswordGrantsST,io.strimzi.systemtest.security.oauth.OauthPlainST,io.strimzi.systemtest.security.oauth.OauthScopeST,io.strimzi.systemtest.security.oauth.OauthTlsST,io.strimzi.systemtest.specific.DrainCleanerST#testDrainCleanerWithComponents,io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST#testKafkaClusterUpgrade,io.strimzi.systemtest.upgrade.kraft.KRaftStrimziDowngradeST#testDowngradeStrimziVersion testDowngradeStrimziVersion-HEAD-0.39.0,io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST#testUpgradeAcrossVersionsWithNoKafkaVersion

strimzi-ci avatar Mar 05 '24 07:03 strimzi-ci

/azp list

see-quick avatar Mar 06 '24 09:03 see-quick

CI/CD Pipelines for this repository:

azure-pipelines[bot] avatar Mar 06 '24 09:03 azure-pipelines[bot]

/azp run feature-gates-regression

see-quick avatar Mar 06 '24 09:03 see-quick

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Mar 06 '24 09:03 azure-pipelines[bot]

@strimzi-ci run tests --profile=all --testcase=HttpBridgeST,MirrorMaker2ST --parallel-count=1 --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Mar 07 '24 09:03 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Mar 07 '24 09:03 strimzi-ci

:x: Test Summary :x:

TEST_PROFILE: all GROUPS: TEST_CASE: HttpBridgeST,MirrorMaker2ST TOTAL: 19 PASS: 17 FAIL: 2 SKIP: 0 BUILD_NUMBER: 30 OCP_VERSION: 4.15 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 1 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

:heavy_exclamation_mark: Test Failures :heavy_exclamation_mark:

  • testSendSimpleMessage in io.strimzi.systemtest.bridge.HttpBridgeST

Re-run command: @strimzi-ci run tests --profile=all --testcase=io.strimzi.systemtest.bridge.HttpBridgeST#testSendSimpleMessage

strimzi-ci avatar Mar 07 '24 12:03 strimzi-ci

@strimzi-ci run tests --cluster-type=ocp --cluster-version=4.14 --install-type=bundle --profile=all --testcase=HttpBridgeST,MirrorMaker2ST --parallel-count=1 --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Mar 07 '24 12:03 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Mar 07 '24 12:03 strimzi-ci

:heavy_check_mark: Test Summary :heavy_check_mark:

TEST_PROFILE: all GROUPS: TEST_CASE: HttpBridgeST,MirrorMaker2ST TOTAL: 19 PASS: 19 FAIL: 0 SKIP: 0 BUILD_NUMBER: 31 OCP_VERSION: 4.14 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 1 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

strimzi-ci avatar Mar 07 '24 15:03 strimzi-ci

@strimzi-ci run tests --cluster-type=ocp --cluster-version=4.14 --install-type=bundle --profile=all --testcase=KRaftStrimziUpgradeST,AlternativeReconcileTriggersST,KRaftKafkaUpgradeDowngradeST --parallel-count=1 --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Mar 07 '24 16:03 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Mar 07 '24 16:03 strimzi-ci

@strimzi-ci run tests --cluster-type=ocp --cluster-version=4.14 --install-type=bundle --profile=all --testcase= NetworkPoliciesST, HttpBridgeTlsST, KRaftStrimziDowngradeST --parallel-count=1 --env=STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

henryZrncik avatar Mar 07 '24 16:03 henryZrncik

:arrow_forward: Build started - check Jenkins for more info. :arrow_forward:

strimzi-ci avatar Mar 07 '24 16:03 strimzi-ci

/azp run kraft-regression

im-konge avatar Mar 07 '24 22:03 im-konge

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines[bot] avatar Mar 07 '24 22:03 azure-pipelines[bot]

:x: Test Summary :x:

TEST_PROFILE: all GROUPS: TEST_CASE: KRaftStrimziUpgradeST,AlternativeReconcileTriggersST,KRaftKafkaUpgradeDowngradeST TOTAL: 13 PASS: 5 FAIL: 8 SKIP: 0 BUILD_NUMBER: 32 OCP_VERSION: 4.14 BUILD_IMAGES: false FIPS_ENABLED: false PARALLEL_COUNT: 1 EXCLUDED_GROUPS: loadbalancer,nodeport,olm ENV_VARIABLES: STRIMZI_FEATURE_GATES=-KafkaNodePools,-UnidirectionalTopicOperator,-UseKRaft

:heavy_exclamation_mark: Test Failures :heavy_exclamation_mark:

  • testKafkaClusterUpgrade in io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST
  • testUpgradeAcrossVersionsWithNoKafkaVersion in io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST

Re-run command: @strimzi-ci run tests --profile=all --testcase=io.strimzi.systemtest.upgrade.kraft.KRaftKafkaUpgradeDowngradeST#testKafkaClusterUpgrade,io.strimzi.systemtest.upgrade.kraft.KRaftStrimziUpgradeST#testUpgradeAcrossVersionsWithNoKafkaVersion

strimzi-ci avatar Mar 07 '24 22:03 strimzi-ci