starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

[Enhancement] Improve kafka authentication error message

Open wyb opened this issue 1 year ago • 2 comments

Why I'm doing:

kafka server uses sasl_ssl but create routine load job with security.protocol = sasl_plaintext

ErrorReason{errCode = 4, msg='Job failed to fetch all current partition with error [failed to get kafka topic: test meta, err: Local: Broker transport failure, , BE: TNetworkAddress(hostname:127.0.0.1, port:8060)]'}

What I'm doing:

the authentication errors event only be triggered when the consumer is closed. close consumer and wait the errors event when message is empty.

ErrorReason{errCode = 4, msg='Job failed to fetch all current partition with error [failed to get kafka topic: test meta, err: Local: Broker transport failure, event: 127.0.0.1:9092/bootstrap: Disconnected while requesting ApiVersion: might be caused by incorrect security.protocol configuration (connecting to a SSL listener?) or broker version is < 0.10 (see api.version.request) (after 5003ms in state APIVERSION_QUERY), BE: TNetworkAddress(hostname:127.0.0.1, port:8060)]'}

Fixes #issue

What type of PR is this:

  • [ ] BugFix
  • [ ] Feature
  • [x] Enhancement
  • [ ] Refactor
  • [ ] UT
  • [ ] Doc
  • [ ] Tool

Does this PR entail a change in behavior?

  • [x] Yes, this PR will result in a change in behavior.
  • [ ] No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

  • [x] Interface/UI changes: syntax, type conversion, expression evaluation, display information
  • [ ] Parameter changes: default values, similar parameters but with different default values
  • [ ] Policy changes: use new policy to replace old one, functionality automatically enabled
  • [ ] Feature removed
  • [ ] Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

  • [ ] I have added test cases for my bug fix or my new feature
  • [ ] This pr needs user documentation (for new or modified features or behaviors)
    • [ ] I have added documentation for my new feature or new function
  • [ ] This is a backport pr

Bugfix cherry-pick branch check:

  • [x] I have checked the version labels which the pr will be auto-backported to the target branch
    • [x] 3.3
    • [x] 3.2
    • [x] 3.1
    • [ ] 3.0
    • [ ] 2.5

wyb avatar Jun 28 '24 11:06 wyb

[FE Incremental Coverage Report]

:white_check_mark: pass : 0 / 0 (0%)

github-actions[bot] avatar Jul 10 '24 11:07 github-actions[bot]

[BE Incremental Coverage Report]

:white_check_mark: pass : 9 / 10 (90.00%)

file detail

path covered_line new_line coverage not_covered_line_detail
:large_blue_circle: be/src/runtime/routine_load/data_consumer.cpp 7 8 87.50% [352]
:large_blue_circle: be/src/runtime/routine_load/data_consumer.h 2 2 100.00% []

github-actions[bot] avatar Jul 10 '24 11:07 github-actions[bot]

@Mergifyio backport branch-3.3

github-actions[bot] avatar Jul 17 '24 06:07 github-actions[bot]

@Mergifyio backport branch-3.2

github-actions[bot] avatar Jul 17 '24 06:07 github-actions[bot]

@Mergifyio backport branch-3.1

github-actions[bot] avatar Jul 17 '24 06:07 github-actions[bot]

backport branch-3.3

✅ Backports have been created

mergify[bot] avatar Jul 17 '24 06:07 mergify[bot]

backport branch-3.2

✅ Backports have been created

mergify[bot] avatar Jul 17 '24 06:07 mergify[bot]

backport branch-3.1

✅ Backports have been created

mergify[bot] avatar Jul 17 '24 06:07 mergify[bot]