beam icon indicating copy to clipboard operation
beam copied to clipboard

PubsubMessageWithTopicCoder.of() is returning wrong coder

Open stankiewicz opened this issue 1 year ago • 6 comments

PubsubMessageWithTopicCoder should return PubsubMessageWithTopicCoder PubsubMessageWithAttributesAndMessageIdCoder.

While investigating Dynamic Destinations on Direct runner I found out that PubsubMessageWithTopicCoder is never used and topic is lost and pipeline fails.

fixes #31679

stankiewicz avatar Jun 17 '24 13:06 stankiewicz

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @m-trieu for label java. R: @chamikaramj for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

github-actions[bot] avatar Jun 17 '24 14:06 github-actions[bot]

@stankiewicz do you mind also cleaning up the one occurrence of new PubsubMessageWithTopicCoder() here to use PubsubMessageWithTopicCoder.of() instead?

sjvanrossum avatar Jun 17 '24 15:06 sjvanrossum

Ah, wow. Thanks for the fix.

Out of curiosity, did you actually run into a failure due to this ? Also, would you mind filing a Github issue with details and the actual failure you potentially ran into ?

chamikaramj avatar Jun 24 '24 18:06 chamikaramj

Yes. It took a while to debug the issue:) bug is created.

stankiewicz avatar Jun 24 '24 19:06 stankiewicz

Thanks LGTM.

Seems like this was added in https://github.com/apache/beam/pull/26063/files

cc: @reuvenlax in case we are missing something here.

chamikaramj avatar Jun 24 '24 20:06 chamikaramj

Shall we merge it?

stankiewicz avatar Jun 27 '24 09:06 stankiewicz

Reminder, please take a look at this pr: @m-trieu @chamikaramj

github-actions[bot] avatar Jul 04 '24 12:07 github-actions[bot]

Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment assign to next reviewer:

R: @robertwb for label java. R: @ahmedabu98 for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

github-actions[bot] avatar Jul 09 '24 12:07 github-actions[bot]

Reminder, please take a look at this pr: @robertwb @ahmedabu98

github-actions[bot] avatar Jul 16 '24 12:07 github-actions[bot]

Assigning new set of reviewers because Pr has gone too long without review. If you would like to opt out of this review, comment assign to next reviewer:

R: @Abacn for label java. R: @damondouglas for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

github-actions[bot] avatar Jul 19 '24 12:07 github-actions[bot]