kop icon indicating copy to clipboard operation
kop copied to clipboard

[BUG] KTable doesn't work against KoP enabled cluster.

Open david-streamlio opened this issue 3 years ago • 10 comments

Describe the bug When attempting to use the KTable feature from the latest version (3.1.0) of the kafka-streams library, no results are produced.

To Reproduce Steps to reproduce the behavior:

  1. Run the WordCount class using your own credentials.
  2. Next, send some data to the input topic using the Word Generator
  3. Observe that no data is produced to the output topic or written to the console.

Expected behavior I expect the code to properly calculate the word count for each of the words in the topic.

david-streamlio avatar May 03 '22 22:05 david-streamlio

Could you grant the access permission to the kafka-migration repo for platform engineers?

BewareMyPower avatar May 05 '22 01:05 BewareMyPower

I think that the Sijie can grant that access.

On Wed, May 4, 2022, 6:52 PM Yunze Xu @.***> wrote:

Could you grant the access permission to the kafka-migration repo for platform engineers?

— Reply to this email directly, view it on GitHub https://github.com/streamnative/kop/issues/1266#issuecomment-1118091401, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIOS2EOFLWEYGVDTOCSSGPLVIMSXHANCNFSM5VAHE5QA . You are receiving this because you authored the thread.Message ID: @.***>

david-streamlio avatar May 05 '22 01:05 david-streamlio

ping @sijie

BewareMyPower avatar May 05 '22 02:05 BewareMyPower

I'm working on adding a test for KTable to debug this issue since we seem to only have a test for GlobalKTable.

ZiyaoWei avatar Jun 10 '22 14:06 ZiyaoWei

Can you share a link to the GloablKTable test?

david-streamlio avatar Jun 10 '22 14:06 david-streamlio

@david-streamlio: It's https://github.com/streamnative/kop/blob/c4d1892d13ae5f2543e5e2deb0a4b4778180f27b/tests/src/test/java/io/streamnative/pulsar/handlers/kop/streams/GlobalKTableTest.java, hope that helps!

ZiyaoWei avatar Jun 10 '22 15:06 ZiyaoWei

@david-streamlio - I added some tests in #1331 and they all pass - will dig a bit more but I suspect it's an environmental issue?

ZiyaoWei avatar Jun 10 '22 16:06 ZiyaoWei

Perhaps, FWIW I ran my code against an StreamNative cloud instance with KoP enabled.

david-streamlio avatar Jun 10 '22 16:06 david-streamlio

Yunze,

Were you able to gain access to this repo?

Regards,

David Kjerrumgaard Developer Advocate

e: @.***

p: +1.330.437.5467

streamnative.io

http://github.com/streamnative https://www.linkedin.com/company/streamnative/ https://twitter.com/streamnativeio/

On Thu, May 5, 2022 at 3:01 AM Yunze Xu @.***> wrote:

ping @sijie https://github.com/sijie

— Reply to this email directly, view it on GitHub https://github.com/streamnative/kop/issues/1266#issuecomment-1118094679, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIOS2EPTIW5OSJUV67SRUELVIMTWXANCNFSM5VAHE5QA . You are receiving this because you authored the thread.Message ID: @.***>

david-streamlio avatar Oct 11 '22 08:10 david-streamlio

Yes now.

BewareMyPower avatar Oct 12 '22 09:10 BewareMyPower