Incorrect seek() handling in 23.1.20

[TomaszGaweda]

In Hazelcast we have such test: https://github.com/hazelcast/hazelcast/blob/master/extensions/kafka/src/test/java/com/hazelcast/jet/kafka/impl/StreamKafkaPTest.java#L638

When we run this test with parameters -Dtest.kafka.use.redpanda -Dtest.redpanda.version="v23.1.21" the test fails - some items seems to be lost.

When running the same test, but with -Dtest.kafka.use.redpanda -Dtest.redpanda.version="v23.1.10", the test passes. When using native Kafka it also passes, that's why I think it's RedPanda's bug introduces somewhere between v23.1.10 and v23.1.21.

This test in general tests the ability to provide initial offsets to read from, it's using seek() operation.

OS etc. doesn't really matter, fails on my Mac M1 and on Jenkins (Ubuntu x86 IIRC). We are using docker.redpanda.com/redpandadata/redpanda image, connecting via Kafka client version 3.6.1

Logs from passing run: https://gist.github.com/TomaszGaweda/07bc73e64d744c4113e1f273a92b0298 Logs from failing run: https://gist.github.com/TomaszGaweda/a999867e422b54c29e99dcdf824656b6 Logs are too long to include directly, sorry for that ;)