[Flink] An unstable UT: testMultiParallelismFailoverConsistencyRead(HiddenLogOperatorsTest) FAILURE!

Open YesOrNo828 opened this issue 3 years ago • 1 comments

Running com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest 22/08/2022 03:38:37.184 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:38:37.184 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] Starting KafkaTestBase 22/08/2022 03:38:37.185 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:38:37.187 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] Starting KafkaTestBase.prepare() for Kafka 2.0 22/08/2022 03:38:38.362 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestEnvironmentImpl] Starting Zookeeper with zookeeperConnectionString: 127.0.0.1:32969 22/08/2022 03:38:38.362 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestEnvironmentImpl] Starting KafkaServer 22/08/2022 03:38:40.528 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestEnvironmentImpl] ZK and KafkaServer started. 22/08/2022 03:38:40.567 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=0, restore=false, lastCkpComplete=null. 22/08/2022 03:38:41.494 ERROR [kafka.server.ReplicaFetcherThread] [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __transaction_state-42 at offset 0 org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 22/08/2022 03:38:41.497 ERROR [kafka.server.ReplicaFetcherThread] [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error for partition __transaction_state-42 at offset 0 org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 22/08/2022 03:38:41.495 ERROR [kafka.server.ReplicaFetcherThread] [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition __transaction_state-2 at offset 0 org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 22/08/2022 03:38:41.510 ERROR [kafka.server.ReplicaFetcherThread] [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error for partition __transaction_state-20 at offset 0 org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 22/08/2022 03:38:41.530 ERROR [kafka.server.ReplicaFetcherThread] [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error for partition __transaction_state-27 at offset 0 org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. 22/08/2022 03:38:42.695 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testProducerFailoverWithoutRetract, partitions:[0]. 22/08/2022 03:38:42.749 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=0, checkpointId=1. 22/08/2022 03:38:42.755 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=0, checkpointId=1, epicNo=2. 22/08/2022 03:38:42.765 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] Can't find out parallelism state, ignore sending flips. 22/08/2022 03:38:42.765 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=0, restore=true, lastCkpComplete=null. 22/08/2022 03:38:42.915 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testProducerFailoverWithoutRetract, partitions:[0]. 22/08/2022 03:38:42.930 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=0, checkpointId=2. 22/08/2022 03:38:42.933 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=0, checkpointId=2, epicNo=2. 22/08/2022 03:38:42.965 WARN [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Ignoring configured key DeSerializer (key.deserializer) 22/08/2022 03:38:42.965 WARN [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Ignoring configured value DeSerializer (value.deserializer) 22/08/2022 03:38:44.400 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 has no restore state. 22/08/2022 03:38:44.402 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] initialize KafkaConsumer, subtaskId=0, log.consistency.guarantee.enable=false 22/08/2022 03:38:44.478 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testProducerFailoverWithoutRetract', partition=0}] 22/08/2022 03:38:44.485 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 creating fetcher with offsets {KafkaTopicPartition{topic='testProducerFailoverWithoutRetract', partition=0}=-915623761773}. log-hidden> +I(true,1,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,2,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,3,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,4,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,5,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,4,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,5,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,6,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,7,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,8,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) 22/08/2022 03:38:49.219 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 1, org.apache.flink.table.data.binary.BinaryRowData@55098279. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 2, org.apache.flink.table.data.binary.BinaryRowData@8d3a5f0d. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 3, org.apache.flink.table.data.binary.BinaryRowData@9e2e0edb. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 4, org.apache.flink.table.data.binary.BinaryRowData@a9b94da5. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 5, org.apache.flink.table.data.binary.BinaryRowData@254eef3a. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 6, org.apache.flink.table.data.binary.BinaryRowData@a9b94da5. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 7, org.apache.flink.table.data.binary.BinaryRowData@254eef3a. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 8, org.apache.flink.table.data.binary.BinaryRowData@d5148f18. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 9, org.apache.flink.table.data.binary.BinaryRowData@a9203a96. 22/08/2022 03:38:49.220 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 10, org.apache.flink.table.data.binary.BinaryRowData@abc8a96b. 22/08/2022 03:38:49.231 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=0, restore=false, lastCkpComplete=null. 22/08/2022 03:38:49.498 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testProduceAndConsume, partitions:[0]. 22/08/2022 03:38:49.543 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=0, checkpointId=1. 22/08/2022 03:38:49.543 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=0, checkpointId=1, epicNo=2. 22/08/2022 03:38:49.548 WARN [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Ignoring configured key DeSerializer (key.deserializer) 22/08/2022 03:38:49.548 WARN [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Ignoring configured value DeSerializer (value.deserializer) 22/08/2022 03:38:50.887 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 has no restore state. 22/08/2022 03:38:50.888 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] initialize KafkaConsumer, subtaskId=0, log.consistency.guarantee.enable=false 22/08/2022 03:38:50.895 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 will start reading the following 1 partitions from the committed group offsets in Kafka: [KafkaTopicPartition{topic='testProduceAndConsume', partition=0}] 22/08/2022 03:38:50.909 INFO [com.netease.arctic.flink.read.FlinkKafkaConsumerBase] Consumer subtask 0 creating fetcher with offsets {KafkaTopicPartition{topic='testProduceAndConsume', partition=0}=-915623761773}. log-hidden> +I(true,0,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,1,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,2,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,3,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,4,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,5,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,6,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,7,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,8,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,9,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,10,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,11,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,12,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,13,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,14,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,15,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,16,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,17,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,18,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) log-hidden> +I(true,19,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.binary.BinaryMapData@9ad027b4)) 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 1, org.apache.flink.table.data.binary.BinaryRowData@c59b5518. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 2, org.apache.flink.table.data.binary.BinaryRowData@55098279. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 3, org.apache.flink.table.data.binary.BinaryRowData@8d3a5f0d. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 4, org.apache.flink.table.data.binary.BinaryRowData@9e2e0edb. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 5, org.apache.flink.table.data.binary.BinaryRowData@a9b94da5. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 6, org.apache.flink.table.data.binary.BinaryRowData@254eef3a. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 7, org.apache.flink.table.data.binary.BinaryRowData@d5148f18. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 8, org.apache.flink.table.data.binary.BinaryRowData@a9203a96. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 9, org.apache.flink.table.data.binary.BinaryRowData@abc8a96b. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 10, org.apache.flink.table.data.binary.BinaryRowData@5ad08add. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 11, org.apache.flink.table.data.binary.BinaryRowData@64aeaf1e. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 12, org.apache.flink.table.data.binary.BinaryRowData@e84dc7c6. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 13, org.apache.flink.table.data.binary.BinaryRowData@e33c33c1. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 14, org.apache.flink.table.data.binary.BinaryRowData@2f67f7dc. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 15, org.apache.flink.table.data.binary.BinaryRowData@68476e0. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 16, org.apache.flink.table.data.binary.BinaryRowData@435e502c. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 17, org.apache.flink.table.data.binary.BinaryRowData@c389b26b. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 18, org.apache.flink.table.data.binary.BinaryRowData@a9d1f0c5. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 19, org.apache.flink.table.data.binary.BinaryRowData@11bf758f. 22/08/2022 03:38:58.995 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest] size 20, org.apache.flink.table.data.binary.BinaryRowData@aa2de1b8. 22/08/2022 03:38:59.016 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=0, restore=false, lastCkpComplete=null. 22/08/2022 03:38:59.286 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:38:59.286 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=1, restore=false, lastCkpComplete=null. 22/08/2022 03:38:59.412 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:38:59.413 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=2, restore=false, lastCkpComplete=null. 22/08/2022 03:38:59.537 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:38:59.547 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=0, checkpointId=1. 22/08/2022 03:38:59.576 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=1, checkpointId=1. 22/08/2022 03:38:59.577 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=2, checkpointId=1. 22/08/2022 03:38:59.589 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=0, checkpointId=1, epicNo=2. 22/08/2022 03:38:59.590 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=1, checkpointId=1, epicNo=2. 22/08/2022 03:38:59.590 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointComplete subtaskId=2, checkpointId=1, epicNo=2. 22/08/2022 03:38:59.594 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=1, checkpointId=2. 22/08/2022 03:38:59.594 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=2, checkpointId=2. 22/08/2022 03:38:59.596 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointAborted subtaskId=1, checkpointId=2. 22/08/2022 03:38:59.596 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointAborted subtaskId=2, checkpointId=2. LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,1,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,11,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,21,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,2,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,12,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,22,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,3,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,13,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,23,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,14,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,24,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} 22/08/2022 03:39:00.667 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] receive CommitRequest=CommitRequest{subtaskId=0, flip message=LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = true, changeAction = INSERT, actualValue = +I()}}. 22/08/2022 03:39:00.668 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] As of now, global state has received a total of 1 commit requests which are [0]. 22/08/2022 03:39:00.669 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=0, restore=true, lastCkpComplete=1. 22/08/2022 03:39:00.804 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:39:00.805 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] receive CommitRequest=CommitRequest{subtaskId=1, flip message=LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = true, changeAction = INSERT, actualValue = +I()}}. 22/08/2022 03:39:00.805 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] As of now, global state has received a total of 2 commit requests which are [0, 1]. 22/08/2022 03:39:00.805 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=1, restore=true, lastCkpComplete=1. 22/08/2022 03:39:00.944 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:39:00.945 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] receive CommitRequest=CommitRequest{subtaskId=2, flip message=LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = true, changeAction = INSERT, actualValue = +I()}}. 22/08/2022 03:39:00.945 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] already receive 3 commit requests. The last subtask received is 2. 22/08/2022 03:39:01.071 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:39:01.072 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] sending 1 partitions with flip message=LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = true, changeAction = INSERT, actualValue = +I()}. 22/08/2022 03:39:01.113 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] finished flips sending, cost 41ms. 22/08/2022 03:39:01.113 INFO [com.netease.arctic.flink.write.hidden.GlobalFlipCommitter] sent flip messages success, cost 445ms. 22/08/2022 03:39:01.113 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] initializeState subtaskId=2, restore=true, lastCkpComplete=1. 22/08/2022 03:39:01.267 INFO [com.netease.arctic.flink.write.hidden.kafka.HiddenKafkaProducer] HiddenKafkaPartition topic:testMultiParallelismFailoverConsistencyRead, partitions:[0]. 22/08/2022 03:39:01.296 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=1, checkpointId=3. 22/08/2022 03:39:01.297 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] snapshotState subtaskId=2, checkpointId=3. 22/08/2022 03:39:01.299 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointAborted subtaskId=1, checkpointId=2. 22/08/2022 03:39:01.299 INFO [com.netease.arctic.flink.write.hidden.AbstractHiddenLogWriter] notifyCheckpointAborted subtaskId=2, checkpointId=2. LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,1,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,11,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = false, changeAction = INSERT, actualValue = +I(true,21,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,2,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,12,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,22,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,3,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,13,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,23,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,14,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,24,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 1, flip = true, changeAction = INSERT, actualValue = null} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,2,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,12,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,22,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 2, flip = false, changeAction = INSERT, actualValue = +I(true,3,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,13,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,23,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,14,1,+I(true,1,1,sssss,4819827,123456789.123456789123456789,123.12345,123.12345,19117,2022-12-12T13:14:14.987654234,2022-12-13T13:33:44.987654320,[1],[49],[2],org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@12397,org.apache.flink.table.data.GenericArrayData@34f360e6,org.apache.flink.table.data.GenericMapData@9d9c39b2))} 22/08/2022 03:39:02.389 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:39:02.390 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] Shut down KafkaTestBase 22/08/2022 03:39:02.390 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:39:22.045 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- 22/08/2022 03:39:22.045 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] KafkaTestBase finished 22/08/2022 03:39:22.046 INFO [com.netease.arctic.flink.kafka.testutils.KafkaTestBase] ------------------------------------------------------------------------- Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 44.867 sec <<< FAILURE! testMultiParallelismFailoverConsistencyRead(com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest) Time elapsed: 3.389 sec <<< FAILURE! org.opentest4j.AssertionFailedError: expected: <20> but was: <19> at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55) at org.junit.jupiter.api.AssertionUtils.failNotEqual(AssertionUtils.java:62) at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:150) at org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:145) at org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:527) at com.netease.arctic.flink.write.hidden.kafka.HiddenLogOperatorsTest.testMultiParallelismFailoverConsistencyRead(HiddenLogOperatorsTest.java:292) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.ParentRunner.run(ParentRunner.java:413) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189) at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165) at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)

Aug 22 '22 07:08 YesOrNo828

It seemed the last element is not consumed or produced.

LogData = {version = net1, upstreamId = f04d, epicNo = 3, flip = false, changeAction = INSERT, actualValue = +I(true,24,1,+I......

Aug 22 '22 09:08 YesOrNo828

I came into a phenomenon that data cannot be polled after reset offset. So I try to find data in the local disk, but it's failed. Maybe the data only keep in memory in kafka test server, and the Kafka env has wrong config. After replace the env with Docker test container, the phenomenon has gone.

Dec 30 '22 08:12 zstraw

Closed as no longer replicable.

Nov 30 '23 07:11 zhoujinsong