hbase icon indicating copy to clipboard operation
hbase copied to clipboard

HBASE-29501 IOException in SerialReplicationChecker.canPush causes entries to be pushed out of order

Open tomasbanet opened this issue 4 months ago • 11 comments

Detailed Example

Zookeeper state:

  • /hbase/replication/regions/e8/bf/b3479752a0512841ed8c47d5c8d0-peer_1
    • pushedSeqId=27
  • (Main queue) /hbase/replication/rs/home-host-1,16020,1754475014225/peer_1/home-host-1%2C16020%2C1754475014225.1754475020411
    • lastWalPosition=409
  • (Reclaimed queue) /hbase/replication/rs/home-host-1,16020,1754475014225/peer_1-home-host-1,16020,1754474482197/home-host-1%2C16020%2C1754474482197.1754474488449
    • lastWalPosition=716

WAL's:

  • (Active WAL) /hbase/replication/rs/home-host-1,16020,1754475014225/peer_1/home-host-1%2C16020%2C1754475014225.1754475020411
position: 409
,{"sequence":"34","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::REGION_EVENT::REGION_OPEN","vlen":216,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754475023833","total_size_sum":"328"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 368 <--- trying to push this entry
position: 750
,{"sequence":"35","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::COMPACTION","vlen":219,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754475024678","total_size_sum":"320"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 360
position: 1079
,{"sequence":"36","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"col1","vlen":4,"row":"key6","type":"Put","family":"cf1","timestamp":"1754475048622","total_size_sum":"88"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 128
position: 1185
  • (Old WAL from reclaimed queue) /hbase/oldWALs/home-host-1%2C16020%2C1754474482197.1754474488449
position: 409
,{"sequence":"27","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::REGION_EVENT::REGION_OPEN","vlen":182,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754474494541","total_size_sum":"296"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 336
position: 716
,{"sequence":"28","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"col1","vlen":4,"row":"key5","type":"Put","family":"cf1","timestamp":"1754474868855","total_size_sum":"88"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 128 <--- trying to push this entry
position: 822
,{"sequence":"30","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::FLUSH","vlen":123,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754474978323","total_size_sum":"216"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 256
position: 1341
,{"sequence":"31","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::FLUSH","vlen":157,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754474979228","total_size_sum":"248"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 288
position: 1603
,{"sequence":"32","region":"e8bfb3479752a0512841ed8c47d5c8d0","actions":[{"qualifier":"HBASE::REGION_EVENT::REGION_CLOSE","vlen":148,"row":"\\x00","type":"Put","family":"METAFAMILY","timestamp":"1754474979245","total_size_sum":"264"}],"table":{"name":[116,101,115,116,95,116,97,98,108,101],"nameAsString":"test_table","namespace":[100,101,102,97,117,108,116],"namespaceAsString":"default","qualifier":[116,101,115,116,95,116,97,98,108,101],"qualifierAsString":"test_table","systemTable":false,"hashCode":2070785505}}edit heap size: 304
position: 1877 

hbase:meta barriers: [2, 5, 6, 9, 17, 26, 33]

Entry with seqId=34 cannot be pushed until previous range finishes (entries with seqId 27, 28, 30, 31, 32, between barriers 26 and 33):

2025-08-06T11:13:05,286 DEBUG [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.wal-reader.home-host-1%2C16020%2C1754475014225,peer_1] regionserver.SerialReplicationChecker: Replication barrier for test_table/e8bfb3479752a0512841ed8c47d5c8d0/34=[#edits: 0 = <>]: ReplicationBarrierResult [barriers=[2, 5, 6, 9, 17, 26, 33], state=OPEN, parentRegionNames=]
2025-08-06T11:13:39,338 DEBUG [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.wal-reader.home-host-1%2C16020%2C1754475014225,peer_1] regionserver.SerialReplicationChecker: Previous range for test_table/e8bfb3479752a0512841ed8c47d5c8d0/34=[#edits: 0 = <>] has not been finished yet, give up

However, if main WAL reader thread runs before RS_CLAIM_REPLICATION_QUEUE WAL reader thread, when running canPush with entry seqId=34 and IOException is caught, in SerialReplicationSourceWALReader.readWALEntries we get:

try {
 if (!checker.canPush(entry, firstCellInEntryBeforeFiltering)) { // <--- entry test_table/e8bfb3479752a0512841ed8c47d5c8d0/34=[#edits: 0 = <>] 
   if (batch.getLastWalPosition() > positionBefore) {
     // we have something that can push, break
     break;
   } else {
     checker.waitUntilCanPush(entry, firstCellInEntryBeforeFiltering);
   }
 }
} catch (IOException e) {
 LOG.warn("failed to check whether we can push the WAL entries", e); // <--- catch exception here
 if (batch.getLastWalPosition() > positionBefore) { // <--- 0 > 409   <=>  false
   // we have something that can push, break
   break;
 }
 sleepMultiplier = sleep(sleepMultiplier); // <--- sleep for some time
}
// arrive here means we can push the entry, record the last sequence id
batch.setLastSeqId(Bytes.toString(entry.getKey().getEncodedRegionName()),
 entry.getKey().getSequenceId()); // <--- lastSeqIds set to 34
// actually remove the entry.
removeEntryFromStream(entryStream, batch);
if (addEntryToBatch(batch, entry)) { // <-- false (entry has 0 edits)
 break;
}
// <---continue to process another entry

The next iteration in SerialReplicationSourceWALReader.readWALEntries processes entry with seqId=35:

try {
 if (!checker.canPush(entry, firstCellInEntryBeforeFiltering)) { // <--- entry test_table/e8bfb3479752a0512841ed8c47d5c8d0/35=[#edits: 0 = <>]
   if (batch.getLastWalPosition() > positionBefore) {
     // we have something that can push, break
     break;
   } else {
     checker.waitUntilCanPush(entry, firstCellInEntryBeforeFiltering);
   }
 }
} catch (IOException e) {
 LOG.warn("failed to check whether we can push the WAL entries", e); // <--- catch exception here
 if (batch.getLastWalPosition() > positionBefore) { // <--- 750 > 409   <=>  true
   // we have something that can push, break
   break; // <--- break here
 }
 sleepMultiplier = sleep(sleepMultiplier);
}

The shipper thread logs:

2025-08-06T11:44:34,477 DEBUG [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.shipperhome-host-1%2C16020%2C1754475014225,peer_1] regionserver.ReplicationSourceShipper: Shipper from source peer_1 got entry batch from reader: WALEntryBatch [walEntries=[], lastWalPath=hdfs://mycluster/hbase/WALs/home-host-1,16020,1754475014225/home-host-1%2C16020%2C1754475014225.1754475020411, lastWalPosition=750, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={e8bfb3479752a0512841ed8c47d5c8d0=34}, endOfFile=false,usedBufferSize=0]

ReplicationSourceShipper.shipEdits ships edit with seqId=34:

 private void shipEdits(WALEntryBatch entryBatch) { // <--- entryBatch WALEntryBatch [walEntries=[], lastWalPath=hdfs://mycluster/hbase/WALs/home-host-1,16020,1754475014225/home-host-1%2C16020%2C1754475014225.1754475020411, lastWalPosition=750, nbRowKeys=0, nbHFiles=0, heapSize=0, lastSeqIds={e8bfb3479752a0512841ed8c47d5c8d0=34}, endOfFile=false,usedBufferSize=0]
   List<Entry> entries = entryBatch.getWalEntries();
   int sleepMultiplier = 0;
   if (entries.isEmpty()) { // <--- true
     updateLogPosition(entryBatch);
     return;
   }

updateLogPosition() will call ReplicationSourceManager.logPositionAndCleanOldLogs(), which calls ZKReplicationQueueStorage.setWALPosition().

ZKReplicationQueueStorage.setWALPosition() updates zookeeper with:

  • /hbase/replication/regions/e8/bf/b3479752a0512841ed8c47d5c8d0-peer_1
    • pushedSeqId=34
  • /hbase/replication/rs/home-host-1,16020,1754475014225/peer_1/home-host-1%2C16020%2C1754475014225.1754475020411
    • lastWalPosition=750

Afterwards main WAL reader thread can push entries with seqId higher than seqId's in reclaimed queue:

2025-08-06T11:55:11,218 DEBUG [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.wal-reader.home-host-1%2C16020%2C1754475014225,peer_1] regionserver.SerialReplicationChecker: Replication barrier for test_table/e8bfb3479752a0512841ed8c47d5c8d0/35=[#edits: 0 = <>]: ReplicationBarrierResult [barriers=[2, 5, 6, 9, 17, 26, 33], state=OPEN, parentRegionNames=]
2025-08-06T11:56:51,300 DEBUG [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.wal-reader.home-host-1%2C16020%2C1754475014225,peer_1] regionserver.SerialReplicationChecker: The previous range for test_table/e8bfb3479752a0512841ed8c47d5c8d0/35=[#edits: 0 = <>] has been finished, pass
2025-08-06T11:57:25,313 TRACE [regionserver/home-host-1:16020.replicationSource,peer_1.replicationSource.wal-reader.home-host-1%2C16020%2C1754475014225,peer_1] regionserver.SerialReplicationChecker: The sequence id for test_table/e8bfb3479752a0512841ed8c47d5c8d0/36=[#edits: 1 = <key6/cf1:col1/1754475048622/Put/vlen=4/seqid=0; >] is continuous, pass

This means table in sink cluster can have out of order entries (key6 seqid in source cluster = 36):

hbase:005:0> scan "test_table"
scan "test_table"
ROW  COLUMN+CELL
 key1 column=cf1:col1, timestamp=2025-08-05T11:45:04.884, value=val1
 key2 column=cf1:col1, timestamp=2025-08-06T04:47:52.269, value=val1
 key3 column=cf1:col1, timestamp=2025-08-06T04:51:51.826, value=val1
 key4 column=cf1:col1, timestamp=2025-08-06T05:08:19.270, value=val1
 key6 column=cf1:col1, timestamp=2025-08-06T11:10:48.622, value=val1
5 row(s)
Took 0.1082 seconds

After reclaimed queue finishes (key5 seqid in source cluster = 28):

hbase:006:0> scan "test_table"
scan "test_table"
ROW  COLUMN+CELL
 key1 column=cf1:col1, timestamp=2025-08-05T11:45:04.884, value=val1
 key2 column=cf1:col1, timestamp=2025-08-06T04:47:52.269, value=val1
 key3 column=cf1:col1, timestamp=2025-08-06T04:51:51.826, value=val1
 key4 column=cf1:col1, timestamp=2025-08-06T05:08:19.270, value=val1
 key5 column=cf1:col1, timestamp=2025-08-06T11:07:48.855, value=val1
 key6 column=cf1:col1, timestamp=2025-08-06T11:10:48.622, value=val1
6 row(s)
Took 0.0735 seconds

Unit test, integration test

TODO

tomasbanet avatar Aug 06 '25 14:08 tomasbanet

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 1m 3s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+0 :ok: codespell 0m 0s codespell was not available.
+0 :ok: detsecrets 0m 0s detect-secrets was not available.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
_ branch-2.6 Compile Tests _
+1 :green_heart: mvninstall 5m 0s branch-2.6 passed
+1 :green_heart: compile 3m 55s branch-2.6 passed
+1 :green_heart: checkstyle 0m 48s branch-2.6 passed
+1 :green_heart: spotbugs 1m 56s branch-2.6 passed
+1 :green_heart: spotless 0m 59s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 4m 21s the patch passed
+1 :green_heart: compile 3m 50s the patch passed
+1 :green_heart: javac 3m 50s the patch passed
+1 :green_heart: blanks 0m 0s The patch has no blanks issues.
+1 :green_heart: checkstyle 0m 49s the patch passed
-1 :x: spotbugs 2m 8s /new-spotbugs-hbase-server.html hbase-server generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 :green_heart: hadoopcheck 25m 41s Patch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.0.
+1 :green_heart: spotless 1m 20s patch has no errors when running spotless:check.
_ Other Tests _
+1 :green_heart: asflicense 0m 14s The patch does not generate ASF License warnings.
54m 25s
Reason Tests
SpotBugs module:hbase-server
Dead store to sleepMultiplier in org.apache.hadoop.hbase.replication.regionserver.SerialReplicationSourceWALReader.readWALEntries(WALEntryStream, WALEntryBatch) At SerialReplicationSourceWALReader.java:org.apache.hadoop.hbase.replication.regionserver.SerialReplicationSourceWALReader.readWALEntries(WALEntryStream, WALEntryBatch) At SerialReplicationSourceWALReader.java:[line 98]
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7194
Optional Tests dupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
uname Linux 22e23b622fc3 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.6 / ae83e1e04c5ffc433b49b47d5f247a78d4d46111
Default Java Eclipse Adoptium-11.0.23+9
Max. process+thread count 77 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/console
versions git=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 06 '25 15:08 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 1m 11s Docker mode activated.
-0 :warning: yetus 0m 5s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2.6 Compile Tests _
+1 :green_heart: mvninstall 4m 50s branch-2.6 passed
+1 :green_heart: compile 1m 24s branch-2.6 passed
+1 :green_heart: javadoc 0m 37s branch-2.6 passed
+1 :green_heart: shadedjars 7m 43s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 4m 11s the patch passed
+1 :green_heart: compile 1m 10s the patch passed
+1 :green_heart: javac 1m 10s the patch passed
+1 :green_heart: javadoc 0m 33s the patch passed
+1 :green_heart: shadedjars 7m 19s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 :green_heart: unit 232m 1s hbase-server in the patch passed.
266m 27s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7194
Optional Tests javac javadoc unit compile shadedjars
uname Linux a237aa42403c 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.6 / ae83e1e04c5ffc433b49b47d5f247a78d4d46111
Default Java Eclipse Adoptium-17.0.11+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/testReport/
Max. process+thread count 4530 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 06 '25 18:08 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 58s Docker mode activated.
-0 :warning: yetus 0m 5s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2.6 Compile Tests _
+1 :green_heart: mvninstall 4m 9s branch-2.6 passed
+1 :green_heart: compile 1m 5s branch-2.6 passed
+1 :green_heart: javadoc 0m 34s branch-2.6 passed
+1 :green_heart: shadedjars 6m 52s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 3m 4s the patch passed
+1 :green_heart: compile 0m 52s the patch passed
+1 :green_heart: javac 0m 52s the patch passed
+1 :green_heart: javadoc 0m 30s the patch passed
+1 :green_heart: shadedjars 6m 22s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 :green_heart: unit 259m 51s hbase-server in the patch passed.
289m 49s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7194
Optional Tests javac javadoc unit compile shadedjars
uname Linux 83ef0119b472 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.6 / ae83e1e04c5ffc433b49b47d5f247a78d4d46111
Default Java Temurin-1.8.0_412-b08
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/testReport/
Max. process+thread count 4259 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 06 '25 18:08 Apache-HBase

:confetti_ball: +1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 1m 1s Docker mode activated.
-0 :warning: yetus 0m 6s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2.6 Compile Tests _
+1 :green_heart: mvninstall 3m 44s branch-2.6 passed
+1 :green_heart: compile 1m 12s branch-2.6 passed
+1 :green_heart: javadoc 0m 38s branch-2.6 passed
+1 :green_heart: shadedjars 7m 50s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 3m 25s the patch passed
+1 :green_heart: compile 1m 8s the patch passed
+1 :green_heart: javac 1m 8s the patch passed
+1 :green_heart: javadoc 0m 32s the patch passed
+1 :green_heart: shadedjars 8m 2s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 :green_heart: unit 267m 4s hbase-server in the patch passed.
299m 57s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR https://github.com/apache/hbase/pull/7194
Optional Tests javac javadoc unit compile shadedjars
uname Linux 25aaef6dc6f5 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision branch-2.6 / ae83e1e04c5ffc433b49b47d5f247a78d4d46111
Default Java Eclipse Adoptium-11.0.23+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/testReport/
Max. process+thread count 4439 (vs. ulimit of 30000)
modules C: hbase-server U: hbase-server
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/1/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 06 '25 19:08 Apache-HBase

Thanks for reporting and analyzing this problem.

We have a pending fix for serial replication in #7172 too, which needs to redefine the code flow, so we'd better land #7172 first and then back to this PR.

Will report back here after fixing #7172

Thanks.

Apache9 avatar Aug 07 '25 02:08 Apache9

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 0s Docker mode activated.
-1 :x: patch 0m 9s https://github.com/apache/hbase/pull/7194 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR https://github.com/apache/hbase/pull/7194
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/2/console
versions git=2.17.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 27 '25 14:08 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 0s Docker mode activated.
-1 :x: patch 0m 9s https://github.com/apache/hbase/pull/7194 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR https://github.com/apache/hbase/pull/7194
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/2/console
versions git=2.17.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 27 '25 14:08 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 0s Docker mode activated.
-1 :x: patch 0m 9s https://github.com/apache/hbase/pull/7194 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR https://github.com/apache/hbase/pull/7194
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/2/console
versions git=2.17.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 27 '25 14:08 Apache-HBase

:broken_heart: -1 overall

Vote Subsystem Runtime Logfile Comment
+0 :ok: reexec 0m 0s Docker mode activated.
-1 :x: patch 0m 9s https://github.com/apache/hbase/pull/7194 does not apply to branch-2.6. Rebase required? Wrong Branch? See https://yetus.apache.org/documentation/in-progress/precommit-patchnames for help.
Subsystem Report/Notes
GITHUB PR https://github.com/apache/hbase/pull/7194
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7194/2/console
versions git=2.17.1
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase avatar Aug 27 '25 14:08 Apache-HBase

Please open a PR against master?

Thanks.

Apache9 avatar Aug 30 '25 14:08 Apache9

@tomasbanet Please open a PR against master?

Thanks.

Apache9 avatar Sep 06 '25 14:09 Apache9