phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

PHOENIX-5860 Throw exception which region is closing or splitting when delete data

Open wangchao316 opened this issue 3 years ago • 12 comments

wangchao316 avatar Sep 06 '20 02:09 wangchao316

@joshelser @gjacoby126 @swaroopak , hello , could you please review this? Thanks

wangchao316 avatar Sep 08 '20 03:09 wangchao316

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 0m 0s Docker mode activated.
-1 :x: docker 5m 35s Docker failed to build yetus/phoenix:871ed211e.
Subsystem Report/Notes
GITHUB PR https://github.com/apache/phoenix/pull/874
Console output https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/1/console
versions git=2.17.1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

stoty avatar Sep 28 '20 17:09 stoty

@joshelser , @stoty ,hello, I alter this code that postRollBackSplit. could you please review this?

wangchao316 avatar Oct 09 '20 01:10 wangchao316

Hi @wangchao316 , the logic looks good to me, do you have anything to add @joshelser ?

yanxinyi avatar Nov 14 '20 04:11 yanxinyi

@joshelser ,hello, do you have anything to add?

wangchao316 avatar Nov 25 '20 08:11 wangchao316

(sorry for the wide ping)

@virajjasani @gjacoby126 @ChinmaySKulkarni @apurtell have any of your noticed this one in 1.x? The change seems reasonable to me, but I haven't kept up with the later 1.x HBase releases to have confidence in the issue and fix.

joshelser avatar Dec 01 '20 01:12 joshelser

Thanks @joshelser for bringing this up. I just realized that we have this exact same issue reported sometime back this year with Phoenix 4.14.x + HBase 1.3.x for Delete queries. Changes indeed look reasonable and simpler to understand.

I am confident about existence of the issue (not the fix though). And @wangchao316 seems to have been able to consistently repro this with minor changes in HBase split code by failing split all the times and let the flow through rollback of split, as per Jira comments. However, let's trigger a QA run first, we don't have clear QA result on PR. If we don't see any issue, I am +1 for rolling out this change, feels worth shipping.

@gjacoby126 @ChinmaySKulkarni @apurtell Thought?

virajjasani avatar Dec 01 '20 07:12 virajjasani

Precommit results are available: https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/229/testReport/ Looks good, failures don't seem relevant. +1(non-binding) for this PR. Thanks @wangchao316

virajjasani avatar Dec 01 '20 09:12 virajjasani

+1. It's really required to avoid issues on split rollback cases.

chrajeshbabu avatar Dec 01 '20 09:12 chrajeshbabu

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 4m 20s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+1 :green_heart: mvninstall 11m 12s 4.x passed
+1 :green_heart: compile 0m 55s 4.x passed
+1 :green_heart: checkstyle 0m 39s 4.x passed
+1 :green_heart: javadoc 0m 44s 4.x passed
+0 :ok: spotbugs 2m 54s phoenix-core in 4.x has 950 extant spotbugs warnings.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 5m 26s the patch passed
+1 :green_heart: compile 0m 56s the patch passed
+1 :green_heart: javac 0m 56s the patch passed
-1 :x: checkstyle 0m 38s phoenix-core: The patch generated 3 new + 364 unchanged - 0 fixed = 367 total (was 364)
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: javadoc 0m 43s the patch passed
+1 :green_heart: spotbugs 3m 11s the patch passed
_ Other Tests _
-1 :x: unit 136m 2s phoenix-core in the patch failed.
+1 :green_heart: asflicense 0m 37s The patch does not generate ASF License warnings.
170m 58s
Reason Tests
Failed junit tests phoenix.end2end.index.LocalImmutableTxIndexIT
phoenix.end2end.IndexBuildTimestampIT
TEST-[RangeScanIT_0]
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/phoenix/pull/874
Optional Tests dupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile
uname Linux 64dce7320f26 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev/phoenix-personality.sh
git revision 4.x / 277b6fd
Default Java Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstyle https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt
unit https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt
Test Results https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/testReport/
Max. process+thread count 6709 (vs. ulimit of 30000)
modules C: phoenix-core U: phoenix-core
Console output https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/3/console
versions git=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

stoty avatar Dec 01 '20 10:12 stoty

+1. It's really required to avoid issues on split rollback cases.

Thanks, can you please merge?

wangchao316 avatar Dec 01 '20 11:12 wangchao316

:broken_heart: -1 overall

Vote Subsystem Runtime Comment
+0 :ok: reexec 0m 32s Docker mode activated.
_ Prechecks _
+1 :green_heart: dupname 0m 0s No case conflicting files found.
+1 :green_heart: hbaseanti 0m 0s Patch does not have any anti-patterns.
+1 :green_heart: @author 0m 0s The patch does not contain any @author tags.
+1 :green_heart: test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+1 :green_heart: mvninstall 11m 0s 4.x passed
+1 :green_heart: compile 0m 55s 4.x passed
+1 :green_heart: checkstyle 0m 38s 4.x passed
+1 :green_heart: javadoc 0m 44s 4.x passed
+0 :ok: spotbugs 2m 53s phoenix-core in 4.x has 950 extant spotbugs warnings.
_ Patch Compile Tests _
+1 :green_heart: mvninstall 5m 26s the patch passed
+1 :green_heart: compile 0m 57s the patch passed
+1 :green_heart: javac 0m 57s the patch passed
-1 :x: checkstyle 0m 38s phoenix-core: The patch generated 5 new + 362 unchanged - 2 fixed = 367 total (was 364)
+1 :green_heart: whitespace 0m 0s The patch has no whitespace issues.
+1 :green_heart: javadoc 0m 46s the patch passed
+1 :green_heart: spotbugs 2m 59s the patch passed
_ Other Tests _
-1 :x: unit 140m 21s phoenix-core in the patch failed.
+1 :green_heart: asflicense 0m 39s The patch does not generate ASF License warnings.
171m 8s
Reason Tests
Failed junit tests phoenix.query.MaxConcurrentConnectionsIT
phoenix.end2end.AlterTableWithViewsIT
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/Dockerfile
GITHUB PR https://github.com/apache/phoenix/pull/874
Optional Tests dupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile
uname Linux 0aa40ae946ff 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev/phoenix-personality.sh
git revision 4.x / 18b9f76
Default Java Private Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstyle https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/diff-checkstyle-phoenix-core.txt
unit https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt
Test Results https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/testReport/
Max. process+thread count 6597 (vs. ulimit of 30000)
modules C: phoenix-core U: phoenix-core
Console output https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-874/4/console
versions git=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

stoty avatar Dec 01 '20 13:12 stoty