carbondata icon indicating copy to clipboard operation
carbondata copied to clipboard

Published 20 hours ago • verified publisher icon apache

[CARBONDATA-4270]Delete segment expect remain_number

Open W1thOut opened this issue 3 years ago • 40 comments

Why is this PR needed?

In some scenarios, need to delete old segments in batches and keep only latest few segments.

What changes were proposed in this PR?

Add a DML.

Does this PR introduce any user interface change?

  • No

Is any new testcase added?

  • Yes

W1thOut avatar Aug 14 '21 16:08 W1thOut

Can one of the admins verify this patch?

CarbonDataQA2 avatar Aug 14 '21 16:08 CarbonDataQA2

start build

W1thOut avatar Aug 14 '21 16:08 W1thOut

retest this please

W1thOut avatar Aug 14 '21 16:08 W1thOut

retest this please

W1thOut avatar Aug 16 '21 13:08 W1thOut

jenkins,add to whitelist

MarvinLitt avatar Aug 16 '21 15:08 MarvinLitt

add to whitelist

MarvinLitt avatar Aug 16 '21 15:08 MarvinLitt

retest this please

W1thOut avatar Aug 17 '21 03:08 W1thOut

@CarbonDataQA2 why this pr can not trigger the CI, please help.

MarvinLitt avatar Aug 17 '21 03:08 MarvinLitt

@CarbonDataQA2 why this pr can not trigger the CI, please help.

W1thOut avatar Aug 17 '21 03:08 W1thOut

add to whitelist

ajantha-bhat avatar Aug 17 '21 03:08 ajantha-bhat

Build Failed with Spark 3.1, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_3.1/263/

CarbonDataQA2 avatar Aug 17 '21 05:08 CarbonDataQA2

Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/5860/

CarbonDataQA2 avatar Aug 17 '21 05:08 CarbonDataQA2

Hi @W1thOut , can you raise the discussion in the community first? As you want to expose a new DDL, please check the community guidelines here: https://www.mail-archive.com/[email protected]/msg01835.html

vikramahuja1001 avatar Aug 17 '21 05:08 vikramahuja1001

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4117/

CarbonDataQA2 avatar Aug 17 '21 05:08 CarbonDataQA2

retest this please

MarvinLitt avatar Aug 17 '21 11:08 MarvinLitt

retest this please

W1thOut avatar Aug 17 '21 11:08 W1thOut

Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/5865/

CarbonDataQA2 avatar Aug 17 '21 13:08 CarbonDataQA2

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4123/

CarbonDataQA2 avatar Aug 17 '21 13:08 CarbonDataQA2

Build Failed with Spark 3.1, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_3.1/268/

CarbonDataQA2 avatar Aug 17 '21 13:08 CarbonDataQA2

Build Failed with Spark 3.1, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_3.1/269/

CarbonDataQA2 avatar Aug 17 '21 18:08 CarbonDataQA2

Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/5866/

CarbonDataQA2 avatar Aug 17 '21 18:08 CarbonDataQA2

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4124/

CarbonDataQA2 avatar Aug 17 '21 18:08 CarbonDataQA2

Hi @W1thOut , can you raise the discussion in the community first? As you want to expose a new DDL, please check the community guidelines here: https://www.mail-archive.com/[email protected]/msg01835.html

okay. but i can not access community: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/ Is it because I don't have permission?

W1thOut avatar Aug 18 '21 14:08 W1thOut

http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/ Please use this link.

nihal0107 avatar Aug 18 '21 14:08 nihal0107

retest this please

W1thOut avatar Aug 18 '21 14:08 W1thOut

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4127/

CarbonDataQA2 avatar Aug 18 '21 15:08 CarbonDataQA2

Build Failed with Spark 3.1, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_3.1/272/

CarbonDataQA2 avatar Aug 18 '21 15:08 CarbonDataQA2

retest this please

W1thOut avatar Aug 18 '21 16:08 W1thOut

Build Failed with Spark 2.3.4, Please check CI http://121.244.95.60:12602/job/ApacheCarbonPRBuilder2.3/5871/

CarbonDataQA2 avatar Aug 18 '21 16:08 CarbonDataQA2

Build Failed with Spark 2.4.5, Please check CI http://121.244.95.60:12602/job/ApacheCarbon_PR_Builder_2.4.5/4129/

CarbonDataQA2 avatar Aug 18 '21 16:08 CarbonDataQA2