eagle icon indicating copy to clipboard operation
eagle copied to clipboard

[EAGLE-985] Upgrade hbase dependency to 1.2.5

Open tedyu opened this issue 7 years ago • 13 comments

Upgrade hbase dependency to 1.2.5

tedyu avatar Apr 03 '17 22:04 tedyu

+1, LGTM, I will be testing this on my dev environment as well sometime tomorrow.

jhsenjaliya avatar Apr 05 '17 03:04 jhsenjaliya

@jhsenjaliya @tedyu After this upgrade, does we still support HBase 0.98?

qingwen220 avatar Apr 05 '17 06:04 qingwen220

Hi @qingwen220 no, since there are some function signature changes here, I dont think it will be compatible. ( without those changes, it is compatible though) so the question really comes down to whether we want to support 0.98 till 0.5 release then this can be pushed to 0.6 when majority of the tech stack is going to change ( storm, kafka, etc..), comment?

jhsenjaliya avatar Apr 05 '17 06:04 jhsenjaliya

Yes. We expect after 0.5, Eagle can support Kafka 0.10 & storm 0.10.

There is a concern. We have a coprocessor module in Eagle for HBase 0.98. I am not sure if we could support this function after upgrade

qingwen220 avatar Apr 05 '17 08:04 qingwen220

Should we have multiple version support for HBase(Storm/Kafka etc) so that users can still use old versions if they cannot switch to new version quickly? I think it will be better if we have some abstractions first instead of doing like this.

wujinhu avatar Apr 05 '17 11:04 wujinhu

@wujinhu +1

r7raul1984 avatar Apr 06 '17 01:04 r7raul1984

In my opition ,we should do more test before upgrade to hbase 1.2.5 rather than just solve compile problem.

r7raul1984 avatar Apr 06 '17 01:04 r7raul1984

master works fine with hbase 1.2.2 I am planning to test this patch with hbase 1.2.5 tonight

jhsenjaliya avatar Apr 06 '17 01:04 jhsenjaliya

hi @tedyu

Is the new API you used supported in 1.0.x?

baibaichen avatar Apr 07 '17 11:04 baibaichen

Yes. But hbase 1.0 wouldn't have any more new release.

tedyu avatar Apr 07 '17 13:04 tedyu

@jhsenjaliya Did you find any issue during testing ?

tedyu avatar Apr 14 '17 14:04 tedyu

@tedyu I pulled your PR and used ur code to run my eagle, I am running alert engine app + hdfs audit log app and it successfully created the alert i was expecting. so this PR is working fine. but As i mentioned earlier, I was using hbase 1.2.2 and also tested hbase 1.2.5 without any code change to eagle and it was working fine as well. so probably these changes are not mandatory but good to follow newer hbase functions.

jhsenjaliya avatar Apr 15 '17 23:04 jhsenjaliya

@qingwen220 , @r7raul1984 looks like we can accommodate hbase 1.2.5 with or without this PR changes but I havent tested with hbase coprocessor enabled. so if someone can test current eagle code with hbase 1.2.5 with coprocessor enabled, we can make decision on whether we can include hbase upgrade in eagle 0.5 or later.

jhsenjaliya avatar Apr 15 '17 23:04 jhsenjaliya