hadoop-native-macos icon indicating copy to clipboard operation
hadoop-native-macos copied to clipboard

Published 20 hours ago • verified publisher icon healchow

Adding M1 ARM support for Hadoop 3.2.1

Open mridang opened this issue 2 years ago • 1 comments

Hi. Is there any chance you can build or help build Hadoop 3.2.1 for Mac M1 ARM please? From the docs it seems that it wasn't possible to build 3.2.0 https://github.com/apache/hadoop/blob/trunk/BUILDING.txt#L416 but I don't see any mention of 3.2.1.

I've spent the day building it using your instructions. I managed to install OpenSSL and also use Protobuf 2.5.0 (even though your comment says to use 3.x https://github.com/healchow/hadoop-native-macos/blob/main/ARM/build.md?plain=1#L3. It looks like 3.2.1 relies on Protobuf 2.5.0.

I get compilation errors and I'm rather lost. Our infrastructure is rather coupled to Hadoop 3.2.1 so it isn't easy for us to upgrade. Any help would be much appreciated. Thank you.

mridang avatar Oct 28 '22 06:10 mridang

@mridang hello buddy. Sorry, I just noticed your request for help. Have you solved this problem yet? Sorry again, I don't have time to do this recently, if I have any updates, I will sync them here.

healchow avatar Feb 12 '23 14:02 healchow