datafusion-java icon indicating copy to clipboard operation
datafusion-java copied to clipboard

Feature request: Add support for macOS / AArch64

Open gunnarmorling opened this issue 1 year ago • 2 comments
trafficstars

Hi, are there plans for adding support for macOS / AArch64 (i.e. M1 Macs) to this library? I am getting this error below which I suppose is the case as the native library only is built for macOS/x64:

Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /var/folders/2h/dglkh0gd07jfc6bqgx5g94nm0000gn/T/datafusion_jni4772271915185568606.dylib

gunnarmorling avatar Apr 20 '24 08:04 gunnarmorling

Hi, are there plans for adding support for macOS / AArch64 (i.e. M1 Macs) to this library? I am getting this error below which I suppose is the case as the native library only is built for macOS/x64:

Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /var/folders/2h/dglkh0gd07jfc6bqgx5g94nm0000gn/T/datafusion_jni4772271915185568606.dylib

I have no problem with the M3 Mac image

caicancai avatar Nov 01 '24 15:11 caicancai

Hi, are there plans for adding support for macOS / AArch64 (i.e. M1 Macs) to this library? I am getting this error below which I suppose is the case as the native library only is built for macOS/x64:

Exception in thread "main" java.lang.UnsatisfiedLinkError: Can't load library: /var/folders/2h/dglkh0gd07jfc6bqgx5g94nm0000gn/T/datafusion_jni4772271915185568606.dylib

I have no problem with the M3 Mac image

i think the issue was not about local dev. it's about the packaged version.

we use GitHub runner to package and as of the time of last publish the runner had no M1 version.

GitHub seemed to have added M series support but not sure if's available for free for open source - see https://docs.github.com/en/actions/using-github-hosted-runners/using-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories maybe worth trying it out

jimexist avatar Nov 01 '24 15:11 jimexist

Right, having the same issue with M4:

Unsupported OS/arch (`Osx' detected), cannot find `/jni_libs/libdatafusion_jni.dylib' or load `datafusion_jni' from system libraries. Please try building from source the jar or providing datafusion_jni in your system.
        at java.base/java.lang.ClassLoader.loadLibrary(ClassLoader.java:2458)
        at java.base/java.lang.Runtime.loadLibrary0(Runtime.java:916)
        at java.base/java.lang.System.loadLibrary(System.java:2063)
        at org.apache.arrow.datafusion.JNILoader.load(JNILoader.java:95)
        at org.apache.arrow.datafusion.SessionContexts.<clinit>(SessionContexts.java:33)

bvolpato avatar May 09 '25 18:05 bvolpato