entity-fishing icon indicating copy to clipboard operation
entity-fishing copied to clipboard

installation failes (at arm64)

Open tammo0 opened this issue 2 years ago • 2 comments

Hi! Im trying to install entity-fishing at an arm64. But I don't know if this causes the problem. Following the instructions, the installation failes at Step 2 (./gradlew clean build) with 35 failed and 6 skipped tests. The grobid-home seems to be fine. Looking at the output there are a lot of java.lang.UnsatisfiedLinkError and java.lang.NoClassDefFoundError. I tested it with java-11-openjdk-arm64 and java-8-openjdk-arm64 but no differences at all.

If it helps, i can provide the cli output.

Also the docker seems not to run, even when i start it with --platform linux/amd64. Will there be a compatible image?

What am i missing?

Thanks for your help

tammo0 avatar Feb 17 '23 13:02 tammo0

Hi @tammo0 !

My guess is that the problem is the native lmdb data/library.

  • for storing and accessing efficiently the huge amount of information, we use LMDB, and more precisely in this project a JNI wrapper. It's likely that the native lib coming with JNI interface (org.deephacks.lmdbjni) does not support arm64 (I would even say very likely !).

  • we provide all the knowledge base resources as precompiled lmdb for linux/amd64 only, we would need to build these resources for arm64 and store it as alternative download

  • as you saw, the docker image is not a multi-arch image... I still need to learn how to do it.

@lfoppiano do you have maybe some ideas how to ensure arm64 compatibility without too much effort/pain ?

kermitt2 avatar Mar 06 '23 17:03 kermitt2

I think that we can build the docker image on linux, and test if it works with a arm64 host using the current knowledge base resources for linux/amd64.

lfoppiano avatar Mar 16 '23 22:03 lfoppiano