aim icon indicating copy to clipboard operation
aim copied to clipboard

Is there a way to build and use it on arm linux (eg. amazonlinux2 arm)?

Open Dong-Ki-Lee opened this issue 2 years ago • 7 comments

❓Question

It seems that the modification was made to build in arm, but it seems to be built only in mac arm (apple m1). Is there any way to build and use it on arm linux? Or could support be added?

Note

Currently when I try to install from arm linux it says aimrocks version 0.21.0 cannot be found.

Environment

os : amazonlinux2 cpu : AWS Graviton python version : 3.8 or 3.10

Dong-Ki-Lee avatar Aug 23 '22 05:08 Dong-Ki-Lee

Hi @Dong-Ki-Lee. Thanks for the question. It seems there are no blockers to provide wheels for arm linux, but there's a dependency from aimrocks, a rocksdb wrapper which should be built as well. Is the missing arm linux a blocker for you?

@mahnerak, will building aimrocks form arm linux take long to implement?

alberttorosyan avatar Aug 23 '22 07:08 alberttorosyan

Hello @alberttorosyan . Thank you for the answer.

As you said above, it seems that the problem is aimrocks (version 0.21.0) is not building well on the arm linux. The following issues occur when working with Amazonlinux2 arm version (also, ubuntu arm version too).

For the aimrocks, when installing with pip, the version(0.21.0) cannot be found and other versions cannot be installed well. In addition, when building the latest source code of aimrocks, errors occur during the build.

When I installing the aim, I could not check any issues other then aimrocks.

Please let me know right away if I misunderstood the part you asked or if you need additional information.

Dong-Ki-Lee avatar Aug 23 '22 08:08 Dong-Ki-Lee

Hello @alberttorosyan . Thank you for the answer.

As you said above, it seems that the problem is aimrocks (version 0.21.0) is not building well on the arm linux. The following issues occur when working with Amazonlinux2 arm version (also, ubuntu arm version too).

For the aimrocks, when installing with pip, the version(0.21.0) cannot be found and other versions cannot be installed well. In addition, when building the latest source code of aimrocks, errors occur during the build.

When I installing the aim, I could not check any issues other then aimrocks.

Please let me know right away if I misunderstood the part you asked or if you need additional information.

@Dong-Ki-Lee thanks for the additional input. Will prioritize the aimrocks build for arm linux. Meanwhile, is running aim for linux x86_64 an option for you?

alberttorosyan avatar Aug 23 '22 08:08 alberttorosyan

@alberttorosyan thank you for the answer. As you said, x86_64 is one of the great options. There is no problem with normal use.

It works very well in the x86_64 environment, but I want to test how faster it will be in an arm cpu environment with high single core performance.

It's just for the testing, so I just asked about the possibility :)

Thank you for your quick reply.

Dong-Ki-Lee avatar Aug 23 '22 09:08 Dong-Ki-Lee

hey @Dong-Ki-Lee. We released a dev version of aimrocks for arm linux. Could you please try it out and let us know if it works?

pip install aimrocks==0.2.2a2
pip install aim

gorarakelyan avatar Aug 26 '22 08:08 gorarakelyan

@gorarakelyan Oh, it works very, very well. Thank you very much for your quick confirmation

env

  • amazonlinux2
  • c7g (graviton3)
  • python3.10 (The default Python version of amazonlinux2 is python3.7, so I built and used python3.10.)

Dong-Ki-Lee avatar Aug 29 '22 15:08 Dong-Ki-Lee

Hi @Dong-Ki-Lee ! Could you please try out the following dev. package of aimrocks? pip install aimrocks==0.2.2.dev6

It is basically the same package as previous one, but already automated by Github Actions. If everything is fine on your side, will roll the new official version and update aim to use the newer version of aimrocks

alberttorosyan avatar Sep 19 '22 07:09 alberttorosyan

Hello @alberttorosyan I'm sorry for the late response. As a result of testing with the dev6 you mentioned, it works well.

ps. test it after installing python3.10 on c7g, Amazonlinux2.

Dong-Ki-Lee avatar Nov 15 '22 07:11 Dong-Ki-Lee