foundationdb icon indicating copy to clipboard operation
foundationdb copied to clipboard

release package for linux arm64

Open qzhuyan opened this issue 1 year ago • 7 comments

It is huge pain to get started with fdb on linux arm64.

  1. There is no release package for linux arm64.
  2. self compiling needs very large machine. (8 GB of ram is not enough)

Would you consider release package for linux arm64 or you don't suggest run FDB on linux arm64?

cross compiling OR compile in Qemu is also option. anyone tried?

suggestions? thanks!

qzhuyan avatar Jun 10 '24 09:06 qzhuyan

Internally we do not use Qemu -- we could do that in a cloud docker environment instead. @jzhou77 and @ammolitor, would you consider this as it seems not a big deal on our side?

xis19 avatar Jun 10 '24 20:06 xis19

I am working on a solution to get arm64 binaries incorporated as part of the release assets. We will not use qemu, but will compile in an actual ARM environment.

ammolitor avatar Jun 10 '24 21:06 ammolitor

@xis19 @ammolitor thanks for replies! looking forward for FDB linux arm64 releases!

qzhuyan avatar Jun 11 '24 15:06 qzhuyan

@qzhuyan I am seeing arm64 pkg released, e.g. https://github.com/apple/foundationdb/releases/tag/7.1.61 Closing as done.

xis19 avatar Jun 27 '24 23:06 xis19

@xis19 Seems .pkg cannot be used directly by linux.

niebayes avatar Jun 28 '24 05:06 niebayes

@xis19 If you mean this one? https://github.com/apple/foundationdb/releases/download/7.1.61/FoundationDB-7.1.61_arm64.pkg, that is for macOS not for linux I think.

qzhuyan avatar Jun 28 '24 08:06 qzhuyan

Okay, I never understand Mac... Let's wait for some longer time since @ammolitor is working on it.

xis19 avatar Jun 28 '24 11:06 xis19

I built some automation for this ~9 months ago: https://github.com/gm42/fdb-build-support

See also the scripts I added in https://github.com/gm42/foundationdb

But of course upstream support would be great & better.

gm42 avatar Jul 02 '24 10:07 gm42

Linux support for FDB is RHEL (Rocky Linux) focused. We now have binaries for linux arm64 as part of the release process. That is as far as we will go at this time. We do not have plans to build RPM or DEB packages for arm64 on linux.

The *.pkg files in the release assets are packages for installing FDB on a mac (x86_64 and arm64) for local (client) development.

FDB is not intended to be compiled/developed on small machines. The arm64 CI builds are built in an BUILD_GENERAL1_LARGE environment in AWS CodeBuild. It has 16GB and 8vCPU. Anything smaller than that is untested territory for our team.

ammolitor avatar Jul 05 '24 15:07 ammolitor

I built some automation for this ~9 months ago: https://github.com/gm42/fdb-build-support

See also the scripts I added in https://github.com/gm42/foundationdb

But of course upstream support would be great & better.

There is not currently a case for us to use this, but it looks like nice work.

ammolitor avatar Jul 05 '24 15:07 ammolitor

We now have binaries for linux arm64 as part of the release process.

Are these going to be part of some future release? I cannot find them in recent releases :thinking:

gm42 avatar Sep 06 '24 07:09 gm42

The binaries are present here: https://github.com/apple/foundationdb/releases/tag/7.3.49 and https://github.com/apple/foundationdb/releases/tag/7.1.62, for some reason the binaries are called aarch64 🤷 .

johscheuer avatar Sep 06 '24 10:09 johscheuer

The binaries are present here: https://github.com/apple/foundationdb/releases/tag/7.3.49 and https://github.com/apple/foundationdb/releases/tag/7.1.62, for some reason the binaries are called aarch64 🤷 .

The name is derived from the uname command on the host they're built on 😉

ammolitor avatar Sep 06 '24 12:09 ammolitor

Thanks @johscheuer @ammolitor! Would it be possible to get them built also for the next non-pre-release? I am trying to stick to stable versions due to that big disclaimer:

🚫 NOT FULLY TESTED, NOT FOR PROD USE 🚫

gm42 avatar Sep 06 '24 12:09 gm42

We already to that, we just didn't have a new stable release. CC @jzhou77 was that disclaimer for 7.3.49 added intentionally?

johscheuer avatar Sep 06 '24 12:09 johscheuer

It's literally what the disclaimer says. Although we believe 7.3.49 and some pre-releases are good, we don't have production clusters running that version. To be sure, please wait for the next stable release that we run in production.

jzhou77 avatar Sep 06 '24 19:09 jzhou77

@jzhou77 When will the stable version containing aarch64 binary be released please?

luwei16 avatar Oct 16 '24 09:10 luwei16

7.3.53 should be the one. We are validating this version. If everything looks good, I'll mark 7.3.53 as the latest stable version.

jzhou77 avatar Oct 16 '24 19:10 jzhou77