doods2 icon indicating copy to clipboard operation
doods2 copied to clipboard

Debian container

Open Curid opened this issue 2 years ago • 13 comments

  • [x] amd64
  • [x] arm/v7
  • [x] arm64/v8
  • [x] amd64-noavx
  • [x] amd64-gpu

Curid avatar Apr 05 '22 19:04 Curid

I will add EdgeTPU and then try the ARM builds.

Curid avatar Apr 05 '22 19:04 Curid

That looks pretty good. I'm sure it's way smaller. If I can come up for air from work stuff I may take another crack at the ARM builds. They are a bear. Basically the Tensorflow people more or less said they are no longer supporting 32 bit arm.

snowzach avatar Apr 06 '22 02:04 snowzach

Added libedgetpu, just needs some testing then amd64 is done.

Uncompressed size. Old: 5.14GB New: 3.74GB

Curid avatar Apr 06 '22 16:04 Curid

The arm64 build just hangs randomly after several hours. No CPU usage and no errors.

Curid avatar Apr 09 '22 16:04 Curid

Is it in the middle of building tensorflow? Are you cross compiling or using buildx or native? In all cases it's likely running out of memory. You need to pass resources into Bazel (and even then it seems like it ignores it) I would just keep ratcheting down memory and cpu until it completed.

snowzach avatar Apr 09 '22 22:04 snowzach

I'm using buildx. I guess the emulation uses more memory. The amd64 builds threw errors before I added a swapfile.

Limiting it with --jobs seems to work, but now it looks like it's going to take 2 days to build.

Curid avatar Apr 10 '22 17:04 Curid

I don't think I ever got it to complete using buildx. I finally bought an ODroid C2 I think it was to compile it on.

snowzach avatar Apr 10 '22 17:04 snowzach

arm64 build successful! Anything else you want me to do? Do you want it in a single commit?

Curid avatar Apr 13 '22 16:04 Curid

Wow! I will check it out... Did you use qemu on an x86 box to do the cross builds? If so, what version was qemu?

Trying out the arm64 one now.

snowzach avatar Apr 13 '22 16:04 snowzach

qemu on x86. I used these commands.

docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-*
docker run --privileged --rm tonistiigi/binfmt --install all

I needed it for the old images but I don't think it's needed now.

Curid avatar Apr 13 '22 17:04 Curid

Why is there no bazel-bootstrap package for armv7?? https://packages.debian.org/bullseye/bazel-bootstrap

Curid avatar Apr 13 '22 17:04 Curid

Turns out you can build Bazel from scratch. I didn't see that before.

Curid avatar Apr 13 '22 19:04 Curid

Small fix, bazel doesn't bundle the jdk anymore.

Curid avatar Apr 14 '22 16:04 Curid