data-prepper icon indicating copy to clipboard operation
data-prepper copied to clipboard

Published 20 hours ago • verified publisher icon opensearch-project

Docker image for ARM architectures

Open dlvenable opened this issue 3 years ago • 6 comments

Is your feature request related to a problem? Please describe.

The Data Prepper Docker image is only available for x86 architectures presently. It is written in Java and should be able to run on ARM.

Describe the solution you'd like

Provide an ARM architecture Docker image. This should be done as a Docker multiarch image so that users can follow the same instructions regardless of their architecture.

Tasks

  • [x] #3352
  • [ ] #2571
  • [ ] Build the ARM image in the GitHub Actions build
  • [ ] Update Jenkinsfile to copy ARM image

dlvenable avatar Nov 22 '21 22:11 dlvenable

Since there are a lot of benefits of using Graviton instances in AWS, in both EC2 or EKS. It would be Nice to support running this container image in ARM architectures.

daixba avatar Sep 01 '22 01:09 daixba

Need this also to run on our EKS clusters (Graviton nodes) As AWS so much promoting they Graviton instances strange that DP still has no ARM image ready

JustinasKO avatar Oct 14 '22 08:10 JustinasKO

It appears that the Gradle plugin that Data Prepper uses to build Docker images supports multiarch through buildx.

https://github.com/palantir/gradle-docker/pull/528

dlvenable avatar Oct 21 '22 01:10 dlvenable

Great finding @dlvenable! But then need to update info about image so it would be clear. ETC: https://hub.docker.com/r/opensearchproject/data-prepper/tags - shows that only supported arch is: linux/amd64

JustinasKO avatar Oct 21 '22 07:10 JustinasKO

@dlvenable Seems like I miss understood so there is possibility to build multi arch but only x64 is beeing built. So if this is small change maybe it could happen soon?

JustinasKO avatar Oct 28 '22 08:10 JustinasKO