[FR] Optimize Docker for Kubernetes deployment

[matmair]

Problem The current docker image is not really optimised for deployment with Kubernetes

Suggested solution Work on a few parts:

• [ ] #2585 regarding storage in general
• [ ] move all data that is written ever to a data dir -> immutable files
• [x] #3042 reduce the docker image size to enable faster deploys

Do you want to develop this? Currently getting more into Kubernetes - would love support by knowledgable ppl. though.

[SchrodingersGat]

Regarding docker image size:

• https://pythonspeed.com/articles/alpine-docker-python/
• https://pythonspeed.com/articles/base-image-python-docker-images/

[matmair]

@nws I think you mentioned in a few issues that you use Kubernetes. Do you have anything to add here? I am working on addressing the S3 thing

[gooosetavo]

I just found this project, found it interesting, and would like to work towards writing/contributing a Helm chart for deploying/managing it on a Kubernetes cluster. I've created a fork/branch of the project and am hoping to have a working chart later this weekend. @matmair, will the s3 thing you're working on require adding an s3 api service like minIO to docker compose and this helm chart? couldn't find info on that feature

[matmair]

@gusmann s3 will be optional