michaelfeil
Slim down michaelf34/infinity:latest-amd
Feature request
The infinity Dockerfile is carefully constructed to not drag its build artifacts into the final image, but unfortunately the base image rocm/pytorch:rocm6.2.3_ubuntu22.04_py3.10_pytorch_release_2.3.0 is not, and it is huge. The infinity image ends up being >20G compressed, and almost 80G on disk.
Motivation
Save disk space. Save the planet.
Your contribution
.
I wish - please provide me with a functioning, better base image.
I am building on the same one as vllm.
Looks like vLLM makes its own base image by apt installing rocm pieces. But I did file an issue against rocm/pytorch, because it's strange that pytorch/pytorch does not have this issue. The building Dockerfiles look correct, so maybe their CI is actually using different scripts.