Request: Dockerfile

[vpereverzev]

@abacaj Would be really helpful to have Dockerfile you've been using in your demo

[fastrick]

I created a Dockerfile, look in the requests. If you have any questions, just ask :)

[ceramicwhite]

# syntax=docker/dockerfile:1.5-labs

ARG GIT_TAG=${GIT_TAG:-main}

FROM python:3.10-slim AS app

ARG GIT_TAG

ENV PIP_NO_CACHE_DIR=yes \
    PYTHONUNBUFFERED=1 \
    PYTHONDONTWRITEBYTECODE=1 \
    HOME=/app \
    PATH="${PATH}:/app/.local/bin"

USER 1000

WORKDIR /app

ADD https://github.com/abacaj/mpt-30B-inference.git#${GIT_TAG} .

RUN pip install -r requirements.txt

CMD [ "python", "inference.py" ]