deep-learning-containers
deep-learning-containers copied to clipboard
[feature-request] TGI DLC requirements.txt
Checklist
- [X] I've prepended issue tag with type of change: [feature]
- [X] (If applicable) I've documented below the DLC image/dockerfile this relates to
- [X] (If applicable) I've documented the tests I've run on the DLC image
- [X] I'm using an existing DLC image listed here: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
- [ ] I've built my own container based off DLC (and I've attached the code used to build my own image)
Concise Description:
It doesn't seem that the HuggingFace TGI DLCs support a requirements.txt
file? I've tried to upload one with my model package, but it isn't updating the transformers version.
DLC image/dockerfile:
763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:2.0-transformers4.28-gpu-py310-cu118-ubuntu20.04
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
I'm not able to load a model with model.safetensors
instead of pytorch_model.bin
with the current transformers version
Describe the solution you'd like I'd like to be able to include a requirements file instead of needing to build a custom image