Steven Grubb

I took a look at this PR, specifically the Dockerfile portion. The chmod -R 777 is a problem from a security PoV. I know the directory is protected by the...

Yes, just looked. But the transformers line now allows installing versions that have the CVEs (and the CVEs are rated high: most are 8.8 cvss). The CVE's were fixed in...

OK, ran the installation. It now downloads transformers from 4.49 all the way back to transformers-4.26.0 while deciding which to pick. Pip then ultimately selected transformers-4.39.3. Previously, the requirements were...

OK, testing my last suggestion leads to a big conflict. Pip is saying this: The conflict is caused by: The user requested transformers==4.48.0 optimum 1.18.1 depends on transformers=4.26.0 Looking at...

I have a feeling this is being pulled in to support multi-modal models. But can we make this a soft dependency so that text only models can work without pulling...

I can look more into migrating to 3.12. However, I would like to understand if running the tokenizer on 3.9 will malfunction or is it deprecated just because the python...