Huw Prosser
Huw Prosser
What did you end up doing in the end?
My solve for this was using python 3.10
> Same here, looks like the call to model.generate in cli.py is not passing the image_sizes variable. Adding the line: imagesize=image.size below the load_image() call, and the line: image_sizes =...
I got this working by building the image from this blog post: https://lavaraja-padala.medium.com/deploy-google-gemma-2b-and-gemma-7b-models-on-aws-sagemaker-f441914ccc6f TGI 2.1.1 seems to be what must be being used internally. Weirdly, HF endpoints seem to be...