Add ability to use ClipTokenizer

[scottroot]

trafficstars

I have a large datasets that was encoded with Clip 32 but I cannot deploy that in ES because it uses the ClipTokenizer. Is there a way to add this?

[davidkyle]

There are 2 models in Clip, the image processing model and a text embedding model. Elastic does not support image processing models but if you want to use the text embedding model you can install the Sentence Transformers implementation: https://huggingface.co/sentence-transformers/clip-ViT-B-32-multilingual-v1