Noah Kasmanoff

Hey, posting in here since I'm interested in multi-modal. I'm currently trying to convert [bakLlava](https://huggingface.co/llava-hf/bakLlava-v1-hf). The model doesn't matter too much to me, but this one worked out of the...

@gboduljak Thank you this is a lot of great info! Will try to catch myself up and help :-)

@gboduljak No problem, but after looking it over, not sure I can be extraordinarily helpful beyond some simpler tasks. This is a lot lower level coding than I'm used to...

@gboduljak I submitted a PR to your existing PR, which creates a local implementation of the CLIPImageProcessor. https://github.com/gboduljak/mlx-examples/pull/1 This should eliminate the dependency on transformers, aside from using it for...