Max Lund

It would be great to have an addition to the examples on how to run Apple's MobileCLIP and AIMv2 models on MLX. Currently we only have the two smaller MobileCLIP...

Hi, wanted to do some quick tests using `aimv2-large-patch14-224-lit` with the MLX backend but can't seem to find any convenience function to encode text in the repo? Digging through the...

E.g. Apple's own MobileCLIP and AIMv2. There are already MLX versions of some, so perhaps that would help. Don't have time to do this now myself, just curious to benchmark...

Running Siglip/Siglip2 on MLX?

7

Hi, just wondering if there is support for running Siglip models on MLX? This PR seems to indicate so https://github.com/Blaizzy/mlx-vlm/pull/24

Benchmarking MPS vs MLX encoding speed using SigLIP

2

```` Aggregated totals by architecture and backend: architecture backend frame_count duration_s avg_fps 0 ViT-B-16-SigLIP2-256 MPS 1637 28.21 58.029068 1 ViT-L-16-SigLIP-256 MPS 1637 91.39 17.912244 2 ViT-L-16-SigLIP-384 MPS 1637 226.56 7.225459...

Make it possible to load siglip models from local files

5

Read img and patch size if supplied in model_config arg. What is the context for the regex parsing of the repo name, the img/patch size isn't always correct in the...

Add support for visheratin/mexma-siglip2

2

Claims to achieve new SOTA results on the multilingual retrieval benchmark Crossmodal-3600. See https://huggingface.co/visheratin/mexma-siglip2

Segfaults on macOS ARM

13

Hi! Getting some crashes on macOS ARM (MBP M1 Pro), which we believe happens when parsing MXF files from Avid Media Composer (i.e. they can be audio, video, image, or...

Segfault during inference

4

``` Crashed Thread: 23 Exception Type: EXC_BAD_ACCESS (SIGSEGV) Exception Codes: KERN_INVALID_ADDRESS at 0x0000000000000700 Exception Codes: 0x0000000000000001, 0x0000000000000700 Termination Reason: Namespace SIGNAL, Code 11 Segmentation fault: 11 Terminating Process: exc handler...