mlx-swift-examples icon indicating copy to clipboard operation
mlx-swift-examples copied to clipboard

Does it support FastVLM-0.5B-4bit version?

Open Lornatang opened this issue 1 week ago • 0 comments

I used the mlx-vlm tool to perform 4-bit quantization on the official FastVLM-0.5B and modified it according to your example, but I encountered this error:

MLXNN/Module.swift:570: Fatal error: 'try!' expression unexpectedly raised an error: MLXNN.UpdateError.needModuleInfo("Unable to get @ModuleInfo for FastVLMMultiModalProjector.layers -- must be wrapped to receive updates")

It would be great if you could take a look at this. Thank you for your great work.

Lornatang avatar Nov 28 '25 12:11 Lornatang