Support Chat API

[madroidmaq]

Hope to support the API style for Chat (friendly to multi-turn conversations), currently it seems to be nearly supporting generate.

For example, in a similar way to the code example like Qwen/Qwen2-VL-2B-Instruct as follows:

messages = [
    {
        "role": "user",
        "content": [
            {
                "type": "image",
                "image": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-VL/assets/demo.jpeg",
            },
            {"type": "text", "text": "Describe this image."},
        ],
    }
]

# apply messages
...

[Blaizzy]

You can do this manually.

I will later check if there is a great way to integrate this. The problem is that not all models support this format.

[Blaizzy]

Also we have a multi-turn example here:

https://github.com/Blaizzy/mlx-vlm/issues/68#issuecomment-2440233679

[madroidmaq]

Also we have a multi-turn example here:

#68 (comment)

Thanks, this example worked for me.

[Blaizzy]

My pleasure!