Isaac Miller

I am also facing a similar issue, but mine is with default ddp strategy, not deepspeed.

Thanks for the help @lantiga Going to respost this in that other thread because I think that is the actual problem, and I doubt that PL is the problem, as...

These issues are still present as of 5/13.

Ill fix this today or tomorrow @okhat

Working on something like this. For now `num_threads` in evaluate is your best bet.

Closing because of LiteLLM migration

> Then at the end of the message I send the list of (ID, img) pairs. @thomasahle Did you find that this worked better than interweaving the `{"type": "image_url", "image_url":...

This is unfortunately known, and the best way to address it is: 1. As of the time of writing - Run everything inside an evaluate call first with a dummy...