What is the conclusion then ?

[Docteur-RS]

Have you found at least one LLM capable of calling tools ? Because I've tested mistral, dolphin-mixtral and llam3:8B and all of them are lost !

If I read correctly your benchmark none of your LLMs achieved it either.

So now what ? We dump CrewAI ? XD Honnestly I don't see the point of using a framework that can't call tools.