openinference icon indicating copy to clipboard operation
openinference copied to clipboard
Published 5 days ago • verified publisher icon Arize-ai

fix(smolagents): fix missing llm input messages in smolagents

Open andstor opened this issue 5 months ago • 5 comments

Instrumentation of smolagents are not handling the LLM input messages properly anymore. This PR should fix it.

andstor avatar Aug 08 '25 07:08 andstor

Hey @andstor, I am not able to reproduce the issue you were hitting on the latest version of the instrumentation and smolagents==1.21.2. Perhaps the issue has been resolved?

axiomofjoy avatar Aug 22 '25 19:08 axiomofjoy

Hey @andstor, I am not able to reproduce the issue you were hitting on the latest version of the instrumentation and smolagents==1.21.2. Perhaps the issue has been resolved?

Hi @axiomofjoy, I just did the same check and the problem persists. I opened an issue to showcase the problem https://github.com/Arize-ai/openinference/issues/2125.

andstor avatar Aug 24 '25 16:08 andstor

Thanks @andstor. Do you have a small code snippet to reproduce the issue?

axiomofjoy avatar Aug 25 '25 14:08 axiomofjoy

Hey @andstor, it looks like this change causes our existing TestModels tests to break. The issue seems to be that the models used in those tests have messages in dictionary format rather than the smolagents.models.ChatMessage format in the snippet you sent here.

I think it will be necessary to support both formats, and tests are needed.

axiomofjoy avatar Sep 11 '25 18:09 axiomofjoy

Hi @andstor ! let us know if you want any help getting this across the line. Thanks for your contribution!

nate-mar avatar Oct 22 '25 09:10 nate-mar