[Feature]: Add logging callbacks for assistants API

[ishaan-jaff]

The Feature

Unfortunately we need to wrap the assistants api and it’s lacking logging or token insights atm. We added this in our fork, but would like to get this into the upstream obviously.

Motivation, pitch

Twitter / LinkedIn details

No response

[ishaan-jaff]

cc @mfittko

[mfittko]

Thanks, I opened a draft PR with our patches, feel free to pick it up from there. It works for us, but it might not be the best approach as we're no python devs and it's not easy to see through tbh ;)

[jeromeroussin]

I second the ask for callbacks to be supported in Assistant related routes. Observability is the second half of the value of litellm for us (Authentication being the other half). Without callback support we cannot expose assistant routes to our users.

[tychoengberinkDIJ]

Is it possible to get this into the upstream?

[mfittko]

Someone from the maintainers would need to pick it up. We would love to not having to use our fork in order to stay compatible with the upstream. While it does what we need, we aren't 100% confident that our approach is implemented in a way that would be okay for the maintainers. We aren't very proficient in python and the stuff that we patched has 10k lines and 20+ indentation depth 🙈

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.