[Feature]: Tracking missing metrics/metadata for observability

[creatorrr]

trafficstars

🔖 Feature description

• [ ] prompt token count in unwrapped prompt step transitions (we should store all of the returned data)
• [ ] integrations should return a usage field (can be None in the beginning but eventually all of them should have it)
• [ ] add file size to files table
• [ ] check if embedding tokens are being counted and logged by pgai vectorizer (and if not, add them)

maybe?

• [ ] record transition blob size before offloading and save that in transitions

🎤 Why is this feature needed ?

No response

✌️ How do you aim to achieve this?

No response

👀 Have you searched issues and PRs to see if this feature request has been raised before?

• [x] I checked and didn't find similar issue