rivet icon indicating copy to clipboard operation
rivet copied to clipboard

[WIP] Add experiment logging support for BrainTrust

Open ankrgyl opened this issue 2 years ago • 1 comments

ankrgyl avatar Aug 08 '23 06:08 ankrgyl

Not strictly necessary to include in the MVP, but if it's possible to emit an event each time a node executes for each test case, we can incrementally log span progress to BrainTrust, and then you'd be able to see performance metrics across the whole execution tree.

Ah yeah I can just pipe in the events from the graph execution!

abrenneke avatar Sep 07 '23 19:09 abrenneke