documentation icon indicating copy to clipboard operation
documentation copied to clipboard

[ML-OB] document metadata for custom evals

Open lievan opened this issue 1 year ago • 4 comments

What does this PR do? What is the motivation?

This PR documents how to set the metadata field for evaluation metrics in the SDK

Merge instructions

  • [ ] Please merge after reviewing

Additional notes

lievan avatar Oct 15 '24 15:10 lievan

Preview links (active after the build_preview check completes)

New or renamed files

  • https://docs-staging.datadoghq.com/evan.li/metadata-for-evals-sdk/llm_observability/setup/sdk/

github-actions[bot] avatar Oct 15 '24 15:10 github-actions[bot]

@lievan is this good to merge?

maycmlee avatar Oct 15 '24 15:10 maycmlee

@maycmlee not yet; waiting on the next release of ddtrace, thanks!

lievan avatar Oct 15 '24 16:10 lievan

@lievan Thanks for letting me know! Feel free to /merge when the next ddtrace has been released.

maycmlee avatar Oct 15 '24 16:10 maycmlee

Holding off on supporting metadata for custom evals

lievan avatar Jan 06 '25 16:01 lievan

✅ Documentation Team Review

The documentation team has approved this pull request. Thank you for your contribution!

github-actions[bot] avatar Jul 15 '25 21:07 github-actions[bot]

nevermind just gonna open a new one

lievan avatar Jul 15 '25 21:07 lievan