langsmith-sdk icon indicating copy to clipboard operation
langsmith-sdk copied to clipboard

Issue: Cannot query multiple runs at `/feedback?run=`

Open spencermize opened this issue 9 months ago • 5 comments

Issue you'd like to raise.

The docs state we can query all feedback by an array of runs: image

    listFeedback({ runIds, feedbackKeys, feedbackSourceTypes, }?: {
        runIds?: string[];
        feedbackKeys?: string[];
        feedbackSourceTypes?: FeedbackSourceType[];
    }): AsyncIterable<Feedback>;

However, running

langsmithClient.listFeedback({ runIds: [id1, id2] }))

returns a 422 Unprocessable Entity. I get the same results if I query the API endpoint directly, using a comma-separated set of UUIDs.

Everything works swimmingly if I query one run at a time; however, this leads to way too many requests for what I'm doing, so it seems better to support the batch functionality as documented.

Thanks!

Suggestion:

No response

spencermize avatar May 23 '24 14:05 spencermize