gateway icon indicating copy to clipboard operation
gateway copied to clipboard

Replays does not respect the order in list of messages (images/text)

Open im-ajaymeena opened this issue 4 months ago • 0 comments

What Happened?

Our original requests to LLM uses message order as ['image_url', 'image_url', 'text'] Image

When we use replay for the above trace -> the portkey changes the order to ['text', 'image_url', 'image_url'] (I didn't knew this until I found change in the reponse behaviour since normally we use playground/replay in pretty mode ) Image

What Should Have Happened?

Replays should respect the order of messages, since the reproducibility gets affects

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

im-ajaymeena avatar Jul 24 '25 03:07 im-ajaymeena