gateway
gateway copied to clipboard
Replays does not respect the order in list of messages (images/text)
What Happened?
Our original requests to LLM uses message order as ['image_url', 'image_url', 'text']
When we use replay for the above trace -> the portkey changes the order to ['text', 'image_url', 'image_url'] (I didn't knew this until I found change in the reponse behaviour since normally we use playground/replay in pretty mode )
What Should Have Happened?
Replays should respect the order of messages, since the reproducibility gets affects
Relevant Code Snippet
No response
Your Twitter/LinkedIn
No response