pipelines icon indicating copy to clipboard operation
pipelines copied to clipboard

How to Retrieve User Feedback (Thumbs Up/Down) from Open Web UI Pipelines for RLHF

Open latent-variable opened this issue 1 year ago • 5 comments

I'm trying to figure out how to retrieve user feedback submitted via the thumbs up/thumbs down interface in the Web UI. Specifically, I need to know how to access this feedback data through the pipelines. Despite searching through the documentation and codebase, I haven't found clear instructions or examples on how to do this.

Can someone please provide guidance or point me to the relevant resources?

latent-variable avatar Aug 12 '24 18:08 latent-variable

There is no user feedback. Those buttons are not used at the moment. They are for future use.

pkeffect avatar Aug 12 '24 19:08 pkeffect

@pkeffect thanks for the response, I will go ahead and close the issue now and track the progress of those features in the open webui

latent-variable avatar Aug 12 '24 19:08 latent-variable

@pkeffect I did some digging. The feedback is being tracked, https://github.com/open-webui/open-webui/discussions/1836 you can manually pull it using the export all chats features "annotation":{"rating":-1,"reason":"Don't like the style","comment":""}

latent-variable avatar Aug 13 '24 01:08 latent-variable

Isn't there a way to have a hook in pipelines for each of the given feedback?

pedroallenrevez avatar Dec 04 '24 13:12 pedroallenrevez

I Also Would be very interested in this feature, being able to track that in a filter would be incredible (for example, langfuse rating)

RAPHCVR avatar Jan 09 '25 09:01 RAPHCVR