Able to define a custom feedback provider (thumb up/down on chat completion)

[Berber31]

Validations

• [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that requests the same enhancement

Problem

Clicking on thumb up/down for a chat completion only post data in ./continue/dev_data/chat.jsonl

In order to improve/compare model performance it could be great to send these metrics to our own metrics storage. with following informations:

• feedback [true/false]
• completion id
• model title
• user comment (involving a new popup to fill it)

Solution

Like defining a custom LLM provider or custom context provider it could be great to be able to define a 'custom feedback provider'.