CodeRL icon indicating copy to clipboard operation
CodeRL copied to clipboard

How to generate Critic Scores that can mimic a reward model

Open AhmedKhaled945 opened this issue 2 years ago • 2 comments

Hello, hope all is well,

Wanted to ask how to generate critic scores for a solution of a code problem, is there a way instead of just classifying them using the critic model?

AhmedKhaled945 avatar Sep 20 '23 07:09 AhmedKhaled945

Hello, I don't know if you solved this problem, I'm also experiencing this problem now, can you give me some advice

YTJY avatar Dec 10 '24 13:12 YTJY

When I used the critic model to score the generated code, I found that the effect was very poor, I don't know if I made a mistake, I wonder if you have ever encountered this situation

YTJY avatar Dec 10 '24 13:12 YTJY