tofu icon indicating copy to clipboard operation
tofu copied to clipboard

Getting truth ratio always 1

Open shaswati1 opened this issue 11 months ago • 13 comments

I am trying to reproduce the results in Figure 8 of the paper and getting the truth ratio as 1.0 for forget set (5%) for all the unlearning steps until 30. Can you please help me with this? @zhilif and @pratyushmaini

P.S. I'm using the new eval pipeline to generate the aggreate_stat.

shaswati1 avatar Mar 25 '24 20:03 shaswati1