RAIN issue: how to set max_new

issue: how to set max_new_tokens ?

Open Dada-Cloudzxy opened this issue 10 months ago • 3 comments

how to set max_new_tokens? I just could find 'maxlen' var in 'main.py', and it would cost too muck time for testing.

Apr 30 '24 07:04 Dada-Cloudzxy

When I set maxlen to 512, my tests on the HH dataset took about 30 times longer than the baseline method.

Apr 30 '24 09:04 Dada-Cloudzxy

That doesn't seem to match what the paper says

Apr 30 '24 09:04 Dada-Cloudzxy

@hongyanz @Liyuhui-12

Apr 30 '24 09:04 Dada-Cloudzxy