TRACE

TRACE copied to clipboard

i find there are many duplicate elements(same questions,same answers) in this dataset.Is this right?

yueluoshuangtian

Question about C-STANCE eval

1

Deer Author: Thanks for your great work. But I noticed that your code in metric.py: `def caculate_accuracy(results, data): scores = 0 for output_id in range(len(results)): prediction = results[output_id] target =...

Kizooo1

the code of "inference/infer_single.py" can not infer "TRACE-Benchmark/LLM-CL-Benchmark_1000", due to CUDA OOM(A100 8G) and only can work on the single card. it's not reasonable. I think the code of "inference/infer_multi.py"...

HandsomeWuuu

Hi @BeyonderXX and thanks for your nice paper and repo !

wynterl

想问一下是否用docker镜像可以拉取，方便复现

mazai-xiangji

How can we run the train using the proposed RCL method? Which command/script should be used?

blmussati