DyLAN icon indicating copy to clipboard operation
DyLAN copied to clipboard

Where is the step 'agent selection' and 'team reformation' in llmlp_listwise_mmlu.py

Open ME-Msc opened this issue 1 year ago • 5 comments

https://github.com/SALT-NLP/DyLAN/blob/006e440a519f7cf21e2826f3b8033d84ae9bf07c/code/MMLU/llmlp_listwise_mmlu.py#L45-L58

As the title describes, I didn't see the step 'agent selection' and 'team reformation' in llmlp_listwise_mmlu.py lines 45-58. You only did forward (propagation in section 3.4(1) of your paper) and backward (aggregation in section 3.4(2) of your paper).

Could you update the code? Thanks.

ME-Msc avatar Dec 09 '24 14:12 ME-Msc

I also noticed that no optimization steps are included.

zhipeng-wei avatar Mar 17 '25 19:03 zhipeng-wei

I think it's the old version code. They didn't implement the experiment as the paper said. Fake research.

ME-Msc avatar Mar 24 '25 06:03 ME-Msc

I think it's the old version code. They didn't implement the experiment as the paper said. Fake research.

绷不住了

permutation248 avatar Jun 07 '25 03:06 permutation248

The workflow of this work is quite confused...

Tsai-ky avatar Jul 17 '25 07:07 Tsai-ky

沽名钓誉之徒啊

fmxu2016 avatar Sep 19 '25 06:09 fmxu2016