The metric summary for pre and post is the same when using UltraEdit

[chenyangzhu1]

Thanks for your repo. When I used UltraEdit to edit Qwen2.5, I found that the metric summary was the same for pre and post. Is this normal?

Metrics Summary: {'pre': {'rewrite_acc': 0.7859880952380952, 'rephrase_acc': 0.6726210317460317}, 'post': {'rewrite_acc': 0.7859880952380952, 'rephrase_acc': 0.6726210317460317, 'locality': {'neighborhood_acc': 1.0}}}

This is my bash command:

python run_ultraedit_editing.py \
    --editing_method=UltraEdit \
    --hparams_dir=EasyEdit/hparams/UltraEdit/qwen2.5-7b.yaml \
    --data_dir=EasyEdit/data/ultraedit/raw/zsre \
    --ds_size=400 \
    --batch_size=100 \
    --data_type=zsre \
    --sequential_edit

[littlefive5]

Hello, the code is provided by the author of UltraEdit. We currently do not know why it failed. We will check it soon, but we recommend you use the original code for the time being.

[chenyangzhu1]

Hello, the code is provided by the author of UltraEdit. We currently do not know why it failed. We will check it soon, but we recommend you use the original code for the time being.

Thanks for your reply. Since I am a newbie in this field, could you recommend me a simple and easy migration method in this repo as a starting point?

[littlefive5]

Hello, the code is provided by the author of UltraEdit. We currently do not know why it failed. We will check it soon, but we recommend you use the original code for the time being.

Thanks for your reply. Since I am a newbie in this field, could you recommend me a simple and easy migration method in this repo as a starting point?

Hi, I recommend AlphaEdit for start.

[chenyangzhu1]

Hello, the code is provided by the author of UltraEdit. We currently do not know why it failed. We will check it soon, but we recommend you use the original code for the time being.

Thanks for your reply. Since I am a newbie in this field, could you recommend me a simple and easy migration method in this repo as a starting point?

Hi, I recommend AlphaEdit for start.

Thanks for your recommendation.

[XiaojieGu]

Hi Chenyang, Thank you for your interest in the UltraEdit project. You can directly use the original UltraEdit repository for editing and testing. If you encounter any other issues later, feel free to raise them in the UltraEdit issue tracker — I’d be very happy to help answer them.

[zxlzr]

hi do you have any questions?