peng2001

Results 22 comments of peng2001

i want to install Mephisto for Crowdsourcing tasks Reference: https://github.com/facebookresearch/ParlAI/tree/main/parlai/crowdsourcing

The issue you are concerned with is actually the generalization of editing, from simple editing prompts to the generation of complex queries. This is a problem that many current works...

Q1: - Your usage is correct; just ensure that the number of items in the `prompts` and `ground_truth` under each dimension, such as "english" and "polish," are consistent. - You...

Thank you for your time to reproduce the results of reliability, generalization, and locality. EasyEdit's metrics have gone through several versions of iterations, which may be the reason for the...

EasyEdit appreciates your feedback. I reviewed the experimental results and found that the performance on `GPT-J` is still less than 5% (FT). You can refer to the paper for this:...

Hello, the results of the portability metrics for various editing methods on LLaMA-2-7B have been updated in the [README](https://github.com/zjunlp/EasyEdit?tab=readme-ov-file#editing-performance). The corresponding EasyEdit paper will also be updated soon. Thank you...

If all your issues have been resolved, please help close this issue.

Thanks for your contribution, I will reorganize your code and rename it to `r-rome` to retain the original implementation of rome.

[Neurips](https://neurips.cc/Conferences/2024) submission is coming soon. I will restart this matter after **5.22** and support it as soon as possible. Thank you for your timely follow-up. If you are interested, I...

I added a standalone implementation of R-ROME based on @akshat57 's implementation. In theory, it supports any models that are compatible with ROME, as there were no significant code changes.