NobHappy comments

Repositories
Issues
Comments

Results 2 comments of


                                            NobHappy

Recommended ROME layers and v_loss_layer for Qwen3 series (0.6B, 1.7B, 4B, 8B)

Same, I'm working on the MEMIT & ROME methods on the Qwen3 series, hoping to get official hparams settings.

Recommended ROME layers and v_loss_layer for Qwen3 series (0.6B, 1.7B, 4B, 8B)

Thank you for your response! Another issue is that, seems the environment cannot recognize Qwen3 models (transformers version too old), hoping it can be fixed together.