knowledge-neurons

knowledge-neurons copied to clipboard

grad error using KnowledgeNeurons with model_name = "gpt2"

5

When I initialize KnowledgeNeurons with model_name = 'gpt2', I get an RuntimeError when trying to run kn.get_refined_neurons() The following snippet would be able to reproduce the error on a colab...

vivekvkashyap

I see this todo list: Find good dataset for GPT-like models to evaluate knowledge neurons (PARAREL isn't applicable since the tail entities aren't always at the end of the sentence)...

CaiJichang212

The GPU memory will keep increase

1

I noticed that when continuously analyzing multiple data streams with neurons, the GPU memory usage keeps increasing, eventually leading to an overflow. Is there any way to solve this problem?

sev777