memit
memit copied to clipboard
CUDA out of memory
Hi authors,
MEMIT is an interesting work. When I run: python -m experiments.evaluate --alg_name=MEMIT --model_name=EleutherAI/gpt-j-6B --hparams_fname=EleutherAI_gpt-j-6B.json --num_edits=10 --use_cache
There is error about CUDA out of memory:
File "\memit-main\memit\memit_main.py", line 97, in
My local is 24GB 3090 GPU. Would you help me how to run the MEMIT code ? How to revise the configure file (EleutherAI_gpt-j-6B.json) , in order to reduce memory?
Thank you very much. MEMIT is very nice.