graphvite icon indicating copy to clipboard operation
graphvite copied to clipboard

Running out of memory when loading pre-trained embeddings

Open mortenterhart opened this issue 1 year ago • 1 comments

I'm running a laptop with an RTX 3070 GPU, an AMD Ryzen 9 5900HX processor and 16 GB RAM on Linux Mint. When trying to load the transe_wikidata5m.pkl model as following

with open('./transe_wikidata5m.pkl', 'rb') as embeddings_file:
    transe_embedding = pickle.load(embeddings_file)

I'm running out of memory and the process gets killed by the OS after some freezing time. I don't have access to another machine at the moment. Is there any alternative way of loading the model or are there smaller versions available?

I would be grateful for any help.

mortenterhart avatar Jan 05 '24 21:01 mortenterhart

/transe_wikidata5m.pkl Where does a similar pkl file like fb15k_237 load

zhangxy22 avatar Jun 07 '24 08:06 zhangxy22