BiMPM icon indicating copy to clipboard operation
BiMPM copied to clipboard

Cannot create a tensor proto whose content is larger than 2GB.

Open TangChangcheng opened this issue 7 years ago • 2 comments

Cannot create a tensor proto whose content is larger than 2GB. The problem occured where word token matrix feed into a tensor: File "/SentenceMatchModelGraph.py", line 35,

TangChangcheng avatar Jun 15 '17 15:06 TangChangcheng

I guess you were trying to load a very large word vector file. A better way is to only crop a smaller word vector file based on all words in your dataset. For the format of word vector file, you can have a look at the example https://drive.google.com/file/d/0B0PlTAo--BnaQWlsZl9FZ3l1c28/view

zhiguowang avatar Jun 22 '17 16:06 zhiguowang

This probably helps. https://stackoverflow.com/questions/35394103/initializing-tensorflow-variable-with-an-array-larger-than-2gb

Joshuaalbert avatar Nov 17 '17 14:11 Joshuaalbert