bottom-up-attention icon indicating copy to clipboard operation
bottom-up-attention copied to clipboard

Memory Error on AddAttrsToSceneGraphs function

Open CharlotteG95 opened this issue 5 years ago • 1 comments

Hi I am running the preprocessing stages in order to use visual genome dataset. I have downloaded the segmented json files via the link within visual_genome_python_driver/local.py however the command ./data/genome/setup_vg.py produces a memory error when run - is there a way around this?

$ data/genome/setup_vg.py Traceback (most recent call last): File "data/genome/setup_vg.py", line 205, in vg.AddAttrsToSceneGraphs(dataDir=dataDir) File "/nas/users/t0192227/faster-rcnn/data/genome/visual_genome_python_driver/local.py", line 227, in AddAttrsToSceneGraphs sg_dict = {sg['image_id']:sg for sg in json.load(f)} File "/usr/lib/python2.7/json/init.py", line 291, in load **kw) File "/usr/lib/python2.7/json/init.py", line 339, in loads return _default_decoder.decode(s) File "/usr/lib/python2.7/json/decoder.py", line 364, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python2.7/json/decoder.py", line 380, in raw_decode obj, end = self.scan_once(s, idx) MemoryError

Thanks Charlotte

CharlotteG95 avatar Jul 02 '19 16:07 CharlotteG95

I have the same problem!

djx2726889 avatar Apr 13 '20 13:04 djx2726889