show-attend-and-tell icon indicating copy to clipboard operation
show-attend-and-tell copied to clipboard

problems with prepro.py

Open jw147520 opened this issue 7 years ago • 2 comments

my RAM is not big enough to run this code, so I'm trying to split batch size to be smaller. and I'm having trouble with the size of train.features.hkl It should be getting bigger as the process goes on, but the size is not changing, fixed as 4MB. It seems hickle.dump is overwriting. So I tried mode='a' option, but I got below error message.

RuntimeError: Unable to create link (Name already exists)

How can I append to already existing file?

jw147520 avatar Apr 25 '17 16:04 jw147520

Did you end up figuring this out?

rubenvereecken avatar Jun 02 '17 14:06 rubenvereecken

No, I couldn't figure it out. I just made train.fetures1..hkl, ..., train.features.9.hkl.

jw147520 avatar Jun 15 '17 09:06 jw147520