PRM icon indicating copy to clipboard operation
PRM copied to clipboard

Stack overflow and OOM

Open saeed68gm opened this issue 5 years ago • 1 comments

Hi,

Very cool work! However I run into some issues trying to experiment with it. How much GPU/CPU memory is recommended for training and inference?

I have a pretty powerful machine (GPU RTX 24 GB RAM) but I could only train with a batch size of 1.

Also at inference time I get stack overflow at the line: proposals = list(map(modules.rle_decode, json.load(f)))

Any advice on how to fix it would be appreciated.

Thanks

saeed68gm avatar Jul 01 '19 21:07 saeed68gm

Hi,

Very cool work! However I run into some issues trying to experiment with it. How much GPU/CPU memory is recommended for training and inference?

I have a pretty powerful machine (GPU RTX 24 GB RAM) but I could only train with a batch size of 1.

Also at inference time I get stack overflow at the line: proposals = list(map(modules.rle_decode, json.load(f)))

Any advice on how to fix it would be appreciated.

Thanks

Hi,

I have the same problem! Could you solve OOM problem? Thanks

raziehkaviani avatar Jul 16 '19 17:07 raziehkaviani