cntk-hotel-pictures-classificator icon indicating copy to clipboard operation
cntk-hotel-pictures-classificator copied to clipboard

Insufficient Memory: bad_alloc

Open TreeLLi opened this issue 6 years ago • 1 comments

Hello, when I was trying to train the model with VGG16 base model, I got an error of bac_alloc related to the insufficient memory allocation on my DSVM with 4GB memory.

Basically, this is not a programming error. But I think pointing out the minimum requirements on the resource, like memory, will ease lots of pain for the people whose training aborted after running for a long time due to this problem.

Finally, here are some experiment results collected from the Linux DSVM:

  1. VGG16 + e2e: above 4GB but below 8GB
  2. VGG16 + 4-stage: around 17GB

Best wishes!

TreeLLi avatar Mar 04 '18 22:03 TreeLLi