Mocha.jl icon indicating copy to clipboard operation
Mocha.jl copied to clipboard

Training Imagenet using Mocha

Open vollmersj opened this issue 10 years ago • 1 comments

Has anyone trained imagenet or parts of imagenet using Mocha or just loaded parts of the data set for backpropgation. Any recommendations about the setup would be greatly appreciated.

vollmersj avatar Sep 09 '15 13:09 vollmersj

@vollmersj I personally have not done that. For training with huge ImageNet dataset, I believe converting the data into HDF5 format is very infeasible. Actually, IO might become the bottleneck at some point. Caffe use specific LevelDB or LMDB to store the images to get high speed random access. I think to make this work, a first thing needed is to at least to write a specific DataLayer to load from proper format of the dataset.

pluskid avatar Sep 09 '15 13:09 pluskid