sparse resnet model

[dongxiao92]

Issue summary

I'd like to use the sparse resnet model. I have downloaded the model from "SkimCaffe/models/resnet/ResNet-50-model.caffemodel.bz2" and loaded it using caffe c++ interface. But when iterating the entry of convolution parameters, I find it seems no entry has the exact 0 value. Instead, the values are very small and close to 0.
So I'd like to know if there is some threasholds. Or I downloaded the wrong model.

Steps to reproduce

1. download the model from "SkimCaffe/models/resnet/ResNet-50-model.caffemodel.bz2" and unzip it.
2. load the model using caffe c++ interface

/**
 * Parse the caffemodel based on the model path.
 **/
bool ParseCaffeModel(const string&caffemodel_path, caffe::NetParameter&param){
    //use coded stream to increase the size limit.
    int fd = open(caffemodel_path.c_str(), O_RDONLY);
    if(fd == -1){
        cerr<<"failed to parse caffemodel:"<<caffemodel_path<<endl;
        return false;
    }   
    ZeroCopyInputStream* raw_input = new FileInputStream(fd);
    CodedInputStream* coded_input = new CodedInputStream(raw_input);
    coded_input->SetTotalBytesLimit(1024*1024*512, 1024*1024*256);
    param.ParseFromCodedStream(coded_input);
    
    delete coded_input;
    delete raw_input;
    close(fd);
    return true;
}

3. iterate the entries

//find convolution layers and get weight blob
caffe::BlobProto weights = layer.blobs(0);
    for(int k=0; k<filter_number; k+=1){
            const float*data = weights.mutable_data()->data()+k*filter_size;
            for(int i=0; i<filter_size; i+=1){
                float val = data[i];
                cout<<"val "<<i<<":"<<val<<endl;
                if( val == static_cast<float>(0) ){
                    zero_count += 1;
                }else{
                    //record the coordinate
                    coos.push_back(make_pair(k,i));
                }
            }
        }
        //layer type information, layer name
        cout<<layer.type()<<","<<layer.name()<<","<<zero_count<<endl;

the nnz_count is zero.

Your system configuration

Operating system: Ubuntu 16.04 Compiler: gcc (Ubuntu 5.4.0-6ubuntu1~16.04.10) 5.4.0 20160609

[jspark1105]

Please grab the one in SkimCaffe/models/resnet/logs/0.0001_0.00005_0.0001_10_0_0_0_0_2017-04-02-22-29-02/