Mask_RCNN icon indicating copy to clipboard operation
Mask_RCNN copied to clipboard

inspect_model.py 1b. RPN Predictions block AssertionError

Open Trotts opened this issue 5 years ago • 3 comments

Hi, I am trying to run the inspect_model.py notebook on a custom dataset, and am running into an AssertionError with block 1b. RPN Predictions. I have seen previous threads related to this issue (#23, #848, #893, #92) however these are all closed and it seems the issue was fixed in a merge previous to me downloading the code.

The specific code causing the issue is:

pillar = model.keras_model.get_layer("ROI").output  # node to start searching from

# TF 1.4 and 1.9 introduce new versions of NMS. Search for all names to support TF 1.3~1.10
nms_node = model.ancestor(pillar, "ROI/rpn_non_max_suppression:0")
if nms_node is None:
    nms_node = model.ancestor(pillar, "ROI/rpn_non_max_suppression/NonMaxSuppressionV2:0")
if nms_node is None:
    nms_node = model.ancestor(pillar, "ROI/rpn_non_max_suppression/NonMaxSuppressionV3:0")

print("TF VERSION", tf.VERSION)
print("PILLAR" , pillar)
print("RPN CLASS" , model.keras_model.get_layer("rpn_class").output)
print("PRE_NMS_ANCHORS: 0" , model.ancestor(pillar, "ROI/pre_nms_anchors:0"))
print("REFINED_ANCHORS_0" , model.ancestor(pillar, "ROI/refined_anchors:0"))
print("REFINED_ANCHORS_CLIPPED_0" , model.ancestor(pillar, "ROI/refined_anchors_clipped:0"))
print("NMS_NODE" , nms_node)
print("PROPOSALS", model.keras_model.get_layer("ROI").output)
print(model.ancestor(pillar, "ROI/rpn_non_max_suppression/NonMaxSuppressionV3:0"))
print(model.ancestor(pillar, "ROI/rpn_non_max_suppression/NonMaxSuppressionV2:0"))
print(model.ancestor(pillar, "ROI/rpn_non_max_suppression:0"))

rpn = model.run_graph([image], [
    ("rpn_class", model.keras_model.get_layer("rpn_class").output),
    ("pre_nms_anchors", model.ancestor(pillar, "ROI/pre_nms_anchors:0")),
    ("refined_anchors", model.ancestor(pillar, "ROI/refined_anchors:0")),
    ("refined_anchors_clipped", model.ancestor(pillar, "ROI/refined_anchors_clipped:0")),
    ("post_nms_anchor_ix", nms_node),
    ("proposals", model.keras_model.get_layer("ROI").output),
])

Which gives me an output of:

TF VERSION 1.10.0
PILLAR Tensor("ROI_1/concat:0", shape=(2, ?, 4), dtype=float32, device=/device:CPU:0)
RPN CLASS Tensor("rpn_class_1/concat:0", shape=(?, ?, 2), dtype=float32, device=/device:CPU:0)
PRE_NMS_ANCHORS: 0 None
REFINED_ANCHORS_0 None
REFINED_ANCHORS_CLIPPED_0 None
NMS_NODE None
PROPOSALS Tensor("ROI_1/concat:0", shape=(2, ?, 4), dtype=float32, device=/device:CPU:0)
None
None
None
---------------------------------------------------------------------------
AssertionError                            Traceback (most recent call last)
<ipython-input-35-42554e916d3d> in <module>
     24     ("refined_anchors_clipped", model.ancestor(pillar, "ROI/refined_anchors_clipped:0")),
     25     ("post_nms_anchor_ix", nms_node),
---> 26     ("proposals", model.keras_model.get_layer("ROI").output),
     27 ])

~/dolphin-recognition/Mask_RCNN-master/mrcnn/model.py in run_graph(self, images, outputs, image_metas)
   2685         outputs = OrderedDict(outputs)
   2686         for o in outputs.values():
-> 2687             assert o is not None
   2688 
   2689         # Build a Keras function to run parts of the computation graph

AssertionError: 

`
If helpful, running `model.keras_model.summary()` gives:

`__________________________________________________________________________________________________
Layer (type)                    Output Shape         Param #     Connected to                     
==================================================================================================
input_image (InputLayer)        (None, None, None, 3 0                                            
__________________________________________________________________________________________________
input_image_meta (InputLayer)   (None, 14)           0                                            
__________________________________________________________________________________________________
input_anchors (InputLayer)      (None, None, 4)      0                                            
__________________________________________________________________________________________________
lambda_4 (Lambda)               (None, None, None, 3 0           input_image[0][0]                
__________________________________________________________________________________________________
lambda_5 (Lambda)               (None, 14)           0           input_image_meta[0][0]           
__________________________________________________________________________________________________
lambda_6 (Lambda)               (None, None, 4)      0           input_anchors[0][0]              
__________________________________________________________________________________________________
lambda_7 (Lambda)               (None, None, None, 3 0           input_image[0][0]                
__________________________________________________________________________________________________
lambda_8 (Lambda)               (None, 14)           0           input_image_meta[0][0]           
__________________________________________________________________________________________________
lambda_9 (Lambda)               (None, None, 4)      0           input_anchors[0][0]              
__________________________________________________________________________________________________
mask_rcnn (Model)               [(None, 100, 6), (No 63733406    lambda_4[0][0]                   
                                                                 lambda_5[0][0]                   
                                                                 lambda_6[0][0]                   
                                                                 lambda_7[0][0]                   
                                                                 lambda_8[0][0]                   
                                                                 lambda_9[0][0]                   
__________________________________________________________________________________________________
mrcnn_detection (Concatenate)   (None, 100, 6)       0           mask_rcnn[1][0]                  
                                                                 mask_rcnn[2][0]                  
__________________________________________________________________________________________________
mrcnn_class (Concatenate)       (None, 1000, 2)      0           mask_rcnn[1][1]                  
                                                                 mask_rcnn[2][1]                  
__________________________________________________________________________________________________
mrcnn_bbox (Concatenate)        (None, 1000, 2, 4)   0           mask_rcnn[1][2]                  
                                                                 mask_rcnn[2][2]                  
__________________________________________________________________________________________________
mrcnn_mask (Concatenate)        (None, 100, 28, 28,  0           mask_rcnn[1][3]                  
                                                                 mask_rcnn[2][3]                  
__________________________________________________________________________________________________
ROI (Concatenate)               (None, 1000, 4)      0           mask_rcnn[1][4]                  
                                                                 mask_rcnn[2][4]                  
__________________________________________________________________________________________________
rpn_class (Concatenate)         (None, None, 2)      0           mask_rcnn[1][5]                  
                                                                 mask_rcnn[2][5]                  
__________________________________________________________________________________________________
rpn_bbox (Concatenate)          (None, None, 4)      0           mask_rcnn[1][6]                  
                                                                 mask_rcnn[2][6]                  
==================================================================================================
Total params: 63,733,406
Trainable params: 63,621,918
Non-trainable params: 111,488
__________________________________________________________________________________________________
__________________________________________________________________________________________________
Layer (type)                    Output Shape         Param #     Connected to                     
==================================================================================================
input_image (InputLayer)        (None, None, None, 3 0                                            
__________________________________________________________________________________________________
zero_padding2d_1 (ZeroPadding2D (None, None, None, 3 0           input_image[0][0]                
__________________________________________________________________________________________________
conv1 (Conv2D)                  (None, None, None, 6 9472        zero_padding2d_1[0][0]           
__________________________________________________________________________________________________
bn_conv1 (BatchNorm)            (None, None, None, 6 256         conv1[0][0]                      
__________________________________________________________________________________________________
activation_1 (Activation)       (None, None, None, 6 0           bn_conv1[0][0]                   
__________________________________________________________________________________________________
max_pooling2d_1 (MaxPooling2D)  (None, None, None, 6 0           activation_1[0][0]               
__________________________________________________________________________________________________
res2a_branch2a (Conv2D)         (None, None, None, 6 4160        max_pooling2d_1[0][0]            
__________________________________________________________________________________________________
bn2a_branch2a (BatchNorm)       (None, None, None, 6 256         res2a_branch2a[0][0]             
__________________________________________________________________________________________________
activation_2 (Activation)       (None, None, None, 6 0           bn2a_branch2a[0][0]              
__________________________________________________________________________________________________
res2a_branch2b (Conv2D)         (None, None, None, 6 36928       activation_2[0][0]               
__________________________________________________________________________________________________
bn2a_branch2b (BatchNorm)       (None, None, None, 6 256         res2a_branch2b[0][0]             
__________________________________________________________________________________________________
activation_3 (Activation)       (None, None, None, 6 0           bn2a_branch2b[0][0]              
__________________________________________________________________________________________________
res2a_branch2c (Conv2D)         (None, None, None, 2 16640       activation_3[0][0]               
__________________________________________________________________________________________________
res2a_branch1 (Conv2D)          (None, None, None, 2 16640       max_pooling2d_1[0][0]            
__________________________________________________________________________________________________
bn2a_branch2c (BatchNorm)       (None, None, None, 2 1024        res2a_branch2c[0][0]             
__________________________________________________________________________________________________
bn2a_branch1 (BatchNorm)        (None, None, None, 2 1024        res2a_branch1[0][0]              
__________________________________________________________________________________________________
add_1 (Add)                     (None, None, None, 2 0           bn2a_branch2c[0][0]              
                                                                 bn2a_branch1[0][0]               
__________________________________________________________________________________________________
res2a_out (Activation)          (None, None, None, 2 0           add_1[0][0]                      
__________________________________________________________________________________________________
res2b_branch2a (Conv2D)         (None, None, None, 6 16448       res2a_out[0][0]                  
__________________________________________________________________________________________________
bn2b_branch2a (BatchNorm)       (None, None, None, 6 256         res2b_branch2a[0][0]             
__________________________________________________________________________________________________
activation_4 (Activation)       (None, None, None, 6 0           bn2b_branch2a[0][0]              
__________________________________________________________________________________________________
res2b_branch2b (Conv2D)         (None, None, None, 6 36928       activation_4[0][0]               
__________________________________________________________________________________________________
bn2b_branch2b (BatchNorm)       (None, None, None, 6 256         res2b_branch2b[0][0]             
__________________________________________________________________________________________________
activation_5 (Activation)       (None, None, None, 6 0           bn2b_branch2b[0][0]              
__________________________________________________________________________________________________
res2b_branch2c (Conv2D)         (None, None, None, 2 16640       activation_5[0][0]               
__________________________________________________________________________________________________
bn2b_branch2c (BatchNorm)       (None, None, None, 2 1024        res2b_branch2c[0][0]             
__________________________________________________________________________________________________
add_2 (Add)                     (None, None, None, 2 0           bn2b_branch2c[0][0]              
                                                                 res2a_out[0][0]                  
__________________________________________________________________________________________________
res2b_out (Activation)          (None, None, None, 2 0           add_2[0][0]                      
__________________________________________________________________________________________________
res2c_branch2a (Conv2D)         (None, None, None, 6 16448       res2b_out[0][0]                  
__________________________________________________________________________________________________
bn2c_branch2a (BatchNorm)       (None, None, None, 6 256         res2c_branch2a[0][0]             
__________________________________________________________________________________________________
activation_6 (Activation)       (None, None, None, 6 0           bn2c_branch2a[0][0]              
__________________________________________________________________________________________________
res2c_branch2b (Conv2D)         (None, None, None, 6 36928       activation_6[0][0]               
__________________________________________________________________________________________________
bn2c_branch2b (BatchNorm)       (None, None, None, 6 256         res2c_branch2b[0][0]             
__________________________________________________________________________________________________
activation_7 (Activation)       (None, None, None, 6 0           bn2c_branch2b[0][0]              
__________________________________________________________________________________________________
res2c_branch2c (Conv2D)         (None, None, None, 2 16640       activation_7[0][0]               
__________________________________________________________________________________________________
bn2c_branch2c (BatchNorm)       (None, None, None, 2 1024        res2c_branch2c[0][0]             
__________________________________________________________________________________________________
add_3 (Add)                     (None, None, None, 2 0           bn2c_branch2c[0][0]              
                                                                 res2b_out[0][0]                  
__________________________________________________________________________________________________
res2c_out (Activation)          (None, None, None, 2 0           add_3[0][0]                      
__________________________________________________________________________________________________
res3a_branch2a (Conv2D)         (None, None, None, 1 32896       res2c_out[0][0]                  
__________________________________________________________________________________________________
bn3a_branch2a (BatchNorm)       (None, None, None, 1 512         res3a_branch2a[0][0]             
__________________________________________________________________________________________________
activation_8 (Activation)       (None, None, None, 1 0           bn3a_branch2a[0][0]              
__________________________________________________________________________________________________
res3a_branch2b (Conv2D)         (None, None, None, 1 147584      activation_8[0][0]               
__________________________________________________________________________________________________
bn3a_branch2b (BatchNorm)       (None, None, None, 1 512         res3a_branch2b[0][0]             
__________________________________________________________________________________________________
activation_9 (Activation)       (None, None, None, 1 0           bn3a_branch2b[0][0]              
__________________________________________________________________________________________________
res3a_branch2c (Conv2D)         (None, None, None, 5 66048       activation_9[0][0]               
__________________________________________________________________________________________________
res3a_branch1 (Conv2D)          (None, None, None, 5 131584      res2c_out[0][0]                  
__________________________________________________________________________________________________
bn3a_branch2c (BatchNorm)       (None, None, None, 5 2048        res3a_branch2c[0][0]             
__________________________________________________________________________________________________
bn3a_branch1 (BatchNorm)        (None, None, None, 5 2048        res3a_branch1[0][0]              
__________________________________________________________________________________________________
add_4 (Add)                     (None, None, None, 5 0           bn3a_branch2c[0][0]              
                                                                 bn3a_branch1[0][0]               
__________________________________________________________________________________________________
res3a_out (Activation)          (None, None, None, 5 0           add_4[0][0]                      
__________________________________________________________________________________________________
res3b_branch2a (Conv2D)         (None, None, None, 1 65664       res3a_out[0][0]                  
__________________________________________________________________________________________________
bn3b_branch2a (BatchNorm)       (None, None, None, 1 512         res3b_branch2a[0][0]             
__________________________________________________________________________________________________
activation_10 (Activation)      (None, None, None, 1 0           bn3b_branch2a[0][0]              
__________________________________________________________________________________________________
res3b_branch2b (Conv2D)         (None, None, None, 1 147584      activation_10[0][0]              
__________________________________________________________________________________________________
bn3b_branch2b (BatchNorm)       (None, None, None, 1 512         res3b_branch2b[0][0]             
__________________________________________________________________________________________________
activation_11 (Activation)      (None, None, None, 1 0           bn3b_branch2b[0][0]              
__________________________________________________________________________________________________
res3b_branch2c (Conv2D)         (None, None, None, 5 66048       activation_11[0][0]              
__________________________________________________________________________________________________
bn3b_branch2c (BatchNorm)       (None, None, None, 5 2048        res3b_branch2c[0][0]             
__________________________________________________________________________________________________
add_5 (Add)                     (None, None, None, 5 0           bn3b_branch2c[0][0]              
                                                                 res3a_out[0][0]                  
__________________________________________________________________________________________________
res3b_out (Activation)          (None, None, None, 5 0           add_5[0][0]                      
__________________________________________________________________________________________________
res3c_branch2a (Conv2D)         (None, None, None, 1 65664       res3b_out[0][0]                  
__________________________________________________________________________________________________
bn3c_branch2a (BatchNorm)       (None, None, None, 1 512         res3c_branch2a[0][0]             
__________________________________________________________________________________________________
activation_12 (Activation)      (None, None, None, 1 0           bn3c_branch2a[0][0]              
__________________________________________________________________________________________________
res3c_branch2b (Conv2D)         (None, None, None, 1 147584      activation_12[0][0]              
__________________________________________________________________________________________________
bn3c_branch2b (BatchNorm)       (None, None, None, 1 512         res3c_branch2b[0][0]             
__________________________________________________________________________________________________
activation_13 (Activation)      (None, None, None, 1 0           bn3c_branch2b[0][0]              
__________________________________________________________________________________________________
res3c_branch2c (Conv2D)         (None, None, None, 5 66048       activation_13[0][0]              
__________________________________________________________________________________________________
bn3c_branch2c (BatchNorm)       (None, None, None, 5 2048        res3c_branch2c[0][0]             
__________________________________________________________________________________________________
add_6 (Add)                     (None, None, None, 5 0           bn3c_branch2c[0][0]              
                                                                 res3b_out[0][0]                  
__________________________________________________________________________________________________
res3c_out (Activation)          (None, None, None, 5 0           add_6[0][0]                      
__________________________________________________________________________________________________
res3d_branch2a (Conv2D)         (None, None, None, 1 65664       res3c_out[0][0]                  
__________________________________________________________________________________________________
bn3d_branch2a (BatchNorm)       (None, None, None, 1 512         res3d_branch2a[0][0]             
__________________________________________________________________________________________________
activation_14 (Activation)      (None, None, None, 1 0           bn3d_branch2a[0][0]              
__________________________________________________________________________________________________
res3d_branch2b (Conv2D)         (None, None, None, 1 147584      activation_14[0][0]              
__________________________________________________________________________________________________
bn3d_branch2b (BatchNorm)       (None, None, None, 1 512         res3d_branch2b[0][0]             
__________________________________________________________________________________________________
activation_15 (Activation)      (None, None, None, 1 0           bn3d_branch2b[0][0]              
__________________________________________________________________________________________________
res3d_branch2c (Conv2D)         (None, None, None, 5 66048       activation_15[0][0]              
__________________________________________________________________________________________________
bn3d_branch2c (BatchNorm)       (None, None, None, 5 2048        res3d_branch2c[0][0]             
__________________________________________________________________________________________________
add_7 (Add)                     (None, None, None, 5 0           bn3d_branch2c[0][0]              
                                                                 res3c_out[0][0]                  
__________________________________________________________________________________________________
res3d_out (Activation)          (None, None, None, 5 0           add_7[0][0]                      
__________________________________________________________________________________________________
res4a_branch2a (Conv2D)         (None, None, None, 2 131328      res3d_out[0][0]                  
__________________________________________________________________________________________________
bn4a_branch2a (BatchNorm)       (None, None, None, 2 1024        res4a_branch2a[0][0]             
__________________________________________________________________________________________________
activation_16 (Activation)      (None, None, None, 2 0           bn4a_branch2a[0][0]              
__________________________________________________________________________________________________
res4a_branch2b (Conv2D)         (None, None, None, 2 590080      activation_16[0][0]              
__________________________________________________________________________________________________
bn4a_branch2b (BatchNorm)       (None, None, None, 2 1024        res4a_branch2b[0][0]             
__________________________________________________________________________________________________
activation_17 (Activation)      (None, None, None, 2 0           bn4a_branch2b[0][0]              
__________________________________________________________________________________________________
res4a_branch2c (Conv2D)         (None, None, None, 1 263168      activation_17[0][0]              
__________________________________________________________________________________________________
res4a_branch1 (Conv2D)          (None, None, None, 1 525312      res3d_out[0][0]                  
__________________________________________________________________________________________________
bn4a_branch2c (BatchNorm)       (None, None, None, 1 4096        res4a_branch2c[0][0]             
__________________________________________________________________________________________________
bn4a_branch1 (BatchNorm)        (None, None, None, 1 4096        res4a_branch1[0][0]              
__________________________________________________________________________________________________
add_8 (Add)                     (None, None, None, 1 0           bn4a_branch2c[0][0]              
                                                                 bn4a_branch1[0][0]               
__________________________________________________________________________________________________
res4a_out (Activation)          (None, None, None, 1 0           add_8[0][0]                      
__________________________________________________________________________________________________
res4b_branch2a (Conv2D)         (None, None, None, 2 262400      res4a_out[0][0]                  
__________________________________________________________________________________________________
bn4b_branch2a (BatchNorm)       (None, None, None, 2 1024        res4b_branch2a[0][0]             
__________________________________________________________________________________________________
activation_18 (Activation)      (None, None, None, 2 0           bn4b_branch2a[0][0]              
__________________________________________________________________________________________________
res4b_branch2b (Conv2D)         (None, None, None, 2 590080      activation_18[0][0]              
__________________________________________________________________________________________________
bn4b_branch2b (BatchNorm)       (None, None, None, 2 1024        res4b_branch2b[0][0]             
__________________________________________________________________________________________________
activation_19 (Activation)      (None, None, None, 2 0           bn4b_branch2b[0][0]              
__________________________________________________________________________________________________
res4b_branch2c (Conv2D)         (None, None, None, 1 263168      activation_19[0][0]              
__________________________________________________________________________________________________
bn4b_branch2c (BatchNorm)       (None, None, None, 1 4096        res4b_branch2c[0][0]             
__________________________________________________________________________________________________
add_9 (Add)                     (None, None, None, 1 0           bn4b_branch2c[0][0]              
                                                                 res4a_out[0][0]                  
__________________________________________________________________________________________________
res4b_out (Activation)          (None, None, None, 1 0           add_9[0][0]                      
__________________________________________________________________________________________________
res4c_branch2a (Conv2D)         (None, None, None, 2 262400      res4b_out[0][0]                  
__________________________________________________________________________________________________
bn4c_branch2a (BatchNorm)       (None, None, None, 2 1024        res4c_branch2a[0][0]             
__________________________________________________________________________________________________
activation_20 (Activation)      (None, None, None, 2 0           bn4c_branch2a[0][0]              
__________________________________________________________________________________________________
res4c_branch2b (Conv2D)         (None, None, None, 2 590080      activation_20[0][0]              
__________________________________________________________________________________________________
bn4c_branch2b (BatchNorm)       (None, None, None, 2 1024        res4c_branch2b[0][0]             
__________________________________________________________________________________________________
activation_21 (Activation)      (None, None, None, 2 0           bn4c_branch2b[0][0]              
__________________________________________________________________________________________________
res4c_branch2c (Conv2D)         (None, None, None, 1 263168      activation_21[0][0]              
__________________________________________________________________________________________________
bn4c_branch2c (BatchNorm)       (None, None, None, 1 4096        res4c_branch2c[0][0]             
__________________________________________________________________________________________________
add_10 (Add)                    (None, None, None, 1 0           bn4c_branch2c[0][0]              
                                                                 res4b_out[0][0]                  
__________________________________________________________________________________________________
res4c_out (Activation)          (None, None, None, 1 0           add_10[0][0]                     
__________________________________________________________________________________________________
res4d_branch2a (Conv2D)         (None, None, None, 2 262400      res4c_out[0][0]                  
__________________________________________________________________________________________________
bn4d_branch2a (BatchNorm)       (None, None, None, 2 1024        res4d_branch2a[0][0]             
__________________________________________________________________________________________________
activation_22 (Activation)      (None, None, None, 2 0           bn4d_branch2a[0][0]              
__________________________________________________________________________________________________
res4d_branch2b (Conv2D)         (None, None, None, 2 590080      activation_22[0][0]              
__________________________________________________________________________________________________
bn4d_branch2b (BatchNorm)       (None, None, None, 2 1024        res4d_branch2b[0][0]             
__________________________________________________________________________________________________
activation_23 (Activation)      (None, None, None, 2 0           bn4d_branch2b[0][0]              
__________________________________________________________________________________________________
res4d_branch2c (Conv2D)         (None, None, None, 1 263168      activation_23[0][0]              
__________________________________________________________________________________________________
bn4d_branch2c (BatchNorm)       (None, None, None, 1 4096        res4d_branch2c[0][0]             
__________________________________________________________________________________________________
add_11 (Add)                    (None, None, None, 1 0           bn4d_branch2c[0][0]              
                                                                 res4c_out[0][0]                  
__________________________________________________________________________________________________
res4d_out (Activation)          (None, None, None, 1 0           add_11[0][0]                     
__________________________________________________________________________________________________
res4e_branch2a (Conv2D)         (None, None, None, 2 262400      res4d_out[0][0]                  
__________________________________________________________________________________________________
bn4e_branch2a (BatchNorm)       (None, None, None, 2 1024        res4e_branch2a[0][0]             
__________________________________________________________________________________________________
activation_24 (Activation)      (None, None, None, 2 0           bn4e_branch2a[0][0]              
__________________________________________________________________________________________________
res4e_branch2b (Conv2D)         (None, None, None, 2 590080      activation_24[0][0]              
__________________________________________________________________________________________________
bn4e_branch2b (BatchNorm)       (None, None, None, 2 1024        res4e_branch2b[0][0]             
__________________________________________________________________________________________________
activation_25 (Activation)      (None, None, None, 2 0           bn4e_branch2b[0][0]              
__________________________________________________________________________________________________
res4e_branch2c (Conv2D)         (None, None, None, 1 263168      activation_25[0][0]              
__________________________________________________________________________________________________
bn4e_branch2c (BatchNorm)       (None, None, None, 1 4096        res4e_branch2c[0][0]             
__________________________________________________________________________________________________
add_12 (Add)                    (None, None, None, 1 0           bn4e_branch2c[0][0]              
                                                                 res4d_out[0][0]                  
__________________________________________________________________________________________________
res4e_out (Activation)          (None, None, None, 1 0           add_12[0][0]                     
__________________________________________________________________________________________________
res4f_branch2a (Conv2D)         (None, None, None, 2 262400      res4e_out[0][0]                  
__________________________________________________________________________________________________
bn4f_branch2a (BatchNorm)       (None, None, None, 2 1024        res4f_branch2a[0][0]             
__________________________________________________________________________________________________
activation_26 (Activation)      (None, None, None, 2 0           bn4f_branch2a[0][0]              
__________________________________________________________________________________________________
res4f_branch2b (Conv2D)         (None, None, None, 2 590080      activation_26[0][0]              
__________________________________________________________________________________________________
bn4f_branch2b (BatchNorm)       (None, None, None, 2 1024        res4f_branch2b[0][0]             
__________________________________________________________________________________________________
activation_27 (Activation)      (None, None, None, 2 0           bn4f_branch2b[0][0]              
__________________________________________________________________________________________________
res4f_branch2c (Conv2D)         (None, None, None, 1 263168      activation_27[0][0]              
__________________________________________________________________________________________________
bn4f_branch2c (BatchNorm)       (None, None, None, 1 4096        res4f_branch2c[0][0]             
__________________________________________________________________________________________________
add_13 (Add)                    (None, None, None, 1 0           bn4f_branch2c[0][0]              
                                                                 res4e_out[0][0]                  
__________________________________________________________________________________________________
res4f_out (Activation)          (None, None, None, 1 0           add_13[0][0]                     
__________________________________________________________________________________________________
res4g_branch2a (Conv2D)         (None, None, None, 2 262400      res4f_out[0][0]                  
__________________________________________________________________________________________________
bn4g_branch2a (BatchNorm)       (None, None, None, 2 1024        res4g_branch2a[0][0]             
__________________________________________________________________________________________________
activation_28 (Activation)      (None, None, None, 2 0           bn4g_branch2a[0][0]              
__________________________________________________________________________________________________
res4g_branch2b (Conv2D)         (None, None, None, 2 590080      activation_28[0][0]              
__________________________________________________________________________________________________
bn4g_branch2b (BatchNorm)       (None, None, None, 2 1024        res4g_branch2b[0][0]             
__________________________________________________________________________________________________
activation_29 (Activation)      (None, None, None, 2 0           bn4g_branch2b[0][0]              
__________________________________________________________________________________________________
res4g_branch2c (Conv2D)         (None, None, None, 1 263168      activation_29[0][0]              
__________________________________________________________________________________________________
bn4g_branch2c (BatchNorm)       (None, None, None, 1 4096        res4g_branch2c[0][0]             
__________________________________________________________________________________________________
add_14 (Add)                    (None, None, None, 1 0           bn4g_branch2c[0][0]              
                                                                 res4f_out[0][0]                  
__________________________________________________________________________________________________
res4g_out (Activation)          (None, None, None, 1 0           add_14[0][0]                     
__________________________________________________________________________________________________
res4h_branch2a (Conv2D)         (None, None, None, 2 262400      res4g_out[0][0]                  
__________________________________________________________________________________________________
bn4h_branch2a (BatchNorm)       (None, None, None, 2 1024        res4h_branch2a[0][0]             
__________________________________________________________________________________________________
activation_30 (Activation)      (None, None, None, 2 0           bn4h_branch2a[0][0]              
__________________________________________________________________________________________________
res4h_branch2b (Conv2D)         (None, None, None, 2 590080      activation_30[0][0]              
__________________________________________________________________________________________________
bn4h_branch2b (BatchNorm)       (None, None, None, 2 1024        res4h_branch2b[0][0]             
__________________________________________________________________________________________________
activation_31 (Activation)      (None, None, None, 2 0           bn4h_branch2b[0][0]              
__________________________________________________________________________________________________
res4h_branch2c (Conv2D)         (None, None, None, 1 263168      activation_31[0][0]              
__________________________________________________________________________________________________
bn4h_branch2c (BatchNorm)       (None, None, None, 1 4096        res4h_branch2c[0][0]             
__________________________________________________________________________________________________
add_15 (Add)                    (None, None, None, 1 0           bn4h_branch2c[0][0]              
                                                                 res4g_out[0][0]                  
__________________________________________________________________________________________________
res4h_out (Activation)          (None, None, None, 1 0           add_15[0][0]                     
__________________________________________________________________________________________________
res4i_branch2a (Conv2D)         (None, None, None, 2 262400      res4h_out[0][0]                  
__________________________________________________________________________________________________
bn4i_branch2a (BatchNorm)       (None, None, None, 2 1024        res4i_branch2a[0][0]             
__________________________________________________________________________________________________
activation_32 (Activation)      (None, None, None, 2 0           bn4i_branch2a[0][0]              
__________________________________________________________________________________________________
res4i_branch2b (Conv2D)         (None, None, None, 2 590080      activation_32[0][0]              
__________________________________________________________________________________________________
bn4i_branch2b (BatchNorm)       (None, None, None, 2 1024        res4i_branch2b[0][0]             
__________________________________________________________________________________________________
activation_33 (Activation)      (None, None, None, 2 0           bn4i_branch2b[0][0]              
__________________________________________________________________________________________________
res4i_branch2c (Conv2D)         (None, None, None, 1 263168      activation_33[0][0]              
__________________________________________________________________________________________________
bn4i_branch2c (BatchNorm)       (None, None, None, 1 4096        res4i_branch2c[0][0]             
__________________________________________________________________________________________________
add_16 (Add)                    (None, None, None, 1 0           bn4i_branch2c[0][0]              
                                                                 res4h_out[0][0]                  
__________________________________________________________________________________________________
res4i_out (Activation)          (None, None, None, 1 0           add_16[0][0]                     
__________________________________________________________________________________________________
res4j_branch2a (Conv2D)         (None, None, None, 2 262400      res4i_out[0][0]                  
__________________________________________________________________________________________________
bn4j_branch2a (BatchNorm)       (None, None, None, 2 1024        res4j_branch2a[0][0]             
__________________________________________________________________________________________________
activation_34 (Activation)      (None, None, None, 2 0           bn4j_branch2a[0][0]              
__________________________________________________________________________________________________
res4j_branch2b (Conv2D)         (None, None, None, 2 590080      activation_34[0][0]              
__________________________________________________________________________________________________
bn4j_branch2b (BatchNorm)       (None, None, None, 2 1024        res4j_branch2b[0][0]             
__________________________________________________________________________________________________
activation_35 (Activation)      (None, None, None, 2 0           bn4j_branch2b[0][0]              
__________________________________________________________________________________________________
res4j_branch2c (Conv2D)         (None, None, None, 1 263168      activation_35[0][0]              
__________________________________________________________________________________________________
bn4j_branch2c (BatchNorm)       (None, None, None, 1 4096        res4j_branch2c[0][0]             
__________________________________________________________________________________________________
add_17 (Add)                    (None, None, None, 1 0           bn4j_branch2c[0][0]              
                                                                 res4i_out[0][0]                  
__________________________________________________________________________________________________
res4j_out (Activation)          (None, None, None, 1 0           add_17[0][0]                     
__________________________________________________________________________________________________
res4k_branch2a (Conv2D)         (None, None, None, 2 262400      res4j_out[0][0]                  
__________________________________________________________________________________________________
bn4k_branch2a (BatchNorm)       (None, None, None, 2 1024        res4k_branch2a[0][0]             
__________________________________________________________________________________________________
activation_36 (Activation)      (None, None, None, 2 0           bn4k_branch2a[0][0]              
__________________________________________________________________________________________________
res4k_branch2b (Conv2D)         (None, None, None, 2 590080      activation_36[0][0]              
__________________________________________________________________________________________________
bn4k_branch2b (BatchNorm)       (None, None, None, 2 1024        res4k_branch2b[0][0]             
__________________________________________________________________________________________________
activation_37 (Activation)      (None, None, None, 2 0           bn4k_branch2b[0][0]              
__________________________________________________________________________________________________
res4k_branch2c (Conv2D)         (None, None, None, 1 263168      activation_37[0][0]              
__________________________________________________________________________________________________
bn4k_branch2c (BatchNorm)       (None, None, None, 1 4096        res4k_branch2c[0][0]             
__________________________________________________________________________________________________
add_18 (Add)                    (None, None, None, 1 0           bn4k_branch2c[0][0]              
                                                                 res4j_out[0][0]                  
__________________________________________________________________________________________________
res4k_out (Activation)          (None, None, None, 1 0           add_18[0][0]                     
__________________________________________________________________________________________________
res4l_branch2a (Conv2D)         (None, None, None, 2 262400      res4k_out[0][0]                  
__________________________________________________________________________________________________
bn4l_branch2a (BatchNorm)       (None, None, None, 2 1024        res4l_branch2a[0][0]             
__________________________________________________________________________________________________
activation_38 (Activation)      (None, None, None, 2 0           bn4l_branch2a[0][0]              
__________________________________________________________________________________________________
res4l_branch2b (Conv2D)         (None, None, None, 2 590080      activation_38[0][0]              
__________________________________________________________________________________________________
bn4l_branch2b (BatchNorm)       (None, None, None, 2 1024        res4l_branch2b[0][0]             
__________________________________________________________________________________________________
activation_39 (Activation)      (None, None, None, 2 0           bn4l_branch2b[0][0]              
__________________________________________________________________________________________________
res4l_branch2c (Conv2D)         (None, None, None, 1 263168      activation_39[0][0]              
__________________________________________________________________________________________________
bn4l_branch2c (BatchNorm)       (None, None, None, 1 4096        res4l_branch2c[0][0]             
__________________________________________________________________________________________________
add_19 (Add)                    (None, None, None, 1 0           bn4l_branch2c[0][0]              
                                                                 res4k_out[0][0]                  
__________________________________________________________________________________________________
res4l_out (Activation)          (None, None, None, 1 0           add_19[0][0]                     
__________________________________________________________________________________________________
res4m_branch2a (Conv2D)         (None, None, None, 2 262400      res4l_out[0][0]                  
__________________________________________________________________________________________________
bn4m_branch2a (BatchNorm)       (None, None, None, 2 1024        res4m_branch2a[0][0]             
__________________________________________________________________________________________________
activation_40 (Activation)      (None, None, None, 2 0           bn4m_branch2a[0][0]              
__________________________________________________________________________________________________
res4m_branch2b (Conv2D)         (None, None, None, 2 590080      activation_40[0][0]              
__________________________________________________________________________________________________
bn4m_branch2b (BatchNorm)       (None, None, None, 2 1024        res4m_branch2b[0][0]             
__________________________________________________________________________________________________
activation_41 (Activation)      (None, None, None, 2 0           bn4m_branch2b[0][0]              
__________________________________________________________________________________________________
res4m_branch2c (Conv2D)         (None, None, None, 1 263168      activation_41[0][0]              
__________________________________________________________________________________________________
bn4m_branch2c (BatchNorm)       (None, None, None, 1 4096        res4m_branch2c[0][0]             
__________________________________________________________________________________________________
add_20 (Add)                    (None, None, None, 1 0           bn4m_branch2c[0][0]              
                                                                 res4l_out[0][0]                  
__________________________________________________________________________________________________
res4m_out (Activation)          (None, None, None, 1 0           add_20[0][0]                     
__________________________________________________________________________________________________
res4n_branch2a (Conv2D)         (None, None, None, 2 262400      res4m_out[0][0]                  
__________________________________________________________________________________________________
bn4n_branch2a (BatchNorm)       (None, None, None, 2 1024        res4n_branch2a[0][0]             
__________________________________________________________________________________________________
activation_42 (Activation)      (None, None, None, 2 0           bn4n_branch2a[0][0]              
__________________________________________________________________________________________________
res4n_branch2b (Conv2D)         (None, None, None, 2 590080      activation_42[0][0]              
__________________________________________________________________________________________________
bn4n_branch2b (BatchNorm)       (None, None, None, 2 1024        res4n_branch2b[0][0]             
__________________________________________________________________________________________________
activation_43 (Activation)      (None, None, None, 2 0           bn4n_branch2b[0][0]              
__________________________________________________________________________________________________
res4n_branch2c (Conv2D)         (None, None, None, 1 263168      activation_43[0][0]              
__________________________________________________________________________________________________
bn4n_branch2c (BatchNorm)       (None, None, None, 1 4096        res4n_branch2c[0][0]             
__________________________________________________________________________________________________
add_21 (Add)                    (None, None, None, 1 0           bn4n_branch2c[0][0]              
                                                                 res4m_out[0][0]                  
__________________________________________________________________________________________________
res4n_out (Activation)          (None, None, None, 1 0           add_21[0][0]                     
__________________________________________________________________________________________________
res4o_branch2a (Conv2D)         (None, None, None, 2 262400      res4n_out[0][0]                  
__________________________________________________________________________________________________
bn4o_branch2a (BatchNorm)       (None, None, None, 2 1024        res4o_branch2a[0][0]             
__________________________________________________________________________________________________
activation_44 (Activation)      (None, None, None, 2 0           bn4o_branch2a[0][0]              
__________________________________________________________________________________________________
res4o_branch2b (Conv2D)         (None, None, None, 2 590080      activation_44[0][0]              
__________________________________________________________________________________________________
bn4o_branch2b (BatchNorm)       (None, None, None, 2 1024        res4o_branch2b[0][0]             
__________________________________________________________________________________________________
activation_45 (Activation)      (None, None, None, 2 0           bn4o_branch2b[0][0]              
__________________________________________________________________________________________________
res4o_branch2c (Conv2D)         (None, None, None, 1 263168      activation_45[0][0]              
__________________________________________________________________________________________________
bn4o_branch2c (BatchNorm)       (None, None, None, 1 4096        res4o_branch2c[0][0]             
__________________________________________________________________________________________________
add_22 (Add)                    (None, None, None, 1 0           bn4o_branch2c[0][0]              
                                                                 res4n_out[0][0]                  
__________________________________________________________________________________________________
res4o_out (Activation)          (None, None, None, 1 0           add_22[0][0]                     
__________________________________________________________________________________________________
res4p_branch2a (Conv2D)         (None, None, None, 2 262400      res4o_out[0][0]                  
__________________________________________________________________________________________________
bn4p_branch2a (BatchNorm)       (None, None, None, 2 1024        res4p_branch2a[0][0]             
__________________________________________________________________________________________________
activation_46 (Activation)      (None, None, None, 2 0           bn4p_branch2a[0][0]              
__________________________________________________________________________________________________
res4p_branch2b (Conv2D)         (None, None, None, 2 590080      activation_46[0][0]              
__________________________________________________________________________________________________
bn4p_branch2b (BatchNorm)       (None, None, None, 2 1024        res4p_branch2b[0][0]             
__________________________________________________________________________________________________
activation_47 (Activation)      (None, None, None, 2 0           bn4p_branch2b[0][0]              
__________________________________________________________________________________________________
res4p_branch2c (Conv2D)         (None, None, None, 1 263168      activation_47[0][0]              
__________________________________________________________________________________________________
bn4p_branch2c (BatchNorm)       (None, None, None, 1 4096        res4p_branch2c[0][0]             
__________________________________________________________________________________________________
add_23 (Add)                    (None, None, None, 1 0           bn4p_branch2c[0][0]              
                                                                 res4o_out[0][0]                  
__________________________________________________________________________________________________
res4p_out (Activation)          (None, None, None, 1 0           add_23[0][0]                     
__________________________________________________________________________________________________
res4q_branch2a (Conv2D)         (None, None, None, 2 262400      res4p_out[0][0]                  
__________________________________________________________________________________________________
bn4q_branch2a (BatchNorm)       (None, None, None, 2 1024        res4q_branch2a[0][0]             
__________________________________________________________________________________________________
activation_48 (Activation)      (None, None, None, 2 0           bn4q_branch2a[0][0]              
__________________________________________________________________________________________________
res4q_branch2b (Conv2D)         (None, None, None, 2 590080      activation_48[0][0]              
__________________________________________________________________________________________________
bn4q_branch2b (BatchNorm)       (None, None, None, 2 1024        res4q_branch2b[0][0]             
__________________________________________________________________________________________________
activation_49 (Activation)      (None, None, None, 2 0           bn4q_branch2b[0][0]              
__________________________________________________________________________________________________
res4q_branch2c (Conv2D)         (None, None, None, 1 263168      activation_49[0][0]              
__________________________________________________________________________________________________
bn4q_branch2c (BatchNorm)       (None, None, None, 1 4096        res4q_branch2c[0][0]             
__________________________________________________________________________________________________
add_24 (Add)                    (None, None, None, 1 0           bn4q_branch2c[0][0]              
                                                                 res4p_out[0][0]                  
__________________________________________________________________________________________________
res4q_out (Activation)          (None, None, None, 1 0           add_24[0][0]                     
__________________________________________________________________________________________________
res4r_branch2a (Conv2D)         (None, None, None, 2 262400      res4q_out[0][0]                  
__________________________________________________________________________________________________
bn4r_branch2a (BatchNorm)       (None, None, None, 2 1024        res4r_branch2a[0][0]             
__________________________________________________________________________________________________
activation_50 (Activation)      (None, None, None, 2 0           bn4r_branch2a[0][0]              
__________________________________________________________________________________________________
res4r_branch2b (Conv2D)         (None, None, None, 2 590080      activation_50[0][0]              
__________________________________________________________________________________________________
bn4r_branch2b (BatchNorm)       (None, None, None, 2 1024        res4r_branch2b[0][0]             
__________________________________________________________________________________________________
activation_51 (Activation)      (None, None, None, 2 0           bn4r_branch2b[0][0]              
__________________________________________________________________________________________________
res4r_branch2c (Conv2D)         (None, None, None, 1 263168      activation_51[0][0]              
__________________________________________________________________________________________________
bn4r_branch2c (BatchNorm)       (None, None, None, 1 4096        res4r_branch2c[0][0]             
__________________________________________________________________________________________________
add_25 (Add)                    (None, None, None, 1 0           bn4r_branch2c[0][0]              
                                                                 res4q_out[0][0]                  
__________________________________________________________________________________________________
res4r_out (Activation)          (None, None, None, 1 0           add_25[0][0]                     
__________________________________________________________________________________________________
res4s_branch2a (Conv2D)         (None, None, None, 2 262400      res4r_out[0][0]                  
__________________________________________________________________________________________________
bn4s_branch2a (BatchNorm)       (None, None, None, 2 1024        res4s_branch2a[0][0]             
__________________________________________________________________________________________________
activation_52 (Activation)      (None, None, None, 2 0           bn4s_branch2a[0][0]              
__________________________________________________________________________________________________
res4s_branch2b (Conv2D)         (None, None, None, 2 590080      activation_52[0][0]              
__________________________________________________________________________________________________
bn4s_branch2b (BatchNorm)       (None, None, None, 2 1024        res4s_branch2b[0][0]             
__________________________________________________________________________________________________
activation_53 (Activation)      (None, None, None, 2 0           bn4s_branch2b[0][0]              
__________________________________________________________________________________________________
res4s_branch2c (Conv2D)         (None, None, None, 1 263168      activation_53[0][0]              
__________________________________________________________________________________________________
bn4s_branch2c (BatchNorm)       (None, None, None, 1 4096        res4s_branch2c[0][0]             
__________________________________________________________________________________________________
add_26 (Add)                    (None, None, None, 1 0           bn4s_branch2c[0][0]              
                                                                 res4r_out[0][0]                  
__________________________________________________________________________________________________
res4s_out (Activation)          (None, None, None, 1 0           add_26[0][0]                     
__________________________________________________________________________________________________
res4t_branch2a (Conv2D)         (None, None, None, 2 262400      res4s_out[0][0]                  
__________________________________________________________________________________________________
bn4t_branch2a (BatchNorm)       (None, None, None, 2 1024        res4t_branch2a[0][0]             
__________________________________________________________________________________________________
activation_54 (Activation)      (None, None, None, 2 0           bn4t_branch2a[0][0]              
__________________________________________________________________________________________________
res4t_branch2b (Conv2D)         (None, None, None, 2 590080      activation_54[0][0]              
__________________________________________________________________________________________________
bn4t_branch2b (BatchNorm)       (None, None, None, 2 1024        res4t_branch2b[0][0]             
__________________________________________________________________________________________________
activation_55 (Activation)      (None, None, None, 2 0           bn4t_branch2b[0][0]              
__________________________________________________________________________________________________
res4t_branch2c (Conv2D)         (None, None, None, 1 263168      activation_55[0][0]              
__________________________________________________________________________________________________
bn4t_branch2c (BatchNorm)       (None, None, None, 1 4096        res4t_branch2c[0][0]             
__________________________________________________________________________________________________
add_27 (Add)                    (None, None, None, 1 0           bn4t_branch2c[0][0]              
                                                                 res4s_out[0][0]                  
__________________________________________________________________________________________________
res4t_out (Activation)          (None, None, None, 1 0           add_27[0][0]                     
__________________________________________________________________________________________________
res4u_branch2a (Conv2D)         (None, None, None, 2 262400      res4t_out[0][0]                  
__________________________________________________________________________________________________
bn4u_branch2a (BatchNorm)       (None, None, None, 2 1024        res4u_branch2a[0][0]             
__________________________________________________________________________________________________
activation_56 (Activation)      (None, None, None, 2 0           bn4u_branch2a[0][0]              
__________________________________________________________________________________________________
res4u_branch2b (Conv2D)         (None, None, None, 2 590080      activation_56[0][0]              
__________________________________________________________________________________________________
bn4u_branch2b (BatchNorm)       (None, None, None, 2 1024        res4u_branch2b[0][0]             
__________________________________________________________________________________________________
activation_57 (Activation)      (None, None, None, 2 0           bn4u_branch2b[0][0]              
__________________________________________________________________________________________________
res4u_branch2c (Conv2D)         (None, None, None, 1 263168      activation_57[0][0]              
__________________________________________________________________________________________________
bn4u_branch2c (BatchNorm)       (None, None, None, 1 4096        res4u_branch2c[0][0]             
__________________________________________________________________________________________________
add_28 (Add)                    (None, None, None, 1 0           bn4u_branch2c[0][0]              
                                                                 res4t_out[0][0]                  
__________________________________________________________________________________________________
res4u_out (Activation)          (None, None, None, 1 0           add_28[0][0]                     
__________________________________________________________________________________________________
res4v_branch2a (Conv2D)         (None, None, None, 2 262400      res4u_out[0][0]                  
__________________________________________________________________________________________________
bn4v_branch2a (BatchNorm)       (None, None, None, 2 1024        res4v_branch2a[0][0]             
__________________________________________________________________________________________________
activation_58 (Activation)      (None, None, None, 2 0           bn4v_branch2a[0][0]              
__________________________________________________________________________________________________
res4v_branch2b (Conv2D)         (None, None, None, 2 590080      activation_58[0][0]              
__________________________________________________________________________________________________
bn4v_branch2b (BatchNorm)       (None, None, None, 2 1024        res4v_branch2b[0][0]             
__________________________________________________________________________________________________
activation_59 (Activation)      (None, None, None, 2 0           bn4v_branch2b[0][0]              
__________________________________________________________________________________________________
res4v_branch2c (Conv2D)         (None, None, None, 1 263168      activation_59[0][0]              
__________________________________________________________________________________________________
bn4v_branch2c (BatchNorm)       (None, None, None, 1 4096        res4v_branch2c[0][0]             
__________________________________________________________________________________________________
add_29 (Add)                    (None, None, None, 1 0           bn4v_branch2c[0][0]              
                                                                 res4u_out[0][0]                  
__________________________________________________________________________________________________
res4v_out (Activation)          (None, None, None, 1 0           add_29[0][0]                     
__________________________________________________________________________________________________
res4w_branch2a (Conv2D)         (None, None, None, 2 262400      res4v_out[0][0]                  
__________________________________________________________________________________________________
bn4w_branch2a (BatchNorm)       (None, None, None, 2 1024        res4w_branch2a[0][0]             
__________________________________________________________________________________________________
activation_60 (Activation)      (None, None, None, 2 0           bn4w_branch2a[0][0]              
__________________________________________________________________________________________________
res4w_branch2b (Conv2D)         (None, None, None, 2 590080      activation_60[0][0]              
__________________________________________________________________________________________________
bn4w_branch2b (BatchNorm)       (None, None, None, 2 1024        res4w_branch2b[0][0]             
__________________________________________________________________________________________________
activation_61 (Activation)      (None, None, None, 2 0           bn4w_branch2b[0][0]              
__________________________________________________________________________________________________
res4w_branch2c (Conv2D)         (None, None, None, 1 263168      activation_61[0][0]              
__________________________________________________________________________________________________
bn4w_branch2c (BatchNorm)       (None, None, None, 1 4096        res4w_branch2c[0][0]             
__________________________________________________________________________________________________
add_30 (Add)                    (None, None, None, 1 0           bn4w_branch2c[0][0]              
                                                                 res4v_out[0][0]                  
__________________________________________________________________________________________________
res4w_out (Activation)          (None, None, None, 1 0           add_30[0][0]                     
__________________________________________________________________________________________________
res5a_branch2a (Conv2D)         (None, None, None, 5 524800      res4w_out[0][0]                  
__________________________________________________________________________________________________
bn5a_branch2a (BatchNorm)       (None, None, None, 5 2048        res5a_branch2a[0][0]             
__________________________________________________________________________________________________
activation_62 (Activation)      (None, None, None, 5 0           bn5a_branch2a[0][0]              
__________________________________________________________________________________________________
res5a_branch2b (Conv2D)         (None, None, None, 5 2359808     activation_62[0][0]              
__________________________________________________________________________________________________
bn5a_branch2b (BatchNorm)       (None, None, None, 5 2048        res5a_branch2b[0][0]             
__________________________________________________________________________________________________
activation_63 (Activation)      (None, None, None, 5 0           bn5a_branch2b[0][0]              
__________________________________________________________________________________________________
res5a_branch2c (Conv2D)         (None, None, None, 2 1050624     activation_63[0][0]              
__________________________________________________________________________________________________
res5a_branch1 (Conv2D)          (None, None, None, 2 2099200     res4w_out[0][0]                  
__________________________________________________________________________________________________
bn5a_branch2c (BatchNorm)       (None, None, None, 2 8192        res5a_branch2c[0][0]             
__________________________________________________________________________________________________
bn5a_branch1 (BatchNorm)        (None, None, None, 2 8192        res5a_branch1[0][0]              
__________________________________________________________________________________________________
add_31 (Add)                    (None, None, None, 2 0           bn5a_branch2c[0][0]              
                                                                 bn5a_branch1[0][0]               
__________________________________________________________________________________________________
res5a_out (Activation)          (None, None, None, 2 0           add_31[0][0]                     
__________________________________________________________________________________________________
res5b_branch2a (Conv2D)         (None, None, None, 5 1049088     res5a_out[0][0]                  
__________________________________________________________________________________________________
bn5b_branch2a (BatchNorm)       (None, None, None, 5 2048        res5b_branch2a[0][0]             
__________________________________________________________________________________________________
activation_64 (Activation)      (None, None, None, 5 0           bn5b_branch2a[0][0]              
__________________________________________________________________________________________________
res5b_branch2b (Conv2D)         (None, None, None, 5 2359808     activation_64[0][0]              
__________________________________________________________________________________________________
bn5b_branch2b (BatchNorm)       (None, None, None, 5 2048        res5b_branch2b[0][0]             
__________________________________________________________________________________________________
activation_65 (Activation)      (None, None, None, 5 0           bn5b_branch2b[0][0]              
__________________________________________________________________________________________________
res5b_branch2c (Conv2D)         (None, None, None, 2 1050624     activation_65[0][0]              
__________________________________________________________________________________________________
bn5b_branch2c (BatchNorm)       (None, None, None, 2 8192        res5b_branch2c[0][0]             
__________________________________________________________________________________________________
add_32 (Add)                    (None, None, None, 2 0           bn5b_branch2c[0][0]              
                                                                 res5a_out[0][0]                  
__________________________________________________________________________________________________
res5b_out (Activation)          (None, None, None, 2 0           add_32[0][0]                     
__________________________________________________________________________________________________
res5c_branch2a (Conv2D)         (None, None, None, 5 1049088     res5b_out[0][0]                  
__________________________________________________________________________________________________
bn5c_branch2a (BatchNorm)       (None, None, None, 5 2048        res5c_branch2a[0][0]             
__________________________________________________________________________________________________
activation_66 (Activation)      (None, None, None, 5 0           bn5c_branch2a[0][0]              
__________________________________________________________________________________________________
res5c_branch2b (Conv2D)         (None, None, None, 5 2359808     activation_66[0][0]              
__________________________________________________________________________________________________
bn5c_branch2b (BatchNorm)       (None, None, None, 5 2048        res5c_branch2b[0][0]             
__________________________________________________________________________________________________
activation_67 (Activation)      (None, None, None, 5 0           bn5c_branch2b[0][0]              
__________________________________________________________________________________________________
res5c_branch2c (Conv2D)         (None, None, None, 2 1050624     activation_67[0][0]              
__________________________________________________________________________________________________
bn5c_branch2c (BatchNorm)       (None, None, None, 2 8192        res5c_branch2c[0][0]             
__________________________________________________________________________________________________
add_33 (Add)                    (None, None, None, 2 0           bn5c_branch2c[0][0]              
                                                                 res5b_out[0][0]                  
__________________________________________________________________________________________________
res5c_out (Activation)          (None, None, None, 2 0           add_33[0][0]                     
__________________________________________________________________________________________________
fpn_c5p5 (Conv2D)               (None, None, None, 2 524544      res5c_out[0][0]                  
__________________________________________________________________________________________________
fpn_p5upsampled (UpSampling2D)  (None, None, None, 2 0           fpn_c5p5[0][0]                   
__________________________________________________________________________________________________
fpn_c4p4 (Conv2D)               (None, None, None, 2 262400      res4w_out[0][0]                  
__________________________________________________________________________________________________
fpn_p4add (Add)                 (None, None, None, 2 0           fpn_p5upsampled[0][0]            
                                                                 fpn_c4p4[0][0]                   
__________________________________________________________________________________________________
fpn_p4upsampled (UpSampling2D)  (None, None, None, 2 0           fpn_p4add[0][0]                  
__________________________________________________________________________________________________
fpn_c3p3 (Conv2D)               (None, None, None, 2 131328      res3d_out[0][0]                  
__________________________________________________________________________________________________
fpn_p3add (Add)                 (None, None, None, 2 0           fpn_p4upsampled[0][0]            
                                                                 fpn_c3p3[0][0]                   
__________________________________________________________________________________________________
fpn_p3upsampled (UpSampling2D)  (None, None, None, 2 0           fpn_p3add[0][0]                  
__________________________________________________________________________________________________
fpn_c2p2 (Conv2D)               (None, None, None, 2 65792       res2c_out[0][0]                  
__________________________________________________________________________________________________
fpn_p2add (Add)                 (None, None, None, 2 0           fpn_p3upsampled[0][0]            
                                                                 fpn_c2p2[0][0]                   
__________________________________________________________________________________________________
fpn_p5 (Conv2D)                 (None, None, None, 2 590080      fpn_c5p5[0][0]                   
__________________________________________________________________________________________________
fpn_p2 (Conv2D)                 (None, None, None, 2 590080      fpn_p2add[0][0]                  
__________________________________________________________________________________________________
fpn_p3 (Conv2D)                 (None, None, None, 2 590080      fpn_p3add[0][0]                  
__________________________________________________________________________________________________
fpn_p4 (Conv2D)                 (None, None, None, 2 590080      fpn_p4add[0][0]                  
__________________________________________________________________________________________________
fpn_p6 (MaxPooling2D)           (None, None, None, 2 0           fpn_p5[0][0]                     
__________________________________________________________________________________________________
rpn_model (Model)               [(None, None, 2), (N 1189394     fpn_p2[0][0]                     
                                                                 fpn_p3[0][0]                     
                                                                 fpn_p4[0][0]                     
                                                                 fpn_p5[0][0]                     
                                                                 fpn_p6[0][0]                     
__________________________________________________________________________________________________
rpn_class (Concatenate)         (None, None, 2)      0           rpn_model[1][1]                  
                                                                 rpn_model[2][1]                  
                                                                 rpn_model[3][1]                  
                                                                 rpn_model[4][1]                  
                                                                 rpn_model[5][1]                  
__________________________________________________________________________________________________
rpn_bbox (Concatenate)          (None, None, 4)      0           rpn_model[1][2]                  
                                                                 rpn_model[2][2]                  
                                                                 rpn_model[3][2]                  
                                                                 rpn_model[4][2]                  
                                                                 rpn_model[5][2]                  
__________________________________________________________________________________________________
input_anchors (InputLayer)      (None, None, 4)      0                                            
__________________________________________________________________________________________________
ROI (ProposalLayer)             (None, 1000, 4)      0           rpn_class[0][0]                  
                                                                 rpn_bbox[0][0]                   
                                                                 input_anchors[0][0]              
__________________________________________________________________________________________________
input_image_meta (InputLayer)   (None, 14)           0                                            
__________________________________________________________________________________________________
roi_align_classifier (PyramidRO (None, 1000, 7, 7, 2 0           ROI[0][0]                        
                                                                 input_image_meta[0][0]           
                                                                 fpn_p2[0][0]                     
                                                                 fpn_p3[0][0]                     
                                                                 fpn_p4[0][0]                     
                                                                 fpn_p5[0][0]                     
__________________________________________________________________________________________________
mrcnn_class_conv1 (TimeDistribu (None, 1000, 1, 1, 1 12846080    roi_align_classifier[0][0]       
__________________________________________________________________________________________________
mrcnn_class_bn1 (TimeDistribute (None, 1000, 1, 1, 1 4096        mrcnn_class_conv1[0][0]          
__________________________________________________________________________________________________
activation_68 (Activation)      (None, 1000, 1, 1, 1 0           mrcnn_class_bn1[0][0]            
__________________________________________________________________________________________________
mrcnn_class_conv2 (TimeDistribu (None, 1000, 1, 1, 1 1049600     activation_68[0][0]              
__________________________________________________________________________________________________
mrcnn_class_bn2 (TimeDistribute (None, 1000, 1, 1, 1 4096        mrcnn_class_conv2[0][0]          
__________________________________________________________________________________________________
activation_69 (Activation)      (None, 1000, 1, 1, 1 0           mrcnn_class_bn2[0][0]            
__________________________________________________________________________________________________
pool_squeeze (Lambda)           (None, 1000, 1024)   0           activation_69[0][0]              
__________________________________________________________________________________________________
mrcnn_class_logits (TimeDistrib (None, 1000, 2)      2050        pool_squeeze[0][0]               
__________________________________________________________________________________________________
mrcnn_bbox_fc (TimeDistributed) (None, 1000, 8)      8200        pool_squeeze[0][0]               
__________________________________________________________________________________________________
mrcnn_class (TimeDistributed)   (None, 1000, 2)      0           mrcnn_class_logits[0][0]         
__________________________________________________________________________________________________
mrcnn_bbox (Reshape)            (None, 1000, 2, 4)   0           mrcnn_bbox_fc[0][0]              
__________________________________________________________________________________________________
mrcnn_detection (DetectionLayer (None, 100, 6)       0           ROI[0][0]                        
                                                                 mrcnn_class[0][0]                
                                                                 mrcnn_bbox[0][0]                 
                                                                 input_image_meta[0][0]           
__________________________________________________________________________________________________
lambda_3 (Lambda)               (None, 100, 4)       0           mrcnn_detection[0][0]            
__________________________________________________________________________________________________
roi_align_mask (PyramidROIAlign (None, 100, 14, 14,  0           lambda_3[0][0]                   
                                                                 input_image_meta[0][0]           
                                                                 fpn_p2[0][0]                     
                                                                 fpn_p3[0][0]                     
                                                                 fpn_p4[0][0]                     
                                                                 fpn_p5[0][0]                     
__________________________________________________________________________________________________
mrcnn_mask_conv1 (TimeDistribut (None, 100, 14, 14,  590080      roi_align_mask[0][0]             
__________________________________________________________________________________________________
mrcnn_mask_bn1 (TimeDistributed (None, 100, 14, 14,  1024        mrcnn_mask_conv1[0][0]           
__________________________________________________________________________________________________
activation_71 (Activation)      (None, 100, 14, 14,  0           mrcnn_mask_bn1[0][0]             
__________________________________________________________________________________________________
mrcnn_mask_conv2 (TimeDistribut (None, 100, 14, 14,  590080      activation_71[0][0]              
__________________________________________________________________________________________________
mrcnn_mask_bn2 (TimeDistributed (None, 100, 14, 14,  1024        mrcnn_mask_conv2[0][0]           
__________________________________________________________________________________________________
activation_72 (Activation)      (None, 100, 14, 14,  0           mrcnn_mask_bn2[0][0]             
__________________________________________________________________________________________________
mrcnn_mask_conv3 (TimeDistribut (None, 100, 14, 14,  590080      activation_72[0][0]              
__________________________________________________________________________________________________
mrcnn_mask_bn3 (TimeDistributed (None, 100, 14, 14,  1024        mrcnn_mask_conv3[0][0]           
__________________________________________________________________________________________________
activation_73 (Activation)      (None, 100, 14, 14,  0           mrcnn_mask_bn3[0][0]             
__________________________________________________________________________________________________
mrcnn_mask_conv4 (TimeDistribut (None, 100, 14, 14,  590080      activation_73[0][0]              
__________________________________________________________________________________________________
mrcnn_mask_bn4 (TimeDistributed (None, 100, 14, 14,  1024        mrcnn_mask_conv4[0][0]           
__________________________________________________________________________________________________
activation_74 (Activation)      (None, 100, 14, 14,  0           mrcnn_mask_bn4[0][0]             
__________________________________________________________________________________________________
mrcnn_mask_deconv (TimeDistribu (None, 100, 28, 28,  262400      activation_74[0][0]              
__________________________________________________________________________________________________
mrcnn_mask (TimeDistributed)    (None, 100, 28, 28,  514         mrcnn_mask_deconv[0][0]          
==================================================================================================
Total params: 63,733,406
Trainable params: 63,621,918
Non-trainable params: 111,488
__________________________________________________________________________________________________

Any help is greatly appriciated!

Trotts avatar Jul 31 '19 10:07 Trotts

I have the same problem.Have you solved it? thanks!

JlexZhong avatar Sep 14 '21 04:09 JlexZhong

What if deleting these two lines: if nms_node is None: nms_node = model.ancestor(pillar, "ROI/rpn_non_max_suppression/NonMaxSuppressionV2:0")

pkugyf avatar Oct 11 '22 14:10 pkugyf

I have the same problem.Have you solved it? thanks!

WANGTENG611 avatar Dec 03 '23 13:12 WANGTENG611