FPN_Faster_RCNN
FPN_Faster_RCNN copied to clipboard
kuku-sichuan
a tensorflow implementation for FPN
Feature Pyramid Network
This tensorflow implementation code is based on Feature Pyramid Networks for Object Detection. **Some code learn from https://github.com/matterport/Mask_RCNN.
Update
- Streamlining structure and removing redundant parts
- Making the code more clear
- Replacing some API by new one
- Adding the compute time graph by set the
COMPUTE_TIMEin config with True
FEATURES:
- Training >=2 image in a GPU
- Training uses Multi-gpu for data parallelism and no significant decrease in performance
- Add ResNet-v2 pretrained model
- The code has been tested and compared to this implementation, it has better performance
- Great debug tools and visualization to see result of intermediate process in the tensorboard
- Using tf.Dataset and tf.estimator which has better computational efficiency and more concise code
Environment
- tensorflow-1.8
- CUDA-9.0
- cuDNN-7.0
The above environment has been tested.
Making dataset
for computational efficiency and coding convenient,we first convert the data into tfrecord format. We only support the transformation of COCO style data. If your data is the style of VOC, you must convert the VOC style to COCO style. One more thing you must notice is that you need to manually add the dictionary of category name and label in your data to /libs/label_dict.py. Then:
cd $FPN_Faster_RCNN/data/
python convert_data_to_tfrecord.py --DATA_dir=/cocodataset/ --annotation_dir=annotations/train.json --image_dir=images/train --save_dir=/tfrecord/ --dataset_name=coco --dataset_class=train
Generate:
save_dir
dataset_name
train.tfreocrd
test.tfrecord
val.tfrecord
Configuration and Training
this implementation has anthor feature is converted to change any params for users. I collect all params in config.py including: training params, network frame, and sample selection etc. So please change all params need to change for your training, such as: dataset dir, num_class, dataset_name, learning rate. To distinguish resnet50_v2 from resnet_v1, we named it as resnet_model. You can download the pre-trained model in there.
If you want train with multi-gpu, you just only change the GPU_GROUPS in config.py. Then:
cd tools/
python train.py
Debug and visualization
In the list, each file has a Debug signal to decide whether the corresponding summary are made in the tensorboard.
| file | function |
|---|---|
| tools/train.py | Whether draw the rpn proposal of region which is the first 50 in the tensorboard and the final detection results. |
| libs/build_fast_rcnn.py | Whether print out the scores and categories of proposals in fast_rcnn; summary the image of ground-true object and training proposals |
Of course, you can imitate our code to print out or visualate everything for debug.
Display images recorded in tensorboard:
ground true objects:
proposals for training head:
the first 50 proposal:
the finial detection:
Other tools
For convenience, our data analysis and the performance of the network are presented ipynb format.
- inspect_data.ipynb:Simple analysis and understanding of datasets and data.
- Predict.ipynb: predict the single image.
- evaluate_network.ipynb: compute mAP and the recall of rpn and error analysis.Error analysis including three types: classifier error, missing objects, false positive. And we also show some error objects to analysis.
kuku-sichuan