PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

Add model VisualBERT

Open chenkangyang opened this issue 2 years ago • 6 comments

What's New

  • 增加3个数据集: coco_captions, vqa2, nlvr2
  • 增加1个模型:visualbert
  • 增加训练样例:examples/multimodal_model/visualbert
  • 增加模型权重:community/chenkangyang/visualbert-*

模型权重文件:

共9个 链接:https://pan.baidu.com/s/1FMUWd_tBOiwEU8RjSafd_w 提取码:6geq --来自百度网盘超级会员V5的分享

训练用图像特征数据:

`examples/multimodal_model/visualbert/README.md· 中包含了两个百度网盘地址,以及路径说明

X_COCO : 下载链接

链接:https://pan.baidu.com/s/1xRZBrxRst3oqtaXdjP5lrA 提取码:7s29 --来自百度网盘超级会员V5的分享

X_NLVR : 下载链接

链接:https://pan.baidu.com/s/1vdR6OcCxo6aEJLS4Wl4PPQ 提取码:13pc --来自百度网盘超级会员V5的分享

训练用数据集标注文件:

  1. paddlenlp/datasets/coco_captions.py Class COCOCaptions
URL_ANNO="http://images.cocodataset.org/annotations/annotations_trainval2014.zip"
  1. paddlenlp/datasets/nlvr2.py Class NLVR2
URL_ANNO = "https://gitee.com/njcky/nlvr2/raw/master/annotations.tar.gz"
  1. paddlenlp/datasets/vqa2.py Class VQA2
URL_ANNO = "https://bj.bcebos.com/v1/ai-studio-online/af70d260aa8841148d136b08d5bf793d56a31024d53b416e90613ae2093e6c51?responseContentDisposition=attachment;filename=imdb.tar.gz"
URL_EXTRA = "https://dl.fbaipublicfiles.com/mmf/data/datasets/vqa2/defaults/extras.tar.gz"

chenkangyang avatar Nov 07 '21 10:11 chenkangyang