TokenFusion icon indicating copy to clipboard operation
TokenFusion copied to clipboard

[CVPR 2022] Code release for "Multimodal Token Fusion for Vision Transformers"

Results 10 TokenFusion issues
Sort by recently updated
recently updated
newest added

Hi,Thanks for your creative work! I am trying to reproduce the results for SUN RGBD on semantic segmentation task. The readme only give instructions about how to prepare for NYUDv2....

Hi, /sunrgbd/sunrgbd_pc_bbox_votes_50k_v1_train How can I get this file

Hi, I am trying to reproduce the results for SUN RGBD. The paper mentions 1e-3 whereas the ReadMe mentions 1e-6. Thanks!

Thanks for making your code public! I was wondering if you would also release the sun rgb-d data (preprocesses, if any) you used.

The model architecture of the checkpoint you provided for sematic segmentation is different from the model architecture you provided in the code ?

Hi! Is loss2d_class_error 100.0000 normal? Thanks [12/21 19:28:05] group-free INFO: Train: [2][30/95] 0head_neg_ratio 0.6538 0head_pos_ratio 0.3462 1head_neg_ratio 0.6538 1head_pos_ratio 0.3462 2head_neg_ratio 0.6538 2head_pos_ratio 0.3462 3head_neg_ratio 0.6538 3head_pos_ratio 0.3462 4head_neg_ratio 0.6538...

How long does it take to train the semantic_segmentation once?

Hi, first of all this is excellent work! I am trying to train some data on the segmentation portion. When I training using the command“ python main.py --backbone mit_b3 -c...

在图像翻译任务中,为什么每个block后要使用LN?block的第一层就是LN,现在的话,是连续使用了两个LN层。

Hi, first of all this is excellent work! I am trying to test some data on the segmentation portion. When I train it with pretained segformer weight, it saves data.pkl...