spatial-temporal-transformer icon indicating copy to clipboard operation
spatial-temporal-transformer copied to clipboard

Published 20 hours ago • verified publisher icon pengzhangzhi

代码中好像没有体现自监督的过程

Open JianSoL opened this issue 3 years ago • 3 comments

JianSoL avatar Nov 20 '22 05:11 JianSoL

代码中有预训练，这部分是自监督。请认真阅读代码

pengzhangzhi avatar Nov 20 '22 10:11 pengzhangzhi

能详细说明下吗，我感觉预训练和训练的代码没啥差别

JianSoL avatar Nov 21 '22 01:11 JianSoL

https://github.com/pengzhangzhi/spatial-temporal-transformer/blob/b17760e01eb08b9b4340e9dd6cbc7cd3caac2b97/train.py#L232 这是预训练部分代码，请仔细阅读一下哈~ 我在dataset class 中 对生成的x,y data pair进行处理，生成预训练数据。实际上就是随机把X中一个frame和y交换。 https://github.com/pengzhangzhi/spatial-temporal-transformer/blob/b17760e01eb08b9b4340e9dd6cbc7cd3caac2b97/train.py#L78

pengzhangzhi avatar Nov 21 '22 01:11 pengzhangzhi