FastFlowNet icon indicating copy to clipboard operation
FastFlowNet copied to clipboard

spatial-correlation-sampler

Open jing98tian opened this issue 2 years ago • 5 comments

i am new to this area, would you relsese the code with "spatial-correlation-sampler" function for me to learn, thank you !

jing98tian avatar Mar 03 '22 02:03 jing98tian

I have added the file ./models/FastFlowNet_.py that supports higher versions of CUDA and PyTorch. Please see the updated README.md.

ltkong218 avatar Mar 04 '22 04:03 ltkong218

thank you for your reply, i try it in cuda10.2/pytorch1.6 and it works.

jing98tian avatar Mar 06 '22 08:03 jing98tian

I find that the network you proposed has poor generalization performance for untrained scenarios. Are you concerned about this problem? and The network seems to have problems in optical flow estimation of distant objects

jing98tian avatar Mar 06 '22 13:03 jing98tian

All the supervised optical flow networks have this problem, since they are trained on synthesized datasets which have large domain gap with real scenes. I suggest you to train FastFlowNet with your video sequences in a self-supervised way, where you can load the released pre-trained model parameters as initialization. For unsupervised learning, you can refer to UnFlow, DDFlow, SelFlow and UFlow.

ltkong218 avatar Mar 08 '22 02:03 ltkong218

thank you very much ,I'll try your suggestion.

jing98tian avatar Mar 08 '22 02:03 jing98tian