How does the D^k network obtain the gradient of back propagation?

[biandh]

The output of the Sk network is the index of the predict key frame. then use this key frame to Sd，but this index is not differentiable，How to optimize the Sk network through this index?

[pcshih]

This is why I think this paper is not reasonable.