snntorch icon indicating copy to clipboard operation
snntorch copied to clipboard
verified publisher icon jeshraghian

Mixed-mode autodiff for RTRL

Open jeshraghian opened this issue 4 years ago • 2 comments

  • Implement forward-mode AD for temporal connections; reverse-mode AD for layer connections
  • Update at each time step
  • Approximate BPTT without having to store any historical gradients

jeshraghian avatar Jul 26 '21 21:07 jeshraghian

Willing to work on this. Could you give some more details please ?

saiftyfirst avatar Oct 16 '23 19:10 saiftyfirst

@saiftyfirst , like this

https://pytorch.org/tutorials//intermediate/forward_ad_usage.html?highlight=func

ahenkes1 avatar Oct 30 '23 05:10 ahenkes1