pyreft
pyreft copied to clipboard
[P1] Unable to access gradients of intervention blocks
Hi @frankaging ,
This is not an issue, but a question. I am trying to access the gradients w.r..t the intervention blocks using the code below. I am able to access the classifer head gradients but the gradients w.r.t the intervention weights always show up to be none.
Have you done this in the past, or if you could help out if you are aware?
Thanks!