pyreft icon indicating copy to clipboard operation
pyreft copied to clipboard

[P1] Unable to access gradients of intervention blocks

Open m-dev12 opened this issue 5 months ago • 1 comments

Hi @frankaging ,

This is not an issue, but a question. I am trying to access the gradients w.r..t the intervention blocks using the code below. I am able to access the classifer head gradients but the gradients w.r.t the intervention weights always show up to be none.

Screenshot 2024-09-07 at 6 40 42 PM

Have you done this in the past, or if you could help out if you are aware?

Thanks!

m-dev12 avatar Sep 07 '24 22:09 m-dev12