Jiseob Kim (delta.function)
                                        Results
                                        2
                                        comments of
                                        
                                
                                            Jiseob Kim (delta.function)
                                        
                                    I think I am having the same issue. Although setting `ddp_find_unused_parameters_true` is not that slow in my case. I double-checked with the following code and printed nothing in between `enter`...
Hi thanks for the reply. I tried `on_after_backward()`, but I got the same result. Nothing prints in between. Maybe this is to do with my usage of `state_dict_hook` which deletes...