Horace He

Results 242 comments of Horace He

Why shouldn't the backwards pass be functionalizable?

> coding the decomposition in pytorch core, it looks like this code is still incorrect for other case. Marking as draft and probably close it later Haha, I've run into...

Can we just check if grad is enabled before we call autograd.grad? I do wonder whether we can have a more minimal repro though - will take a closer look...

I added a decomposition for `aten.native_batch_norm` (forward) - following up with the PR on backwards.

> I'm curious can I use vmap to do multi-model training? Yes! > For example, can I use batch_pred from vmap and directly do loss.backward(), optimiser.step() to train the ensemble...

@Maistho There's a couple big limitations with Vim's Ctrl-z functionality. One big example is macros.

@bs One example is macros. Following VSCode's undo stack, every ctrl+z press would undo one of the actions of the macro. However, in vim, you would want to undo the...

@johnfn Do you think that if we set VSCode's undo stops to correspond with how they should be in vim, we can get rid of our undo stack completely? It...

@johnfn wait what is it that simple? I've seen a bunch of buggy behavior related to undo that would probably be fixed by having vscode manage undo stops. Is there...

@koreyconway You can just bind `u` to `` and such. @chuckdries I think for this project, it seems like it will be likely for us to implement the undo tree...