functorch
functorch copied to clipboard
pytorch
functorch is JAX-like composable function transforms for PyTorch.
I am installing functorch on google colab; when I don't specify the version, it installs version 0.2.2 and PyTorch version 1.12.0, and uninstall currently installed PyTorch 1.11.0 on colab. But,...
Most in-place operations look the same: the first argument is mutable and no other arguments are mutable. F.batch_norm is an exception to that rule: it has multiple mutable arguments. We...
See title. From discussion with @albanD
Most of the examples I've seen use hmap at the top level, to create an 'outer' ensemble of models, or to factor out the batch dimension. However, my use case...
Proposes a new method to load weights in `FunctionalModule` and `FunctionalModuleWithBuffers`. A map `module` `param_name` `param_value` is created and used to set attributes. Test: The following test runs twice as...
Hi developers, After I upgraded functorch from `v0.1.1` to `0.2.0`, I noticed a 25% performance regression when calculating hessian, please check the following benchmark result and the attached benchmark script....
- test_vmapjvpall_has_batch_rule_linalg_det_singular_cpu_float32 - test_vmapvjp_has_batch_rule_linalg_det_cpu_float32
We want to merge functorch's build system into pytorch so we can package functorch and pytorch together. In order to do that, we want to make sure we don't take...
I am working on a project which requires me to calculate the trace of the Hessian of standard ResNet architectures. To this end I am using the Hutchinson method, which...
Hi, Thank you for this exciting work. I will try to explain a use case that I hope will be possible with functorch because the naive way is just extremely...
