Brian Chen
Brian Chen
Having (optional?) support for promises will allow for even more elegant usage with libaries like co. Since fermata is already using es6 features, it wouldn't be too farfetched to either...
Being able to represent https://github.com/onnx/onnx/blob/master/docs/Operators.md#if would be great. I think it might also remove some of the sharper edges of normal tracing, such as certain branches not being hit.
At present, Zygote will use forward mode AD (outsourced to FowardDiff) under 2 circumstances: 1. Based on a heuristic for broadcasting 2. Upon an explicit call to `Zygote.forwarddiff` As shown...
Should fix the 2 compiler-related failures on nightly, e.g. https://github.com/FluxML/Zygote.jl/runs/7613462813?check_suite_focus=true. The rest look to be factorization-related—@sethaxen could I bug you about those?
Inspired by https://discourse.julialang.org/t/ann-new-package-snoopprecompile/84778, I threw together a quick POC using the existing (but unused) `precompile` function. Results may be found in [this post](https://discourse.julialang.org/t/ann-new-package-snoopprecompile/84778/21). There's probably more to be done to...
These may be as simple as a couple lines of comments, but as noted in https://github.com/FluxML/Zygote.jl/issues/1243#issuecomment-1200400917 they would be good to have: - [ ] `accum` - [ ] `accum_param`...
We've had one in Flux for ages, but if anything Zygote needs one more. Ideally it would be possible to do this org-wide, does anyone know if that's possible?
This PR ports @Keno's work on https://github.com/FluxML/Zygote.jl/pull/78 to 2022 Zygote. Because IRTools and base Julia have slightly different IR representations, some tweaks were necessary for the core algorithm: 1. Instead...
Fixes the MWE in https://github.com/FluxML/Zygote.jl/issues/1233. Removing the `@assert` does not appear to be a problem, but there may be unknown consequences that haven't been captured by the existing test suite....
We have `ZygoteRuleConfig` for this, so there should be no major technical limitations. `rrule`s generally have far better UX than `@adjoint`s (as anyone who has had to read a stacktrace...