kfac-jax
kfac-jax copied to clipboard
Published
20 hours ago •
google-deepmind
google-deepmind
Second Order Optimization and Curvature Estimation with K-FAC in JAX.
Results
12
kfac-jax issues
Sort by
recently updated
recently updated
newest added
### Feature I kindly request the addition of support for the Kronecker-Factored Approximate Curvature (KFAC) optimization technique in LSTM and GRU layers within the existing KFAC Optimizer. Currently, most of...
Making KFAC use `pjit` instead of `pmap`
![copybara-service[bot] avatar](https://avatars.githubusercontent.com/in/44061?v=4 "copybara-service[bot] avatar"){kind=avatar}
Metadata
204
Stars
15
Forks
Watchers
Owner
Metadata
Second Order Optimization and Curvature Estimation with K-FAC in JAX.