Lei Wang comments

Results 6 comments of


                                            Lei Wang

How to use kfac to train two probabilistic models jointly?

Perhaps a more concrete example of my question: How train a [VAE](https://github.com/deepmind/dm-haiku/blob/main/examples/vae.py) using `kfac-jax`?

How to use kfac to train two probabilistic models jointly?

Thanks!

Calculating gradients with cureg

I guess the @GiggleLiu 's point is not to replace `expect'` by `Zygote`, but combine them together. For example, you can fill a parameter array with shared parameters, and then...

Possible updates to PyTorch 1.10

Thank you. Glad you find it is useful. There might be multiple places that need updating. For now, I will leave it as it is and keep your issue open....

Gradient of SVD with degenerate singular values becomes NaN

> @Jakob-Unfried : I am facing the same problem and like your `safe_inverse` solution, but I'm not sure how to apply such a thing when doing backpropagation in Pytorch. Do...

Gradient of SVD with degenerate singular values becomes NaN

Here is an example of how to use that function https://github.com/wangleiphy/tensorgrad/blob/master/tensornets/trg.py#L3-L4