Jarrett Revels
Jarrett Revels
> The idea would be to create the linear algebra counterpart to DiffRules.jl, which only support functions of scalars. I'd love it if we could get DiffRules to support both...
> I'm definitely open to getting the linear algebra operations from DiffLinearAlgebra into DiffRules Hmm...after looking at DiffLinearAlgebra (great stuff, BTW!), it seems to be solving a *very* different set...
> Dual already supports complex numbers (#29) so not sure if that would keep everyone happy. I don't think this is an issue, ForwardDiff's `Dual` also supports complex numbers (and...
> Are there any downsides of Complex{T
> Is the proposal that ForwardDiff.Dual be renamed DualNumbers.Dual, that is, we retain this package but with a new implementation? Yes (sorry for the late reply).
> I'm guessing one pro for FowardDiff.Dual
Thanks @ranjanan. Before you go down this route, be warned that it will probably involve a good bit of work and digging into the implementation details of both packages. I...
Ah, this is a good one. It's definitely the case that spaces around `^` look super weird, so that one's easy; we should just have a rule to elide spaces...
``` 2. One major feature of Knet is that it supports dynamic computational graphs, i.e. the ability to construct the CG at runtime so one can use arbitrary Julia code...
> @jrevels did you try running any Knet examples with ReverseDiff? Nope, that could be fun. Looking at the examples it seems like (in most cases) it'd be as easy...