OnlineAI.jl icon indicating copy to clipboard operation
OnlineAI.jl copied to clipboard

Automatic differentiation

Open Evizero opened this issue 10 years ago • 1 comments

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

Evizero avatar Sep 04 '15 20:09 Evizero

Yes nothing stopping auto diff as part of the framework... Should be no more than a short method or 2 to implement. Let me know if you have a specific cost function or activation that you're interested in... I might be able to help out.

On Sep 4, 2015, at 4:08 PM, Christof Stocker [email protected] wrote:

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

— Reply to this email directly or view it on GitHub.

tbreloff avatar Sep 04 '15 21:09 tbreloff