Tracker.jl

Tracker.jl copied to clipboard

Softmax fails on array of TrackedReal

1

I first noticed this problem with Flux 0.8.2, but it may have existed in earlier versions. ``` using Flux tracked_array = Flux.param(Flux.glorot_uniform(10,3)); # tracked array of reals Flux.softmax(tracked_array) # all...

mboedigh

Upper/LowerTriangular gradients

2

pshashk

`vcat` with tracked reals

1

``` vcat(param(1),param(2:3)) ``` This currently returns an array of tracked scalars; would be good to catch it in the tracking code.

MikeInnes

Support for tracked SharedArrays?

3

Currently, a SharedArray becomes non-shared when passed to the function param. ```julia julia> W = SharedArray(rand(4, 3)) b = SharedArray(rand(4)) l = Dense(param(W), param(b), relu) l.W.data 4×3 Array{Float64,2}: 0.97669 0.26793...

jbrea

Similar to `vcat`, `hcat` and `cat`.

gustafsson

e.g. ``` param.(rand(2,2))*param(rand(2,2)) ``` Currently this returns a tracked array of tracked reals, which will cause further issues down the line. It'd be good to catch this when `*` is...

MikeInnes