brainstorm icon indicating copy to clipboard operation
brainstorm copied to clipboard

Added strided elewise ops (logistic, tanh).

Open TimDettmers opened this issue 10 years ago • 1 comments

The element-wise operations are performed on the last dimension on a given index. It assumes that tensors are stacked row-wise but that their dimension is increased in the next dimension on the tensor.

For example take 3 stacked 2x2 tensors, which have dimension 2x2x3 [a, a] [a, a] [b, b] [b, b] [c, c] [c, c]

The elementwise operation with index 0 will perform operations on a, index 1 on b, index 2 on c. Currently only logistic and tanh are implemented, but other elementwise operations can be added easily.

See the test in the test_handler_operations for examples.

TimDettmers avatar Nov 25 '15 21:11 TimDettmers

Code Health Repository health increased by 0.07% when pulling 5eec5fe on TimDettmers:master into 2d03d14 on IDSIA:master.

landscape-bot avatar Nov 25 '15 21:11 landscape-bot