Knet.jl icon indicating copy to clipboard operation
Knet.jl copied to clipboard

Create Knet.Layers21

Open denizyuret opened this issue 3 years ago • 0 comments

  • [x] move atype to Knet.jl
  • [ ] move param to Layers21.
  • [x] implement Uniform(r) and short form U as init fn. Define fanin, fanout. Write the formula instead of using cryptic names.
  • [ ] have atype and init be standard options in all layers.
  • [ ] 7.2.14. cudnnGetAttnDescriptor()
  • [ ] 7.2.15. cudnnGetMultiHeadAttnBuffers()
  • [ ] 7.2.16. cudnnGetMultiHeadAttnWeights()
  • [ ] Use convbiasadd

denizyuret avatar Jul 25 '20 10:07 denizyuret