NumpyFlow icon indicating copy to clipboard operation
NumpyFlow copied to clipboard

使用numpy搭建自己的简易深度学习框架

NumpyFlow

详细文档请参照:https://blog.csdn.net/kid_14_12/article/details/105852626

待添加.....

Tensor

封装numpy数组,是NumpyFlow的数据载体,相当于torch中的Tensor。

已完成

基本类

  • [x] Operation:用于支持基本的运算及对应的梯度计算,是支持自动微分的基本算子
  • [x] Tensor:
  • [x] Optimizer
  • [x] Module

Operation

  • [x] Assign、Add、Multiply、Subtract
  • [x] Divide、Negative、Positive、Power
  • [x] Exp、Log、Log2、Log10
  • [x] MatMul、EinSum

Optimizer

  • [x] sgd
  • [ ] adam

初始化方法

  • [x] Kaiming初始化
  • [ ] Xavier初始化
  • [ ] 随机初始化
  • [x] 填充0初始化
  • [x] 填充1初始化

Module

核心网络层

  • [x] Linear
  • [x] Relu、Sigmid、Softmax
  • [ ] Conv1D
  • [x] Conv2D
  • [ ] Conv3D
  • [ ] MaxPool1D
  • [x] MaxPool2D
  • [ ] MaxPool3D
  • [ ] BatchNorm1D
  • [x] BatchNorm2D
  • [ ] BatchNorm3D
  • [ ] Reshape
  • [ ] Permute
  • [ ] Flatten
  • [ ] RepeatVector
  • [ ] Lambda
  • [ ] ActivityRegularization
  • [ ] Masking
  • [ ] SpatialDropout1D
  • [ ] SpatialDropout2D
  • [ ] SpatialDropout3D

局部连接层和循环层

  • [ ] LocallyConnected1D
  • [ ] LocallyConnected2D
  • [ ] RNN
  • [ ] GRU
  • [ ] LSTM
  • [ ] ConvLSTM2D
  • [ ] SimpleRNNCell
  • [ ] GRUCell
  • [ ] LSTMCell
  • [ ] CuDNNGRU
  • [ ] CuDNNLSTM
  • [ ] Embedding