Commit 1ccf9fd
committed
Refactor neural network training and initialization
- Updated the optimizer to include SGDMomentum with momentum support.
- Enhanced the DenseLayer to accept weight and bias initializers.
- Introduced various initializers: Constant, HeNormal, XavierUniform, and Zeros.
- Modified the CPU and GPU backends to support random normal initialization.
- Adjusted the neural network serialization to accommodate new layer structures.
- Updated integration tests to validate changes in optimizer and layer initialization.1 parent 625042f commit 1ccf9fd
19 files changed
Lines changed: 516 additions & 274 deletions
File tree
- examples/mnist
- src
- backend
- cpu
- gpu
- initializer
- layer
- optimizer
- serialization
- train
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
38 | 39 | | |
39 | 40 | | |
40 | 41 | | |
41 | | - | |
| 42 | + | |
42 | 43 | | |
43 | 44 | | |
44 | 45 | | |
| |||
111 | 112 | | |
112 | 113 | | |
113 | 114 | | |
114 | | - | |
115 | | - | |
| 115 | + | |
| 116 | + | |
116 | 117 | | |
117 | 118 | | |
118 | 119 | | |
| |||
0 commit comments