An implementation of a vanilla Multi-Layer-Perceptron from scratch with numpy which i wrote while in highschool
This includes implementation of optimizers including:
- SGD
- Momentum
- Nesterov
- Adam
Additionally a custom forward-mode differentiation is implemented for all components.
The whole system is benchmarked on the MNIST dataset.