Course Content Deep Learning Understanding Nervous System for Neural Networks Understanding Perceptron Training a Single Perceptron Back Propagation Multi-layer Perceptron Neural Network Training Multi-layer Perceptron Back Propagation Sigmoid and Tanh Activation Functions The Power of Neural Network How it Provide Nonlinearity Relu Leaky Relu and Swish Activation Functions Convex Non-Convex Functions and Contour for Neural Network Saddle Point in Neural Network Problem with SGD in Neural Network Exponential Weighted Average SGD with Momentum Optimizer Ada Grad and Ada Delta Optimizer Adam Optimizer for Neural Network How Normalization Helps Gradient Descent Scaling and Shifting For Batch Normalization Need of Batch Normalization How Batch Normalization Implemented Regularization in Neural Network 11 of 13
