Setting Up Machine Learning Model

Note - These are my notes on DeepLearning Specialization Improving Deep Neural Networks (Week 1)

Setting up your machine Learning Application

Train / Dev / Test sets

Bias / Variance

Basic Recipe for Machine Learning

Regularizing your neural network


Why regularization reduces overfitting?

Dropout Regularization

Understanding Dropout

Other regularization methods

Setting up your optimization problem

Normalizing inputs

Vanishing / Exploding gradients

Weight Initialization for Deep Networks

Numerical approximation of gradients

Gradient Checking

Gradient Checking Implementation Notes

Credits to the teacher