100 Days Challenge Day 2 - Backpropagation, Error Analysis, Bias and Variance

100 Days Challenge - Day 2.

Backpropagation, Algorithm Evaluation

Revised Week 5 and Week 6 of Andrew Ng's Machine Learning course on Coursera which I had already completed a few months ago.

Topics covered include:

Backpropagation

• Cost Function
• Algorithm

Algorithm Evaluation

• Model Selection
• Train/Test/Cross Validation Sets
• Bias and Variance
• Regularization and its Effects on Bias and Variance
• Learning Curves plotted against number of training examples, regularization parameter.

ML System Design

• What to Prioritize (Spam Classifier example)
• Error Analysis 
• Skewed Classes, Precision and Recall