Introduction
Part I: Foundations
A gentle start
A formal learning model
Learning via uniform convergence
The bias-complexity trade-off
The VC-dimension
Non-uniform learnability
The runtime of learning
Part II: From Theory to Algorithms
Linear predictors
Boosting
Model selection and validation
Convex learning problems
Regularization and stability
Stochastic gradient descent
Support vector machines
Kernel methods
Multiclass, ranking, and complex prediction problems
Decision trees
Nearest neighbor
Neural networks
Part III: Additional Learning Models
Online learning
Clustering
Dimensionality reduction
Generative models
Feature selection and generation
Part IV: Advanced Theory
Rademacher complexities
Covering numbers
Proof of the fundamental theorem of learning theory
Multiclass learnability
Compression bounds
PAC-Bayes
Appendices
Technical lemmas
Measure concentration
Linear algebra