Shai Ben-David, Professor at the University of Waterloo, gave Machine Learning Course composed of 23 Lectures (CS 485/685) at the University of Waterloo on Jan 14, 2015.
Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI.
Shai Ben-David holds a PhD in mathematics from the Hebrew University is Jerusalem. He has held postdoctoral positions at the University of Toronto in both the Mathematics and CS departments. He was a professor of computer science at the Technion in Haifa, Israel. Ben-David has held visiting positions at the Australian National University and Cornell University, and since 2004 has been a professor of computer science at the University of Waterloo in Canada.
His research interests are in CS theory and machine learning. He has been program chair for COLT and ALT (the two main annual machine learning conferences), and also served long terms on their steering committees. Ben-David has also been an area chair and senior program committee member for ICML and NIPS (the two major general machine learning conferences)
Machine Learning Course- Shai Ben-David: Lecture 1
Introduction: What is machine learning? and an outline of the course.
Machine Learning Course- Shai Ben-David: Lecture 2
First formal learnability theorem: Assuming realizability, ERM is guaranteed to succeed over finite classes.
Machine Learning Course- Shai Ben-David: Lecture 3
The basic definitions of learnability of a class H: PAC learnability and Agnostic PAC learnability.
Machine Learning Course- Shai Ben-David: Lecture 4
Extensions of the definition of PAC learnability to various more realistic scenarios. The basic notion of representative samples
Machine Learning Course – Shai Ben-David : Lecture 5 by Mohammad-Hassan Zokaei Ashtiani
Proving that every finite class is Agnostically PAC learnable.
Machine Learning Course – Shai Ben-David : Lecture 6 by Mohammad-Hassan Zokaei Ashtiani
Learnability of the class of threshold functions and the No-Free-Lunch theorem
Machine Learning Course- Shai Ben-David: Lecture 7
Introducing the VC-dimension.
Machine Learning Course- Shai Ben-David: Lecture 8
The relationship of VC dimension and learning: Statement of the “fundamental theorem of statistical machine learning” and a proof of the non-learnability of classes of infinite VC-dimension.
Machine Learning Course- Shai Ben-David: Lecture 9
The VC dimension of Linear predictors and the quantitative version of the fundamental theorem (how the VC dimension determines the sample complexity of learning)
Machine Learning Course- Shai Ben-David: Lecture 10
Lower bounding the sample complexity of learning in terms of the VC-dimension and the desired accuracy
Machine Learning Course- Shai Ben-David: Lecture 11
The Sauer Lemma: Proof and its relevance to sample complexity.
Machine Learning Course- Shai Ben-David: Lecture 12
A more realistic notion – Non-uniform learnability
Machine Learning Course- Shai Ben-David: Lecture 13
VCdim-based characterization of non-uniform learnability
Machine Learning Course- Shai Ben-David: Lecture 14
VCdim-based characterization of non-uniform learnability
Machine Learning Course- Shai Ben-David: Lecture 15
The Consistency version of learning, and defining the computational complexity of learning.
Machine Learning Course- Shai Ben-David: Lecture 16
Computational complexity: Examples of (provably) computationally efficient learning
Machine Learning Course- Shai Ben-David: Lecture 17
Machine Learning Course- Shai Ben-David: Lecture 18
The AdaBoost algorithm
Machine Learning Course- Shai Ben-David: Lecture 19
Analyzing and applying AdaBoost
Machine Learning Course- Shai Ben-David: Lecture 20
Convexity of sets and functions
Machine Learning Course- Shai Ben-David: Lecture 21
convex optimization problems, learning and convex loss functions
Machine Learning Course- Shai Ben-David: Lecture 22
Machine Learning Course- Shai Ben-David: Lecture 23
Last lecture – Support Vector Machines
