Timeline History of Machine Learning
1950s
- Samuel’s Checker Player
- Selfridge’s Pandemonium
1960s
- Neural Networks: Perceptron
- Pattern Recognition
- Learning in the Limit Theory
- Minsky and Papert prove limitations of Perception
1970s
- Symbolic Concept Induction
- Winston’s Arch Learner
- Expert Systems and the Knowledge Acquisition Bottleneck
- Quinlan’s ID3
- Michalski’s AQ and Soybean Diagnosis
- Scientific Discovery with BACON
- Mathematical Discovery with AM
1980s
- Advanced Decision Tree and Rule Learning
- Explanation-based Learning (EBL)
- Learning and Planning and Problem Solving
- Utility Problem
- Analogy
- Cognitive Architectures
- Resurgence of Neural Networks (connectionism, backpropagation)
- Valiant’s PAC Learning Theory
- Focus on Experimental Methodology
1990s
- Data Mining
- Adaptive Software Agents and Web Applications
- Text Learning
- Reinforcement Learning (RL)
- Inductive Logic Programming (ILP)
- Ensembles: Bagging, Boosting, and Stacking
- Bayes Net Learning
2000s
- Support Vector Machines & Kernel Methods
- Graphical Models
- Statistical Relational Learning
- Transfer Learning
- Sequence Labeling
- Collective Classification and Structured Outputs
- Computer Systems Applications (Compilers, Debugging, Graphics, Surveys)
- E-mail management
- Personalized Assistants that Learn
- Learning in Robotics and Vision
2010s
- Deep learning systems
- Learning for Big Data
- Bayesian Methods
- Multi-task & Lifelong Learning
- Applications to Vision, Speech, Social networks, Learning to Read, etc.
- ???
