In this episode, we explain the proper semantic interpretation of the Akaike Information Criterion (AIC) and the Generalized Akaike Information Criterion (GAIC) for the purpose of picking the best model for a given set of training data. The precise semantic interpretation of these model selection criteria is provided, explicit assumptions are provided for the AIC and GAIC to be valid, and explicit formulas are provided for the AIC and GAIC so they can be used in practice. Briefly, AIC and GAIC provide a way of estimating the average prediction error of your learning machine on test data without using test data or cross-validation methods. The GAIC is also called the Takeuchi Information Criterion (TIC).
LM101-026: How to Learn Statistical Regularities (Rerun)
LM101-025: How to Build a Lunar Lander Autopilot Learning Machine
LM101-024: How to Use Genetic Algorithms to Breed Learning Machines
LM101-023: How to Build a Deep Learning Machine
LM101-022: How to Learn to Solve Large Constraint Satisfaction Problems
LM101-021: How to Solve Large Complex Constraint Satisfaction Problems (Monte Carlo Markov Chain)
LM101-020: How to Use Nonlinear Machine Learning Software to Make Predictions
LM101-019 (Rerun): How to Enhance Intelligence with a Robotic Body (Embodied Cognition)
LM101-018: Can Computers Think? A Mathematician's Response (Rerun)
LM101-017: How to Decide if a Machine is Artificially Intelligent (Rerun)
LM101-016: How to Analyze and Design Learning Rules using Gradient Descent Methods
LM101-015: How to Build a Machine that Can Learn Anything (The Perceptron)
LM101-014: How to Build a Machine that Can Do Anything (Function Approximation)
LM101-013: How to Use Linear Machine Learning Software to Make Predictions (Linear Regression Software)
LM101-012: How to Evaluate the Ability to Generalize from Experience (Cross-Validation Methods)
LM101-008: How to Represent Beliefs Using Probability Theory
LM101-011: How to Learn About Rare and Unseen Events (Smoothing Probabilistic Laws)
LM101-010: How to Learn Statistical Regularities (MAP and maximum likelihood estimation)
LM101-009: How to Enhance Intelligence with a Robotic Body (Embodied Cognition)
LM101-007: How to Reason About Uncertain Events using Fuzzy Set Theory and Fuzzy Measure Theory
Create your
podcast in
minutes
It is Free
Insight Story: Tech Trends Unpacked
Zero-Shot
Fast Forward by Tomorrow Unlocked: Tech past, tech future
The Unbelivable Truth - Series 1 - 26 including specials and pilot
Acquired