Introduction to machine learning: What is learning, learning objectives, data needed.<\/p>\n\n\n\n
Bayesian inference and learning: Inference, na\u00efve Bayes.<\/p>\n\n\n\n
The basic objective of learning: Assumption of nearness and contiguity in input spaces, accuracy, Bayesian risk and casting of learning as Bayesian inference, Risk matrix, other cost measures<\/p>\n\n\n\n
Other issues in learning: Generalization and model complexity, Accuracy, Empirical risk and training, validation, and testing, Model complexity, Structural risk, number of free parameters vs. VC dimension, Bias-variance the tradeoff, Curse of dimensionality, Training sample size requirement, Convergence and training time, Memory requirement, Introduction to online\/incremental learning<\/p>\n\n\n\n
Objective functions for classification, regression, and ranking<\/p>\n\n\n\n
Some supervised learning formulations: Linear regression and LMS algorithm, Perceptron and logistic regression, Cybenko\u2019s theorem for nonlinear function estimation, MLP and backpropagation, introduction to momentum and quasi-Newton, L1-norm penalty and sparsity, SVM, support
vector regression, decision trees<\/p>\n\n\n\n
Kernelization of linear problems: RBF, increase in dimensionality through simple kernels, kernel definition and Mercer\u2019s theorem, Kernelized SVM and SVR, Other applications of kernelization, matching a kernel to a problem<\/p>\n\n\n\n
Role of randomization and model combination: Committees and random forests, boosting cascade of classifiers<\/p>\n\n\n\n
Some unsupervised learning machines: Clustering criteria, K-means, Fuzzy C-means, DB-scan, PDF estimation, Parzen window, EM-algorithm for a mixture of Gaussians<\/p>\n\n\n\n
Optional topics: Manifold learning, Kernel-PCA, semi-supervised learning, introduction to generative and probabilistic graphical models<\/p>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-global-header-display":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":""},"acf":[],"yoast_head":"\n