Statistical Machine Learning

MATH48292 Statistical Machine Learning 15 Semester 2 Undergraduate Level 4 Rendani Mbuvha Unit coordinator Thomas House Unit coordinator 1 FHEQ level (Framework for Higher Education Qualifications) ' Masters/Integrated Masters P4 ' European Credit Transfer & Accumulation System Rating : 7.5 An introduction to machine learning models and algorithms, both for unsupervised and supervised learning, with a focus on the underlying mathematical and statistical principles, while including some aspects of implementation and practice. Studying the relation of machine learning approaches with traditional statistical methods.  An introduction to machine learning models and algorithms, both for unsupervised and supervised learning, with a focus on the underlying mathematical and statistical principles, while including some aspects of implementation and practice. Studying the relation of machine learning approaches with traditional statistical methods.  The unit aims to:Provide an introduction to machine learning models and algorithms, both for unsupervised and supervised learning, with a focus on the underlying mathematical and statistical principles, while including some aspects of implementation and practice.  A further aim is to study the relation of machine learning approaches with traditional statistical methods.  On the successful completion of the course, students will be able to:<ol><li>Explain the principles underlying both probabilistic and algorithmic machine learning techniques</li><li>Select and identify appropriate methodology for data analysis at the interface of statistics and machine learning</li><li>Apply modern machine learning methods to supervised and unsupervised learning problems</li><li>Use R and/or Python to analyse data with the methods discussed in the course</li></ol> Part A - Nonlinear (non-neural network) machine learning approaches<ul><li>Limitations of traditional linear statistical models</li><li>Supervised Machine Learning:</li></ul>      -   K-nearest neighbours (including Bayesian KNN)      -   Decision trees and random forests<ul><li>Unsupervised Machine Learning:</li></ul>      -   Nonparametric clustering (e.g. Dirichlet process mixture models)      -   Topic models (e.g. Latent Dirichlet Allocation)      -   Dimensionality reduction including manifold learning (SNE, t-SNE) Part B - Nonlinear (neural network) machine learning approaches<ul><li>Single-layer neural networks and deep neural networks</li><li>Optimising neural networks (gradient descent, backpropagation)</li><li>Statistical properties (overparametrisation, regularisation, universal function approximation)</li><li>Standard models (e.g. multi-layer perceptron, convolutional networks, auto-encoders) and diverse data types (e.g. image data, time series, text data) </li></ul> Teaching is composed of two hours of lectures per week and one tutorial class per week. Teaching materials will be made available online for reference and review. One week is reserved for coursework. 0 Other 30% 1 Written exam 70% Other = coursework data analysis project, with a 30% weighting Generic feedback will be provided after marks are released.  MATH38161 Multivariate Statistics and Machine Learning Pre-Requisite Compulsory MATH48061 Multivariate Statistics Pre-Requisite Compulsory MATH27720 Probability and Statistics 2 Pre-Requisite Compulsory MATH27711 Linear Regression Models Pre-Requisite Compulsory MATH20802 Statistical Methods Pre-Requisite Compulsory MATH38141 Regression Analysis Pre-Requisite Compulsory MATH48292 Pre-Requisites: MATH27720 and MATH27711, and one of MATH38161 or MATH48061One of either MATH38161 Multivariate Statistics and Machine Learning or MATH48061 Multivariate Statistics required as a pre-requisite. N C. M. Bishop and H. Bishop. 2024.  Deep learning: Foundations and concepts. Springer.https://link.springer.com/book/10.1007/978-3-031-45468-4   G. James et al. 2021. An introduction to statistical learning with applications in R (2nd edition). Springer.https://link.springer.com/book/10.1007/978-1-0716-1418-1   G. James et al. 2023. An introduction to statistical learning with applications in Python. Springer.https://link.springer.com/book/10.1007/978-3-031-38747-0  https://www.statlearning.com/   K. P. Murphy. 2022. Probabilistic machine learning: An introduction. MIT Press.https://mitpress.mit.edu/9780262046824/probabilistic-machine-learning/  https://probml.github.io/pml-book/book1.html   A. Zhang et al. 2024. Dive into deep learning. Cambridge University Press.https://d2l.ai/    Lectures 22 Practical classes & workshops 12 0 116