Multivariate Statistics and Machine Learning

MATH38161 Multivariate Statistics and Machine Learning 10 Semester 1 Undergraduate Level 3 Nilabja Guha Unit coordinator Department of Mathematics 1 FHEQ level (Framework for Higher Education Qualifications) ' Last part of a Bachelors ' European Credit Transfer & Accumulation System Rating : 5.0 Multivariate statistical models and methods are essential for analysing complex-structured and possibly high-dimensional data from any areas of science and industry, ranging from biology and medicine, and genetics to finance and sociology. Multivariate statistics also provides the foundation of many machine learning algorithms.In the first part of this module covers the foundations of multivariate data analysis, e.g., multivariate random variables, covariance and correlation, and multivariate regression. In addition, related approaches such dimension reduction and latent variable models are discussed.The second part of the course is concerned with multivariate approaches for statistical learning in supervised and unsupervised settings, including techniques from machine learning, and their application in pattern recognition, classification, and high-dimensional data analysis. Multivariate statistical models and methods are essential for analysing complex-structured and possibly high-dimensional data from any areas of science and industry, ranging from biology and medicine, and genetics to finance and sociology. Multivariate statistics also provides the foundation of many machine learning algorithms.In the first part of this module covers the foundations of multivariate data analysis, e.g., multivariate random variables, covariance and correlation, and multivariate regression. In addition, related approaches such dimension reduction and latent variable models are discussed.The second part of the course is concerned with multivariate approaches for statistical learning in supervised and unsupervised settings, including techniques from machine learning, and their application in pattern recognition, classification, and high-dimensional data analysis. To familiarise students with the fundamental concepts and ideas underlying multivariate statistical data analysis methods and related supervised and unsupervised machine learning approaches for pattern recognition and classification, as well as with their practical implementation and application using the R statistical programming language. On successful completion of the course students will be able to: <ul> <li> use the programming language R for multivariate data analysis and graphical presentation</li> <li> apply dimension reduction techniques such as PCA and CCA</li> <li> perform clustering and classification using tools from both statistics and machine learning</li> <li> make good choices among available parametric and nonparametric approaches</li> <li> analyse high-dimensional data sets with suitable regularisation techniques</li> </ul> <ul> <li> Multivariate normal model: distributional properties, estimation of covariance and correlation matrix both in large and small sample settings (using likelihood and regularised/shrinkage estimation), connection with multivariate regression. [4]</li> <li> Dimension reduction and latent variable models: whitening transformations, Principle Components Analysis (PCA), Canonical Correlation Analysis (CCA), Factor Analysis (FA). [4]</li> <li> Unsupervised learning / clustering: model-based clustering (finite normal mixture models), algorithmic approaches (e.g. K-means, hierarchical clustering). [4]</li> <li> Supervised learning / classification: Diagonal, Linear, and Quadratic Discriminant Analysis (DDA, LDA, QDA) and regularised versions for high-dimensional data analysis.  Further approches to classification (eg support vector machines). [4]</li> <li> Nonlinear and Nonparametric models: splines, decision trees, random forest. [4]</li> </ul> 0 Other 30% 1 Written exam 70% <ul><li>Coursework: weighting 30%</li><li>End of semester examination: weighting 70%</li></ul> Computer labs will provide an opportunity for students to try out the methods on real data and to get feedback from the instructor. Coursework projects also provide an opportunity for students to receive feedback. Students can also get feedback on their understanding directly from the lecturer, for example during the lecturer's office hour or after class. MATH27720 Probability and Statistics 2 Pre-Requisite Compulsory MATH38161 Pre-Requisites: MATH27720DesirableGood working knowledge in the R statistical programming language.Students are not permitted to take more than one of MATH38161 or MATH48061 for credit in the same undergraduate year.  Students are not permitted to take MATH48061 and MATH68061 for credit in an undergraduate programme and then a postgraduate programme. N <ul> <li> Härdle, W.K., and L. Simar. 2015. Applied Multivariate Statistical Analysis. Fourth edition. Download within UoM from <a href="https://link.springer.com/book/10.1007/978-3-662-45171-7">https://link.springer.com/book/10.1007/978-3-662-45171-7</a></li> <li> Hastie, T., R. Tibshirani, and J. Friedman. 2009. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer. PDF freely available online from <a href="https://web.stanford.edu/~hastie/ElemStatLearn/">https://web.stanford.edu/~hastie/ElemStatLearn/</a></li> <li> James, G., D. Witten, T. Hastie and R. Tibshirani. 2013. An Introduction to Statistical Learning with Applications in R. Springer. PDF freely available online from <a href="http://www-bcf.usc.edu/~gareth/ISL/">http://www-bcf.usc.edu/~gareth/ISL/</a></li> </ul> Lectures 11 Tutorials 11 0 78