Advanced Topics in Machine Learning

COMP64802 Advanced Topics in Machine Learning 15 Semester 2 Postgraduate Taught Level 6 Anirbit Mukherjee Unit coordinator 1 FHEQ level (Framework for Higher Education Qualifications) ' Masters/Integrated Masters P4 ' European Credit Transfer & Accumulation System Rating : 7.5 A key property of real-world data is that it is often presented in large dimensions and yet many of its relevant properties can be encoded in much lower dimensions. The ability to find such low dimensional representation of data can hugely aid the feasibility of the downstream Machine Learning (ML) tasks that one might want to accomplish using it. Further, real-world data is often unlabelled. In this module we will learn to discover such efficient representations of unlabelled data and learn how it can be leveraged to extract insights.  A property of real-world data is that it is often presented as high-dimensional vectors and yet many of its relevant properties can be encoded in vectors of much lower dimensions. It's not uncommon for these two dimensions to be separated by factor(s) of ten. The ability to find such low dimensional representations of data can hugely aid the time and memory efficiency or even the feasibility of the downstream Machine Learning (ML) tasks that one might want to accomplish using the data. One such task that informs this course is being able to learn the distribution from which the training data would have been sampled – and such distribution learning is a key component of the modern pursuit of generative AI.   This course unit focuses on: (a) methods which enable the discovery of low dimensional representations of data; and (b) being able to leverage the low dimensional representations for distribution learning. Given that both these goals are accomplished using unlabelled data (as is most natural in the real world), this course also serves as a window into the exciting world of unsupervised learning.  There are two primary aims of this module (a) to introduce the students to thinking systematically about unsupervised machine learning with high-dimensional data and (b) to get the students become familiar with implementing on modern software some of the classical algorithms of this type.  <ol><li>Describe the fundamental concepts of unsupervised learning and in particular the methods of detecting effective low dimensional descriptions of data, if such exist.    </li><li>Analyze the differences between the methods and utility of various ML methods that detect effective low dimensional structure in data.  </li><li>Explain the models and training algorithms used to implement a (Variational)Auto-Encoder (V)AE.   </li><li>Apply different dimension reduction methods in a judicious way depending on the data and the need.   </li><li>Implement different unsupervised ML methods in standard ML-specific software.   </li></ol> Analytical skills Innovation/creativity Problem solving Written communication <ul><li>Principal Component Analysis (and its variants)</li><li>Spectral Clustering</li><li>Dimension Reduction  </li><li>Boltzmann Machines</li><li>(Variational) Auto-Encoders  </li></ul> <ul><li>Asynchronous material in the form of video lectures, formative exercises, lecture slides and code examples delivered via the virtual learning environment, lectures and supported tutorials.    </li><li>Weekly lectures consolidating asynchronous materials and providing opportunities for discussion and questions.    </li><li>Weekly supervised lab sessions provide support for coursework and formative exercises.   </li></ul> 0 Other 50% 1 Written exam 50% Other: Coursework (50%)    <ul><li>Individual feedback would be available on request when coursework scores are released.    </li><li>Cohort level feedback will be available for the final exam, after marking.  </li></ul> COMP64501 Topics in Machine Learning Pre-Requisite Recommended Y “Introduction to Statistical Learning”,  G. James, D. Witten, T. Hastie, R. Tibshirani, Springer, 2023.    “Probabilistic Machine Learning: Advanced Topics”,   K.P. Murphy, MIT Press, 2023.  Assessment written exam 2 Lectures 10 Tutorials 20 0 118 Students are expected to spend 20 hours on Coursework.