Numerical Linear Algebra

MATH66101 Numerical Linear Algebra 15 Semester 1 Postgraduate Taught Level 6 Francoise Tisseur Unit coordinator Department of Mathematics 1 FHEQ level (Framework for Higher Education Qualifications) ' Masters/Integrated Masters P4 ' European Credit Transfer & Accumulation System Rating : 7.5 This module treats the main classes of problems in numerical linear algebra: linear systems, least square problems, and eigenvalue problems, covering both dense and sparse matrices. It provides analysis of the problems along with algorithms for their solution. It also introduces MATLAB as tool for expressing and implementing algorithms and describes some of the key ideas used in developing high-performance linear algebra codes (blocking, BLAS). Applications will be introduced throughout the module. This module treats the main classes of problems in numerical linear algebra: linear systems, least square problems, and eigenvalue problems, covering both dense and sparse matrices. It provides analysis of the problems along with algorithms for their solution. It also introduces MATLAB as tool for expressing and implementing algorithms and describes some of the key ideas used in developing high-performance linear algebra codes (blocking, BLAS). Applications will be introduced throughout the module. To develop understanding of modern methods of numerical linear algebra for solving linear systems, least squares problems and the eigenvalue problem. On completion of the module, students will be able to <ul> <li> construct some key matrix factorizations using elementary transformations,</li> <li> choose an appropriate numerical method to solve systems, least squares problems, and the eigenvalue problem.</li> <li> evaluate and compare the efficiency and numerical stability of different algorithms for solving linear systems, least squares problems, and the eigenvalue problem.</li> <li> design algorithms that exploit matrix structures such as triangularity, sparsity, banded structure, and symmetric positive definiteness,</li> <li> quantify the sensitivity of a linear system or least squares problem to perturbations in the data.</li> </ul> <ul><li>Introduction. Summary/recap of basic concepts from linear algebra and numerical analysis: matrices, operation counts. [1 lecture]. Introduction to MATLAB. [2]. Matrix norms. Linear system sensitivity. [2]</li><li>Matrix factorizations. Cholesky factorization. QR factorization by Householder matrices and by Givens rotations. [5]. LU factorization and Gaussian elimination; partial pivoting. Error analysis. [2]. Block algorithms and their suitability for modern machine architectures. [1]. The BLAS and LAPACK. [1]</li><li>Linear systems. Solving triangular systems by substitution. Solving full systems by factorization. Application: Newton's method for nonlinear systems. [1]</li><li>Sparse and banded linear systems and iterative methods. LU factorization for banded and sparse matrices. Storage schemes. [1]. Iterative methods: Jacobi, Gauss-Seidel and SOR iterations. Krylov subspace methods, conjugate gradient method. Preconditioning. Application: differential equations. [4]</li><li>Linear least squares problem. Basic theory using singular value decomposition (SVD) and pseudoinverse. Perturbation theory. Numerical solution: normal equations. SVD and rank deficiency. Application: image deblurring. [5]</li><li>Eigenvalue problem. Basic theory, including perturbation results. Power method, inverse iteration. Similarity reduction. QR algorithm. Application: Google PageRank. [5]</li></ul> 1 Written exam 100% Feedback tutorials will provide an opportunity for students' work to be discussed and provide feedback on their understanding.  Coursework also provides an opportunity for students to receive feedback.  Students can also get feedback on their understanding directly from the lecturer, for example during the lecturer's office hour.   MATH11022 Linear Algebra Pre-Requisite Compulsory Students are not permitted to take, for credit, MATH46101 in an undergraduate programme and then MATH66101 in a postgraduate programme at the University of Manchester, as the courses are identical. N Further Reccomended ReadingDirect methods for sparse linear systems /    Davis, Timothy A.    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    2006    ISBN: 9780898718881 Applied numerical linear algebra /    Demmel, James W.    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    1997    ISBN: 9781611971446 Matrix computations    Golub, Gene H. (Gene Howard), 1932-2007, author.    Johns Hopkins University Press    2013    ISBN: 9781421407944 MATLAB guide    Higham, Desmond J., 1964-    Society for Industrial and Applied Mathematics    2016    ISBN: 9781611974652 Accuracy and stability of numerical algorithms /    Higham, Nicholas J.,    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    2002    ISBN: 9780898718027 Iterative methods for sparse linear systems /    Saad, Y.    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    2003    ISBN: 9780898718003 Introduction to matrix computations    Stewart, G. W. (Gilbert Wright)    Academic Press    1973    ISBN: 0126703507 Matrix algorithms. Volume 1, Basic decompositions /    Stewart, G. W.    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    1998    ISBN: 9781611971408 Matrix algorithms. Volume 2, Eigensystems /    Stewart, G. W.    Society for Industrial and Applied Mathematics (SIAM, 3600 Market Street, Floor 6, Philadelphia, PA 19104),    2001    ISBN: 9780898718058 Numerical linear algebra    Trefethen, Lloyd N. (Lloyd Nicholas)    Society for Industrial and Applied Mathematics    1997    ISBN: 0898713617 Fundamentals of matrix computations    Watkins, David S.    Wiley    2010    ISBN: 9780470528334   Lectures 11 Tutorials 11 0 128