Introduction to Visual Computing

COMP27112 Introduction to Visual Computing 10 Semester 2 Undergraduate Level 2 Terence Morley Unit coordinator Department of Computer Science 1 FHEQ level (Framework for Higher Education Qualifications) ' Middle part of Bachelors ' European Credit Transfer & Accumulation System Rating : 5.0 The field of Visual Computing brings together two fundamentally important aspects of modern computing: Computer Graphics - concerned with the synthesis of images from computer models - and Image Processing, which deals with analysis and understanding of images by computers. There are now considerable overlaps between these two, traditionally separate, fields of research and their applications.The Visual Computing theme consists of the following course units:•    Year 2: Introduction to Visual Computing (Computer Graphics and Image Processing) (10 credits)•    Year 3: Graphics & Virtual Environments (10 credits)•    Year 3: Computer Vision (10 credits)The second-year Introduction to Visual Computing unit covers the following topics.Image Transformations (2 weeks)Image representations: resolution, colour models. Image transformations: point transformations (brightness, contrast, grey-level mapping, windowing, colour transformations and colour spaces) and geometrical transformations (including camera calibration). This part also describes some of the history and applications of image processing.Image Enhancement (3 weeks)Local processes, convolution, image smoothing (local averaging, weighted averaging), size of support, Gaussian mask. Edge enhancement (sharpening). Edge detection (Prewitt, Sobel, Canny, Marr-Hildreth), Line detection (Hough transform). Thresholding, blob detection, simple measurement (geometrical features such as perimeter and area). Rank order filters (median, max-min). This part also describes image file formats, camera exposure and image compression.Fundamentals (1 week)2 and 3 D Coordinate systems. Vectors, matrices and basic vector/matrix operations. 2 and 3D geometric transformations (translation, rotation, scaling, affine).3D Modelling and Illumination (4 weeks)The programmable graphics pipeline. 3D graphics primitives, meshes, models, and scene graphs. Rasterisation and hidden surface removal. The camera model, viewing and projection. Local illumination: ambient, diffuse, specular. Gouraud and Phong shading. Writing shaders with GLSL. Surface detail: textures, bump mapping.  The field of Visual Computing brings together two fundamentally important aspects of modern computing: Computer Graphics - concerned with the synthesis of images from computer models - and Image Processing, which deals with analysis and understanding of images by computers. There are now considerable overlaps between these two, traditionally separate, fields of research and their applications.The Visual Computing theme consists of the following course units:•    Year 2: Introduction to Visual Computing (Computer Graphics and Image Processing) (10 credits)•    Year 3: Graphics & Virtual Environments (10 credits)•    Year 3: Computer Vision (10 credits)The second-year Introduction to Visual Computing unit covers the following topics.Image Transformations (2 weeks)Image representations: resolution, colour models. Image transformations: point transformations (brightness, contrast, grey-level mapping, windowing, colour transformations and colour spaces) and geometrical transformations (including camera calibration). This part also describes some of the history and applications of image processing.Image Enhancement (3 weeks)Local processes, convolution, image smoothing (local averaging, weighted averaging), size of support, Gaussian mask. Edge enhancement (sharpening). Edge detection (Prewitt, Sobel, Canny, Marr-Hildreth), Line detection (Hough transform). Thresholding, blob detection, simple measurement (geometrical features such as perimeter and area). Rank order filters (median, max-min). This part also describes image file formats, camera exposure and image compression.Fundamentals (1 week)2 and 3 D Coordinate systems. Vectors, matrices and basic vector/matrix operations. 2 and 3D geometric transformations (translation, rotation, scaling, affine).3D Modelling and Illumination (4 weeks)The programmable graphics pipeline. 3D graphics primitives, meshes, models, and scene graphs. Rasterisation and hidden surface removal. The camera model, viewing and projection. Local illumination: ambient, diffuse, specular. Gouraud and Phong shading. Writing shaders with GLSL. Surface detail: textures, bump mapping.  The importance of visual interfaces has never been greater. Graphical interfaces have become ubiquitous, from desk-top interaction, to games and three-dimensional virtual environments. In parallel, there has been an explosion in digital image processing and analysis. We take for granted digital photography and video, while our health services rely on digital X-ray systems, CT and MRI scanners for seeing inside our bodies. Meanwhile, the visualization of computer simulations is an essential aspect of product design and testing, genome exploration, drug design, and climate modelling. The demand for computer scientists with advanced knowledge of such areas has never been greater. The theme will enhance your knowledge and understanding, answering such questions as: How are three-dimensional environments represented in a computer, and how are interactive 3D worlds created? How are 2D and 3D representations combined? For example, how can we recover 3D geometry from 2D images? How are the basic mathematical techniques and algorithms used to build useful applications? How are images stored, processed and manipulated? How can computers interpret images captured by cameras and other recording devices?  ILO 1: Apply the mathematics of 3D transformations and viewingILO 2: Design systems using programmable-pipeline WebGLILO 3: Design image processing pipelines to connect together multiple image processing techniques for a desired applicationILO 4: Describe the principles of interactive computer graphicsILO 5: Implement fundamental computer graphics algorithms (using three.js)ILO 6: Implement fundamental image processing algorithms (using C/C++ and the popular OpenCV library)ILO 7: Describe the principles of image processingILO 8: Describe the principles of the rendering pipeline Analytical skills Innovation/creativity Project management Problem solving The field of Visual Computing brings together two fundamentally important aspects of modern computing: Computer Graphics - concerned with the synthesis of images from computer models - and Image Processing, which deals with analysis and understanding of images by computers. There are now considerable overlaps between these two, traditionally separate, fields of research and their applications.The Visual Computing theme consists of the following course units:•    Year 2: Introduction to Visual Computing (Computer Graphics and Image Processing) (10 credits)•    Year 3: Graphics & Virtual Environments (10 credits)•    Year 3: Computer Vision (10 credits)The second-year Introduction to Visual Computing unit covers the following topics.Image Transformations (2 weeks)Image representations: resolution, colour models. Image transformations: point transformations (brightness, contrast, grey-level mapping, windowing, colour transformations and colour spaces) and geometrical transformations (including camera calibration). This part also describes some of the history and applications of image processing.Image Enhancement (3 weeks)Local processes, convolution, image smoothing (local averaging, weighted averaging), size of support, Gaussian mask. Edge enhancement (sharpening). Edge detection (Prewitt, Sobel, Canny, Marr-Hildreth), Line detection (Hough transform). Thresholding, blob detection, simple measurement (geometrical features such as perimeter and area). Rank order filters (median, max-min). This part also describes image file formats, camera exposure and image compression.Fundamentals (1 week)2 and 3 D Coordinate systems. Vectors, matrices and basic vector/matrix operations. 2 and 3D geometric transformations (translation, rotation, scaling, affine).3D Modelling and Illumination (4 weeks)The programmable graphics pipeline. 3D graphics primitives, meshes, models, and scene graphs. Rasterisation and hidden surface removal. The camera model, viewing and projection. Local illumination: ambient, diffuse, specular. Gouraud and Phong shading. Writing shaders with GLSL. Surface detail: textures, bump mapping.  Lectures24 hours spread over 12 weeksLaboratories10 hours in total, 5 2-hour sessions.<div>Three.js laboratory exercises. </div><div>C Programming, manipulating images and finding objects using OpenCV.</div><div> </div><div> </div> 1 Written exam 70% 8 Practical skills assessment 30% Face to face feedback and marking  in programming laboratories.<div>Three.js laboratory exercises. </div><div>C Programming, manipulating images and finding objects using OpenCV.</div>Workshop: 10 hoursDemonstration: 10 hoursPractical: 20 hoursLecture: 20 hoursIndependent Study: 40 hours <div> </div><div> </div> Students who are not from the School of Computer Science must have permission from both Computer Science and their home School to enrol. Y <ol><li>Angel, Edward. (2015). Interactive computer graphics : a top-down approach with WebGL. Pearson Education Limited. ISBN:<a href="https://www.librarysearch.manchester.ac.uk/discovery/search?query=isbn,contains,9781292019338&search_scope=MyInst_and_CI&sortby=rank&vid=44MAN_INST:MU_NUI&lang=en&mode=advanced&offset=0" target="_blank"> 9781292019338</a>  </li><li>Morris, Tim. (2004). Computer vision and image processing. Palgrave Macmillan. ISBN:<a href="https://www.librarysearch.manchester.ac.uk/discovery/search?query=isbn,contains,0333994515&search_scope=MyInst_and_CI&sortby=rank&vid=44MAN_INST:MU_NUI&lang=en&mode=advanced&offset=0" target="_blank"> 0333994515 </a></li></ol> Demonstration 10 Lectures 20 Practical classes & workshops 30 0 40