Course description
Visual perception: light, human vision, cameras, illumination, image quality parameters, sampling and quantization, visualization, image formats and standards.
Digital image processing and restoration: smoothing and sharpening, statistical and morphological filtering, image resampling, geometrical transformations and registrations.
Robust recognition of 2D objects: keypoints, lines, circles, and template detectors, 3D model alignment to 2D images, basics of unsupervised and supervised object detection. Solution in case of partial object occlusion in the image.
Calibration of imaging systems: distortions of real optical systems, accuracy and precision, spatial homogeneity, temporal stability, self-calibration.
3D object reconstruction: review of techniques for depth perception from 2D images, concepts of systems and methods for stereo vision, structured light and photometric stereo.
Visual navigation: concepts of methods for image-based object tracking and motion analysis, pose estimation, and object localization and environment mapping from 2D images.
Applications of robot vision: visual quality control, product sorting, object and obstacle detection, modelling of object shape and appearance, motion trajectory planning.
Course is carried out on study programme
2nd Cycle Postgraduate Study Programme in Electrical Engineering
Objectives and competences
The objective of this course is: to introduce the principal building blocks of a robot vision system and the associated fundamental problems; to introduce the main concepts and techniques used to solve those problems; to enable students to create robot vision systems and implement problem solutions; to enable students to understand the basic methodology discussed in the robot vision literature.
Learning and teaching methods
Theoretical foundations, concepts and exemplar use cases are given during lectures, while practical skills are gained through lab works, weekly labwork assignements and an individual seminar work.
Intended learning outcomes
After successful completion of the course, students should be able to:
- list the technologies and main building blocks of robot vision systems, and understand and be able to critically assess and compare their key features,
- develop and use method for basic image processing and analysis,
- detect objects and their pose in the image using automated methods,
- perform system calibration and conduct object measurements,
- compute depth and shape of an object from 2D images,
- track object motion in the image, analyse its trajectory and use this data for selflocalization and environment mapping, and
- design a robot vision system by defining, assembling and using all vital hardware and software components.
Reference nosilca
- ŠPICLIN, Žiga, LIKAR, Boštjan, PERNUŠ, Franjo. Groupwise registration of multi-modal images by an efficient joint entropy minimization scheme. IEEE Tr on Image Processing, 2012, vol. 21, no. 5, str. 2546-2558.
- GALIMZIANOVA, Alfiia, PERNUŠ, Franjo, LIKAR, Boštjan, ŠPICLIN, Žiga. Robust estimation of unbalanced mixture models on samples with outliers. IEEE Tr Pattern Analysis and Machine Intelligence, 2015, vol. 37, no. 11, str. 2273-2285.
- JERMAN, Tim, PERNUŠ, Franjo, LIKAR, Boštjan, ŠPICLIN, Žiga. Blob enhancement and visualization for improved intracranial aneurysm detection. IEEE Tr on Visualization and Computer Graphics, 2016, vol. 22, no. 6, str. 1705-1717.
- JERMAN, Tim, PERNUŠ, Franjo, LIKAR, Boštjan, ŠPICLIN, Žiga. Enhancement of vascular structures in 3D and 2D angiographic images. IEEE Tr on Medical Imaging, 2016, vol. 35, no. 9, str. 2107-2118.
- MADAN, Hennadii, PERNUŠ, Franjo, LIKAR, Boštjan, ŠPICLIN, Žiga. A framework for automatic creation of gold-standard rigid 3D-2D registration datasets. International Journal of Computer Assisted Radiology and Surgery, 2017, vol. 12, no. 2, str. 263-275.
Study materials
- Wilhelm Burger in Mark J. Burge. Principles of Digital Image Processing: Fundamental Techniques, Springer, 2009.
- Wilhelm Burger in Mark J. Burge. Principles of Digital Image Processing: Core Algorithms, Springer; 1st Edition. 2nd Printing, 2011.
- Reinhard Klette. Concise Computer Vision: An Introduction to Theory and Algorithms, Springer, 2014.
- Richard Szeliski. Computer Vision: Algorithms and Applications, Springer; 2011 edition, 2010.
- Predstavitev in informacije na spletni strani http://lit.fe.uni-lj.si/RV, navodila za vaje in ostala gradiva v spletni učilnici FE: https://e.fe.uni-lj.si