Course description
Transition from fully manual computer vision methods to the paradigm of feature point detection and image descriptors in conjunction with learnable classifiers. Visual tracking, motion model concept. Transition to the paradigm of learnable image descriptors and convolutional neural networks.
- Fundamentals of the human visual system and the difference between human vision and the classical computer vision methods.
- Image datasets and their use for the development and evaluation of modern computer vision algorithms.
- Feature point detectors and feature point and region descriptors. SIFT, HOG, MSER, COV, and others. Multiresolution approaches, scale space.
- Visual object detection and tracking, tracking with detection. Tracking within the framework of Bayesian sequential recursive filtering. Tracking with the Kalman filter.
- Convolutional neural networks, learnable methods for computing visual descriptors. Deep neural networks, their application in automation and robotics.
Course is carried out on study programme
2nd Cycle Postgraduate Study Programme in Electrical Engineering
Objectives and competences
The aims of this course are to cover selected existing and emerging topics in advanced computer vision, and to prepare students for teamwork, as well as independent work in research and development.
Learning and teaching methods
The lectures provide a theoretical background on particular subjects together with practical examples in Matlab and Python.
Practical work is being performed as the part of laboratory exercises, and is accomplished in the form of multiple assignments, acquainting students with computer vision algorithms. Students work in groups, consisting of two or three students, and the results are in the form of Matlab and Python code. After completing each part, students present their results to the assistant.
Homework project addresses the particular problem from the machine vision domain, either robot vision or industrial machine vision applications.
Intended learning outcomes
After successful completion of the course, the students should be able to:
- Explain the differences between human visual system and computer vision methods
- Decide, which of the advanced computer vision methods is appropriate for the problem at hand
- Implement modern computer vision algorithms
- Develop complex solutions for computer vision problems, made up of multiple advanced methods
- Judge the performance of computer vision methods on the available data
- Propose solutions to computer vision problems from the field of automation and robotics that require the use of the advanced and complex algorithms, including neural networks and other learnable algorithms.
Reference nosilca
- KOPOREC, Gregor, PERŠ, Janez. Human-centered deep compositional model for handling occlusions. Pattern recognition : the journal of the Pattern Recognition Society. [Print ed.]. 2023, vol. , [article no.] 109397, str. 1-44, ilustr. ISSN 0031-3203, DOI: 10.1016/j.patcog.2023.109397. [COBISS.SI-ID 142438403],
- BOVCON, Borja, MUHOVIČ, Jon Natanael, VRANAC, Duško, MOZETIČ, Dean, PERŠ, Janez, KRISTAN, Matej. MODS – a USV-oriented object detection and obstacle segmentation benchmark. IEEE transactions on intelligent transportation systems. [Print ed.]. Aug. 2022, vol. 23, iss. 8, str. 13403-13418, DOI: 10.1109/TITS.2021.3124192. [COBISS.SI-ID 84026883]
- MUHOVIČ, Jon Natanael, MANDELJC, Rok, BOVCON, Borja, KRISTAN, Matej, PERŠ, Janez. Obstacle tracking for unmanned surface vessels using 3-D point cloud. IEEE journal of oceanic engineering. [Print ed.]. 2019, vol. , str. 1-13, ilustr. ISSN 0364-9059. DOI: 10.1109/JOE.2019.2909507. [COBISS.SI-ID 12642388]
- KOPOREC, Gregor, VUČKOVIĆ, Goran, MILIĆ, Radoje, PERŠ, Janez. Quantitative contact-less estimation of energy expenditure from video and 3D imagery. Sensors. Aug. 2018, iss. 8, 4235, str. 1-32, ilustr. ISSN 1424-8220. http://www.mdpi.com/1424-8220/18/8/2435, DOI: 10.3390/s18082435. [COBISS.SI-ID 12120148]
- KRISTAN, Matej, SULIĆ KENK, Vildana, KOVAČIČ, Stanislav, PERŠ, Janez. Fast image-based obstacle detection from unmanned surface vehicles. IEEE transactions on cybernetics, ISSN 2168-2267, Mar. 2016, vol. 46, no. 3, pp. 641-654.
Study materials
- D. Forsyth, J. Ponce, Computer vision, a modern approach, 2nd ed., Pearson 2012.
- R. Szeliski, Computer vision, Algorithms and applications, Springer 2011.
- Temeljni članki, objavljeni v znanstvenih revijah (Basic scientific papers, published in scientific journals)