Course description
Introduction (extended, mixed, augmented, and virtual reality); Human factors (visual, acoustic, haptic and vestibular perceptions, motor system); Kinematics and dynamics of virtual environment (motion, deformation, collision detection, virtual environment modelling); Motion tracking (user’s pose and motion tracking, measurement of interaction forces, environment sensing); Interaction (manipulation of objects, virtual navigation, interaction with other users); Visual modality (graphical modelling, animation, visual rendering , 3D displays); Acoustic modality (acoustics, surround sound, audio rendering); Haptic modality (kinaesthetic and tactile haptic interfaces, haptic rendering); Cooperation and interaction in multi-user virtual environments; Presence (mental and physical immersion and presence, creating conditions for presence, measuring presence); Augmented reality (blending of information from the real and virtual worlds),Use of virtual reality in industrial and medical applications, education and design.
Course is carried out on study programme
Electrical engineering 1st level
Objectives and competences
The course addresses the interaction between a human and a computer-generated virtual environment. It analyzes physical background, technological challenges as well as opportunities and constraints related to the construction of multimodal virtual and augmented environments. The emphasis is on concepts necessary for understanding virtual environments and user’s responses to synthetic visual, auditory and haptic stimuli. Students acquire practical knowledge in the laboratory while completing interdisciplinary research projects.
Learning and teaching methods
Students have access to a book with the course content. In the lectures, the emphasis is on theoretical basics of multimodal virtual environments. Due to the specificity of the course, lectures are mostly conducted with the help of multimedia presentations. Latest developments in the field of virtual environments are presented in the form of “video lectures". Practical exercises are conducted in the laboratory, which is equipped with a number of different haptic robots, surround sound systems and 3D stereoscopic graphical displays. Students work in interdisciplinary project teams, where each student engages in a particular modality of virtual environment.
Intended learning outcomes
After successful completion of the course, students should be able to:
– explain human perceptions of visual, acoustic, tactile and kinesthetic stimuli,
– analyze human movements based on different measurement systems,
– synthesize visual, acoustic and haptic stimuli,
– select appropriate displays for presenting visual, acoustic and haptic feedback to a person,
– integrate synthesized stimuli into multimodal virtual environments that allow user’s physical and mental immersion,
– upgrade the virtual reality into augmented reality,
– use computer tools for implementation of virtual or augmented reality applications,
– develop practical applications based on virtual or augmented reality (extended reality).
Reference nosilca
- M. Mihelj, D. Novak, S. Beguš, Virtual Reality Technology and Applications, Springer, 2013.
- M. Mihelj, J. Podobnik, Haptics for Virtual Reality and Teleoperation, Springer, 201
-
MIHELJ, Matjaž, PODOBNIK, Janez, MUNIH, Marko. Sensory fusion of magnetoinertial data based on kinematic model with Jacobian weighted-left-pseudoinverse and Kalman-adaptive gains. IEEE transactions on instrumentation and measurement. Jul. 2019, vol. 68, no. 7, str. 2610-2620.
-
ŠLAJPAH, Sebastjan, ČEBAŠEK, Eva, MUNIH, Marko, MIHELJ, Matjaž. Time-based and path-based analysis of upper-limb movements during activities of daily living. Sensors. Feb.-1 2023, vol. 23, iss. 3, 1289, str. 1-20.
-
TAVČAR, Rok, DRNOVŠEK, Janko, BOJKOVSKI, Jovan, BEGUŠ, Samo. Optimization of a single tube practical acoustic thermometer. Sensors. 1 Mar. 2020, iss. 5, 1529, str. 1-19.
Study materials
- M. Mihelj, D. Novak, S. Beguš, D. Fefer: Navidezna resničnost, Založba FE in FRI, 2014 (digitalna verzija).
- M. Mihelj, D. Novak, S. Beguš, Virtual Reality Technology and Applications, Springer, 2013.
- A. Grasnick, Basics of Virtual Reality, Springer, 2021.
- W. Sherman, A. B. Craig, Understanding Virtual Reality, Morgan Kaufmann, 2003.
- A. B. Craig, Understanding Augmented Reality, Morgan Kaufmann, 2013.
- D. Schmalstieg, T. Höllerer, Augmented Reality, Addison-Wesley, 2016.