Module A: Virtual and Augmented Reality

Subject description

Introduction (extended, mixed, augmented, and virtual reality); Human factors (visual, acoustic, haptic and vestibular perceptions, motor system); Kinematics and dynamics of virtual environment (motion, deformation, collision detection, virtual environment modelling); Motion tracking (user’s pose and motion tracking, measurement of interaction forces, environment sensing); Interaction (manipulation of objects, virtual navigation, interaction with other users); Visual modality (graphical modelling, animation, visual rendering , 3D displays); Acoustic modality (acoustics, surround sound, audio rendering); Haptic modality (kinaesthetic and tactile haptic interfaces, haptic rendering); Cooperation and interaction in multi-user virtual environments; Presence (mental and physical immersion and presence, creating conditions for presence, measuring presence); Augmented reality (blending of information from the real and virtual worlds),Use of virtual reality in industrial and medical applications, education and design.

The subject is taught in programs

Electrical engineering 1st level

Objectives and competences

The course addresses the interaction between a human and a computer-generated virtual environment. It analyzes physical background, technological challenges as well as opportunities and constraints related to the construction of multimodal virtual and augmented environments. The emphasis is on concepts necessary for understanding virtual environments and user’s responses to synthetic visual, auditory and haptic stimuli. Students acquire practical knowledge in the laboratory while completing interdisciplinary research projects.

Teaching and learning methods

Students have access to a book with the course content. In the lectures, the emphasis is on theoretical basics of multimodal virtual environments. Due to the specificity of the course, lectures are mostly conducted with the help of multimedia presentations. Latest developments in the field of virtual environments are presented in the form of “video lectures". Practical exercises are conducted in the laboratory, which is equipped with a number of different haptic robots, surround sound systems and 3D stereoscopic graphical displays. Students work in interdisciplinary project teams, where each student engages in a particular modality of virtual environment.

Expected study results

After successful completion of the course, students should be able to:

– explain human perceptions of visual, acoustic, tactile and kinesthetic stimuli,

– analyze human movements based on different measurement systems,

– synthesize visual, acoustic and haptic stimuli,

– select appropriate displays for presenting visual, acoustic and haptic feedback to a person,

– integrate synthesized stimuli into multimodal virtual environments that allow user’s physical and mental immersion,

– upgrade the virtual reality into augmented reality,

– use computer tools for implementation of virtual or augmented reality applications,

– develop practical applications based on virtual or augmented reality (extended reality).

Basic sources and literature

M. Mihelj, D. Novak, S. Beguš, D. Fefer: Navidezna resničnost, Založba FE in FRI, 2014 (digitalna verzija).
M. Mihelj, D. Novak, S. Beguš, Virtual Reality Technology and Applications, Springer, 2013.
A. Grasnick, Basics of Virtual Reality, Springer, 2021.
W. Sherman, A. B. Craig, Understanding Virtual Reality, Morgan Kaufmann, 2003.
A. B. Craig, Understanding Augmented Reality, Morgan Kaufmann, 2013.
D. Schmalstieg, T. Höllerer, Augmented Reality, Addison-Wesley, 2016.