Module A: Virtual and Augmented Reality

Introduction (extended, mixed, augmented, and virtual reality); Human factors (visual, acoustic, haptic and vestibular perceptions, motor system); Kinematics and dynamics of virtual environment (motion, deformation, collision detection, virtual environment modelling); Motion tracking (user’s pose and motion tracking, measurement of interaction forces, environment sensing); Interaction (manipulation of objects, virtual navigation, interaction with other users); Visual modality (graphical modelling, animation, visual rendering , 3D displays); Acoustic modality (acoustics, surround sound, audio rendering); Haptic modality (kinaesthetic and tactile haptic interfaces, haptic rendering); Cooperation and interaction in multi-user virtual environments; Presence (mental and physical immersion and presence, creating conditions for presence, measuring presence); Augmented reality (blending of information from the real and virtual worlds),Use of virtual reality in industrial and medical applications, education and design.

The course addresses the interaction between a human and a computer-generated virtual environment. It analyzes physical background, technological challenges as well as opportunities and constraints related to the construction of multimodal virtual and augmented environments. The emphasis is on concepts necessary for understanding virtual environments and user’s responses to synthetic visual, auditory and haptic stimuli. Students acquire practical knowledge in the laboratory while completing interdisciplinary research projects.

Students have access to a book with the course content. In the lectures, the emphasis is on theoretical basics of multimodal virtual environments. Due to the specificity of the course, lectures are mostly conducted with the help of multimedia presentations. Latest developments in the field of virtual environments are presented in the form of “video lectures". Practical exercises are conducted in the laboratory, which is equipped with a number of different haptic robots, surround sound systems and 3D stereoscopic graphical displays. Students work in interdisciplinary project teams, where each student engages in a particular modality of virtual environment.