3D sound in multimedia

Vibration and sound waves

·    propagation properties of sound

·    characteristics of the media

·    characteristics of sound sources

2. The perception of sound and psychoacoustics

3. Localization of sound

·    inter-aural time and amplitude cues

·    spectral content

·    head movements of source movements cues

·    distance and reverberation

4. Recording the surround sound

·    multi-channel and surround sound recording techniques

·    acquisition of head-related transfer functions (HRTF)

5. Playback of surround sound

·    two-channel stereo

·    multichannel stereo and surround systems

·    implementation of head-related transfer functions

·    using digital signal processors

·    simulation of distance and reverberation

6. Auditory user interfaces in multimedia devices

·    speech interfaces

·    non-speech interfaces

·    sonication

·    auditory icons

·    interface metaphors

 7. 3D auditory user interfaces in multimedia devices

·      portable devices

·      virtual Environments

·      aeronautics

·      vehicles

·      visually impaired and blind users

·      brain-computer interfaces

Broader insight into 3D sound and its use in modern multimedia services and devices. Students should understand the basic physical characteristics of sound waves in different media and spaces, and the ability of perception and sound localization in humans. They also acquire the knowledge on recording and implementation techniques of 3D sound and its use in the interaction between a user and modern multimedia devices.

Lectures in which the student is acquainted with the theoretical basics and lab work where the student meets the practical problems and solves them in the team.