3D sound in multimedia

Subject description

Vibration and sound waves

·    propagation properties of sound

·    characteristics of the media

·    characteristics of sound sources

2. The perception of sound and psychoacoustics

3. Localization of sound

·    inter-aural time and amplitude cues

·    spectral content

·    head movements of source movements cues

·    distance and reverberation

4. Recording the surround sound

·    multi-channel and surround sound recording techniques

·    acquisition of head-related transfer functions (HRTF)

5. Playback of surround sound

·    two-channel stereo

·    multichannel stereo and surround systems

·    implementation of head-related transfer functions

·    using digital signal processors

·    simulation of distance and reverberation

6. Auditory user interfaces in multimedia devices

·    speech interfaces

·    non-speech interfaces

·    sonication

·    auditory icons

·    interface metaphors

 7. 3D auditory user interfaces in multimedia devices

·      portable devices

·      virtual Environments

·      aeronautics

·      vehicles

·      visually impaired and blind users

·      brain-computer interfaces

The subject is taught in programs

Objectives and competences

Broader insight into 3D sound and its use in modern multimedia services and devices. Students should understand the basic physical characteristics of sound waves in different media and spaces, and the ability of perception and sound localization in humans. They also acquire the knowledge on recording and implementation techniques of 3D sound and its use in the interaction between a user and modern multimedia devices.

Teaching and learning methods

Lectures in which the student is acquainted with the theoretical basics and lab work where the student meets the practical problems and solves them in the team.

Expected study results

After successful completion of the course, students should be able to:

–          describe basic properties and principles of acoustic wave in a space,

–          explain mechanisms for human sound localization,

–          explain techniques for 3D sound recording,

–          explain techniques for 3D sound processing,

–          explain techniques for generation of 3D sound through digital signal processing,

–          explain techniques for replying 3D sound through different configurations of loud speakers

–          describe different categories and specifics of auditory user interfaces based on 3D sound

Basic sources and literature

1.      Sodnik J, Tomažič S: Spatial auditory human-computer interfaces, SpringerBriefs in Computer Science, september 2015.

2.       Begault R. Durand: 3D Sound for Virtual Reality and Multimedia, Academic Press, Inc. UK, 1994.

3        Rumsey F: Spatial Audio (Music Technology), Elsevier, 2005.

Stay up to date

University of Ljubljana, Faculty of Electrical Engineering Tržaška cesta 25, 1000 Ljubljana

E:  dekanat@fe.uni-lj.si T:  01 4768 411