Course description
Probability, random variables (trials, events, definition of probability, probability density function, mean values, central limit theorem). Stochastic processes (sample function, time averages, ergodicity, power density spectrum). Information (metrics, information sources, entropy, redundancy). Coding and data compaction (source coding theorem, entropy coding, Lempel-Ziv coding). Mutual information and channel capacity (mutual information, information channel, joint entropy of discrete sources, differential entropy, information capacity theorem).
Analogue signal coding – basic formatting (ideal and flat toped sampling, reconstruction of continuous time signals, band-pass signal sampling; quantization, granular and overload noise, dynamic range). Audio signals (sound and hearing, properties of audio signal, perceptual properties of human hearing, frequency masking, redundancy and irrelevance, properties of speech, vocal tract modeling, speech redundancy).
Speech coding (non-linear quantization, A- law compression, predictive coding; scalar quantization (DPCM, ADPCM), vector quantization (CELP). Audio signal coding (standard coding formats: CD, DVD-audio, DSD; lossy compression, MP2, MP3, AAC)
Course is carried out on study programme
Electrical engineering 1st level
Objectives and competences
Basic principles of information transmission and related backgrounds. Entropy as the basic measure of information. Source coding and basic data compaction algorithms. Fundamental limits of reliable communication over noisy channel. Properties of analogue signals that are important for coding schemes.
Distinction between redundancy and irrelevance. Redundancy removal in advanced speech coding. Basic principles of perceptual coding of audio signals.
Learning and teaching methods
Lectures, tutorial, homeworks
Intended learning outcomes
After successful completion of the course, students should be able to:
– explain the difference between irrelevance and redundancy in the informing process,
– explain the expression for the amount of information of a symbol of a discrete source,
– derive the mathematical proof of the maximal entropy of a discrete memoryless source,
– calculate the matrix of conditional probabilities of the transmission of multilevel symbols in the presence of additive Gaussian noise,
– compare the differential entropy of a random variable with the entropy of a discrete information source,
– describe the necessary procedures that are required for analogue signal coding,
– calculate the minimum number of bits of an A/D converter to achieve a desired signal to noise ratio within the required dynamic range of the input signal.
Reference nosilca
1 PIRC, Matija, FURLAN, Jože. Effects of high electric fields on tunneling-assisted optical electron transitions in a-Si. IEEE transactions on electron devices. [Print ed.]. Dec. 2011, vol. 58, no. 12, str. 4318-4323, ilustr. ISSN 0018-9383. http://dx.doi.org/10.1109/TED.2011.2169068
2 PIRC, Matija, TOPIČ, Marko. Electroabsorption modeling in hydrogenated amorphous silicon. IEEE transactions on electron devices. [Print ed.]. Dec. 2013, vol. 60, no. 12, str. 3973-3978, ilustr. ISSN 0018-9383. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6631493
3 BRECL, Kristijan, PIRC, Matija, BOKALIČ, Matevž, MORELJ, Dorijan, TOPIČ, Marko. PV module behaviour
on the substring level under real conditions monitored by junction box electronic device Jubomer. IET renewable power generation. [Print ed.]. 2019, vol. , no. , str. 1-5, ilustr. ISSN 1752-1416. https://digital-library.theiet.org/content/journals/10.1049/iet-rpg.2019.0156, DOI: 10.1049/iet-rpg.2019.0156
4 PIRC, Matija, CASERMAN, Simon, FERK, Polonca, TOPIČ, Marko. Compact UV LED lamp with low heat emissions for biological research applications. Electronics. Mar. 2019, vol. 8, no. 3, str. 1-18, ilustr. ISSN 2079-9292. https://www.mdpi.com/2079-9292/8/3/343, DOI: 10.3390/electronics8030343
5 PIRC, Matija. Idle noise reduction of a parametric acoustic array power driver = Zmanjšanje lastnega šuma ojačevalnika in modulatorja za parametrično akustično polje. Informacije MIDEM : časopis za mikroelektroniko, elektronske sestavne dele in materiale. [Tiskana izd.]. Mar. 2019, vol. 49, no. 1, str. 33-42, ilustr. ISSN 0352-9045. http://www.midem-drustvo.si/Journal%20papers/MIDEM_49(2019)1p33.pdf, DOI: 10.33180/InfMIDEM2019.105
Study materials
1. S. Tomažič, Osnove telekomunikacij I, Založba FE in FRI, 2002
2. N. Pavešič, Informacija in kodi, Založba FE in FRI, 2010
3. J.R. Deller, J.G. Proakis, J.H. Hansen, Discrete-time processing of speech signals, MacMillan, New York, 1993
4. N. Moreau, Tools for signal compression, ISTE Ltd. and John Wiley & Sons, Inc., 2009