IT elective - Multimedia Technologies

1. The aim of the course is to provide students the foundation knowledge of multimedia computing, e.g. media characteristics, compression standards, multimedia representation, data formats, multimedia technology development. A mix of lectures and lab sessions is used to deliver the various topics in this subject.

2. Lectures of the course are conducted to initiate students with the concepts and techniques of multimedia computing. They will introduce tools and techniques for creating and handling multimedia content consisting from text, hypertext, voice, audio, animation, images and video. Algorithms, standards and protocols on which multimedia information and multimedia communications depend are covered. Maturity in computer science and basic knowledge in digital signal processing are required.

3. Laboratories of the course provide students programming training in multimedia system design, multimedia computing and/or implementations. Students are given the opportunity to gain handsome experience on designing and implementing a multimedia system.

Basic literature

1. Z. N. Li and M. Drew, Fundamentals of multimedia, Prentice Hall, 1st edition, 2004.

2. Paul L. Rosin (Editor), Yu-Kun Lai (Editor), Ling Shao (Editor), Yonghuai Liu (Editor), RGB-D Image Analysis and Processing, Advances in Computer Vision and Pattern Recognition, Springer, 2019.

3. T. Vaughan, Multimedia: Making It Work, McGraw-Hill Education, Ninth Edition, 2014.

4. A. Case, A. Day, Designing with Sound: Fundamentals for Products and Services, O'Reilly Media, 1 edition, 2018.

Complementary literature

1. K.Blair-Benson: Audio Engineering Handbook, McGraw Hill, 1990

2. Z.N. Li, M. Drew and J. Liu, Fundamentals of multimedia, Springer, 2nd edition, 2014.

3. H.M.Blanken, A.P.de Vries, H.E.Blok, L.Feng (Eds.): Multimedia Retrieval. Springer, Series: Data-Centric Systems and Applications, 2007, ISBN: 978-3-540-72894-8

4. G.De Poli, A.Piccialli, C.Roads: Representations of Musical Signals, MIT Press, 1991

5. S. McGloughlin: Multimedia: concepts and practice, Prentice Hall, Upper Saddle River, NJ, USA, 2001

6. B. Hansen, The Dictionary of Multimedia, Terms and Acronyms, Fitzroy Dearborn, Chicago, 1998

7. E.C.Ifeachor, B.W.Jervis: Digital signal processing: a practical approach, Addison-Wesley Publishing Co., Wokingham, England, 1995

8. Jones H. F., Desktop Digital Video Production, Prentice Hall, Upper Saddle River, NJ, USA, 1999

9. H. Levkowitz, Color Theory and Modeling for Computer Graphics, Visualisation, and Multimedia Applications, Kluwer AP, London 1997

10. C. Lewis (tech. cons.) 101 Essential Tips, Exploring Multimedia. DorlingKindersley'97

11. James O. Pickles, An Introduction to the Physiology of Hearing, Academic Press, London 1994

12. Sharda N.K., Multimedia Information Networking, Prentice Hall, Upper Saddle River, NJ, USA, 1999

13. M.Smith, A.Smaill, G.A.Wiggins (Eds.): Music Education: An Artificial Intelligence Approach, Proceedings of a Workshop held as part of AI-ED 93, World Conference on Artificial Intelligence in Education, Edinburgh, Scotland, UK, 25 August 1993. Workshops in Computing, Springer 1994, ISBN 3-540-19873-3

14. D.O'Shaughnessy: Speech Communications: Human and Machine, Addison-Wesley 1987

15. V. Subrahmanian, Principles of Multimedia Database Systems, MK 1998

16. Tanguiane: Artificial Perception and Music Recognition, LNCS/LNAI 746, Springer-Verlag 1993

17. P.Todd, D.G.Loy: Music and Connectionism, MIT Press, 1991

18. G. Blelloch, Introduction to data compression, Lecture notes, Carnegie Mellon University.

19. D. Huffman, A method for the construction of minimum-redundancy codes, Proceedings of the I.R.E., pp. 1098-1101, Sept. 1952.

20. T. Welch, A technique for high-performance data compression, Computer, pp. 8-29, June 1984.

21. I. Witten, R. Neal and J. Cleary, Arithmetic coding for data compression, Communications of the ACM, pp. 520-540, June 1987.

22. B. Atal and S. Hanauer, Speech Analysis and Synthesis by Linear Prediction of the Speech Wave, Journal of the Acoustical Society of America, pp.637-655, 1971.

23. M. Schroeder and B. Atal, Code-excited linear prediction (CELP): High quality speech at very low bit rates, Intern. Conf. on ASSP, 1985.

24. R. Gray, Vector Quantization, IEEE ASSP Magazine, pp. 4-29, April 1984.

25. T. Painter and A. Spanias, Perceptual Coding of Digital Audio, Proceedings of the IEEE, pp. 451-513, April 2000.

26. N. Chapman and J. Chapman, Digital multimedia, 2nd edition, J. Wiley and sons, 2004.

27. R. Steinmetz and K. Nahrstend, Multimedia systems, Springer-Verlag, 2004.

28. R. Steinmetz and K. Nahrstend, Multimedia applications, Springer-Verlag, 2004.

29. R. Steinmetz and K. Nahrstend, Multimedia fundamentals, Prentice Hall, 2002.

30. R. Packer and K. Jordan, eds, Multimedia: from Wagner to virtual reality, W. W. Norton, 2001.

31. J. D. Gibson, T. Berger, T. Lookabaugh, D. Lindbergh and R. Baker, Digital compression for multimedia: Principles and standards, Morgan Kauffman, 1998.

32. K.Jeffay, H.Zhang: Readings In Multimedia Computing And Networking. Elsevier (Imprint: Morgan Kaufmann), 2001. ISBN-13: 978-1-55860-651-7

33. J. Whitaker, B. Benson: Standard Handbook Of Audio And Radio Engineering. McGraw-Hill 2002

34. J. Whitaker, B. Benson: Standard Handbook of Video and Television Engineering. McGraw-Hill, 2003, ISBN: 0-07-141180-1

35. B. Atal, The History of Linear Prediction, IEEE Signal Processing Magazine, pp. 154-157, March 2006.

During the term the students will have the opportunity to verify the developed skills as well as to obtain points due to

1) projects of theoretical or computational character

2) short tests

3) mid term and final tests

4) oral answers during the classes.