Academics
  /  
Courses
  /  
Descriptions
ELEC_ENG 421: Multimedia Signal Processing

This course is not currently offered.

Prerequisites

ELEC_ENG 359 or equivalent, or permission of the instructor

Description

Fundamentals of processing multimedia signals: text, graphics, speech, audio, image, video; standards for multimedia coding, processing and compression. Related products and services will be discussed. 

REQUIRED TEXTS: Khalid Sayood, Introduction to Data Compression , Morgan Kaufmann, 4th edition (2012)

COURSE INSTRUCTOR: Prof. Thrasyvoulos N. Pappas

COURSE DIRECTOR: Prof. Aggelos Katsaggelos

COURSE GOALS: To provide an introduction to the fundamental principles and techniques in multimedia signal processing and compression, an overview of the current multimedia standards and technologies, and a brief description of future technologies.

PREREQUISITES BY COURSES: ELEC_ENG 359 or equivalent, or permission of the instructor

DETAILED COURSE TOPICS:

  • Digital Processing Basics
  • Multimedia Processing and Communications
  • Compression and Networking as Cornerstones
  • Information Theory Basics
  • Lossless Source Coding
  • Huffman/arithmetic Codes, LZW
  • Text/graphics Compression
  • Fax Standards (Group 3, Group 4, JBIG)
  • Quantization (scalar/vector)
  • Waveform, Transform, Model-based Coding
  • Performance Criteria, Perception
  • Human Visual System Models
  • Still Image Compression
  • JPEG, JPEG2000
  • Wavelet/Subband/Fractal
  • Perceptually-based Coders
  • 2 nd Generation Image Coding
  • Speech Production
  • Speech Compression
  • LPC, CELP, MELP
  • Applications
  • Audio Compression
  • The G.72X Standars
  • Fundamentals of Perceptual Coders
  • MPEG-1/2, Dolby AC-2 and AC-3
  • Compression of Stereo and Surround Sound
  • Video Compression Basics
  • Motion Estimation and Compensation
  • Rate-Distortion based Optimal Encoding
  • Overview of Multimedia Communication Standards H.323 and H.324
  • Video Compression Standards H.261, H.263
  • Video Compression Standards MPEG-1, MPEG-2, and HDTV
  • Applications/Consumer Electronic Products
  • “Modern” Coding Techniques
  • MPEG-4
  • Coding of Audio Objects (natural, synthetic)
  • Coding of Visual Objects (boundary encoding)
  • Sprites, Facial Animation
  • MPEG-7
  • Applications
  • Multimedia Transmission
  • Error Resilience and Concealment
  • Multimedia over IP
  • Multimodal Signal Processing
  • Speech-assisted Video Coding
  • Multimodal Speech Recognition

COMPUTER USAGE: None.

PROJECT: A bibliographical search or computer type project is required. The purpose of this project is to enhance the understanding of a topic covered in class or to investigate a topic not covered in class. A final report and a presentation are required.

GRADES:

Homework Assignments – 60%

Project – 40%

COURSE OBJECTIVES: When a student completes this course, s/he should be able to:

•  Understand the fundamentals behind multimedia signal processing.

•  Understand the fundamentals behind multimedia compression.

•  Understand the basic principles behind existing multimedia compression and communication standards.

•  Understand future multimedia technologies.

•  Apply the acquired knowledge to specific multimedia related problems and projects at work.

•  Take advanced courses in this area.