Scribd
Upload
22 views

Lecture 1

Uploaded by

Mrawan Taha
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
22 views

Lecture 1

Uploaded by

Mrawan Taha
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 23

Multimedia Systems and

Applications

Lecture 1 - Introduction to
Multimedia

Introduction to Multimedia 1
Introduction to Multimedia 2
Objectives
 To provide an overview to the subject.
 To describe a number of fundamental concepts
 Digitization Process.
 Sound/Audio.
 Images and Graphics.
 Text and fonts
 Video and Animation
 Compression Techniques
 Quality of Services (QoS)

Introduction to Multimedia 3
Contents

 What is multimedia?
 Global Structure
 Digital Technology

Introduction to Multimedia 4
What is Multimedia?
 Multi- means many; much; multiple

 Medium means:
 An intervening substance through which something is
transmitted or carried on.
 A means of mass communication such as newspaper,
magazine, or television.

 Multimedia is woven combinations of text, graphic


art, sound, animation, video and other kinds of
elements.
Introduction to Multimedia 5
What is Multimedia?
 Sample projects include: Newspapers,
advertisements, libraries, websites, e-learning, user-
interface design…etc.

 When a viewer of a multimedia presentation is


allowed to control what elements are delivered and
when, it is interactive multimedia.
 Important

Introduction to Multimedia 6
What is Multimedia?
 Multimedia is an inter-disciplinary subject
because it involves a variety of different theories
and skills:
 These include computer technology, hardware and
software.
 Arts and design, literature, presentation skills.

Introduction to Multimedia 7
Global Structure
 Application domain — provides functions to the user to
develop and present multimedia projects. This includes
Software tools, and multimedia projects development
methodology.

 System domain — including all supports for using the


functions of the device domain, e.g., operating systems,
communication systems (networking) and database
systems.

 Device domain — basic concepts and skill for processing


various multimedia elements and for handling physical
device.
Introduction to Multimedia 8
Introduction to Multimedia 9
Multimedia File Systems
Image File Formats
 .JPEG/JFIF
 .Exif
 .TIFF
 .GIF
 .BMP
 .PNG
 .PPM, .PGM, .PBM, and .PNM
 .WEBP
 .RGBE
 .HEIF
 .BPG
 .CGM
 .Gerber format (RS-274X)
 .SVG
Introduction to Multimedia 10
Multimedia File Systems
Audio File Formats
 Uncompressed audio formats, such
as WAV, AIFF, AU or raw header-less PCM;

 Formats with lossless compression, such as FLAC, Monkey's


Audio (.ape), WavPack (.wv), TTA, ATRAC Advanced
Lossless, ALAC (.m4a), MPEG-4 SLS, MPEG-4 ALS,MPEG-4
DST, Windows Media Audio Lossless (WMA Lossless),
and Shorten (SHN).

 Formats with lossy compression, such


as Opus, MP3, Vorbis, Musepack, AAC, ATRAC and Windows
Media Audio Lossy (WMA lossy).
Introduction to Multimedia 11
Multimedia File Systems
Video File Formats
 .webm
 .mkv
 .ogv, .ogg
 .drc
 .avi
 .asf
 .mov, .qt
 .wmv
 .yuv
 .rm, .rmvb
 .mp4, .m4p (with DRM), .m4v
 .mpg, .mp2, .mpeg, .mpe, .mpv

Introduction to Multimedia 12
Operating Systems for Multimedia
 Real Time systems (RTOS)

 Often used as a control device in a dedicated


application such as: a. Controlling scientific
experiments, b. Medical imaging systems, c.
Industrial control systems.

 Well-defined fixed-time constraints.

 Real-time system may be either hard or soft


system
Introduction to Multimedia 13
Operating Systems for Multimedia

Hard real-time systems


 Must know exact time for each task
 Scheduling either pre-determined or done by resource
reservation.
 Resource reservation – The task tries to reserve
resources before starting. It is rejected if all resources
are not available.

Introduction to Multimedia 14
Operating Systems for Multimedia
 Soft real-time systems
 Real-time processes are given priority over other
processes
 Processes must have small dispatch latency, usually
implemented by preemption.

Introduction to Multimedia 15
Other Directions
 Networking Multimedia
 The characteristics of multimedia make heavy demands on
storage and transmission systems.

 A Multimedia Database Management


System (MMDBMS) is a framework that manages
different types of data potentially represented in a wide
diversity of formats on a wide array of media sources.
 Static media (time-independent: image and graphic object).
 Dynamic media (time-dependent: audio, video and animation).
 Dimensional media (3D game and spatial objects).

Introduction to Multimedia 16
Technical challenges
 Sheer volume of data
 Need to manage huge volumes of data

 Timing requirements
 among components of data computation and
communication.
 Must work internally with given timing constraints -
real-time performance is required.

Introduction to Multimedia 17
Technical challenges
 Integration requirements
 Need to process traditional media (text, images) as
well as continuous media (audio/video).
 Media are not always independent of each other -
synchronization among the media may be required.

Introduction to Multimedia 18
Situation 1

 A photograph of 4×3 inches is to be scanned. It


will be used in a multimedia application in which
the image will be displayed on screen. Hardcopy
may be printed on a 150dpi laser printer if the
user wants. The size of the hardcopy should be
4×2 inches. What is the best resolution to be
used in scanning?

Introduction to Multimedia 19
Situation 2
 A photo of size A3 is scanned using a resolution
of 600 dpi and a depth of 32-bit. The image is
then compressed by a compression algorithm;
the compression ratio is 25%. The final file is
uploaded on a server with a download speed 10
Mbps. How long (in min) will it take a user to
download this image using a 1 Mbps modem?

Introduction to Multimedia 20
Situation 3
 Your hard disk has 340 Mbyte of free space. You
are going to record a speech with a sampling
rate of 22 KHz – 16-bit resolution in stereo
mode. What is the length (in sec) of the
recording that can be stored in the hard disk?

Introduction to Multimedia 21
Course Overview
We can roughly divide the lectures into the following parts:

 Multimedia Elements which deals with the various


properties of each kinds of elements:
 Sound, audio, voice and music
 Graphics, photographs and images
 Text, and layout
 Full-motion video and animation

 Application domain which deals how to develop


multimedia applications:
 Multimedia application development method
 Interface design and Software tools— element processing tools,
authoring tools

Introduction to Multimedia 22
Course Overview
 Supporting technology which deals the
technology that are needed to support
multimedia applications, such as:
 Data Compression
 Data and file format
 Multimedia input, output and storage

 Multimedia and the Internet - Quality of


Services (QoS)

Introduction to Multimedia 23

You might also like