CHAPTER 1: Fundamentals of multimedia systems

What is multimedia?

The word multi and media are combined to form the word multimedia. The word “multi”
signifies “many.” Multimedia is a type of medium that allows information to be easily
transferred from one location to another.

Multimedia is the presentation of text, pictures, audio, and video with links and tools that
allow the user to navigate, engage, create, and communicate using a computer.

Multimedia refers to the computer-assisted integration of text, drawings, still and moving
images(videos) graphics, audio, animation, and any other media in which any type of
information can be expressed, stored, communicated, and processed digitally.

A Multimedia Application is an application which uses a collection of multiple media sources

e.g. text, graphics, images, sound/audio, animation and/or video

Elements of multimedia include: sound, graphics, text and video.

Categories of Multimedia
1. Linear Multimedia
It is also called Non-interactive multimedia. In the case of linear multimedia, the end-user
cannot control the content of the application. It has literally no interactivity of any kind. Some
multimedia projects like movies in which material is thrown in a linear fashion from beginning
to end. A linear multimedia application lacks all the features with the help of which, a user can
interact with the application such as the ability to choose different options, click on
icons, control the flow of the media, or change the pace at which the media is displayed.
Linear multimedia works very well for providing information to a large group of people such
as at training sessions, seminars, workplace meetings, etc.
2. Non-Linear Multimedia
In Non-Linear multimedia, the end-user is allowed the navigational control to rove
through multimedia content at his own desire. The user can control the access of the

1
application. Non-linear offers user interactivity to control the movement of data. For example,
computer games, websites, self-paced computer-based training packages, etc.

What is Hypertext and Hypermedia?

Hypermedia

Hypermedia is not constrained to be text-based. It can include other media e g graphics images
and, e.g., graphics, images, and especially the continuous media – sound and video.

Example Hypermedia Applications?

 The World Wide Web (WWW) is the best example of a hypermedia application.

 PowerPoint

 Adobe Acrobat

2
Representation Dimension of media:

Media are divided into two types in respect to time in their representation space:

1. Time independent (discrete): Information is expressed only in its individual value. E.g.: text,
image, etc.

2. Time dependent (continuous): Information is expressed not only it’s individual value, but also
by the time of its occurrences. E.g.: sound and video.

Multimedia system is defined by computer controlled, integrated production, manipulation,

presentation, storage and communication of independent information, which is encoded at least
through a continuous and discrete media.

Classification of Media:

1. The perception media

2. The representation Media

3. The Presentation Media

4. The storage media

5. The transmission media

6. The information Exchange media

i. Perception media:

Perception media help human to sense their environment. The central question is how human
perceive information in a computer environment. The answer is through seeing and hearing.
Seeing: For the perception of information through seeing the usual such as text, image and video
are used. Hearing: For the perception of information through hearing media such as music noise
and speech are used.

ii. Representation media:

3
 Representation media are defined by internal computer representation of information. The
central question is how the computer information is coded? The answer is that various format are
used to represent media information in computer.

i. Text, character is coded in ASCII code

ii. Graphics are coded according to CEPT or CAPTAIN video text standard

iii. Image can be coded as JPEG format

iv. Audio video sequence can be coded in different TV standard format (PAL, NTSC, SECAM
and stored in the computer in MPEG format)

iii. Presentation Media: Presentation media refer to the tools and devices for the input and
output of the information. The central question is, through which the information is delivered by
the computer and is introduced to the computer. Output media: paper, screen and speaker are the
output media. Input Media: Keyboard, mouse, camera, microphone are the input media.

iv. Storage media: Storage Media refer to the data carrier which enables storage of information.
The central question is; how will information be stored? The answer is hard disk, CD-ROM, etc.

v. Transmission media: Transmission Media are the different information carrier that enables
continuous data transmission. The central question is, over which information will be
transmitted? The answer is co-axial cable, fiber optics as well as free air.

vi. Information exchange media: Information exchange media includes all information carrier
for transmission, i.e. all storage and transmission media. The central question is, which
information carrier will be used for information exchange between different places? The answer
is combine uses of storage and transmission media. E.g. Electronic mailing system

Multimedia structure

1. Application domain

2. System domain

4
3. Device domain

Application domain: provides functions to the user to develop and present multimedia projects.

This includes software tools, and multimedia projects development methodology.

System Domain: including all supports for using the function of the device
domain, e.g. operating system, communication systems (networking) and database systems.

Device domain: basic concepts and skill for processing various multimedia elements and for

handling physical device.

A Multimedia System is a system capable of processing multimedia data and applications. A

Multimedia System is characterized by the processing, storage, generation, manipulation and
rendition of Multimedia information.

Multimedia systems have to deal with the

i. Generation of data
ii. Manipulation of data
iii. Storage of data

5
 iv. Presentation of data
v. Communication of information/data

Characteristics of a Multimedia System

A Multimedia system has four basic characteristics:

i. Multimedia systems must be computer controlled.

ii. Multimedia systems are integrated.
iii. The information they handle must be represented digitally.
iv. The interface to the final presentation of media is usually interactive.

Challenges for Multimedia Systems

i. Distributed Networks
ii. Temporal relationship between data
iii. Render different data at same time -continuously.
iv. Sequencing within the media
v. Playing frames in correct order/time frame in video
vi. Synchronization — inter-media scheduling

Key Issues for Multimedia Systems

i. The key issues multimedia systems need to deal with here are:
ii. How to represent and store temporal information.
iii. How to strictly maintain the temporal relationships on play back/retrieval
iv. What process are involved in the above.
v. Data has to represented digitally — Analog– Digital Conversion Sampling etc, Sampling
etc.
vi. Large Data Requirements — bandwidth, storage, compression
vii. Data has to represented digitally so many initial source of data needs to be digitized--
translated from analog source to digital representation. The will involve scanning

6
 (graphics, still images), sampling (audio/video) although digital cameras now exist for
direct scene to digital capture of images and video.
viii. The data is large several Mb easily for audio and video - therefore storage, transfer
(bandwidth) and processing overheads are high. Data compression techniques very
common.

Desirable Features for a Multimedia System

Given the above challenges the following feature a desirable (if not a prerequisite) for a
Multimedia System:

i. Very High Processing Power - needed to deal with large data processing and real time
delivery of media. Special hardware common place.
ii. Multimedia Capable File System - needed to deliver real-time media -- e.g.
Video/Audio Streaming. Special Hardware/Software needed e.g. RAID (redundant array
of independent disks) technology.
iii. Data Representations/File Formats that support multimedia - Data
representations/file formats should be easy to handle yet allow for
compression/decompression in real-time.
iv. Efficient and High I/O - input and output to the file subsystem needs to be efficient and
fast. Needs to allow for real-time recording as well as playback of data. e.g. Direct to
Disk recording systems.
v. Special Operating System- to allow access to file system and process data efficiently
and quickly. Needs to support direct transfers to disk, real-time scheduling, fast interrupt
processing, I/O streaming etc.
vi. Storage and Memory - large storage units (of the order of 50 -100 Gb or more) and
large memory (50 -100 Mb or more). Large Caches also required and frequently of Level
2 and 3 hierarchy for efficient management.
vii. Network Support -Client-server systems common as distributed systems common.
viii. Software Tools - user friendly tools needed to handle media, design and develop
applications, deliver media.

7
Properties of Multimedia System

1. Combination of media: A simple text processing program with in corporate image is often
called a multimedia application. Because two media are processed through one program. But
one should talk multimedia only when both continuous and discrete media are utilized. So text
processing program with incorporated images is not a multimedia application.

2. Computer support integrated: computer is idle tools for multimedia application

3. Independence: An important aspect of different media is their level of independence from

each other. In general, there is a request for independence of different media but multimedia
may require several level of independence. E.g. A computer controlled video recorder stores
audio and video information’s. There is inherently tight connection between two types of media.
Both media are coupled together through common storage medium of tape. On the other hand,
for the purpose of presentation the combination of DAT (digital audio tape recorder) signals and
computer available text satisfies the request for media independence

Elements of a multimedia system

Multimedia consists of the following 5 elements:

1. Text
Characters are used to form words, phrases, and paragraphs in the text. Text appears in all
multimedia creations of some kind. The text can be in a variety of fonts and sizes to match the
multimedia software’s professional presentation. Text in multimedia systems can communicate
specific information or serve as a supplement to the information provided by the other media.

2. Graphics
Non-text information, such as a sketch, chart, or photograph, is represented digitally. Graphics
add to the appeal of the multimedia application. In many circumstances, people dislike reading
big amounts of material on computers. As a result, pictures are more frequently used than
words to clarify concepts, offer background information, and so on. Graphics are at the heart of
any multimedia presentation. The use of visuals in multimedia enhances the effectiveness and
presentation of the concept. Windows Picture, Internet Explorer, and other similar programs

8
are often used to see visuals. Adobe Photoshop is a popular graphics editing program that
allows you to effortlessly change graphics and make them more effective and appealing.

3. Animations
A sequence of still photographs is being flipped through. It’s a set of visuals that give the
impression of movement. Animation is the process of making a still image appear to move. A
presentation can also be made lighter and more appealing by using animation. In multimedia
applications, the animation is quite popular. The following are some of the most regularly used
animation viewing programs: Fax Viewer, Internet Explorer, etc.

4. Video
Photographic images that appear to be in full motion and are played back at speeds of 15 to 30
frames per second. The term video refers to a moving image that is accompanied by sound,
such as a television picture. Of course, text can be included in videos, either as captioning for
spoken words or as text embedded in an image, as in a slide presentation. The following
programs are widely used to view videos: Real Player, Window Media Player, etc.

5. Audio
Any sound, whether it’s music, conversation, or something else. Sound is the most serious
aspect of multimedia, delivering the joy of music, special effects, and other forms of
entertainment. Decibels are a unit of measurement for volume and sound pressure level. Audio
files are used as part of the application context as well as to enhance interaction. Audio files
must occasionally be distributed using plug-in media players when they appear within online
applications and webpages. MP3, WMA, Wave, MIDI, and RealAudio are examples of audio
formats. The following programs are widely used to view videos: Real Player, Window Media
Player, etc.

Applications of Multimedia

Multimedia finds its application in various areas including, but not limited to, advertisements,
art, education, entertainment, engineering, medicine, mathematics, business, scientific research
and spatial, temporal applications. A few application areas of multimedia are listed below:

9
I. Commercial

Much of the electronic old and new media utilized by commercial artists is multimedia. Exciting
presentations are used to grab and keep attention in advertising. Industrial, business to business,
and interoffice communications are often developed by creative services firms for advanced
multimedia presentations beyond simple slide shows to sell ideas or liven-up training.

ii. Entertainment and Fine Arts

In addition, multimedia is heavily used in the entertainment industry, especially to develop

special effects in movies and animations. Multimedia games are a popular pastime and are
software programs available either as CD-ROMs or online. Some video games also use
multimedia features.

Multimedia applications that allow users to actively participate instead of just sitting by as
passive recipients of information are called Interactive Multimedia.

iii. Education

In Education, multimedia is used to produce computer-based training courses (popularly called

CBTs) and reference books like encyclopedia and almanacs. A CBT lets the user go through a
series of presentations, text about a particular topic, and associated illustrations in various
information formats.

Entertainment is an informal term used to describe combining education with entertainment,

especially multimedia entertainment.

iv. Engineering

Software engineers may use multimedia in Computer Simulations for anything from
entertainment to training such as military or industrial training. Multimedia for software
interfaces are often done as collaboration between creative professionals and software engineers.

v. Industry

In the Industrial sector, multimedia is used as a way to help present information to shareholders,
superiors and coworkers. Multimedia is also helpful for providing employee training, advertising
and selling products all over the world via virtually unlimited web-based technologies.

10
vi. Mathematical and Scientific Research

In Mathematical and Scientific Research, multimedia is mainly used for modeling and
simulation. For example, a scientist can look at a molecular model of a particular substance and
manipulate it to arrive at a new substance.

vii. Medicine

In Medicine, doctors can get trained by looking at a virtual surgery or they can simulate how the
human body is affected by diseases spread by viruses and bacteria and then develop techniques
to prevent it.

viii. Multimedia in Public Places

In hotels, railway stations, shopping malls, museums, and grocery stores, multimedia will
become available at stand-alone terminals or kiosks to provide information and help. Such
installation reduce demand on traditional information booths and personnel, add value, and they
can work around the clock.

11