Scribd
Upload
40 views

13 - Multimedia

The document discusses multimedia networking and protocols. It defines multimedia and describes classifications of media types. It also covers streaming stored multimedia, real-time protocols including RTSP, RTP and RTCP, and how applications mitigate network issues through buffering and protocols.

Uploaded by

boysaobang
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
40 views

13 - Multimedia

The document discusses multimedia networking and protocols. It defines multimedia and describes classifications of media types. It also covers streaming stored multimedia, real-time protocols including RTSP, RTP and RTCP, and how applications mitigate network issues through buffering and protocols.

Uploaded by

boysaobang
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 33

Trng Th M Trang [email protected].

vn

Introduction Streaming stored multimedia Real-time protocols

digital Integration of multiple media type (text, graphics, still and moving images, animation, sounds, and any other medium) can be represented, stored, transmitted and processed digitally

Classifications of various media types


o Captured vs. synthesized media
Captured media (natural) : information captured from the real world Example: still image, video, audio Synthesized media (artificial) : information synthesize by the computer Example: text, graphics, animation

o Discrete vs. continuous media


Discrete media: spaced-based, media involve the space dimension only Continuous media: time-based, media involves both the space and the time dimension

Sound
Continuous

Video

Animation
Continuous

Image
Discrete Captured From real world

Text

Graphics
Discrete

Synthesized By computer

Local vs. networked


o Local: storage and presentation of multimedia information in standalone computers
Sample applications: DVD

o Networked: involve transmission and distribution of multimedia information on the network


Sample applications: videoconferencing, web video broadcasting, multimedia Email, etc.

network audio and video (continuous media)

Fundamental characteristics: typically delay sensitive


o end-to-end delay o delay jitter

loss tolerant: infrequent losses cause minor glitches

Classes of MM applications: 1) stored streaming 2) live streaming 3) interactive, real-time

Jitter is the variability of packet delays within the same packet stream

Example:
o Music/video online o You tube o VOA o CNN

1. video recorded

2. video sent network delay

3. video received, played out at client time

streaming: at this time, client playing out early part of video, while server still sending later part of video

VCR-like functionality: client can pause, rewind, fast forward, push slider bar timing constraint for still-to-be transmitted data: in time for playout

Examples: Internet radio talk show live sporting event Streaming (as with streaming stored multimedia) playback buffer playback can lag tens of seconds after transmission still have timing constraint Interactivity fast forward impossible rewind, pause possible!

applications: IP telephony, video conference, distributed interactive worlds

TCP/UDP/IP: best-effort service

no guarantees on delay, loss


? ? ? ?

But you said multimedia apps requires QoS and level of performance to be ? ? effective!

?
?

Todays Internet multimedia applications use application-level techniques to mitigate (as best possible) effects of delay, loss

1. How should the Internet evolve to better support multimedia? 2. Transport: TCP? UDP? Other protocol?

Introduction Streaming stored multimedia Real-time protocols

application-level streaming techniques for making the best out of best effort service:
o client-side buffering o use of UDP versus TCP o multiple encodings of multimedia

Media Player
jitter removal decompression error concealment graphical user interface w/ controls for interactivity

audio or video stored in file files transferred as HTTP object


o received in entirety at client o then passed to player

audio, video not streamed: no, pipelining, long delays until playout!

browser GETs metafile (contains information of URL, type of

encoding, etc about the audio/video file) browser launches player, passing metafile player contacts server server streams audio/video to player

Introduction Streaming stored multimedia Real-time protocols


o RTSP o RTP o RTCP

the protocols and their application field


o stream description:
describe the session and content

M3U, RAM, SMIL...


RTSP

o stream control: o media transport:


send data and metadata

remote control the session

RTP

o resource reservation (if any!): RSVP, DiffServ


make sure the communication path offers appropriate guaranties otherwise Best-Effort transmissions!

<smil> <head> <meta name="Title" content="Streaming Media Sample"/> <meta name="Author" content="Toongabbie Anglican Church"/> <meta name="Copyright" content="Toongabbie Anglican Church"/> <layout> <region id="pic" top="0" left="0" width="150" height="150" background-color="white"/> </layout> </head> <body> <par> <audio src="http://simon.job.id.au/files/streaming/stream.rm" title="Freedom"/> <img src="http://simon.job.id.au/files/streaming/logo_rm.gif? url=http://simon.job.id.au/articles/3/streaming-media-tutorial" region="pic" title="picture" fill="freeze"/> </par> </body> </smil>

Application protocol RFC 2326 acts as a network remote control allows a media player to control the transmission of a media stream for exchanging control information supports the following operations:
o retrieval of a media from a server o invitation of a media server to a conference o recording of a conference

client

media descr. web server

audio server

video server

step 1: get description (in SDP format) step 2: open streams with RTSP step 3: play step 4: teardown

Major methods
o SETUP:
o PLAY: o PAUSE: o TEARDOWN: o o o o o o

Additional methods

server allocates resources for a stream and starts an RTSP session starts data tx on a stream temporarily halts a stream free resources of the stream, no RTSP session on server any more

OPTIONS: get available methods ANNOUNCE: change description of media object DESCRIBE: get low level descr. of media object RECORD: server starts recording a stream REDIRECT: redirect client to new server SET_PARAMETER: device or encoding control

HTTP GET presentation description (sdp) client C SETUP PLAY RTP audio/video RTCP TEARDOWN

web server W

media servers A&V

Transport protocol RFC 3550 RTP specifies packet structure for packets carrying audio, video data
o RTP packets encapsulated in UDP segments

RTP packet provides


o payload type identification o packet sequence numbering o time stamping

Payload Type: 7 bits, providing 128 possible different types of encoding; eg PCM, MPEG2 video, etc. Sequence Number: 16 bits; used to detect packet loss Timestamp: 32 bytes; gives the sampling instant of the first audio/video byte in the packet; used to remove jitter introduced by the network Synchronization Source identifier (SSRC): 32 bits; an id for the source of a stream; assigned randomly by the sour

works in conjunction with RTP. Used to exchange control information (report) between the sender and the receiver
o report statistics useful to application: # packets sent, # packets lost, interarrival jitter, etc.

feedback can be used to control performance


o sender may modify its transmissions based on feedback

Bi ging gio trnh Computer Networking: A Top Down Approach, 5th edition, J.F Kurose and K.W. Ross Bi ging EE442Multimedia Networking, Jane Dong, California State University, Los Angeles

You might also like