(Muttimedia) to Compaters. : Multimedia Untwodu ction) ; i Ankequiation of text | Murimedia ia Mre had Concerned, with the computor conbe\ied agice drawings, sh and moviag ima. ges Cvideo) , animahon, audio and go of. Mattimedias Growal sisiuctuce o) Multi media. co Agglication domain = provides Yundion My user bo | develop & present multimedia ee Fools _and Weplicatina Sea Oi \ Leog ramming, \aterface| aintrack oa \ reyects Tn Includes software 0 rocle & wiulhimectia project _deve- Jegment Methodology - enon patio Databrne | Operating | Communication| Septey [ 7 Kplem \ Syplenn Compuler ‘Technology. System Domain : g Comp ronion ¢ nde aie date il fundhions of th ia| | Ge Operant 4 Comandante and dataloase _syshenMallimedig Applications Digital video Citing. | Clechmaic _naospaper A: Ww Nome shopping — _ _ a Video Con Perencing - _ Garning _ a 2] 4 > 3 || \nkerackve W. 2. > 5 3 Vislual Eeali Aiden on. demand. ele _ | Chanactesictics 0}, Multienedtia OTF i =| Computer Counted _ Z 2 \nteanated sig comcgicmgivel 3 Mgitaillyy 3) \nkeracktve. 2 _ FT Components of Wunti media. 4 || Caghuce devicas, _ - 3 | =|] Storage devices, 5] Communi calon Nehoon le =| Computer Systems Display, NeyleoseChallenges of Multimedia sy | Duke Network. Automatica tt ‘s Analyt Ling sndering and AMAZING om ation video sage ween ey to Qudto, ma woni2.ahoo = au enc. no Antea. roeilia echeduli g- Multimedia tovalbes ve Aifeoxn! research areas that Needs more c\icient alapuilen and hardware plod forms:— Sound is yhoni cay Phenomenon matter and ts trans mijted ag eoove’ Sound wones arc charac erized via Veniod cs Esrequwency Liven} tavern Praglitide Lrcadnen J andwi dh. Foniod Min We interval at which gortiodte Oigmal 2169 eal$ requlag $ foraquenur4: OO yeaprecar bate Wb the paoo,o, Pte of pentod My Moe _Hedprcal value _o4 pew of. ie | fe ayp. | Onjt a4, Keoquent iS Wearl2 or kilohearty Gk | kHz) According to freq uencss sound _can be diabsbubed ao. ___ Sound { Pequencs4: Humen car \s most Fi lafra- Sound Q-20 Hz perenne G00 -6000 Wi Audible. Scund Chumea? 202-20kH2 | vilta-sauad Oka - 4 Ue Ayer gsun a, 1 we — to TAZ\ || Bandwidth a . Min wang. o) Fiequency a device can psodu |_Fimglitude \h iy Ane Leu dine G_humag can bean _ a Computer Repainentation of sound « wave ave taken md each sample ic repres ——_t by Q Number on the code. r Fo_computea sep meatal goo} Sond tt sequives _|| whe AigRtt sation of sound. Dight?zation of scund. > |\h in the prowss OF conveating analog Signal te a _digita\ signal. |Oigitication of sound consist of Fattaciag % steps “Sampling yore , \| Quantizabion oad. Sound Wardusgre, ‘ExcenclinigeThe siale_at which continuous woaveform i¢ sampled w_ alled Sowapling ate). sel — No-ol, samples ger second ob called sanghigeale Quantization: Sampling of amplitude. in_Called_quantizatoa | tascen “ok aepasinliag daaplihuce of sachsamle as ahaa or Num ben 1S coed Quantization Cound Mardwore. Qevies thal are connected +» ADe and DAC CApatoy te Digital Converien and Digih Poni ry fea fox io pu and. ouipud of cu dio to the com patend. € an EECH. MLL LMusiatnstaument Digital Interface J W communication chandand developed! fn early) 1980 For echo neh amputers: WINS io as Anat _olu ff Computer's senial post A\l ao} 99 paul }O\S » Mini is tne \nlerkace ipchaeen electro nic munieal_imbumoat— dnd _tompul ers id EaMio) _ tee _uivenecty accepted standard $ —— | nfeemation _ About = ton sal_pesesrn x cugitals = | Cemsnon_ S001 devicos, Nacludes electronic music Som Ahe ers | Modules 101 _devicas io_common) sound eande: , Mio DEVICES: As Mil lolerkd@ oehoeon mimical iashumont f tompalea.\A consicl ol Ios oh munical devices ome Ahem _are. y _Soppthe sizer cer _ i) Coatrolleas 0 iD | _ Sequuencors ‘ : yi||_Nehoocks: TU Stynthesizen_[peorgorater only wlth Wp wm gofheate |] __-y|_Synthesfaen_Is_o component that Generate sound bared L-oatoe -SU0)_mena. ge - ; 1] Rack. Mounted Sspatioesizen | FNXpcs of MUO symtnesizer (1 Ctxamples” mae Inleqvated Yexyboasdond Sgnthaizer wm Machine ia| Synthesizer ane “not ficken cil tategrated, with o _ — Keyboard. such a0 Rack. maimed wip\_syrthesieen, MDL Synthesizer ate ened in creating qi Percussion sound. Conigiolleas- Linccegorates with ealy KID. solreare’] . oO JNO conoilers gre Ye devices foo manipalatiqg Yao generaled tipi -sothoare_menages. _ KUID\ contyollea can fave Ye fom 6} almost all Geowhic 02\ cleo are Imbumen| ouch a \eexyboard, gut bar, dvume, sels, dum pads. TALD\ controlten_never _sunthesi2e_ov genenate audible music: _. MIO) contellen a: \ 0 oO Hhegizr fmize We apgli "Example: Zar, Alesis &, _Kequence Incorporates with both MID sol\iwore L hardware WIOL_Sequiencer bb eleclonie devi ce incorporating loth vol Min) sothoare and win hardware - vo wed pa stosing oud aeplanyng, MUO sebhoa 2_mene — Gequan ce. :Ldmcliony of _vupt Sequencer, —— eoek [som Wadi sofhonte menage sequen. —__=_- J Replays dhe MIO SoFroate menage secucnca. vo apprep-tming gaovides gone cord pf. axiilvig capabill hea. ——— ee 7 | Nekoor\es: Min Metworle iS a combination of hard ene and _SoPhaate Ya to interconnect group of WNO\ devicoa _guch on Santnestzer, conlvoller and 's equencor. Thew aie_ond or multigh gots or MID\ ports to enpect dozens ©} HU) devicos toto a achdor i. © [tn general the Mudd nohoorls fc _jush_a_gonecalization. of 6 devics_calted_Patch Gay _ AML Ahe YUL davicog coacict of oe o multiple paris. _ _Gie MIDL-ln, MI01- Dut) that are used: to Interconnect |_ditferenl devicos so Ihat o YAW nehoork eould be | formed: - |MIDI Maange, MinL_mmage Asransro Information beh i y | Midl devices. which Aetemmina Ahe Kind of munical eecnt io be pamed Faiom deviv to device MUO Menage Conmnrk ol ° @ Stak bate @)__data_byre )) Statuy byte * > Fast byte of Midl_ menage Wat dorcaibes We monage \ Chandel voice menage dercsies mnie by del ing_pitcn amplitude, Hmbre, Aueation and over sound qualities: 9 [Each menage laos at \eont_ane and ually hoo data layer J Vat accor ny [help stahn bute To_V describe sound quality. o . Example: Note On, Note OF, channel Pronuee, Control Cha ng ete 99) fonanoel nde Menage 7 4 |] Channel rode Menage dedereine Abe teay} that_4_tecieving MIDI device _aerpand to channel voice menage s. OF 0 channel _seceiving made ig_seb for difforont UO) deviag’ _ Eeample: Anal Conbol, All Woloc OFF, Omni Mode oft et3} | Sepleno Mowagp. S| Seplo Miemages qo teat hn Chanocl numbers ane apecivede- 7 TYPES _OF SYSTEM Menage. a D_ Septem Real-Time Monage, Vi) Systm Common Memage ow ‘ii) Sptoro_ex clive menage _ Y | Seplom Real-hene Menadt- ~ > [These are very short and simile _Comrinting o} ingle byte > [| Trey corny data wil how te aenchwonSe he Ht g, of M101 devieas io pottowmnancd « ~ || therehose, tt in \mportant thal Tore sewwade qe _Seat gaccisadyy = |e avoid delays « Yhese Monagt ave sent t middle ok the moma Eeample. Syplers Reoek, Vining Chock. | NU W || Sytem Commoa Monage: > hee Qe tommands Wat Qrepare Sequencers, and sepadhesi 2erS_ hy May 6 GOA + Varioun menage enables Ay Sdeck Phe sens, fad commoo starting plac wo son, and Sune sypyYhesi zor it needed Selec) ,Vune Select- Ga mp\e-_|| end- 4 geclunive menage. | Sepleen Exclu cive Menage. a “allacs riot manujachire rg | to menage te send beeen ADI der Wr menage state with ¢gaplem exclu | Where mantle cure is gpeci fied and ends wil vol) _ =o _ [Mint Mecenael : | Channel Menage | <5 en Mon et [nt Volco Menage ie Qeal twine Wonage | Chonoel Mode Mowa Ne) Common Mona ~% Peer Eechnive Menage SI _YADL and ear & wna Senhind HID _siep Hoduces Jeadi tional “vole” Jeng usin’ A DL docks tonto are orepsregented Muarmgh ering Clo, mo UKag PIO) cook , ecreNe toa Wyontonize with Heck 23 of Me senden. — Fos epample , GMI clodk helps keep separate Sequencun. Ne_same IUD) syptern Paeyend at at Ine ¢ tempo. same Aempo to kee ) Standard aoe “specifications sh state _Yhot 2 ee re tp) Av efexe v reFevones. a saad SN 4 MID de DI dock ¢ay =—9 quarter note. ~2Q.Ual ene ey[As an alleanattye, “eM pie Anny standard (& ey a dF Motion Pichures and TelevisionY Engiocens ) can Be [fused SMPIt psiteymat developed by NASA an O Way +o MAAK WO Coming data From dieeerent tracking Ao 0S So thot serena compulevr Could tell ter ea M4 onat \wnr_ each piece Soh data won Created. Vhe_\m_and_video quomoled by SMPTE, the SPT E Miming_shandand acks as eA precise clock Ynat skamps a Hime reading on cath Fran and Fraction ¥ ; 6) hie, enrlma Goro begining oF a Alm os video- 6 Or ad SHPTE, fon more precise seadiag oF Hme_. he SMPTE con sihs oO hours § ent des Seeond$: Frames | ioPts Cesample j bo Framn por send) @ useg q 94 Nous clocks Yai county Gom 0 to 2%) fo ever more Prease Vime SMPTE vreakg each Frame ialo Bo brie. LOMED SIAPTE__divides Mme into Searmonts ag Smallas one haeak- Give huadyed yn oo Seomd.| Once_a. comgulen ic connocled to IDI sytem, Q Lanickey of up| seYioare agelicah ons can 40 ——_ || onik col a) | he so Wow Neary eeally Calle inte Fouc mayor Meslegeter oe * || Music necording a, skorm'an pplication 2 | Musical notahon? and palling anh application x Sepathestron__pat-cl editors Vand \ibraviang | Muatt ealucatiog Applications — a | -SPeech Generation. ; | @asic notions. ee Speech consist of Jundamental Frequency as {i's component: Lag th ig uced 4p present a _vviced eewnd. (alloghone) . consist of, morph, phone,as_emallect gece unit: A voiced sound is_generated ‘via vocal cords- Me consist of yowd.s, contants 0g Ws component:| Reproduce Speech Out pukftaeneeahon. = [Nhe een} wart tu reproduce the specch output 3s te use =— Ahe_previo xecarded cywech and Paying, iA loo: : => | Spool can We verorded ag QCM Wulse de Modulation) 04 using tre Moo ol, digi tirarion of soured. Spoech Ovipus | Grenecation . a Jo wepmduce the [Tre goxvimavy qoal of speech analysis is te cowect of deiermine individuals" Word. - || Syeceh finalysis fails te achieve t's qual whea due fo Jalan factor - a Ambient Notse- D\_Word ambiguity example’, there] thelr, dear] pare. 4) Dialects and ‘etress: Speech Rewqnition a 4 7 |Lapability of clechvonic device 40 understand words spoken. __-7 |W micvophone record a gersen's woice_oad hord ware en digntize st. | dual worl finally a sodhoor digitized sound as i inpret inteyprels wi— Speech Hoclysi 2 ——Cirect frtgis] ie of ZY _ Coho) Gta 2) te 2) _ SS “sy — a S = ce = (veri Fi cation ) Craentifi cakion) | Recegniti on) (Gnderstancley | Fru: RESEARCH ARE OF CREECH ANALYSIS [the at yc A_guues the ‘ veaarding research are | agen bea seganding Concesned__valtn seed ‘analytic: ~ 7 Londlysic neede 1 steeaqwize who is Ane _spedver, he +0 know TJ. Ar human speaker hor covtain charccterishica, hence s fe Word Model Speech Revogn ; topabilit of etectvoate device ko undetand tne spoken words- aa Bator 1 tA == [= fatal | Speed —> | Acountve and Pronetical anatyin [ Prnalyria FLU: COMPONENTS OF SPEECH RE ComnirtOn A. i Nothi e 2 ated Xi Nve_ and oghical Gnalyats 2. || me 8 Kalical Gnalurin 80 Mal the gvvore oh greoiaus, e| agnised ona suyntay ca\ Analeyyin in_made geoai ding addi onal -decigion aids jo (a reco nised Speech. Wid cep deale willy semantic analysis to Me recoqnised specch renin and Hnalty undowalle a: nah justo \i ead ‘Ma _eaarnys oh | Speech in_qunenated TYPES OF SPEECH RECOUNITION SYSTEM. ” Cx} Speaker Dependent Recognition system 7, Lh Speaker IndependentSHeec any Rocen af senctg tig ‘epecch | audio 0 Som ‘senides ts be ecioves wri _— \undernental \_t0 = movide Me Samre_gpecch Laudio Ceownd alga tan generated Ot sender cide. Signal form Coding : . _ 4 \t is technique ty achieve ves nce coding of We audio gna witha consi nf Speech poperty A. paramelen Source coding in gavaanatetacd sytem. || PavamedoPeed ‘sunken works wi ‘seurce’ coding algoritwn. [Lt uses the speech at dio thonoclents Res foe adha rate reduck | Ceanngle: Channel vo-coder, pate S0ree— —y [no | _ Signal 4 re. [Speech Pat y Y coded speech oional ~_ FRecenntnichion _ ae “ea [3 ] 9 rmaley Speech ok Spal. wien vig soure ceding a = Septem.“| Only We charactenighics ol Whe speech elements Ore Hranemi the Used to data ato reduchion- oa we Speed Coding : Application for dala _comproniaa oh digital audio signal=> | tina nosed _yiaels in_an. aeatonic| digita | Ta said “0 digital mag. _______—__ 2 | Each gixel is srepaesented ~ aueneateal volun > | Digilal_\ eit more gixels in more clear ak bmite level Digital mag eis represented bya malic of sumenc values. 3 Digikel_twnage with niger _divn Aimension toasict Of Miqhey no. “of pixels and vice versa which AivecMss_gopotiona yo Ye ~ quality oh a \maae- Wage Wie Formate ) format: “pesaatplion . a T\ | TREY > Common le formal with vighty supported Jona Sunt Proragrap hres > Ves lossy compronion Everts Group] > Bost degrade is not much nokicable Fy uae ain comprenion T[raphics Wlercrongiasle 5 supports oni, 156 colors format“) > Can be_animated 3 ton add Avangparency S| png > bination of good \eatwes o [Qorlabe wer SEL ond LAE Uraghics > We see is bigger a6 _ = vob Com manly tuned [used for specail yrpes 5) [rie 1 Uncomproned (mage) {Oss lon comprenian Jagged Wage a Used ba eeperts high quay Wo \orna ii li ta ai a a?| captured Image format 1s sped fied by eo main 3 foramcers aS WW SPatial resolution. aD W) Gelor encoding. Stored (mage format format, while stoving We Image 1 Gara Photographic Exzork Ursup ) o& Cearaph ics tnkerchang eable format ) Wi) PR — Clorbabile Nehoovle Graphics ) : 5 W) TIFF (tagged mage He format) v) Bitmap [ebm p. deudoped by Micwsolt Jor wiadeus) w EPS Cencapsulated PostSextpt ) ; vy) RAW Craw, Crd )“mage fle formal _ “Sasi Joint Photographic c Expats Grups TPEG_Civa,-ipeg) —_eCommnan fle jownat_commen| jou_ digital cameras. © Compression: BEES= Lossy 2 Gest for: Web Image, Ennai Paver poio t . = Spcaal Attmbule + Amant of a Gil Cegif) compreninn can be. Allocated: Gsaphics \oterchangable Srmat: eirddy used for weld qrdghica. and Supports only 256 colors - 0 5 Compression + Lossless. © Best for: Web Images: eSoccial Attributes = can be animated 5 PN _C- pag) can ada ¥rans parency. G Portable Nehoorle 2 combination of quod features of | Praphics. SPEU_and_gif with bigger Mle _sfze. and supports 46 ™ Colors pused for SPeaal purpose. e Compression Lose lege. @ Best Jor! Web tmaget- | Specia) Atm ioule ~ can add Arana paren * a TLEE CHF Hee) # widdy used for hugh quauity Tagaed \wnage fi Jornat- pints, professional gubhicahon « Compreninn : Lossless + Bask for: high quality pals # Special Atsitoute + ta|Tn, general follnsing ANC Cons Aaphic “primitives and” Mew Wray con sis of Nines, vectangies, Cede, ellipses be Bastealiy graphic nage une sped ed Yoeogh arm babes, Wat idered as graphic jornat Meta Hi eg. | Raster graphics CBtkmap qaaphies) | Vector graphics Raster Graphics Vector Geaphics- Are Composed of pixels. + Stoves Images as wathe- matical repre sentation - such as \ines. |] Prxel_dependent_pa_ tne ‘An_\m he: © rel \ndepen dent | qual, and vice = ver. ge losee #he qualily |¢ Rescaled with 5 1 the waldy ok po Higher ~The _n0-o} pixel sere produce a igh Any Srna ths veg cal Compression. [Usually dont |___ CompressionScan ae ae Langs WW Size cemparred | to Raster . } II Cosh Jess e Comparatively higher ‘cost i ang _ 2 || Conmeriy used Vile evlenyions; leCommeniy used file extensions, TPA AIEF ULE, PNU, mp | .svey, ERS, .DWG,. Ox. + Oun- I metadiles: = | Te 4S Me developed or advanced version that allaos woth Aacter and vecton qaaphics to nesfde with 4 Same file. ~> || Thwas developed for tnrancf axing ob mag data, & fe fs uscd Within Specific sector with speciic application. 3] Some common extentionc, CUM, WME, EMF, Woe. CUM > Computer Graphics Metadile . WME -7 Windows Metafile EMF 7 Windows enhanced Metatile Wo > WordPerbect_tvaphice welalileOnt tv; Video and Antmvation a > || Video Signal Representation » —5 | Video Signa) Representation is the prow of presenting He visual Aqnalc. tm conventional Tu |lvfsua) Representation i one of major aspect of video gna) vepresentaHion lich durthen \ncudes Jot\wora 'g_\engortan measures D_ [Vertical Detail and viewing distant. o — [The gon of Hee W image Aqpercls gon aspect rao: The Conventional acpect ratio 1S 41/%- se tgeetiooeatatices Agpect pation > width - 9) ‘ ~~ hatqit h) | lengental detail and Pichive Width. “The piche width for convenlional WO) 1S 419 8 of, picture height: a _ widin= 4 4) picture height: re 5 pis ~__ [Total Detail Content of Image — >] Vertical vesolution = no-o} pfxels io picture ht. — 0) No" of pixel in width of pichire = vertical vesol K ] OA Yne_initial stage o aeneraling anima 00, the drawings oust be digitized Toonder Te agnerale [create key prames Jor _Aigiing Me deairegs the melviod of optical Scanning , Sracng Aled with cata Tablet 1s used: _ Sinus digit image chaddlboe vept fo ley jyrames_at echreme OF Characteristics poition fat Was te be animated. S| Composition [tania tage the forieqarind and backqrrund figures ace combine) 40 gprerate_ ‘he Tndividual frames jon the flaal ewinvation . mn _ | 3) [In bekween Process > |The animation of movement fron one posi tien tb another needs A composition ef \rames with Inleamediale ames _w behoren eet, frames This is Called WA behocen promse, which is crealed_| cated learprag swith some limitations Mh of S Ponss syste in 2od ending Position. | Whe ca sist Mnterpolati or method is ‘near jater? ola a - fir Ecample; \norder te calculate tlenmediate positen of A_Anwon ball Cverlically) ie air Ug he Sequence of MWeea 4 “frames as Stailnq, mid and {ual position, then the, hevgg or near Interpolabon is anable ‘We_caloulate the Inter edi ate positon. In this case splines ave Tnvoed. ie) Changing colors’ ae for Changing colors, compuler aided animation uses Tab on CLOT Ceolor lookup Tale) io a frame bubfen and Whe process of “daubk lbupjeiag: the Ul animation iS generated by mampulating the color \wkuP table. the Simplest mebnod ‘1s Wo Gace He colors to Ahe lut4s Diflerent languaget dor dagcaibing animalion, are, i] | Unear-Wet Notations: >| Unear Ket notation language is animation Support language Where each event wm He animation is de crib] by Starting and endungy frame mumbo and an acon that Was to: tale place Ccero Cecene Wornat) jc an example of Uneay-Uct notation Eramgpe; Lb 4%, DB, rotate ,"palm”, 4, 30- here, startin ame no: 45 ending be no: 53 =) table | Rotale > Acton Qaim > doje ct i) sqraight angle "I dD end angle - oR - ° from 42 frame no te 53 , whale the object called Palm abr aris 4 by 30 depred:G raghical Language. Computer a Mite \s alco a high level pegqearming language to = i develop animation ao well graphics - Ce | Geample: Autocad [Autocad - ~__3) | General purpose fanquage- ~__ "5 | is also a high Teel Pre computer fanquage - dweloped for nomnal application soktwoare development: F Phat Sapport We fealuves of animation ala? 7 wth graphic drawing c Reample: ABASIC ¢, Crt, java de a *_|| Methods for Cont relling Pmimatior. _ Oo Ditkeronl methods Jor coahoiling gaimaton anc a TI] Au explicit contro) “=a Tt ts the simplest type of Cont) tn anys animator provides the ene infomation of entire events tah cold occur fm dhe animavon. Wie “animator may Spesihyl changes. Stith AC trang lahion ecaling, rotation. s = Ee| Rreced uwal Gonteohy Hg a a Tt ig based on communication beltoeen Yanious clayects tp determine thar properties: | dn_yanticulan, + Physi cally- based systenn, Me ge sition of one ebyect May uence the motion of another olgject “example: balls cannot Pan thay wang + ackor- based soptans the individual actors mag fon their positon to other ackors to affect: thei, bebavieurs 3) || Constvaink - based Seplems. >| Tt ¥s used to speciby an animalion sequence. | 4J | ivackuig live achon: | -y |} Bue action can be Aracked 40 generate Ara\ecko Wes of objects io the course of an animation . 5) | Kinematics and Pyvramics- z= Kinematics refers 6 the position and Nelogiley. 6} poids. Kinenvalics describes the Scene. And dynamics bakes the_accouml of sha_kinematics « Puystcal laws of movement that “governs _¥|_ Dis play el Fininration __ > |e display animations with vaster systems, animated object < must be Scan- converted their pismap_o frame bubber: 3 | chao a volating object, we can scan- convert ko the Suecesstye pixmap views. > _|[Sean- conversion prwtdes a smooth effect > _||The fram buffer. is divided mito hoo halves Images, each with hal}, ol, bits yer pixel of overall Arame lou fen. \el_us assume image. and lmager as too Halves ol overall frame loufter (pimmap) + load look-up table hk dicplay values as Wackgvourd clon + Sean -convert object ink mage o + load \wk-up table to dicplay aly image, REPEAT + Scan convert ohyecl mbe images + load lok-up table to dircplay my image, + Rotate olyect dala shucture descuptr o * Sean cement object mly_ image, ‘oad Imle-up *able to dicplay only image, + Qotafe eby ect data shucture description. oNtTEL (termination condikon)tenchniques Ate Used. Symbolic RQreemtation. ‘Va Bo Ane an aphi cal Aesoniption (civele) ob an aninated olgeet Coat) along with operation Command Crot!). Prinvabion is_dicplayed al Wie gecieved by scan- conver Won qd obo) eck tanto Plamap- ‘Twansmission vale depends up = size of sqymbalic aepnesentatiod chuchie, size fh | operation styuckure. | + number ef, aninrated ahjects and ef commands ‘Transmission tre ic short as symbolic “yepresentabien Te smaller twan pinmap seprezentalter tout dic pray time 1S longer WN Scan Conver {or Wan Aa he done At secefun's end: _ a | Pramay Representation ed longer Aranemigsion ime than symbolic repro ¢ ental oo because of large data sire in_pinmap- > || Shorter cieplay Hime because no SCAn- Conversion Wan to lz done at yecetue's end- ~> | \Wwansmission vale = de cf piemay ® grame rate {fixed dyansmi elon vak)Orit Vi rs forage, Space. ’ : : ; u vs > [The storage. spac sequirement or Phe uncom pre sseq} data_is kan Wuge AS compared to the comprened dala. The uncomproned daa Aaemng more Sloraq spac while subjected ty Arancmuwn Sova digital nekwork TS highly complicated w the sense twat the uatomp roned dala Srequires highe bandstdth for a single point- to- point communication + find fe eradicate yl s complication alg with more wst ebyidensy .mulkmedia tem cee campressecl formats of digital audio and viaco stream, & Coding Requirement Invages Sequices Wigher storage compared to dext- Audios and videos have even more demanding properties Jor dala storage alon wih data vales Jor tomm unicapoo. Comprenion | coding to mulhmedia is cubyecked fe antarn limiations| conkraints= while dewding \deomproniag the comproned data, ii shad be as geod a8 pomide, Oraleque Mode App cation Rcrieval Mode Applicabon- 24) Dvaleyue ‘Mode Application. —— > || nterackion amMGg humans [users via mul immedi a tak oY MAH ON. > || Requirement for cmpremicn and deompronicn. End -¥o-end “delay lower ywan (50 ms- tend to- end delay" of 60 ms fos face-te face dialsque applications Z| Retrieval Mode Applications. >] A human user nelnieves information fom a muttimedia databace. = [| Requirements: + [fast forward and backward data relwevay yuh imal tanenis dicplay: VP rast search Jor Information io mullimedia databases. 7 P Random access te Single *mage and audio Frames wilh an access time len aan 0-5 scemd- + | Qeeomprenion without a Uak te other dala unite ger yandom acon and editing:ft rope fading (statistical) Lossless codio deceomprenian proc reqenerakes “Ye data completely. - - bly Used regard levy ob, the vacdials egeciic charackensvics. Data_ctream is considered fe be a_gimple digital Sequence. Examples: Jun: length enceding, Mulfrnran enwding , q Asitimele encedi aq wy Sure Encoding. \omy coding ‘ Semantics o\ We data are con ddered. Dequee of compremion depends on data contents. JIL] Y Examples: Pulse Code wiedulaton(Opcr) Differential Pulge Code Modulation C DPCM) Diccrste Coste Transformation (De 1). Eniropy, Gding Source Coding: Locsle sé Coding , decomgremon process }e Lossy, coding. Comply generated data compktdy Indepertst gp, data characteristics | + May consider cemantics of dala Simple digatal sequence of data stream + Degree of comprenion de pends on data content: lex: Hublpaan ceding Apanmelic encoding: | + ec; peer, DOT -py eomiag + Wuf{man coding - Huffman Coding, Huliman coding is a lossless coding , where ducing the decoding of data completely regenerates soe. oaiginal data: 5 || Yur pose of Hudiman Coding - 2 | Nata _com prenion ’ ll pata encoding whl lossless data comprenion Prelix Code» b ~y llh_meang thal codes ) Prefix codes meang What the codes (toit sequence) Aste _amignecl i such a wa Anal the code assigned t» one character ic not she prefiy cocle agsiqned ti any other characters. OR | proliy code Aw the unique sequence of bit or code shat ic assigned ty a _eevtain character go that No other chavader have the Same code. > | Prefix code is made up of OS and t'c.__characler —frequens __., 4, b <0) t — co aes d \d 7 at @ \S £ 45 here, mo-o} character = Wi. Code must = of length 3 a 97 26 (not of Suitable ro use) LB 26 Cguilable te use) STEPL: fate i let Ceu2) fate) fetel [eras\ STEPL: Select two leak containing tne least values. (Always select character Uwe) that gives minimum sutpat ) Sdechng Colace smaller at nq side) flv] rans! G4) tel eras: Tals J Pols] STEPS: — Select two leaf with minimum aud pal (place sreralien at left side) rele] _@ Tete2 (2s) 50 Tews | es ct] lata) Ga) [else ZN fats) Tels) rep h: (F(a) 65) Fela] fall3) Qu) Te 4 [ams] SJ STEP 6: (eo), left and 4 fo sight lea} dor entire tree. | Amign Oereq wency PD. code- ; : UENCE Ps ees A 2 (100. ee iz b a yyol S \v (oo 4 13 vol _ e SG Vth £ AS ° - Otte used before. coding L BRD + BKB + ADHD + 1DHKDB 1exdr UBXS = 300° Bits used after coding + BRN A GRY 12S FBR FT \ox3+ UBXO = ATS t. B00-319 xyo0s 40-3 ‘h ok spac is saved or | Boo Compremed after Uning hutiman coding: _& | Arftlametic Encoding ~>||A-E- is a form of entropy encoding used m tocsless data comp. = | 4 string of characters is represented using fixed number of 3 || When a string ig converted ty anthrelic edcoding, Frequently bits per character. fused chavacters will be gtoved wilh feaer bits and gharaclers > | ASthmetic encoding encodes the entire message wale | Combination ¢ Lechniqueg_or_comprenion algositans ~~ which worke wore data. Livenlly iworder tu generale comaprened dlyovi d Coding uses the sare format of data compen i dn jor Comproning data. Uncomprened data: |pichive. Picture [_Prepavation | ichire Procegsing t W fete Hon l aT RES | Ghivory, Encoding y Conprened Piclure. ig! Mnror STEPS OF DATA Comparecy ww ns nnn rsLossy ¢ Det Discrete cosine Transform. c1 based Mode. Enceder HY * \ enh 2 L—>\F0c 1 | \Quantzahon| J NS comprened — t nage dal | Uncompressed \ iwage dala Caves] [raves] ie: Lonny Sequential Dei based mode. =< Aca) = tb Coy & = cosGxi)un cos (2415) 4 eri 16 wa ichove Cu, Cos FNr for uO , ofherwise Ca, Cv 2. \mage. Proce ssing + Neher \nage preparation, the uncomprened wnage data ane qreuped into S&B unis of 8x8 Pircls- \e_Opi cu Cach sample is enconded using p= Sbil: Each pitd is an itegen behown 0 to 255 oe Image procoving 'S carried cul as Joilaos: = = + oe lite bet based pranshormation ceding is caved. ail- A forward DcY CFDCT) is applied doy Yateraconstrachoo, Yh decoder usec ToctQuanlization. \wa Qe Proconing ic fonooed by quanhza tion. o : g The entire lossy prcess occurs quanhzabeoo Hecific krequemicies are qven More, importan@ than overs - : YaWes are used for quantization and dequan h2za}in Iwvage qualily wary decrease due to quan rabon : 3) frbepy Gneadiag. > | Qwankzalion ic follaved be Eke pyt Encoding (uumerg Sukprran Codeeq JO onty) g + | Oc coel{i cients axe encoded by Sab} racking the De coe {a dents of previms an > -luflenan coding 1S prefered ag his Tree (not patented 1 | Coding tavlef Jor eadd De and AC cock praents muni be provided: TT] Ac walficents ane pew wang Zig-Zag sequen“Image preparation mut be San bi Wistead of Pe S_bit per piel: a Agithroeke encoding can be used io “addifion +o Suoan coding in entropy encoding sechon. ry a Nolte: Only Above poo gorats dipherenti ate lossy Sequential Oc1 pased mock with exparded tomy Det mode Rest ie same] A is 2 TPEW and MPEL Compronion-User \ntenlace Basic Desi gn _\ssues . Architectural Tssues An ebbedive [pres enlation] design shad support an wleractive action along wilh sequential flow ef ‘achon$.” ‘| Gach Presentation requires continucus and Imtantancus fedback while walang decisions regen ding media and modalifieS: i; Information Characleti shes for Presentation Chfeckue human - comp ater \nkeratlion Audio and video at user Inlerfac. User foiiendUness Cprimary goal) Toform ation Characteristics for Presentation. A_complele eel of lnjprmation 1s Neconary for ap prprale Mapping tn behween lnformation and presenta bo technique. The Information characlenstics paby- ‘Types _ Relational stra ckuves Mull domain velation lange dala _cetsered dala. There are hoo types of or Coordinates vercas amount. lotervals versus amex Vato. 2) || Relational Structures => || Relational gtruchires rekers to the way ta which a "| selation maps ammg its domain sele Cdependency) > | Tt congst of two dikf erent clependencies- a) functiooa) Dependence. example: bar chart: b)_Noa- functional Dependency. Example: student entry ia velationa) database. 3) || Mutli- domain Relations: > | mwbtiple attrtoute of, single chect wuch ag position, coin. > || raulliple objecl sels such ag graphical symbols on a map- > || multiple dicplays- such as multiple winds A || Large data | Rekers to the numerus altribute a coleclion of heerage neous objecls such as presentation of Semanhc nehaorks-Paesentation gunction is something jhal disp! ays an 3S - ehjectS as per the user sequirement: such as printf jor display ok an ebyecl ov character. || ais important to speaky presentation junchion \ndependent Yo presentation form, style oe infprmation wr conveys - * Presentation Desiqn knowledge > | Jor presenting a deign follacing Hugs [topics needs to be consi dered’. 2 9 1 |) Content Celeckion ~ | >|] content gelection is the key +0 Rresentation devigqn. The ° more Clear and gimple content in presentaton leads to higher efficacy of presentation and easy Ye_convey the desired [appwprate lnjprmation yo We user. Media selection. Along with content selection, media selecion shaild be made aypapriate te conwy the desired Inbormation to user. with higher efficacy: for example, a presentor has to demostrate the size and ghucture of a play grind Ufsoibal) hen Nelche chould use graphics videos rather Awan dext . describing the Jeng th and dimension.Coordina tion : Coordination sien play veers to the collection of dikberent aspects ‘tchich helps the presen tor Yo convey he desired iajormation Yo the user with clear victon. Ceerdinaticn may combine Yollacing aspects fv making a better™ persentation. Encodiig techniques Presentation object Mutliple Displays. EfFectwehuman- Computer Interaction. The most woportant {ssue veqarding multimedia Voterbace ie ef fectlue human computer Wnterhace be. User {yhendtioess The main geal of multimedia ve congiclered as effective Ruman- computer Wlerachon \ user }riendiness {om beung user fortendly fptlooinq Gitesa chald Wiarch. vi Easy lo learn lngivuchoo Wy aby elemenks § Easy te rernember Inshvuchon Wy vid) Wleann@hul ipcarios foal Effective \nshuckon iu Nocation of fuedt® wy pniy Presentation v7 1) Dialvque boxer AestnelHicg- % Effective \mplementation support |x) Additionay den xy Design SRecifie ¢:encliy a ghoul posses a proper > [| MOI_for bang a_user 4 sues s _ \hat the user can easily vem em ber qhe application Inshuckoa Toles. Any dh MOT having easy rand simyle_iastwucthon helps user Av Interact with computers er Cevies. withark an complications which will qurther Jead to Avend linen to MOL. Sl Thorder to maintain the friendlinen , the loterbace should nave those \nshwuchon that are Sienpler ease cand also the Prevailing Inshuctica ome other means wich ‘are tn general use ok public Thumans. 5) || Presentation: user 5 |/T ic another erttevia Mat leads to Awendiiness . ke Te General presantaticn least can Wave follacing vasants » || Avbreviated Text W |] Fut kext | Wi] Toone be Qrayhics ’ wh) Micons je. motion videos : fach variants of presentation MAY OF MAYNot be emily underctsod te the user. Example: cw Call Waiting) MAY _ be easy te undewtand Yo Som» user hut not to all ca waiting can early We early undembeod wut vod clear | \con We vecty dle Wore roy be eamly depict W's use ty nek to all.Dialogue Boxes - _ ; roe = [Ave dialeque boxes being dispray wiih opheae ke ok and Abort cheuld always Wave a eat 5 to place them al A _Specrfic part of, dialogue Ook Avr example: While wnul Hple_diailecte lox “Ave disprrued Hen He _Loulton ok of entive dialsguc Doxoe eunid ke at came poution Wke Hoe und anlyang, dial eque tox should Wave We Carn des Boning of ophons as of Surkace | disprayed Done. Additional Desiqn Criteria. yy bang user. ricndllyy Interface RIS jen por tant that _certaio additional deviqn be \ocluded which would be helpful te ucer while lateractng- The cursor achng aca rotating dish Instead of berg steady whik a task ic at pwogron. an _enby bang highkghted while boeing Selected, Fthe detail of any wage video, audio beng dig taged ag _a_cursor stay on it for a while, J te ns Design Specific ovilevia. Along with additional deign ov teria, deniqn specific aiteria_ way intease the Interact on behaen Wee hewn br userworke | or ‘Lelephrone specific pehcore < functions hi Ike dialing a nurakey, an telephone 1m mobile e end device smut per cH comer’ o. aneiveng A call request over call, x . requivere nt plaang he call on held er adding 7 a_call - | Audio and video at_user Interface. _ - aa + an be ‘vnplemented al the user Interhace dor J Application @onrvel Tun speech analysis is neconary + || Speeds Analaysts is bamicatty eb snooty pe A)|| Speaker- dependent Anal | T+ alllans Moe Input of aor 15,006 aia " words with a relatively lao ervor vate [in Speaker- dependent eoralysis A Avaining Session iS mut for Speaker. aperikic chavaceristics. : - — b) SPeator- Independent Rwralysic: > | t1 Bs len advanced awran tal _ob Speaker dependent kom in A gence Wal Wocan oly yecoqynirve only Jeo limited worde- > || this paralysis thee \S NO need ok WwAaming Sesion. Dimengion ef Space ramopriony 9 Lal audio sources Wave same ¢pahal i Storophmy _( allacs bikaleral Weaving ) Qua copa} Coconcept ob two ov move cbrannels ) iv—* | ideo] at sey Werkac, IN continues sequenee of alleal 15 images per_scw gives A wuqh perception of coghinucve mohion prchwre. 2 As A_usey \nterkace video is implemented Awreugh A _eonkinurus Sequence oh Individual Inages: for enamples Oc _Usea Wheabace soltware Yai Inplemd Video Hivngh conhaung sequence of Swragea J Remole Camera Coat) Application - =7 M1 is bamicalty used Yon surveillance Purpose > || Meve camera \& romorelyy conbolled by a computer: Eadn Hine camera recoives contw\om Computer And worl accordinady: > || Camera can be atone Waugh — |\keyboards — || ukong iO Windno Suber -_||_semt\ bars merce, foystion ele, Suptem SoJoave Hypication cognoare. Enables entive sepom for prper | Sophware Wrak wun on OS gunchion ing Syeaiic Purpose. Machine dependent Machine Independent Direct hardware Werachon \ndivecl hardware \atenackon Walter i lao-level language + Wailten io Wigh-leel - Fanquage- Tmlalled alg Pr 0S. ‘Pstalled chen vequired ene Ge. Device driver, o-¢. Ex: video editor, Qyeeadsheel*Mollimedia Qppheation | Obieck Ovented Wigher Deqrammng Yeqraraming kang _ \anqyuca J& Tours. J Syon Seloare [_ Ubraves Qauice Driver for Continue Media Device 7) [[\nivoduction to bbravtes - s [The Procoming ol, continucus media ic baeed om jundiod or get of, funckions embedded wiv \ibranes- || Wis is_usual_ solution Aor programming mull medi Ubraries lien wo Maeir_deqvee oh alntyacHion.ach ee _ alec. channe) = AADI_ CNA —__||_ ach. mode = qapy_ pay _ _ _— aud ait C4 ach) audvc = Fab open (Audiofullfile Name, AWE ®_ open, 3 AAEB-EYNO 0,2 Fad ,0,0,00)) fork (START in PARALLEL) 3 raud-ctyt (8 ach) displayPosition (RelaKve Stavt ime, Duration) = a Septem Software, =>| Instead of Implementing accen lo mullimedia devices a theeugh individual \ibeavies, the device accen can become ° part of OS. a) Data as Time Capsule. Chile extensions) Fach LOV Clegical pata Ont) caries In Ho Mme capsule alma with data type, actual value aad valid like seaq. useful concapt for video, where each brame hag vad Span oh 40 me P changed presentation rate Jor vck Cites CREE Ree — dunchion Uke past qerward ; cleo fenced | Past rewind| Data ag sve [A stream denoles the “continues Koo ef ~qudio and. video dala between a seurce and sink: - i wide te Me Slow ,e' Stream is etablished equivalent he Me setup of a connection i a aehoorleed envtvoament: S| Talks: S| Toolkit ig considered as a simpler Way compared Fo |The Tnterpwoan Communicahon LEPC} muoh be cleri qed and Implemented in real-hme(the current LPC _ecan be omitted). SA ample Vanquage_chaild be developed go twat it can be deniqnned and be inplemented to teal Wma : 2 Examples OccAM-2) Parallel C-vaviant , ADA- 5] | OGsect_ ORTENTED APPROACHES. > | OOP is a programming Paradigm baeed on concep of object and ig the collabavation of different deatwee such as Cam and shject, lahovi Fance, polymer daha almirach on, encapsulation. as“Cam 16 a collechion of aimil user dekaed data type havin Junchioa. 1} don} allocates, memory whileit vg Created, S|Lohject ts an imtance of a clan: tt allocates Me memmny when allocated: | Symtar lL Erample: elace chudenk Class class-name & Public data : Grav name lo] Y Junchen int id) Jy ‘th bp | Toleaitance 3] D1 is jhe poem of acquiriag the quality fom parent |b ~ a clam fo child daw. Example; Sports [| —— Parmt clan|base laa [Trdeor Ouldoy | —s tni)d dan] dowd dan, JL oN [ones faux) [Mac] [reibatyitu = [Rely means any, morphs meant cforms Tuy WV means having many forme. | “ Example. A Person M could be Me bye ther of %, could be hunband +} Vs could lo Son eo} 2. More pevton ™1 qs having multiple come - ‘Types of Polymorphism. Dl Run-Hme polyworphi sro 2 1) || tompile- Heme Polymoyphisw. Deviceg ag _clamm. Sl ore We dwiceg are aniqned ‘as a object to represent behavirur 2 intent gen Exam ple: claee media-dewica — ' char name [ied ] publics void ond), oF FCI s 45QMO: Bae Multimedia Slaject cM ° (emnpand wiul\imodiq object Processing Unik ac classee Three main objets ee = lI a Sore oO ject _ b) denilfoation ebject ; © tombined gource — destination cbjcet allows data fiow path via _connechon of obycele Media as can) dere media au amigned w_A chet nal dekine Wemanhical relation Joe dibberent media- dikkerent class Vierarhies ane better suited for difperent applications Example, video Video. ccone Medium T wage Hentic Mediuny S mage. seopment, mMugic Dine) Opus Une Score Pinel _ Pudio Block Column Sample Bloc Pinel Speech Ora walt Ce) ais Teck E Opvical Medium vee “| Video ~ Video scone