Scribd
Upload
32 views

Final HPC Unit II

Hpc unit 2

Uploaded by

mehetreshital1212
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
32 views

Final HPC Unit II

Hpc unit 2

Uploaded by

mehetreshital1212
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF or read online on Scribd
You are on page 1/ 26
Froy-(rhary A: N+ pace |pAssistant Pot: “UNTT-IL @ = | compu ep _9 Tiallel Pecgromming. HP CIBE) ie principle of Pavaliel Aigadtinnss deo pss eases = An algo: provides ep try Shep salu! ¢ eicwes priden: fir alga. [Fass fat the_unes_and boned upon ijp> aftee pel-forming- ~____ the defined Computahns. provides the FP ©lP. = etek = “The _bapic_sheps_in_}re_denign—¢_li4_tlgo-—are 4_pantaboning L \ Wet Computation and_omignmef- __ _ goal |@: Geenpeererth -compufahina inta diff. pecessors - ___= Decomposition , task § Dependanuy graphs # ______ + _ Decomposition 4 ay ae: “ovata Computation can be pasta i jpho_seme nurber _ 4 Small_size computation <0 Huai the longea> __. diveded path er any paiv ¢ stmt and finish mode, = The quant yetened ao critical path length 4 the. Sum_g weight ¢ node ona. cniticel Paty — ee i fe a ee D_Totol_amoun—e_ work = # Hee, th tal amount [email protected] lh Le ie 1S assumed | eenege 4 degree 4 Concuavrenty ~ _______ ——_—_—_ = “the avenge _leqvee _g.Cmuuvrent} deal swith. — the _avg_im tosks alowed te’ txecuse joel. tes degree lors sven, — “Total ameuset Valor. rte Bact Neng 4g jp Avg degver ee a |__ procemes and Mapping = = The anvivorment_.tn_tonido_o. pralem in being g0\ved by mean 9. Viel Compuieutan usually. heir Severo cunning _peccewa _Simu Haneart ico With ach obtee fpr need 4 > synch and exchanging 4 info? = Tht peg_unritten_-fr_Such_platfuerm are cated 1€!_ pooqe- Zone et prog can have Rae penne ee tn — diff: tasko Smuttuneowsly - Se —— —2k__Mapping £ In We! preg, doaiyn, iH o “yequired 40 “specify where each tas in te erecule rd fi we fonad proces pavtorma ex took a a apn nla NE Prcen 2 called: mapping = —* De-Compasiray dedniques @ a = Te tage date Sis ipvabed—_ in dite pelle eon le divided sito _emalle_pau'_and: piney jndepepdenty = = seaial Reampi(ien Grantee t= — ——__—___5— _.. —-— Lammom Heck suped Foye = There_oye__hapicaliy 2 Stera jin Hin Mechniques = - & degrned Computation ia divided — into. ie oe a” cle tri ae —__Compuknhon inte mer q tack handled on tne pordabienes data» pi : = ar pele al ___fxample= Maki Mulhiglication & = ane at) ua eg ke al Bee 4b _ylald_averhix C- Te ofp matux ¢ ca: nee _Pantaboned Vata. 4 tank given. elo: Have each tasks conpuito ane element Q reoult mnabix it: te Mabix a> |Qu ae | Mahix B > |b bie - Jost au [bz bee Mahix 0» [On Oe bu i} Los, oar | | bo, bee Mabiy C_ —> u cw | Coy Cae La, sb + Qw- bey aibaaon sees | ay-bi + Q22+bar Qai-br ¢£Q20 phos | aaa a) ___ & Reansive Devompositn? J —_ Wve tran, diene § Gonquer_in cae dine shrakegy~ 4s solving ee Te da_loaotd oh Dideass Mt _appaa eh est prods _direcky iftit jo piviel Dan dt ppt dees ts pal taesdl fi 4 canna she Sabved aa i 4o_and_sotve the 894 flex pb. = a Exporatny Denowpacition? —There aat_gitabian here _¢ —\n hand with }£s ete gudl, prem typically AVAL tte exploration or search ¢ tale space q- sol Ne geawh space prt. do divided inte inate! bench Somuller pak un searched Cane ienHy Bil the potnp od which the expected sa? ua found . Lxampe = SEE Sa ee cee prdcblean_, Such ov find 'ng nodes fo a2 —_ + oe = 9. Ale SS Burd _peobr xo I pene —toived- using) bee denen : _____ tee: domig fiom inibal_con ible buccenees ave aw = —nunabesrol | Hanoy tae gel ie tae gal Shown 4 = ore fle Is tet tani t So that_maren Con he mad @. “Tle 4 possi bles mover here aie veprerenkd a moves po __ down plete § anger The stent $ inal conf one Speued 5) dwn _ paul o_chaattained ) objedhve debeamiais — ayy sep morea for a ek ie a ae ae 209g Hep —e must be Seacded fromm ei — Le hy] 34 a3 iP a4 sisl7isl [sel [slate fo D I 4 loll qo} 1 t Pe It 3 VU Bays Rist Ils. IAIGHS | See Feast) 6 foley Aleta a —_K Sepeulabve Decompasttray & edo tin. sushian when_poq_hos may ephann— 1 apolar eps she deneatbed. fa tea 4 spooific task + Coasida a task T]. invelus in = ee _ output Ot: TU gittahes jn which “alleen AN he —_+hi_veuuit fom tte compu? to te executed in Hot can will be kept. fue anhiaPcha ahaxt +t. possible tempulahios Cannes ee lorie a 2G - Constetor fall Switeh Shalement un Seq $ Hel ven jon auenbal Net __| Compute “expr 5 =f slaveqy £ — + Quoltch (expr) “Compute eis a) [= =n f : ooh + (requeor ); Lr | Case $= Compule-et iF (vequeas) brecte | ____ send (ei, 0); Case" Compute -€2 7 & breate ; Maser () Cage 3". compute’e3, 5 brate | & Compute expy |. aise Suiich (err 3. £ * Cope 4.) ¢ Fe i Serd Croquet, 11 | ee ee “ . r : | nda | Exavuple Topalogi ca! Sorting = i= &n_divected. a Sorting to used fy. provide an ovd. ey fo vetices VEY ga tap G. fo_thin Gap, ———teheen_ path exists be? UB V, Shon Vv apreara athe a — Au qiaph howd acytic pe, ctgunie “fran edge, —__repremenied ath from Udo and fom vy wy § Hotspot tue _evcleding camnt he.» Ohtaunod - fi bts = i 4 AR pesfoned in which Jame deat depend On the othe and if in ———pétlible to do-enly one. fle: ani a ———-he_dependanu graph, jd odeing ab? V Vas Ve and. Ve pV3-VeVe + The_altye the Jomcal Sorting alga: gre? Tri in- | the verry a find 0 ap o_verbey with dearee O- ond ere it tn the lish thee o_o cyde fourd ond the algovitinna—_stopy = 9 Pemare_Ahe vente (1 and all edgen (iv) it belong ———from_‘he graph: _ r ; ; Ss 3 ; 4) Repeat glep-2 thin. 4 till the senkicen_pranent fon processing fn. Tp Sorting * ee ded_qroph GWE) fin Leen acs Rien eo. xe —___V_precedan ww In _dtre ortanfeg Tnvalid topelogical ported gregh __Tepalogical sort Aigo yet ra fp bef Sine ee eee ee ee 9 Duele the yoater 9 incdeqree 0. apd all it. eubgoing edger From. the raph place it Im the ojp - 9) fepeal stp 5 and —hep=9.until_qrnph dn emply CA oP ® aac uo a | a 4, ‘= | 36 a al - Seen tuple a7] —S=08 RS SE EE wT a se —_ —« O86 @ ——— Pepeat sles § 9 watt —asaphadla amply - a 7 =O © © OGG Lats Finally te ‘ppulogted aurking 23a shee ——) | _ ak Oharachistios tatea_and faleathon® ee [a Charachishian She) eee © Generates 9 Hepp The taalt_iactuded in| 14_olgo: are _possilie 4o_gencrore, } = eivhet_on_yrioy bonis _teumed aa stabe /dynomic. —_____* Stubic task gemeroben? “Tha_took _aie_lefined before. charting abe thes. ¢ dial axes g tne algo: —___and_speaifi ed_order_ta te he. Followed by the alga-in exe. eg, Rplicak « mis tade Genta a = The tank +o he pertoroued are ceased dynami calls hoped | upon, the _detomposibin ¢ the data mn _Cenrain Sitkabicn, Se eee before olay. fx eurhon = —#& Mapping Fechniquea* oe: a = The _-miapping cP to used to map: asa into procenes So that [el exe. Can be performed - = She oveeqt Computabon ansoclased jin_peblan tp +e Solved. divided intw nes 9 task. = Ahese teil ave esapeed aula _ppocenes. with the goal 4. — Completing exe in the maiviewura anabuiat g hime: Thee ger 9 techmiquenes 1) static napping 2) Dynamic a 4) shabic mapping = ES PCE dp performed —indicades Hot tusks ave dishibuted befee_exe-_9 algo. “Thun avenge pones Pho ta on 7 Schome__fm_Stabi< ama pping + F i 5 Yk pps pong. | a ae ae 3). pytand shategion 2) Dunamic mapping + a ar Ahin tech the mapping 4 task ante cthe proces —_—2_petfirmed_duving the €xe- 4 the algonthm. Ce ye eee ee ee eee smelt inal deducts wane jeep eee 4a ued: = namic Leet” da _applial in atualtes whee. ange Amat amout ———— _—4_pavalel gprs slot a ae oe wed ty dlasaike the Slory -fov_patabaning dee. sah how _theie dota ane preconen = Js sgh etc epee = ———lffLalgo.on_-the_banis g 2 fech + _ a [nah 9 patterned apiog. tech ee | proper use _qshalegy fir inkeache smainimiaabons = There _ave_bavically six diff. types 4 en i 1) Data_vel mode 4) Masles [slave mi —9_The fade graph model 5) edinl jeticn-ceonaaelilales 3) The talc pool mudel ©) Hyloid model [ras er wap = tle once the date pave been dishinwed Pl opiawe>s Can he pevfremed= din thls yay, 4he ope? perfovmed ln ead task k ave Similoe but dhe data On whidr sere oped Woes are different . = The ove! task he. Puafarmed may he divided into ite piaca: — ee cea el ene L = The Nel mahix muibiglicaron a example ¢ dati Computarn 1) The taste graph model? = Pr we _hewe alvead4 shidied tek dependany graph ty wah 40 denote Compuraben aun WA oko = fle dark a ne Ht ih label est aese ie dds Coss eames by He, injevretahonship: ameng the Haak in_qesk dependasiy qua» Je data movernant curt va optimized hy the une g amapping - Statical ly» — Me _if lism dancrihed twits foot dependanuy qraph Whee — 260 tank ian independent dale to Called an task (lism, = 2-8. parallel quick. art alga. int = fe? ool Mo, i a ‘ib ures dynamic mapping approach fin tule awnignment >» = In_4nin,_cenhiabized or decenhalired mapping Con be. : adupled « es Ae staph phil nied con be uve in | smasq -paming paradigm. _______twhen_datuamoctasked voithe the faobs sin smaller than computation amociated wlth the tasko= 58mg iat uieh Oenk deal JALa ach te— ba Masta —slave quodd + = Sn dla (ene puosemer ip designated ay masier-5 other an slave ard méntts di _rtapomihle 40 tnordinase. the aeBMRG wumerg | mat Sve ppeneyen = fn_swanier_, it generates ra ee meq _vankua| Slaven procenens = Teal? 4 taak a deptod tip size 4 tusk: L = wee 8 ave ih albocated fo odtnes Jobo it Peifayms dift-zoke ____» masks Jo respomible tv _syndaonin +e achvibes g Hae Slaven = Of each phone « So! = The maak = slave model 4_gencally suitable fer doaced _____addiesa_space 5 1as4_pamin4 fagadigm: _ —— 5) Te pipeline ‘or producer -Conume model? = This model 2_Iponed on tre Paning Gn Seam 9. data Ho: Pocenen arranged tn 0 Sulcevssnr.— fhe date fas too. suctenive prcenes $4) that atch procen does some ope? on it This so called cheam Helism, ——= - Wheneres, WD leks eA a ae vernal Inihates by He poceers in He pipelite. This maoclel ip Glled ao jpeduent ~ consume awed —~bC2_ pipeline ach Ao chain 9 producerd Consumeen- —_____ i = ————— ee i i. : phased an the doverage 9 at diff achvities vequived + Péifoner_tanile handling I computing using copa. D0 cpelial fir unit fav transéen dental . ———2\_4 multithvecwled nth pep 4) Gn daip\ thared memory. = Gnafarier _finend blocks ue dmiged ty snulhprocemoe. dudien Hread block dnc. Grup gral recut tes —_§£§ Sena he nin iti ei cas hpi Amend lolbek & Communicaha ~. — = The comm _.in_platform sin in eu g peer -tu Peer coma. - “The_copA peer-te-peev API in used > enable divect - b. \nier device coms - =. L =“The_cudA $16 1b peerto pees Com. ‘The CODA P2P API Suppor two rodeo hati allaw = divect Com? bel GPL; - E e pee to peey Olea $$$ $$ 4 ive a. a idain a COD. aM Organizatans <. : = Cup lunes segmented memouy archilechne tat allad appl? a at and fexhe memory dishnit Read and ane chovachisko - _ 4 as vale." loral™ { well a reqishera> Eve Hkad in teed beck han wrcen = 40 unified (shoved soem” » Shaved Oana ch Hyreads fir the ife g thot “tmead Werks Finally all thyead hove Tead fume. Gicem fy shohal memo = Thew aloo eiSt @ sead-only ‘tondanP 4 bexlure memay in the some fo of global meray, ~ Global 4 A i _____may_ re" coalesced’ 4p hide “phe high memay acceia fokngy, ; ; : - ot Qo e\ohal memo4. thin mem deny be cached » = jo 2 foe bal mem: and 1 also Cached « pre model implemeitabor | | Pogrard Model = Com astute [ Ginpie [Diraul Be [S4S* boURAay i Operabng Systems | : Hilo J si beundou, Pochi lech | bch See — ncn = The boundary hep peag_§ pred model inp L_cowaie ibaa. el pr medels. hoa sin fa aid op S Preston COPA Cer “Applications = ‘The appl? fix: Hoe avehite. Conlaive serial and VI) code — Shown _in_fiq. —The senial ode extcayeo in a host (CPU) Hmtade whewas Hm ltl Geode execubs In many deiioes (GPy) hntods axon _ | ___F —taul pled — een 7 _\ cope Clore applicat— recor, LULtCS~S~S Dent = GPO ely pt ot fl aul fi] |] ——— [ore 1 | TBM Cell Broadband _Pngine (CBE) |__—>= The Non _pwieeine _eureatedl yo DBM hth the CaldaboreKaa 4 sony, $.Mshiba aed Chile = ye asa _s | el . 2 you 2 po ‘ —=“lle powme PE (fascePe Procening Slement)- and SPE aves two ditt procené, Combined in €BE - Te_othel Component 4 CBE a ——— [per aed emia, ene huh -bandwidtn: clemat inlelonnett bu» eg Speed, memcuy § to oe Dn. J ie tile ay 2) een heigl on Gear TE cts = Th proce included in cme have 9 dif? jac? see -o tampa. 2 set he CMs + —_=‘tle proce clement in the (BE aye. J — z Pim pure. Gop ating ali —____- dt Tam ¢B6 Lommoniy ued ao. o promis fur sony) Lay sabi cn System + Bese SI Peay] [SPO PEL | mer ery A [Prap! 1 Taal Sia] | _[inkerfece peel | { ik Hew [fi ose 6 aa my pe a ee a a = pe | | r Peer ore (eee fsa} pear aT t Taseaytt eh i —* Nvidia esta apy = = 4 lh aii A Sette dod” MaDe el th aoccielittieigeit. | and. teunsfornwa abled every time_a BD see Scene do vedvauon >" = The eeu th_uned to avait CPL miuthemabcalty_ciatenive tnaee.— * i 4 ap! in a. ed och AND « Ahe CPU ta freed from the oveiheid® gecuvred om graphic ‘related wathemafC~ thes taaka- _____ = The GOW) un aed Along alts the cpu to acleale seabGc ni 7 ie H Qtulevared ty dhe GEV ond thoufove hid fied 4 uampuhing 4b_talied GPU otcelevatedl Computing » =e bani difference Wet? a CPO §.G0U ia Hos une 4 aes G—__§ oye ft : 1 Sequential. _____stial_preconing ushewan a GPL (nlain mors than Hhouraids — smaller and efficients aves for handling yulfiele teu les ____ Simultanenuals |e Tiled Nehalem Micro-architechire $ 7 = t_in_om the sucleners @ the “inlels core architecture. Ine) core _onchilechye ues amulbole Cores in singe die for. _ + impnvement g_ Performance me Single Core _archilechne. a = The iniels Nehalem architec gro viclen ieapoverenta in core-to-Cor Comrd ho the re 4 Point » point topulogy Thence point m point topology povides direch Comm tw? ong the ricaaprecemcr Coren and +he Sys: merrie Coun be accened ia moe di Pf ways ae _—___= The nehalers archi api i nM Pare te the core _archite The wodulaL archit-n_pehalem nvake,. i ite. M eet =! i = 4b , 0. 12 Cache) J LB cay i 2a apni Wee) ‘pap OPT quick Path inteeonnede Hekolem Quaker | [care Wwe ur yu [fo jy ta |] te | be ff te Shaved level 3 cache. ——— —_fig_-Shaua _©9- 9 ight core Nehalem gece in which Tub “@P1 nn conbalier included - E a i hates Mulf pocerxse system = Nehalem imple” apmeacl used Sea Togs pavers eles - Shoo Seven new ins? added by Me intel m take as advantages 9 date level Neism- Tr Buppat SIMD. facili. Tue to St Dy jnlensive appl? Cire. multimedia) can lee perfrrmed <+8icienlty- = News ade Lamhe called ay ATA CAI? tovgekd Accelerate.) ar er eee os os. 5) TWansacho. deckaside uptes (tL) 4 a —Te_petfrnmanta—gcacle doped 9 TR: The TUS ta caeat te map: nizhial addvenen ‘dan si a nieMcniy Ge -COChe = Ne vse 4 18 wnppeves He _pelcfonesane- ieee ee 0 pega cin _artCereed quidely Inte Cache when it jp rapped An the TLR... 6) cache § Coherence, + ule? You con torile yeory, abut i 2g) aa alee 2 ae z ee \akemasey qmem: conbollee t> te powng oy in a a nd Q the oft -Chip On mictahoerd. = = dics pt vont hnetomes tetetly tree £ iadeperdend a iio — t povides jomovemers +y qunnin ao faok on h/@ platfoen. = * Thead Organivabin? EEE an a ences Cebledl_Heavel- i; [a enel da ~2thial) a. Bish —demhiee —et_edlid--puog - ___ =o LA all host sys sams Kopel - = } Te. 7) a Pranwitives thread - Crd mY == — r 9) 7 a LL | \ Wt Jp i ook lock Tt! en a } — ts 7 é x a 7 \ x a ve MV A a Block (11) - k | Tyend (ep od (v0) anak Thead (34) | = Thee outa hatrios 9 _priowltives treads cog@nired __ tip tread _Alods: Ar thréad block coudawy a Speadfic we 4 _penitives b, oad cunnout A nelt_ao mem: ladenty bidy ‘ Leok charohisho dened. | eS) = “The we 4 Head in Head block do also—finitect by —___ - to S12 thread per bode. Such Head Bittin- Head block @_Commuynitole- cp Cen) us dam | Bumped sp ead Head blocks sy sing trier saved amen, ell thread con also —Synel ____ eaitHhtn Hartod toeie a Dittin Head block pas if\ cum thread -_ ______Hivencl__hlokes ‘ave - emganired jntn 1'D, 2D or 3D cago =_fS_Sham_in_fig- 2 gat_uahich 0 collechon 9 need" _ bn i c ich dis Heal blot ove _pluysically Weniled to 512. tineade pes ack ___ Gee eat gerd sone ted Fit Cewapuling a lenge nen -4 atvead bloteete fey = Thad bled in gad ee wot. one. The diag: sunt de mead moony rddvdy game a gaven eure) covtatn 3X2 od q_ thread blede - - Shed eae dytel Z2 Hhreads executr4 jn He Paid keyel whee eact fmead block js a 4X3

You might also like