Scribd
Upload
75 views

Enabling Software

This doctoral dissertation investigates the importance of organizational issues in software process improvement. The research was conducted through multiple empirical studies within large software process improvement projects in Norway. The findings suggest that organizational factors are as important as technical factors for successful process improvement. Six key organizational factors were identified that are critical for success. Additionally, differences were found between how small and large software organizations respond to changing situations. The conclusion is that process improvement depends on creating an environment for learning, knowledge creation, and purposeful action within the software organization. The dissertation contributes to understanding how organizational issues significantly influence the success of software process improvement efforts.

Uploaded by

Najaf Shan
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PDF, TXT or read online on Scribd
75 views

Enabling Software

This doctoral dissertation investigates the importance of organizational issues in software process improvement. The research was conducted through multiple empirical studies within large software process improvement projects in Norway. The findings suggest that organizational factors are as important as technical factors for successful process improvement. Six key organizational factors were identified that are critical for success. Additionally, differences were found between how small and large software organizations respond to changing situations. The conclusion is that process improvement depends on creating an environment for learning, knowledge creation, and purposeful action within the software organization. The dissertation contributes to understanding how organizational issues significantly influence the success of software process improvement efforts.

Uploaded by

Najaf Shan
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 352

(QDEOLQJ6RIWZDUH3URFHVV,PSURYHPHQW

$Q,QYHVWLJDWLRQRIWKH,PSRUWDQFHRI2UJDQL]DWLRQDO,VVXHV

E\

7RUH'\En

'RFWRUDO'LVVHUWDWLRQ

6XEPLWWHGIRUWKH3DUWLDO)XOILOOPHQWRIWKH5HTXLUHPHQWVIRUWKH'HJUHHRI

'RFWRU,QJHQL¡U

'HSDUWPHQWRI&RPSXWHUDQG,QIRUPDWLRQ6FLHQFH
)DFXOW\RI3K\VLFV,QIRUPDWLFVDQG0DWKHPDWLFV
1RUZHJLDQ8QLYHUVLW\RI6FLHQFHDQG7HFKQRORJ\

7URQGKHLP1RYHPEHU
&RS\ULJKW‹E\7RUH'\En

$OOULJKWVUHVHUYHG1RSDUWRIWKLVSXEOLFDWLRQPD\EHUHSURGXFHGRUWUDQVPLWWHG
LQDQ\IRUPRUE\DQ\PHDQVZLWKRXWSHUPLVVLRQRIWKH$XWKRU

,661
,6%1

)RUTXHVWLRQVDERXWWKLVSXEOLFDWLRQSOHDVHFRQWDFW

7RUH'\En
6,17()7HOHFRPDQG,QIRUPDWLFV
17URQGKHLP
1RUZD\

WRUHG\ED#VLQWHIQR

,',5HSRUW
1718

3ULQWHGLQ1RUZD\E\
7DSLU7U\NNHUL7URQGKHLP1RYHPEHU
7RWKH0HPRU\RI0\)DWKHU

3HU7RUEM¡UQ'\En
WK$SULO²WK6HSWHPEHU
$EVWUDFW
6RIWZDUH GHYHORSPHQW DQG PDLQWHQDQFH LQYROYHV RUJDQL]DWLRQDO DV ZHOO DV WHFKQLFDO LVVXHV
:KLOH VRIWZDUH HQJLQHHULQJ KDV EHHQ RIIHUHG DV D ZD\ RI UHVROYLQJ WKH LQWULQVLF WHFKQLFDO
SUREOHPV WKH RUJDQL]DWLRQDO SUREOHPV QHHG DQRWKHU DSSURDFK 6WLOO WKH W\SLFDO UHVSRQVH WR
WKHSHUVLVWHQWSUREOHPVLQVRIWZDUHGHYHORSPHQWKDVEHHQWRDSSO\HYHQPRUHULJRURXVO\WKH
SULQFLSOHVRIHQJLQHHULQJ2UJDQL]DWLRQDOLVVXHVDUHRIWHQLJQRUHGRUQRWSURSHUO\DGGUHVVHGLQ
PXFKRIWKHUHFHQWOLWHUDWXUHZLWKRQO\DKDQGIXORIVWXGLHVEHLQJUHSRUWHG
7RKHOSILOOWKLVJDSWKLVGRFWRUDOVWXG\ZDVLQLWLDWHGWRH[SORUHWKHUHODWLYHLPSRUWDQFHRI
RUJDQL]DWLRQDO LVVXHV LQ VRIWZDUH SURFHVV LPSURYHPHQW 7KH SRVLWLRQ WDNHQ LV VWURQJO\
LQIOXHQFHG E\ VRFLRWHFKQLFDO WKHRU\ ZLWK LWV FHQWUDO FRQFHSWLRQ WKDW RUJDQL]DWLRQV DUH ERWK
VRFLDO DQG WHFKQLFDO V\VWHPV DQG WKDW WKH FRUH RI WKH VRIWZDUH RUJDQL]DWLRQ LV UHSUHVHQWHG
WKURXJK WKH LQWHUIDFH EHWZHHQ WKH WHFKQLFDO DQG KXPDQ VRFLDO  V\VWHP 7KH IXQGDPHQWDO
DVVXPSWLRQLVWKDWSURFHVVLPSURYHPHQWLVDVRFLDOO\FRQVWUXFWHGOHDUQLQJSURFHVVDQGWKDWD
FRPPLWPHQW WR OHDUQLQJ UDWKHU WKDQ WR ³EHVW SUDFWLFH´ PRGHOV LV QHHGHG WR DFFRPSOLVK
LPSURYHPHQWVLQVRIWZDUHGHYHORSPHQW
7KH UHVHDUFK SUHVHQWHG LQ WKLV GLVVHUWDWLRQ LV EDVHG RQ VHYHUDO HPSLULFDO VWXGLHV
SHUIRUPHG ZLWKLQ WKH FRQWH[W RI WKH (XURSHDQ 6\VWHPV DQG 6RIWZDUH ,QLWLDWLYH DQG WKH
1RUZHJLDQVRIWZDUHSURFHVVLPSURYHPHQWSURMHFWV63,4DQG352),7
7KH RYHUDOO UHVHDUFK GHVLJQ IRU WKH VWXG\ ZDV D VHTXHQWLDO PL[HG PHWKRG GHVLJQ
FRQVLVWLQJRIWZRPDMRUSKDVHVILUVWDTXDOLWDWLYHPRGHOEXLOGLQJSKDVHWKHQDTXDQWLWDWLYH
PRGHOWHVWLQJSKDVH7KHPRGHOEXLOGLQJSKDVHZDVJURXQGHGLQSULRUFRQVXOWLQJH[SHULHQFH
LQVRIWZDUHGHYHORSPHQWLQREVHUYDWLRQVGRQHLQ DSLORWFDVHVWXG\DV ZHOO DV LQ D PXOWLSOH
FDVHVWXG\RIWZHOYH RUJDQL]DWLRQV DQG LQ DQ H[WHQVLYH OLWHUDWXUH UHYLHZ 7KH PRGHOWHVWLQJ
SKDVHIRFXVHGRQWHVWLQJWKHDVVRFLDWLRQVEHWZHHQWKHNH\IDFWRUVIRUVXFFHVVDQGWKHRXWFRPH
YDULDEOHE\DTXDQWLWDWLYHVXUYH\DPRQJVRIWZDUHRUJDQL]DWLRQV
7KH ILQGLQJV IURP WKH LQYHVWLJDWLRQV VXJJHVW WKDW WKH NH\ WR VXFFHVVIXO OHDUQLQJ LV D
FRQWLQXRXVDQGVLPXOWDQHRXVGLDOHFWLFLQWHUSOD\EHWZHHQWKHNQRZOHGJHWKDWWKHRUJDQL]DWLRQ
KDVHVWDEOLVKHGRYHUWLPHDQGWKHNQRZLQJRIWKHRUJDQL]DWLRQ¶VPHPEHUVLQWKHLUUHVSHFWLYH
FRQWH[WV $OVR WKH ILQGLQJV LQGLFDWH WKDW VXFFHVV GHSHQGV FULWLFDOO\ RQ VL[ RUJDQL]DWLRQDO
IDFWRUV )LQDOO\ WKH ILQGLQJV VKRZ WKDW WKHUH DUH LPSRUWDQW GLIIHUHQFHV EHWZHHQ VPDOO DQG
ODUJH VRIWZDUH RUJDQL]DWLRQV VSHFLILFDOO\ LQ WKH ZD\V LQ ZKLFK WKH\ UHDFW WR XQVWDEOH DQG
FKDQJLQJVWLPXOXVVLWXDWLRQV
7KHFRQFOXVLRQRQWKHUHVHDUFKSUREOHPLVWKDWSURFHVVLPSURYHPHQWFDQQRWEHPDQDJHG
EXWRQO\HQDEOHGWKURXJKWKHVSDFHLQZKLFKWKHVRIWZDUHRUJDQL]DWLRQFUHDWHVWKHSRVVLELOLWLHV
IRUVHQVHPDNLQJNQRZOHGJHFUHDWLRQDQGSXUSRVHIXODFWLRQ
7KHPDLQFRQWULEXWLRQRIWKHGLVVHUWDWLRQLVWRLQFUHDVHWKHXQGHUVWDQGLQJRIWKHLQIOXHQFH
RI RUJDQL]DWLRQDO LVVXHV E\ HPSLULFDOO\ VKRZLQJ WKDW WKH\ DUH DW OHDVW DV LPSRUWDQW DV
WHFKQRORJ\ IRU VXFFHHGLQJ ZLWK VRIWZDUH SURFHVV LPSURYHPHQW 7KLV VXJJHVWV WKDW VRIWZDUH
RUJDQL]DWLRQV WKDW ZDQW WR SURVSHU LQ WKH VW FHQWXU\ VKRXOG V\QHUJLVWLFDOO\ FRPELQH
WHFKQRORJ\ZLWKVRFLDOFROODERUDWLRQWREHFRPHOHDUQLQJVRIWZDUHRUJDQL]DWLRQV

±Y±
$FNQRZOHGJHPHQWV
, DP LQ JUHDW GHEW WR VHYHUDO SHUVRQV ZKR KDYH SURYLGHG KHOS VXSSRUW DQG HQFRXUDJHPHQW
WKURXJKRXWP\ZRUNZLWKWKHGRFWRUDOVWXGLHVGXULQJWKHODVWIRXU\HDUV)LUVWRIDOO,ZRXOG
OLNH WR WKDQN P\ DGYLVRUV 5HLGDU &RQUDGL DQG 7RU 6WnOKDQH IRU WKHLU H[WHQVLYH FRPPHQWV
VWLPXODWLQJGLVFXVVLRQVDQGORQJODVWLQJFRRSHUDWLRQ ,ZRXOG DOVROLNHWRWKDQN \RX IRUQRW
JLYLQJXSRQPHGXULQJP\SHULRGVRIGULIWLQJEHWZHHQVRIWZDUHHQJLQHHULQJDQGRUJDQL]DWLRQ
GHYHORSPHQW
6,17() 7HOHFRP DQG ,QIRUPDWLFV KDV UHPDLQHG D ILUP IRXQGDWLRQ DQG DQ HQFRXUDJLQJ
HPSOR\HU7KDQNVWR$DJH7KXQHP(OGIULG‘YVWL‘YVWHGDODQG0HWWH9HVWOLIRU JLYLQJ PH
WKLV RSSRUWXQLW\ , DOVR DFNQRZOHGJH WKH 5HVHDUFK &RXQFLO RI 1RUZD\ IRU WKHLU ILQDQFLDO
VXSSRUWRIP\ZRUNWKURXJKJUDQWQR
,ZRXOGOLNHWRWKDQN5HLGDU3DOPVWU¡PDQG+DQV(ULN6WRNNH QRZ3URWHN7HOVRIW$6
IRUWKHLUNLQGVXSSRUWDQGFRRSHUDWLRQGXULQJWKHSLORWVWXG\DW1HUD$6,DOVRDFNQRZOHGJH
DQGWKDQNDOOLQIRUPDQWVRIWKH FDVHVWXGLHV DQGDOOUHVSRQGHQWVRIWKHVXUYH\ LQYHVWLJDWLRQV
IRUWKHLUZLOOLQJQHVVWRSDUWLFLSDWHLQP\LQTXLULHV
)XUWKHUPRUH,DFNQRZOHGJHDQGWKDQNDOOP\UHVHDUFKFROOHDJXHVDQGLQGXVWULDOSDUWQHUV
LQ WKH 63,4 DQG 352),7 SURJUDPV IRU WKHLU FRRSHUDWLRQ DQG XVHIXO GLVFXVVLRQV $ VSHFLDO
WKDQNVJRHVWR1LOV%UHGH0RH*HLU.MHWLO+DQVVHQDQG.DUL-XXO:HGGH QRZ&OXVWUD$6
DW6,17()7RUJHLU'LQJV¡\UDQG0DULD/HWL]LD-DFFKHULDW1718'DJ6M¡EHUJDQG0DJQH
-¡UJHQVHQDWWKH6LPXOD5HVHDUFK/DERUDWRU\DQG7RU8OVXQGDW%UDYLGD*HRPDWLNN
, ZRXOGDOVR OLNH WR DFNQRZOHGJH P\ IDPLO\ $ VSHFLILF WKDQNV JRHV WR P\ PRWKHU DQG
IDWKHU IRU VXSSRUWLQJ DQG EHOLHYLQJ LQ PH GXULQJ DOO \HDUV 6DGO\ P\ IDWKHU GLHG RI FDQFHU
EHIRUHWKLVZRUNZDVILQLVKHG,WZDVKDUGWRVHHKLPVWUXJJOHZLWKVXFKEUDYHU\GXULQJWKHVH
\HDUV±DQGORVH,PLVV\RX
)LQDOO\ , ZRXOG OLNH WR WKDQN 7UXGH DQG RXU FKLOGUHQ 6RQGUH (UOHQG DQG 9LOGH IRU
NHHSLQJXSZLWKPHGXULQJWKHVHLPSRUWDQW\HDUVRIRXUOLYHV,SXWDKHDY\EXUGHQRQ\RXDOO
EXWPRVWRIDOORQ7UXGH, DPGHHSO\ JUDWHIXOIRU \RXU HQGXULQJVXSSRUWDQG XQGHUVWDQGLQJ
IRU ZK\ , FRXOGQ¶W DOZD\V SDUWLFLSDWH LQ IDPLO\ DFWLYLWLHV VRFLDO JDWKHULQJV DQG YDFDWLRQV
7KDQN\RX

17181RYHPEHU

7RUH'\En

±YLL±
&RQWHQWV

$%675$&7  Y
$&.12:/('*(0(176  YLL

&+$37(5 ,1752'8&7,21  


 %DFNJURXQGWRWKH5HVHDUFK 
 3UREOHPVLQVRIWZDUHGHYHORSPHQW  
 7KHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,  
 5HVHDUFK&RQWH[W  
 5HVHDUFK3UREOHPDQG4XHVWLRQV 
 &ODLPHG&RQWULEXWLRQV  
 5HVHDUFK0HWKRG 
 2XWOLQHRIWKH7KHVLV  

3$57,67$7(2)7+($57$1'67$7(2)7+(35$&7,&(
&+$37(5 $3352$&+(67262)7:$5(352&(66,03529(0(17  
 6RIWZDUH3URFHVV  
 3URFHVVPRGHOV  
 3URFHVVLQIUDVWUXFWXUH  
 3URFHVVPHDVXUHPHQW  
 6RIWZDUH3URFHVV$VVHVVPHQW  
 $VVHVVPHQWSULQFLSOHV  
 $VVHVVPHQWPRGHOV 
 $VVHVVPHQWVXFFHVVIDFWRUV  
 6RIWZDUH3URFHVV,PSURYHPHQW 
 ,PSURYHPHQWSULQFLSOHV 
 ,PSURYHPHQWPRGHOV 
 ,PSURYHPHQWVXFFHVVIDFWRUV 
 6RIWZDUH3URFHVV,QQRYDWLRQ 
 ,QQRYDWLRQSULQFLSOHV 
 ,QQRYDWLRQPRGHOV  
 ,QQRYDWLRQVXFFHVVIDFWRUV 
 3URFHVVLPSURYHPHQWYHUVXVSURFHVVLQQRYDWLRQ  
 &KDSWHU6XPPDU\ 

±L[±
&217(176

&+$37(5 $3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+  


 (PSLULFDO6RIWZDUH(QJLQHHULQJ5HVHDUFK  
 'LPHQVLRQVRIHPSLULFDOVRIWZDUHHQJLQHHULQJUHVHDUFK 
 )XQGDPHQWDOVRIUHVHDUFKGHVLJQ  
 *HQHUDOWKUHDWVWRYDOLGLW\  
 *XLGHOLQHVIRULQFUHDVLQJYDOLGLW\  
 (PSLULFDO5HVHDUFK$SSURDFKHV  
 ([SHULPHQWDOUHVHDUFK  
 6XUYH\UHVHDUFK  
 &DVHVWXG\UHVHDUFK  
 $FWLRQUHVHDUFK 
 &RPSDULVRQRI5HVHDUFK$SSURDFKHV  
 &KDSWHU6XPPDU\ 

3$57,,7+(25(7,&$/)5$0(:25.
&+$37(5 )281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21  
 6RFLDO/HDUQLQJ  
 7KHUDWLRQDOLVWLFWUDGLWLRQ  
 6RIWZDUHGHYHORSPHQWDVUHDOLW\FRQVWUXFWLRQ 
 7KHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ  
 6HQVHPDNLQJ 
 7KHFRQFHSWRIVHQVHPDNLQJ  
 2UJDQL]DWLRQDOSURFHVVHVRIVHQVHPDNLQJ  
 6KDUHGDVVXPSWLRQV  
 .QRZOHGJH&UHDWLRQ 
 2UJDQL]DWLRQDONQRZOHGJH 
 ,QGLYLGXDONQRZOHGJHFUHDWLRQ  
 2UJDQL]DWLRQDONQRZOHGJHFUHDWLRQ 
 (QDEOLQJFRQGLWLRQV 
 3XUSRVHIXO$FWLRQ 
 7KHRULHVRIDFWLRQ  
 0RGHOVRISODQQHGFKDQJH 
 ,PSURYLVDWLRQDOFKDQJHPRGHOV 
 2UJDQL]DWLRQDONQRZLQJ  
 &KDSWHU6XPPDU\ 

&+$37(5 $'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17  


 ,QWURGXFWLRQ  
 2UJDQL]DWLRQDO&RQWH[W  
 (QYLURQPHQWDOWXUEXOHQFH  
 2UJDQL]DWLRQDOVL]H  

±[±
&217(176

 /HDUQLQJ&\FOH  


 /RFDONQRZLQJ 
 *HQHUDWLQJH[SOLFLWNQRZOHGJH 
 2UJDQL]DWLRQDOPHPRU\  
 &ROOHFWLYHO\LQWHUSUHWLQJWKHNQRZOHGJH  
 63,6XFFHVV  
 2UJDQL]DWLRQDOSHUIRUPDQFH  
 3HUFHLYHGOHYHORIVXFFHVV  
 )DFLOLWDWLQJ)DFWRUV 
 %XVLQHVVRULHQWDWLRQ  
 ,QYROYHGOHDGHUVKLS  
 (PSOR\HHSDUWLFLSDWLRQ 
 &RQFHUQIRUPHDVXUHPHQW  
 /HDUQLQJVWUDWHJ\  
 -RLQWFRQWULEXWLRQRIIDFLOLWDWLQJIDFWRUV  
 &KDSWHU6XPPDU\ 

3$57,,,(03,5,&$/,19(67,*$7,21
&+$37(5 5(6($5&+0(7+2'2/2*<  
 -XVWLILFDWLRQIRUWKH0HWKRGRORJ\  
 5HVHDUFK'HVLJQ 
 3RSXODWLRQDQG6DPSOH 
 9DULDEOHVDQG0HDVXUHV  
 'DWD&ROOHFWLRQ3URFHGXUH  
 'DWD$QDO\VLV7HFKQLTXHV 
 3URFHGXUHIRU+\SRWKHVLV7HVWLQJ  
 &KDSWHU6XPPDU\ 

&+$37(5 $1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,1
62)7:$5(352&(66,03529(0(17  
 ,QWURGXFWLRQ  
 .H\)DFWRUVRI63,6XFFHVV 
 ,WHP&UHDWLRQ 
 &RQVWUXFWLRQRI0HDVXUHPHQW6FDOHV 
 3LORW7HVWRI0HDVXUHPHQW6FDOHV  
 6XEMHFWVDQG,QVWUXPHQW$GPLQLVWUDWLRQ  
 5HOLDELOLW\RI0HDVXUHPHQW6FDOHV 
 'HWDLOHG,WHP$QDO\VLV  
 9DOLGLW\RI0HDVXUHPHQW6FDOHV  
 &RQWHQWYDOLGLW\  

±[L±
&217(176

 &RQVWUXFWYDOLGLW\  


 &ULWHULRQYDOLGLW\  
 &KDSWHU6XPPDU\ 

&+$37(5 (03,5,&$/5(68/76  


 &DVH6WXG\$([SHULHQFHZLWK*RDO2ULHQWHG0HDVXUHPHQW 
 'HILQLQJ*40JRDOV  
 'HILQLQJWKHPHDVXUHPHQWSODQ 
 'DWDFROOHFWLRQDQGYDOLGDWLRQ  
 'DWDDQDO\VLV 
 )HHGEDFNVHVVLRQV 
 /HVVRQVOHDUQHG  
 &DVH6WXG\%([SHULHQFHZLWK3DUWLFLSDWLYH6RIWZDUH3URFHVV
$VVHVVPHQW  
 $VVHVVPHQWPHWKRG  
 /HVVRQVOHDUQHG  
 &DVH6WXG\&([SORULQJWKH8WLOLW\RI)RUPDO5RXWLQHVWR7UDQVIHU
.QRZOHGJHDQG([SHULHQFH 
 .QRZOHGJHRIURXWLQHV  
 8VHRIURXWLQHV 
 8SGDWLQJRIURXWLQHV 
 5RXWLQHVDVDPHGLXPIRUWUDQVIHURINQRZOHGJHDQG
H[SHULHQFH 
 0DLQ6XUYH\7KH.H\)DFWRUVRI6XFFHVVLQ63,  
 (YDOXDWLRQRIDQDO\WLFDODVVXPSWLRQV  
 7HVWLQJLQGLYLGXDOUHODWLRQVKLSV  
 7HVWLQJRYHUDOOUHODWLRQVKLSV  
 ([DPLQLQJLQGLYLGXDOFRQWULEXWLRQVWRWKHYDULDWH  
 ([SORULQJWKHHIIHFWVRIHQYLURQPHQWDOFRQGLWLRQV  
 ([SORULQJWKHHIIHFWVRIRUJDQL]DWLRQDOVL]H  
 ([SORULQJWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[W
DQGPRGHVRIOHDUQLQJ  
 ([SORULQJWKHHIIHFWVRIRWKHURUJDQL]DWLRQDOFKDUDFWHULVWLFV  
 ([SORULQJWKHHIIHFWVRIWKHUHVSRQGHQWV¶FKDUDFWHULVWLFV  
 &KDSWHU6XPPDU\ 

&+$37(5 ',6&866,21$1',03/,&$7,216  


 7KH/HDUQLQJ3URFHVVHVLQ63, 
 )RXQGDWLRQV  
 &RPPXQLWLHVRISUDFWLFH  
 /LYLQJRUJDQL]DWLRQDOPHPRU\  
 7KH.H\)DFWRUVRI6XFFHVVLQ63,  
 %XVLQHVVRULHQWDWLRQ  
 ,QYROYHGOHDGHUVKLS  
 (PSOR\HHSDUWLFLSDWLRQ 

±[LL±
&217(176

 &RQFHUQIRUPHDVXUHPHQW  


 /HDUQLQJVWUDWHJ\  
 7KH(IIHFWVRI2UJDQL]DWLRQDO&RQWH[W  
 (QYLURQPHQWDOWXUEXOHQFH  
 2UJDQL]DWLRQDOVL]H  
 ,PSOLFDWLRQVIRU7KHRU\ 
 7KHWDFLW±H[SOLFLWQH[XV 
 7KHORFDO±JOREDOQH[XV 
 7KHNQRZOHGJH±DFWLRQQH[XV  
 7KHH[SORUDWLRQ±H[SORLWDWLRQQH[XV  
 ,PSOLFDWLRQVIRU0HWKRGRORJ\ 
 7KHULJRU±UHOHYDQFHQH[XV  
 7KHFRQYHUJHQFH±GLYHUJHQFHQH[XV 
 7KHSURFHVV±SUDFWLFHQH[XV 
 ,PSOLFDWLRQVIRU3UDFWLFH  
 %XLOGLQJDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ  
 3HUIRUPDQFHPDQDJHPHQW  
 /HDGLQJRUJDQL]DWLRQDOOHDUQLQJDQG63,  
 7KHUHVSRQVLELOLWLHVRIRUJDQL]DWLRQDOPHPEHUV 
 &KDSWHU6XPPDU\ 

3$57,9&21&/86,216
&+$37(5 &21&/86,216  
 &RQFOXVLRQVRQWKH5HVHDUFK3UREOHPDQG4XHVWLRQV  
 &RQWULEXWLRQV 
 7KHRUHWLFDOFRQWULEXWLRQV 
 0HWKRGRORJLFDOFRQWULEXWLRQV 
 3UDFWLFDOFRQWULEXWLRQV 
 (YDOXDWLRQ  
 /LPLWDWLRQV  
 )XUWKHU5HVHDUFK  
 )LQDO5HPDUNV  

3$579$33(1',&(6
$33(1',;$ 7(50,12/2*<  
$ $EEUHYLDWLRQV  
$ 'HILQLWLRQV 

$33(1',;% ,17(59,(:*8,'(  

±[LLL±
&217(176

$33(1',;& (;$03/(2)5(68/76)520$1(;3/25$725<678'<,1&;  

$33(1',;' 25,*,1$//,672))$&,/,7$7,1*)$&7256$1',1',&$7256  

$33(1',;( 0($685(0(17,167580(17  

$33(1',;) 48(67,211$,5(  

$33(1',;* 6859(<'$7$ 

5()(5(1&(6  

±[LY±
/LVWRI)LJXUHV
)LJXUH 2YHUDOOUHVHDUFKGHVLJQ 
)LJXUH 'HJUHHVRISURFHVVFKDQJHIRUGLIIHUHQWLQWHUYHQWLRQVWUDWHJLHV  
)LJXUH 5HODWLRQVKLSEHWZHHQSURFHVVFRQWH[WDQGRXWFRPH 
)LJXUH 7KHUHODWLRQVKLSEHWZHHQWKH([SHULHQFH)DFWRU\DQGWKH3URMHFW2UJDQL]DWLRQ
DVLPSOHPHQWHGDW1$6$*6)& 
)LJXUH *40KLHUDUFKLFDOVWUXFWXUH  
)LJXUH 7KHFRQWH[WRIVRIWZDUHSURFHVVDVVHVVPHQW 
)LJXUH 0RGHOEDVHGDVVHVVPHQWSURFHVV  
)LJXUH $QRYHUYLHZRIWKH,62,(&WZRGLPHQVLRQDODUFKLWHFWXUH 
)LJXUH 7KH6KHZDUWLPSURYHPHQWF\FOH 
)LJXUH 7KH,'($/YPRGHO  
)LJXUH 7KH4XDOLW\,PSURYHPHQW3DUDGLJP 
)LJXUH 'DYHQSRUW¶VDSSURDFKWRSURFHVVLQQRYDWLRQ  
)LJXUH 3IOHHJHU¶VWHFKQRORJ\WUDQVIHUSURFHVV  
)LJXUH 3URFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQ  
)LJXUH $KLJKOHYHOSURSRVDOIRUVXFFHVVIXO63,WKDWLQWHJUDWHVSURFHVVGHILQLWLRQ
SURFHVVDVVHVVPHQWSURFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQ 
)LJXUH ,QGXFWLYHDQGGHGXFWLYHDSSURDFKHVWRUHVHDUFK 
)LJXUH 7KUHDWVWRH[SHULPHQWDOYDOLGLW\  
)LJXUH 7KH&RJHQHUDWLYH$FWLRQ5HVHDUFK0RGHO  
)LJXUH 7KHXVHRIDOWHUQDWLYH(6(UHVHDUFKDSSURDFKHVLQWKHSURFHVVRIWKHRU\
EXLOGLQJWHVWLQJDQGH[WHQVLRQ  
)LJXUH 7KHFRQVWUXFWLRQRIVRFLDOUHDOLW\ 
)LJXUH $OWHUQDWLYHGHILQLWLRQVRIRUJDQL]DWLRQDOOHDUQLQJ  
)LJXUH 7KHHSLVWHPRORJLFDODQGRQWRORJLFDOGLPHQVLRQVRINQRZOHGJH  
)LJXUH .ROE¶VH[SHULHQWLDOOHDUQLQJF\FOH  
)LJXUH 2UJDQL]DWLRQDONQRZOHGJHFUHDWLQJSURFHVV  
)LJXUH 7KHJHQHUDOIRUPRIDWKHRU\RIDFWLRQ  
)LJXUH 7KHRULHVRIDFWLRQZLWKLQWKHFRQWH[WRI63, 
)LJXUH 6LQJOHORRSDQGGRXEOHORRSOHDUQLQJ 
)LJXUH $QLPSURYLVDWLRQDOPRGHORIFKDQJH  
)LJXUH $G\QDPLFPRGHORIVRIWZDUHSURFHVVLPSURYHPHQW 
)LJXUH 7KHRUJDQL]DWLRQDOSHUIRUPDQFHGLPHQVLRQRI63,VXFFHVV 
)LJXUH /HH¶VPRGHOIRULQWHJUDWLQJSRVLWLYLVWDQGLQWHUSUHWLYHDSSURDFKHV 
)LJXUH 2YHUDOOUHVHDUFKGHVLJQ 
)LJXUH 3URFHVVIRUGHYHORSLQJDQGMXVWLI\LQJWKHK\SRWKHVHV  
)LJXUH &RQFHSWXDOL]DWLRQDQGRSHUDWLRQDOL]DWLRQ 
)LJXUH 2YHUDOO63,VXFFHVVRIWRSWKLUGYHUVXVERWWRPWKLUGVRIWZDUHRUJDQL]DWLRQV 
)LJXUH &RQFHSWXDOUHVHDUFKPRGHOIRUWKHTXDQWLWDWLYHSDUWRIWKHVWXG\ 

±[Y±
/,672)),*85(6

)LJXUH 6WDWLVWLFDOSRZHUDQGWKHSUREDELOLW\RI7\SH,DQG7\SH,,HUURULQWHVWLQJD
GLUHFWLRQDOK\SRWKHVLV  
)LJXUH ,QVWUXPHQWGHYHORSPHQWSURFHVV 
)LJXUH 6FUHHSORWIRUWKH([SORUDWLRQVFDOH  
)LJXUH 3DUWRI1HUD¶V*40WUHH 
)LJXUH 3DUWLFLSDWLYHDVVHVVPHQWSURFHVV 
)LJXUH 7\SLFDOTXHVWLRQIRUPDWIURPWKHTXHVWLRQQDLUH  
)LJXUH ([DPSOHRIDQLOOXVWUDWLRQRISUHOLPLQDU\ILQGLQJV 
)LJXUH ,PSURYHPHQWVWUDWHJ\YHUVXVRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDOWXUEXOHQFH
IRU D H[SORLWDWLRQDQG E H[SORUDWLRQLQVPDOODQGODUJHRUJDQL]DWLRQV 
)LJXUH 'LIIHUHQWW\SHVRINQRZOHGJHLQ63, 
)LJXUH 7KHLPSDFWRIDELOLW\DQGUHOLDELOLW\RQSHUIRUPDQFH  
)LJXUH 7KH2VERUQ3DUQHVILYHVWDJHFUHDWLYHSURFHVVPRGHO  
)LJXUH 63,SHUIRUPDQFHPDQDJHPHQWPRGHO  

±[YL±
/LVWRI7DEOHV
7DEOH 0RGHOEDVHGYVSDUWLFLSDWLYHDSSURDFKWRSURFHVVDVVHVVPHQW 
7DEOH .H\3URFHVV$UHDVLQWKH6:&00  
7DEOH %HQFKPDUNLQJDSSURDFKYHUVXVDQDO\WLFDODSSURDFK  
7DEOH 3HUVSHFWLYHVRQTXDOLW\PDQDJHPHQW  
7DEOH )DFLOLWDWLQJIDFWRUVLGHQWLILHGLQVRIWZDUHSURFHVVLPSURYHPHQW  
7DEOH )DFLOLWDWLQJIDFWRUVDQGEDUULHUVWR63, 
7DEOH 3URFHVVLPSURYHPHQWYHUVXVSURFHVVLQQRYDWLRQ 
7DEOH 3XUSRVHRIUHVHDUFK  
7DEOH 3ULQFLSOHVIRULQWHUSUHWLYHILHOGUHVHDUFK 
7DEOH $VXPPDU\RIWKHNH\IHDWXUHVVWUHQJWKVDQGZHDNQHVVHVRIDOWHUQDWLYH
(6(UHVHDUFKDSSURDFKHV  
7DEOH ³%HVWSUDFWLFH´DSSURDFKYVOHDUQLQJVRIWZDUHRUJDQL]DWLRQ  
7DEOH 2UJDQL]DWLRQDOVHQVHPDNLQJSURFHVVHV 
7DEOH (QDEOLQJFRQGLWLRQVLGHQWLILHGLQRUJDQL]DWLRQDOOHDUQLQJDQGNQRZOHGJH
FUHDWLRQ 
7DEOH 0HPRU\FDWHJRULHVDQGH[DPSOHVRIW\SLFDOHOHPHQWV  
7DEOH ([SORLWDWLRQYHUVXVH[SORUDWLRQ  
7DEOH 5HVHDUFKK\SRWKHVHV  
7DEOH &RPSDULVRQDPRQJWKHPDMRUUHVHDUFKSDUDGLJPV  
7DEOH &KDUDFWHULVWLFVRIWKHSLORWDQGPXOWLSOHFDVHVWXGLHV  
7DEOH &KDUDFWHULVWLFVRIWKHVXUYH\VDPSOH 
7DEOH 6WHYHQV¶OHYHOVRIPHDVXUHPHQW 
7DEOH :D\VRIEHLQJFRUUHFWRUPDNLQJDQHUURUZKHQFKRRVLQJEHWZHHQWZR
FRPSHWLQJK\SRWKHVHV  
7DEOH (IIHFWVL]HLQGH[HVDQGWKHLUYDOXHVIRUVPDOOPHGLXPDQGODUJHHIIHFWV
IRUWHVWVXVHGLQWKLVVWXG\  
7DEOH 1IRUVPDOOPHGLXPDQGODUJHHIIHFWVL]HVDWSRZHU IRUD 
DQG 
7DEOH .H\IDFWRUVRI63,VXFFHVV  
7DEOH /HDGHUVKLSLQYROYHPHQWVFDOH 
7DEOH &ODVVLILFDWLRQRIUHOLDELOLW\HVWLPDWLRQPHWKRGV 
7DEOH 5HOLDELOLW\DQDO\VLVUHVXOWVIRUWKHNH\IDFWRUVRI63,VXFFHVV  
7DEOH 7KUHHEDVLFW\SHVRIYDOLGLW\LQPHDVXUHPHQWLQVWUXPHQWV  
7DEOH &RUUHFWHGLWHPVFDOHFRUUHODWLRQPDWUL[ 
7DEOH 6XPPDU\RIIDFWRUPDWULFHVIRUHDFKFRQVWUXFW  
7DEOH *40DEVWUDFWLRQVKHHWIRUJRDOUHOLDELOLW\  
7DEOH 0HWULFVGHILQLWLRQWHPSODWH  
7DEOH .QRZOHGJHRIFRPSDQ\URXWLQHV  
7DEOH 'HJUHHRILQYROYHPHQWGXULQJLQWURGXFWLRQRIURXWLQHV 

±[YLL±
/,672)7$%/(6

7DEOH $OWHUQDWLYHPHGLDIRUNQRZOHGJHWUDQVIHU  


7DEOH 'R\RXUHJDUGZULWWHQURXWLQHVDVDQHIILFLHQWPHGLXPIRUWUDQVIHURI
NQRZOHGJHDQGH[SHULHQFH"  
7DEOH 'HJUHHRILQYROYHPHQWYVDVVHVVPHQWRIIRUPDOURXWLQHVDVDQHIILFLHQW
PHGLXPIRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFH 
7DEOH 7HVWVIRUQRUPDOLW\RIWKHLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV 
7DEOH 7HVWVRIKRPRJHQHLW\RIYDULDQFHV 
7DEOH 7HVWVIRUOLQHDULW\RIWKHUHODWLRQVKLSEHWZHHQWKHGHSHQGHQWDQG
LQGHSHQGHQWYDULDEOHV 
7DEOH ,WHPPHDQVVWDQGDUGGHYLDWLRQVDQGFRUUHODWLRQVDPRQJWKHLQGHSHQGHQW
YDULDEOHV  
7DEOH 7HVWVIRUPXOWLFROOLQHDULW\EHWZHHQWKHLQGHSHQGHQWYDULDEOHV 
7DEOH 7HVWVRIK\SRWKHVHV+±+  
7DEOH 0XOWLSOHUHJUHVVLRQPRGHOVXPPDU\XVLQJDOOLQGHSHQGHQWYDULDEOHV 
7DEOH 0XOWLSOHUHJUHVVLRQDQDO\VLVRIYDULDQFHXVLQJDOOLQGHSHQGHQWYDULDEOHV  
7DEOH 0XOWLSOHUHJUHVVLRQEHWZHHQDOOLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV 
7DEOH 6WHSZLVHUHJUHVVLRQPRGHOVXPPDU\±ILQDOPRGHO 
7DEOH 6WHSZLVHUHJUHVVLRQDQDO\VLVRIYDULDQFH  
7DEOH 6WHSZLVHUHJUHVVLRQFRHIILFLHQWV  
7DEOH 5HVXOWVRIDVVHVVLQJWKHVWXG\¶VUHVHDUFKK\SRWKHVHV  
7DEOH 6WDEOHYHUVXVWXUEXOHQWHQYLURQPHQW 
7DEOH /HYHORIWXUEXOHQFHLQODUJHYHUVXVVPDOOVRIWZDUHRUJDQL]DWLRQV  
7DEOH /HYHORIWXUEXOHQFHLQVXFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUH
RUJDQL]DWLRQV  
7DEOH /DUJHYHUVXVVPDOOVRIWZDUHRUJDQL]DWLRQV  
7DEOH /DUJHVXFFHVVIXOYHUVXVODUJHOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV 
7DEOH 6PDOOVXFFHVVIXOYHUVXVVPDOOOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV  
7DEOH /DUJHVXFFHVVIXOYHUVXVVPDOOVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV  
7DEOH 6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV 
7DEOH 6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV 
7DEOH 6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV 
7DEOH &KDUDFWHULVWLFVRIORFDODQGJOREDONQRZOHGJH  
7DEOH (YDOXDWLRQRIULJRU  
7DEOH (YDOXDWLRQRIUHOHYDQFH 

±[YLLL±
&+$37(5 
,QWURGXFWLRQ

³7KHVFLHQWLVWLVQRWDSHUVRQZKRJLYHVWKHULJKWDQVZHUV
KHLVRQHZKRDVNVWKHULJKWTXHVWLRQV´
±&ODXGH/HYL6WUDXVV

,Q WKLV FKDSWHU WKH EDFNJURXQG WR WKH UHVHDUFK LV H[SODLQHG E\ IRFXVLQJ RQ WKH SHUVLVWHQW
SUREOHPVLQVRIWZDUHGHYHORSPHQWDQGWKHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQLPSURYLQJ
WKH VRIWZDUH SURFHVV )XUWKHUPRUH WKH FKDSWHU GHVFULEHV WKH UHVHDUFK FRQWH[W WKH UHVHDUFK
SUREOHP DQG TXHVWLRQV WKH FODLPHG FRQWULEXWLRQV DQG WKH UHVHDUFK PHWKRG )LQDOO\ WKH
RXWOLQHRIWKHWKHVLVLVGHVFULEHG

 %DFNJURXQGWRWKH5HVHDUFK
6RIWZDUHLVWKHQHZLQIUDVWUXFWXUHRIWKHVWFHQWXU\,WSHUYDGHVRXUVRFLHW\DQGLVEHFRPLQJ
LQFUHDVLQJO\FULWLFDOIRUEXVLQHVVHVDVZHOODVIRUOHLVXUHWLPHDQGHQWHUWDLQPHQW6RIWZDUHLV
EHLQJXVHGLQPRUHDQGPRUHVHQVLWLYHDSSOLFDWLRQVUDQJLQJIURPQXFOHDUUHDFWRUVDLUSODQHV
DQG DLUWUDIILF FRQWURO WR WHOHFRPPXQLFDWLRQ QHWZRUNV EDQNLQJ DQG DXWRPRELOHV ,W LV
IXQGDPHQWDOWRHFRQRPLFVXFFHVVVFLHQWLILFDQGWHFKQLFDOUHVHDUFKDQGQDWLRQDOVHFXULW\$W
WKHVDPHWLPHWKHUHLVDJURZLQJSHUFHSWLRQWKDWVRIWZDUHTXDOLW\LVDVYXOQHUDEOHDV$FKLOOHV¶
KHHO LQ GHYHORSLQJ KLJKTXDOLW\ SURGXFWV 7KH FKURQLF ³VRIWZDUH FULVLV´ WKDW VRIWZDUH LV
DOPRVW  DOZD\V ODWHU WKDQ H[SHFWHG PRUH H[SHQVLYH WKDQ SODQQHG DQG ZLWK OHVV RU HYHQ
ZURQJIXQFWLRQDOLW\KDVEHFRPHHYHQPRUHFULWLFDODVVRIWZDUHSHUYDGHVRXUGD\WRGD\OLYHV
'HVSLWH LPSUHVVLYH WHFKQRORJLFDO DGYDQFHV WKH H[SRQHQWLDOO\ LQFUHDVLQJ GHPDQGV
FRPSOH[LW\RI WKH SUREOHPV DQG VFDOH RI ZRUN DGGUHVVHG E\ VRIWZDUH VHHP WR RXWSDFH RXU
DELOLW\WRGHYHORSDQGPDLQWDLQVRIWZDUH7KXVLQDGGLWLRQWREHLQJXVHGLQLQFUHDVLQJO\PRUH
VHQVLWLYH DSSOLFDWLRQV VRIWZDUH LV DOVR EHFRPLQJ ODUJHU DQG PRUH FRPSOH[ /DUJHU
DSSOLFDWLRQV ZLWK D JUHDWHU YROXPH RI FRGH PHDQV LQFUHDVHG ULVN RI HUURU XQOHVV ZH
GUDPDWLFDOO\LPSURYHWKHHUURUUDWHVRIVRIWZDUH$WWKHVDPHWLPHWKHLQFUHDVLQJFRPSOH[LW\
RILQGXVWULDOVRIWZDUHV\VWHPVPDNHWKHPSURJUHVVLYHO\PRUHGLIILFXOWWRWHVW,QFRPELQDWLRQ

±±
&+$37(5

WKHVHWUHQGVH[SRVHXVWRHYHQJUHDWHUULVNVRIVRIWZDUHIDLOXUHVDQGFRUUHVSRQGLQJGLVDVWHUVDV
ZHXVHVRIWZDUHLQLQFUHDVLQJO\FULWLFDODSSOLFDWLRQV

 3UREOHPVLQVRIWZDUHGHYHORSPHQW
6LQFHWKHWHUP ³VRIWZDUH HQJLQHHULQJ´ ZDV ILUVW FRLQHG DW WKH KLVWRULF 1$72 &RQIHUHQFH LQ
*DUPLVFK3DUWHQNLUFKHQ LQ  1DXU DQG 5DQGHOO   WKHUH KDV EHHQ D ZLGHVSUHDG
FRQVHQVXVWKDWWKHUHDUHSUREOHPVZLWKWKHGHYHORSPHQWDQGPDLQWHQDQFHRIVRIWZDUH7KHVH
SUREOHPVZHUHODWHUGLVFXVVHGE\%URRNV  LQKLVFODVVLFERRN7KH0\WKLFDO0DQ
0RQWK DQG WKH WHUP ³VRIWZDUH FULVLV´ ZDV FRLQHG WR HPEUDFH WKH SUREOHPV LQ VRIWZDUH
GHYHORSPHQW ± WKH\ ZHUH VHHQ DV D ZHUHZROI WKDW QHHGHG VOD\LQJ ZLWK D ³VLOYHU EXOOHW´
%URRNV 
)ROORZLQJ$ULVWRWOH%URRNV  GLVWLQJXLVKHGEHWZHHQWKHHVVHQWLDODQGWKHDFFLGHQWDO
SUREOHPVLQVRIWZDUHGHYHORSPHQW7KHHVVHQWLDOSUREOHPVDUHWKHGLIILFXOWLHVLQKHUHQWLQWKH
QDWXUH RI VRIWZDUH ZKLFK ZH KDYH WR OHDUQ WR OLYH ZLWK DV ORQJ DV ZH FRQWLQXH WR GHYHORS
VRIWZDUH 7KH DFFLGHQWDO SUREOHPV RQ WKH RWKHU KDQG DUH WKRVH GLIILFXOWLHV WKDW DWWHQG
VRIWZDUHGHYHORSPHQWEHFDXVHRIWKHKLVWRULFDOSURJUHVVRIRXUSUDFWLFH7KH\DUHQRWLQKHUHQW
DQGFDQEHUHPRYHGLIZHFDQLGHQWLI\DQGXQGHUVWDQGWKHLUFDXVHV
0RUHUHFHQWO\*LEEV  ZURWH DZLGHO\FLWHG DUWLFOH LQ6FLHQWLILF $PHULFDQ HQWLWOHG
6RIWZDUH¶V&KURQLF&ULVLVIRFXVLQJRQDZLGHUDQJHRISUREOHPVLQVRIWZDUHGHYHORSPHQW

6WXGLHVKDYHVKRZQWKDWIRUHYHU\VL[QHZODUJHVFDOHVRIWZDUHV\VWHPVWKDWDUHSXWLQWR
RSHUDWLRQ WZR RWKHUV DUH FDQFHOOHG 7KH DYHUDJH VRIWZDUH GHYHORSPHQW SURMHFW RYHU
VKRRWVLWVVFKHGXOHE\KDOIODUJHUSURMHFWVGRZRUVH$QGVRPHWKUHHTXDUWHUVRIDOOODUJH
V\VWHPVDUHµRSHUDWLQJIDLOXUHV¶WKDWHLWKHUGRQRWIXQFWLRQDVLQWHQGHGRUDUHQRWXVHGDW
DOO LELGSS 

$OVR WKH 3,7$& UHSRUW -R\ DQG .HQQHG\   VLQJOHG RXW WKH SUREOHPV ZLWK VRIWZDUH
TXDOLW\DQGVRIWZDUHGHYHORSPHQWDVDNH\REVWDFOHIRUWKHZD\ZHOLYHOHDUQZRUNDQGSOD\
LQWKHVWFHQWXU\6LPLODUWRWKHDERYHSDVVDJHIURP*LEEV  WKH3,7$&UHSRUWTXRWHV
ILJXUHV IURP WKH 6WDQGLVK *URXS VWDWLQJ WKDW  SHUFHQW RI VRIWZDUH SURMHFWV DUH ODWH
VXEVWDQWLDOO\RYHUEXGJHWFDQFHOHGRURXWULJKWIDLOXUHV
7KHWHUP³VRIWZDUHHQJLQHHULQJ´ZDVFRLQHGDWWKH1$72FRQIHUHQFHDVDQDQVZHUWRWKH
SUREOHPV LQ VRIWZDUH GHYHORSPHQW ,W ZDV GHOLEHUDWHO\ SURYRFDWLYH LPSO\LQJ WKH QHHG IRU
VRIWZDUHGHYHORSPHQWWREHEDVHGRQWKHSULQFLSOHVDQGSUDFWLFHVVHHQLQHQJLQHHULQJ7KXV
WKH SRLQW RI GHSDUWXUH IRU PRVW RI WKH VXEVHTXHQW HIIRUWV LQ DGGUHVVLQJ WKH SUREOHPV LQ
VRIWZDUHGHYHORSPHQWKDVEHHQWRWUHDWWKHHQWLUHWDVNRIVRIWZDUHGHYHORSPHQWDVDSURFHVV
WKDWFDQEHLPSURYHGWKURXJKHQJLQHHULQJPHWKRGV
+RDUH   IRU H[DPSOH FRQVLGHUHG WKH ³ULVH RI HQJLQHHULQJ´ DQG WKH XVH RI
³PDWKHPDWLFDO SURRI´ LQ VRIWZDUH GHYHORSPHQW DV D SURPLVH WR ³WUDQVIRUP WKH DUFDQH DQG
HUURUSURQH FUDIW RI FRPSXWHU SURJUDPPLQJ WR PHHW WKH KLJKHVW VWDQGDUGV RI D PRGHUQ
HQJLQHHULQJ SURIHVVLRQ´ LELG S   /LNHZLVH /HKPDQ   IRFXVHG RQ UHGXFLQJ
XQFHUWDLQW\ LQ WKH GHYHORSPHQW SURFHVV WKURXJK WKH ³HQJLQHHULQJ RI VRIWZDUH´ ZKLOH %DVLOL
 SXWWKHFDVHIRUDVFLHQWLILFDSSURDFKWRVRIWZDUHGHYHORSPHQWVWDWLQJWKDW³6RIWZDUH
HQJLQHHULQJLVDODERUDWRU\VFLHQFH´ LELGSHPSKDVLVLQRULJLQDO 
+XPSKUH\   UHFRJQL]HG WKDW WKH NH\ SUREOHPV LQ VRIWZDUH GHYHORSPHQW DUH QRW
WHFKQRORJLFDO EXW PDQDJHULDO LQ QDWXUH &RQVHTXHQWO\ KH GHYHORSHG D IUDPHZRUN IRU

±±
,1752'8&7,21

PDQDJLQJ DQG LPSURYLQJ WKH VRIWZDUH SURFHVV ZKLFK ZDV ODWHU NQRZQ DV ³7KH &DSDELOLW\
0DWXULW\ 0RGHO IRU 6RIWZDUH´ &00  3DXON HW DO   7KLV IUDPHZRUN UHIOHFWV WKH
XQGHUO\LQJ SUHPLVH RI VRIWZDUH SURFHVV LPSURYHPHQW 63,  WKDW ³WKH TXDOLW\ RI D VRIWZDUH
SURGXFW LV ODUJHO\ JRYHUQHG E\ WKH TXDOLW\ RI WKH SURFHVV XVHG WR GHYHORS DQG PDLQWDLQ LW´
LELG S   &RQVLVWHQW ZLWK WKH YLHZV RI VRIWZDUH HQJLQHHULQJ WKH &00 LV URRWHG LQ WKH
HQJLQHHULQJ WUDGLWLRQ HPSKDVL]LQJ SUHGLFWDELOLW\ DQG LPSURYHPHQW WKURXJK WKH XVH RI
VWDWLVWLFDOSURFHVVFRQWURO+XPSKUH\  IRUPXODWHGKLVIXQGDPHQWDOYLHZLQWKLVZD\³,I
WKHSURFHVVLVQRWXQGHUVWDWLVWLFDOFRQWUROVXVWDLQHGSURJUHVVLVQRWSRVVLEOHXQWLOLWLV´ LELG
S 
$V WKHVH H[DPSOHV IURP VRPH RI WKH PRVW LQIOXHQWLDO DFDGHPLF OHDGHUV ZLWKLQ WKH
VRIWZDUH FRPPXQLW\ VKRZ VRIWZDUH GHYHORSPHQW DQG VRIWZDUH SURFHVV LPSURYHPHQW DUH
VWURQJO\URRWHGLQWKH UDWLRQDOLVWLF WUDGLWLRQV RI HQJLQHHULQJ ,QGHHG PRVW RI WKH ZULWLQJV WR
GDWH FDQ EH VHHQ WR KDYH DQWHFHGHQWV LQ WKH LQGXVWULDO PRGHOV GHYLVHG E\ )UHGHULF :LQVORZ
7D\ORUDQG+HQU\)RUGDQGDOVRLQWKHQRWLRQRIEXUHDXFUDF\GHVFULEHGE\0D[:HEHU$VD
UHVXOW WKH PRYH WRZDUG LPSURYHPHQWV LQ VRIWZDUH GHYHORSPHQW SURFHVVHV KDV UHPDLQHG
WHFKQRORJ\GULYHQ
+RZHYHU VRIWZDUH GHYHORSPHQW DQG VRIWZDUH SURFHVV LPSURYHPHQW LQYROYHV RUJDQL]D
WLRQDO DV ZHOO DV WHFKQLFDO LVVXHV :KLOH VRIWZDUH HQJLQHHULQJ KDV EHHQ RIIHUHG DV D ZD\ RI
UHVROYLQJWKHLQWULQVLFWHFKQLFDOSUREOHPVWKHRUJDQL]DWLRQDOSUREOHPVQHHGDQRWKHUDSSURDFK
+RZHYHU ERWK FODVVHV RI SUREOHPV QHHG WR EH MRLQWO\ UHVROYHG WR LPSURYH WKH SURFHVV RI
VRIWZDUH GHYHORSPHQW ± LH WKH\ DUH FRSURGXFHUV RI WKH RXWFRPH ,W LV WKHUHIRUH P\
FRQWHQWLRQ WKDW ZH FDQQRW H[SHFW WR VXFFHHG ZLWK WKH SUDFWLFH RI 63, LI ZH FRQWLQXH WR
DSSURDFK63,UHVHDUFKZLWKRQHH\HFORVHG

 7KHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,
&RQFHUQ ZLWK WKH UHODWLRQVKLS EHWZHHQ WKH SUREOHPV LQ VRIWZDUH GHYHORSPHQW DQG
RUJDQL]DWLRQDOLVVXHVLVQRWDQHZSKHQRPHQRQ0RUHWKDQ\HDUVDJR/XFDV  ZURWHD
FODVVLFERRNRQZK\LQIRUPDWLRQV\VWHPVIDLOVXJJHVWLQJWKDW³WKHSULPDU\FDXVHIRUV\VWHP
IDLOXUH KDV EHHQ RUJDQL]DWLRQDO EHKDYLRU SUREOHPV´ LELG S   7KHUH LV KRZHYHU DQ
LQFUHDVLQJDPRXQWRIHYLGHQFHWRVXJJHVWWKDWRUJDQL]DWLRQDOLVVXHVDUHQRZPRUHLPSRUWDQW
DQGZLOOEHFRPHHYHQPRUHFULWLFDOWRWKHVXFFHVVIXOLPSURYHPHQWRIVRIWZDUHGHYHORSPHQW
WKDQWKH\ZHUHZKHQ/XFDV  ZURWHKLVERRN %HQQHWWVHWDO%MHUNQHV'DKOERP
HWDO'DKOERPDQG0DWKLDVVHQ'RKHUW\DQG.LQJD.DZDOHNDQG
:DVWHOO 7KLVZDVDOVRWKHIRFXVRIWKH2FWREHULVVXHRI&RPPXQLFDWLRQVRIWKH
$&0 DQG WKH 0D\-XQH  LVVXH RI ,((( 6RIWZDUH ZKLFK KDG D IRFXV RQ RUJDQL]DWLRQDO
FKDQJH
'HVSLWH WKLV LQFUHDVLQJO\ UHFRJQL]HG LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV ZLWKLQ WKH 63,
FRPPXQLW\WKHW\SLFDOUHVSRQVHWRWKHSHUVLVWHQWSUREOHPVLQVRIWZDUHGHYHORSPHQWKDVEHHQ
WRDSSO\HYHQPRUHULJRURXVO\WKHSULQFLSOHVRIHQJLQHHULQJ HJ)ORUDFDQG&DUOHWRQ 
2UJDQL]DWLRQDO LVVXHV DUH RIWHQ LJQRUHG RU QRW SURSHUO\ DGGUHVVHG LQ PXFK RI WKH UHFHQW
OLWHUDWXUH ZLWK RQO\ D KDQGIXO RI VWXGLHV EHLQJ UHSRUWHG HJ (O (PDP HW DO  
*ROGHQVRQDQG+HUEVOHE*XLQDQHWDO6DZ\HUDQG*XLQDQ )XUWKHUPRUH
RUJDQL]DWLRQDOLVVXHVDUHRQO\WUHDWHGLPSOLFLWO\RULQPDQ\FDVHVQRWDWDOOHYHQE\PDQDJHUV
ZKR SHUFHLYH RUJDQL]DWLRQDO LVVXHV WR EH RI PRUH LPSRUWDQFH WKDQ WHFKQLFDO LVVXHV LQ
GHWHUPLQLQJ WKH VXFFHVVIXO RXWFRPH RI V\VWHPV GHYHORSPHQW SURMHFWV 'RKHUW\ DQG .LQJ

±±
&+$37(5

E 7KHUHLVWKHUHIRUHDSUHVVLQJQHHG IRU HPSLULFDO UHVHDUFK WR LQYHVWLJDWH WKH LPSRU


WDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,
7KHSRVLWLRQWDNHQLQWKLVWKHVLVUHJDUGLQJRUJDQL]DWLRQDOLVVXHVLVVWURQJO\LQIOXHQFHGE\
VRFLRWHFKQLFDO WKHRU\ 7ULVW DQG %DPIRUWK  7ULVW   ,WV FHQWUDO FRQFHSWLRQ LV WKDW
RUJDQL]DWLRQV DUH ERWK VRFLDO DQG WHFKQLFDO V\VWHPV DQG WKDW WKH FRUH RI WKH VRIWZDUH
RUJDQL]DWLRQ LV UHSUHVHQWHG WKURXJK WKH LQWHUIDFH EHWZHHQ WKH WHFKQLFDO DQG KXPDQ VRFLDO
V\VWHP7KXV,GHILQHRUJDQL]DWLRQDOLVVXHVZLWKLQWKHFRQWH[WRI63,DVDQ\GLVWLQFWDUHDRQ
WKHLQWHUIDFHEHWZHHQWKHWHFKQLFDOV\VWHPDQGWKHVRFLDOV\VWHPZKLFKFDQHQDEOHVRIWZDUH
SURFHVVLPSURYHPHQWV7KLVGHILQLWLRQHQFRPSDVVHVDZLGHUDQJHRIRUJDQL]DWLRQDOLVVXHVWKDW
QHHG WR EH DGGUHVVHG LQ 63, ZKLFK RWKHUV KDYH FODVVLILHG DV PDQDJHULDO +XPSKUH\ 
  EHKDYLRUDO &XUWLV HW DO   KXPDQ :DVWHOO   RU SHRSOH 'H0DUFR DQG
/LVWHU LVVXHV
)URP D VRIWZDUH HQJLQHHULQJ SHUVSHFWLYH WKH ZRUOG LV FRPSRVHG RI SUREOHPV ZKRVH
H[LVWHQFH LV GLVWLQFW IURP WKH PHWKRGV WRROV DQG WHFKQLTXHV RI VRIWZDUH HQJLQHHULQJ 7KH
WHFKQLFDO UDWLRQDOLW\ EHKLQG WKLV ZRUOGYLHZ HPSKDVL]HV ³REMHFWLYH WUXWKV´ DQG JOREDO ³EHVW
SUDFWLFHV´ DW WKH H[SHQVH RI ORFDO FRQWH[W DQG H[SHUWLVH $Q LPSRUWDQW DVSHFW RI VRFLR
WHFKQLFDO WKHRU\ KRZHYHU LV WKH EHOLHI WKDW WKHUH PD\ EH PDQ\ RSWLPDO VROXWLRQV ± RU EHVW
ZD\V±WRDVSHFLILFSUREOHPVLQFHWKH³MRLQWRSWLPL]DWLRQ´RIDSDUWLFXODUWHFKQLFDODQGKX
PDQV\VWHPFDQEHLPSOHPHQWHGLQVHYHUDOZD\VWKDWFDQEHHTXDOO\HIILFLHQW7KLVSRVLWLRQLV
SDUWLFXODUO\ UHOHYDQW IRU 63, EHFDXVH DV , DOUHDG\ KDYH DUJXHG RI WKH LQWLPDWH LQWHUGH
SHQGHQFHEHWZHHQWHFKQLFDODQGRUJDQL]DWLRQDOLVVXHV
,QDGGLWLRQWR³MRLQWRSWLPL]DWLRQ´VRFLRWHFKQLFDOWKHRU\DOVRHPSKDVL]HVWKHSULQFLSOHV
RI ³PLQLPXP FULWLFDO VSHFLILFDWLRQ´ ³DXWRQRPRXV ZRUN JURXSV´ DQG ³FRGHWHUPLQDWLRQ´
7ULVW ,QVWHDGRIDVHDUFKIRUJOREDOEHVWSUDFWLFHVWKHUHIRUHWKHWKHVLVSRLQWVWRWKH
LPSRUWDQFHRIFRQWH[WVHQVLWLYHOHDUQLQJ :DO]HWDO DQGWRIROORZWKHUXOHVVXJJHVWHG
E\ WKH VLWXDWLRQ DW KDQG 5RELQVRQ HW DO   )XUWKHUPRUH , HQYLVDJH VRIWZDUH
GHYHORSPHQW ODUJHO\ DV D KXPDQ EDVHG LQWHOOHFWXDO DFWLYLW\ :HLQEHUJ    WKDW
LQYROYHVFRQVWDQWQHJRWLDWLRQDQGUHQHJRWLDWLRQDPRQJDQGEHWZHHQWKHVRFLDOJURXSVVKDSLQJ
WKHVRIWZDUH
7KXVWKHIXQGDPHQWDODVVXPSWLRQEHKLQGWKHLQYHVWLJDWLRQSUHVHQWHGLQWKLVWKHVLVLVWKDW
VRIWZDUH SURFHVV LPSURYHPHQW LV D VRFLDOO\ FRQVWUXFWHG OHDUQLQJ SURFHVV DQG FRQVHTXHQWO\
WKDWDFRPPLWPHQWWROHDUQLQJUDWKHUWKDQWR³EHVWSUDFWLFH´PRGHOVLVQHHGHGWRDFFRPSOLVK
LPSURYHPHQWV LQ VRIWZDUH GHYHORSPHQW 7KHUHIRUH WKH WKHVLV IRFXVHV RQ VWXG\LQJ WKHVH
OHDUQLQJ SURFHVVHV DQG WKH NH\ IDFWRUV WKDW HQDEOH LPSURYHPHQWV LQ RUJDQL]DWLRQDO SHUIRUP
DQFH

 5HVHDUFK&RQWH[W
7KHUHVHDUFKSUHVHQWHGLQWKLVWKHVLVKDVIRUWKHPRVWSDUWEHHQSHUIRUPHGZLWKLQWKHFRQWH[W
RIWKHIROORZLQJWKUHHSURMHFWV

7(/0(7 7HOHFRPPXQLFDWLRQV0HWULFV$SSURDFK ZDVD3URFHVV,PSURYHPHQW([SHULPHQW


3,( ZLWKLQ1HUD$6VXSSRUWHGE\WKH(XURSHDQ6\VWHPVDQG6RIWZDUH,QLWLDWLYH (66, WKDW
ODVWHG IURP $SULO  WR $SULO  7KH RYHUDOO JRDO RI 7(/0(7 ZDV WR LPSURYH WKH
TXDOLW\DQGSURGXFWLYLW\RIWHOHFRPPXQLFDWLRQVRIWZDUHV\VWHPVGHYHORSPHQWE\LQWURGXFLQJ

±±
,1752'8&7,21

PHWULFVLQWKHWHVWLQJDQGLQVSHFWLRQSURFHVVHV,QDGGLWLRQWKHSURMHFWDFWHGDVWKHILUVWVWHSLQ
1HUD¶VHIIRUWWRDGYDQFHIURPTXDOLWDWLYHWRTXDQWLWDWLYHJRDOVHWWLQJ7KHWHFKQLFDOREMHFWLYHV
ZHUH  WRLGHQWLI\DQGGHILQHVRIWZDUH PHWULFV WR LPSURYH SURGXFW TXDOLW\   WR DQDO\]H
WKHHIIHFWRITXDQWLWDWLYHJRDOVHWWLQJDQGPHDVXUHPHQWDQG  WRYDOLGDWHWKHFKRVHQPHWULFV
LQRUGHUWRLPSOHPHQWSRVW3,(DFWLRQV
, ZDV SDUW RI WKH 3,( WHDP ZLWK D JHQHUDO UHVSRQVLELOLW\ IRU WUDLQLQJ DQG PHWKRGRORJ\
VXSSRUWGXULQJDOOSKDVHVRIWKHPHDVXUHPHQWSURJUDP6SHFLILFDOO\ ,KDGUHVSRQVLELOLW\ IRU
GHYHORSLQJPHDVXUHPHQWSODQVDFFRUGLQJWRDPLDQG*40 VHH&KDSWHU  DQGSHUIRUPLQJ
VWDWLVWLFDO GDWD DQDO\VLV DV GDWD EHFDPH DYDLODEOH VHH '\En HW DO  6WnOKDQH HW DO
E 

63,4 6RIWZDUH3URFHVV,PSURYHPHQWIRUEHWWHU4XDOLW\ ZDVDODUJH1DWLRQDO63,SURJUDP


SDUWO\IXQGHGE\WKH5HVHDUFK&RXQFLORI1RUZD\ZKLFKODVWHGIRUWKUHH\HDUVIURP-DQXDU\
 WR 'HFHPEHU  7KH REMHFWLYH RI 63,4 ZDV WR LQFUHDVH WKH FRPSHWLWLYHQHVV DQG
SURILWDELOLW\ RI 1RUZHJLDQ ,7LQGXVWU\ WKURXJK D V\VWHPDWLF DQG FRQWLQXRXV DSSURDFK WR
SURFHVV LPSURYHPHQW 7KH JRDO RI 63,4 ZDV WZRIROG   WR HVWDEOLVK DQ HQYLURQPHQW IRU
SURFHVVLPSURYHPHQWLQWKHVRIWZDUHRUJDQL]DWLRQVDVVRFLDWHGZLWK63,4DQG  WRWUDQVIHU
DQG GLIIXVH WKH NQRZOHGJH JDLQHG WR WKH UHPDLQLQJ ,7LQGXVWU\ LQ 1RUZD\ WKURXJK WUDLQLQJ
VHPLQDUVDQGFRQIHUHQFHV
7KHWZHOYHVRIWZDUHFRPSDQLHVWKDWDFWLYHO\SDUWLFLSDWHGLQ63,4FRYHUHGRUJDQL]DWLRQV
RI GLIIHUHQW VL]HV ZLWK D ZLGH UDQJH RI SURGXFWV DQG PDUNHWV GHYHORSLQJ HLWKHU VRIWZDUH RU
FRPELQHG VRIWZDUH DQG KDUGZDUH SURGXFWV 6RPH FRPSDQLHV EHORQJHG WR WKH WUDGLWLRQDO
HOHFWURQLFV EDVHG ,7LQGXVWU\ ZKLOH RWKHUV EHORQJHG WR WKH QHZ GRWFRP LQGXVWU\ %HVLGHV
6,17()WKH1RUZHJLDQ8QLYHUVLW\RI6FLHQFHDQG7HFKQRORJ\ 1718  DQGWKH8QLYHUVLW\
RI2VORPDGHXSWKHUHVHDUFKSDUWQHUVLQWKHSURJUDP
, ZDV RQH RI WKUHH 3K' IHOORZV LQ 63,4 0\ PDLQ UROH ZDV WR DVVLVW WKH PHPEHU
RUJDQL]DWLRQVZLWKPHDVXUHPHQWEDVHGLPSURYHPHQWRIWKHLUVRIWZDUHGHYHORSPHQWSURFHVVHV
UHODWLYH WR FRPSDQ\VSHFLILF TXDOLW\ JRDOV VHH &RQUDGL DQG '\En  '\En F G
'\EnDQG0RH6WnOKDQHHWDO ,QDGGLWLRQ,DOVRKDGWKHHGLWRULDOUHVSRQVLELOLW\
IRUWKH63,40HWKRGRORJ\+DQGERRN VHH'\EnH 

352),7 3URFHVVLPSURYHPHQWIRU,7LQGXVWU\ LVD1DWLRQDO63,SURJUDPSDUWO\IXQGHGE\


WKH5HVHDUFK&RXQFLORI1RUZD\ZKLFKVWDUWHGLQ0DUFKDQGZLOOFRQWLQXHWKURXJKRXW
7KHRYHUDOOJRDORI352),7LVWR³LQFUHDVHWKHFRPSHWLWLYHQHVVDQGSURILWDELOLW\RIWKH
1RUZHJLDQ ,7LQGXVWU\ WKURXJK IRFXVLQJ RQ OHDUQLQJ DQG SURFHVV LPSURYHPHQW LQ WKH
FRQWLQXRXVO\FKDQJLQJHQYLURQPHQWRIWKHVRIWZDUHEXVLQHVV´/LNH63,4352),7LQYROYHV
WZHOYHVRIWZDUHFRPSDQLHVZLWK6,17()1718DQGWKH8QLYHUVLW\RI2VORDVWKHUHVHDUFK
SDUWQHUV
)RFXV DUHDV IRU 352),7 DUH VRIWZDUH SURFHVV LPSURYHPHQW XQGHU XQFHUWDLQW\ DQG
FKDQJH 352),7 WULHV WR GHDO ZLWK WKHVH LVVXHV E\ IRFXVLQJ RQ KHOSLQJ VPDOO DQG PHGLXP
VL]HG VRIWZDUHLQWHQVLYH FRPSDQLHV FUHDWH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQV $V LQ 63,4 WKH
VRIWZDUHFRPSDQLHVSDUWLFLSDWLQJLQ352),7UXQLPSURYHPHQWSURMHFWVDFFRUGLQJWRWKH(66,
PRGHOZLWKDQLPSURYHPHQWSURMHFWDVDOD\HURQWRSRIDUHDOGHYHORSPHQWSURMHFW
$VLQ7(/0(7 DQG63,4P\ UROHLQ352),7LV WR KHOS VRIWZDUH RUJDQL]DWLRQV LQ LP
SURYLQJ WKHLU VRIWZDUH GHYHORSPHQW SURFHVVHV UHODWLYH WR FRPSDQ\VSHFLILF TXDOLW\ JRDOV

±±
&+$37(5

ZKLOHDWWKHVDPHWLPHFRQWULEXWLQJWRWKHERG\RINQRZOHGJHZLWKLQ63, VHH'\EnD
E 

$GGLWLRQDOO\P\SHUVRQDOH[SHULHQFHIURP\HDUVRIVRIWZDUHGHYHORSPHQWDQGFRQVXOWLQJ
IRU D ZLGH UDQJH RI FXVWRPHU DQG VXSSOLHU RUJDQL]DWLRQV LQ LQGXVWU\ DQG JRYHUQPHQW KDV
VWURQJO\LQIOXHQFHGERWKWKHFRQWHQWDQGWKHDSSURDFKRIWKHSUHVHQWLQYHVWLJDWLRQ

 5HVHDUFK3UREOHPDQG4XHVWLRQV
,Q WKLV VHFWLRQ WKH UHVHDUFK SUREOHP DQG TXHVWLRQV DUH H[SODLQHG $OWKRXJK LW KDV SDUWLDOO\
EHHQ FRYHUHG E\ WKH GLVFXVVLRQ LQ 6HFWLRQ  , FRPPHQW RQ WKH WLWOH RI WKH WKHVLV ILUVW WR
UHYHDOVRPHRIWKHPRVWLPSRUWDQWDVVXPSWLRQV

7KHVLV7LWOH
(QDEOLQJ6RIWZDUH3URFHVV,PSURYHPHQW
$Q,QYHVWLJDWLRQRIWKH,PSRUWDQFHRI2UJDQL]DWLRQDO,VVXHV

7KHWLWOHRIWKHWKHVLVKDVIRXUPDLQSDUWVZKLFKDUHLQIRUPDOO\H[SODLQHGEHORZ

x (QDEOLQJ 7KH SHUVSHFWLYH WDNHQ LQ WKLV WKHVLV LV D UHFRJQLWLRQ RI WKH QHHG WR HQDEOH
VRIWZDUHSURFHVVLPSURYHPHQWUDWKHUWKDQWU\LQJWRFRQWUROLW7KHUHIRUHWKHIRFXVLVRQ
HQDEOLQJ63,UDWKHUWKDQRQHIIRUWVWRPDQDJHLW
x 6RIWZDUH3URFHVV,PSURYHPHQW7KHIXQGDPHQWDODVVXPSWLRQRI63,WDNHQLQWKLVWKHVLV
LV WKDW FKDQJHV WR WKH SURFHVV FDXVH FKDQJHV LQ WKH RXWFRPH 7KXV UDWKHU WKDQ EHLQJ
LQWHUHVWHGLQWKHSURFHVVLWVHOIWKHWKHVLVLVPRUHFRQFHUQHGDERXWWKHSURFHVVRXWFRPHV
x ,QYHVWLJDWLRQ 7KH WKHVLV LQFOXGHV D VXEVWDQWLDO WKHRUHWLFDO LQYHVWLJDWLRQ ZLWK DQ
H[WHQVLYH OLWHUDWXUH UHYLHZ RI PRUH WKDQ  UHIHUHQFHV 7KH HPSLULFDO LQYHVWLJDWLRQ
LQFOXGHV  TXDOLWDWLYH FDVH VWXGLHV DV ZHOO DV WKH PDLQ TXDQWLWDWLYH VXUYH\ RI 
VRIWZDUHRUJDQL]DWLRQV
x ,PSRUWDQFH RI 2UJDQL]DWLRQDO ,VVXHV 7KH DLP RI WKH WKHVLV LV WR LQYHVWLJDWH
RUJDQL]DWLRQDO LVVXHV WKDW KDYH D VXEVWDQWLDO LPSRUWDQFH LQ HQDEOLQJ 63, 7KH WKHVLV
IRFXVHVRQWZRFODVVHVRIVXFKLVVXHV  WKHVRFLDOO\FRQVWUXFWHGOHDUQLQJSURFHVVHVDQG
 WKHNH\IDFWRUVWKDWIDFLOLWDWHLPSURYHPHQWVLQRUJDQL]DWLRQDOSHUIRUPDQFH

'HVSLWH WKH LQFUHDVLQJO\ UHFRJQL]HG LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV ZLWKLQ WKH 63,
FRPPXQLW\IHZHPSLULFDOVWXGLHVKDYHEHHQUHSRUWHG7RKHOSILOOWKLVJDSWKHGRFWRUDOVWXG\
UHSRUWHGLQWKLVWKHVLVZDVLQLWLDWHGWRH[SORUHWKHUHODWLYHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHV
E\LQYHVWLJDWLQJWKHOHDUQLQJSURFHVVHVDQGNH\IDFWRUVIRUVXFFHVVLQ63,

±±
,1752'8&7,21

7KXVWKHSUREOHPDGGUHVVHGLQWKLVWKHVLVLV

5HVHDUFK3UREOHP
+RZFDQVRIWZDUHRUJDQL]DWLRQVHQDEOHVRIWZDUHSURFHVVLPSURYHPHQW"

(VVHQWLDOO\,DUJXHWKDW63,FDQQRWEHPDQDJHGEXWRQO\HQDEOHGWKURXJKWKHVSDFHLQZKLFK
WKHVRIWZDUHRUJDQL]DWLRQFUHDWHVWKHSRVVLELOLWLHVIRUVHQVHPDNLQJNQRZOHGJH FUHDWLRQDQG
SXUSRVHIXODFWLRQ

7RQDUURZWKHIRFXVRIWKHLQYHVWLJDWLRQWKHUHVHDUFKSUREOHPDGGUHVVHGE\WKLVWKHVLVFDQEH
VXPPDUL]HGE\WKHIROORZLQJWKUHHTXHVWLRQV

5HVHDUFK4XHVWLRQV
4 :KDWDUHWKHNH\OHDUQLQJSURFHVVHVLQVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV"
7KHILUVWTXHVWLRQIRFXVHVRQLGHQWLI\LQJWKHNH\SURFHVVHVWKDWDUHSDUWRID
VXFFHVVIXOVRIWZDUHRUJDQL]DWLRQ¶VOHDUQLQJF\FOH$WKHRUHWLFDOLQYHVWLJDWLRQ
DQGDVHWRITXDOLWDWLYHFDVHVWXGLHVDQVZHUWKHTXHVWLRQ
4 :KDWDUHWKHNH\IDFWRUVRIVXFFHVVLQVRIWZDUHSURFHVVLPSURYHPHQW"
7KHVHFRQGTXHVWLRQIRFXVHVRQLGHQWLI\LQJWKHNH\IDFWRUVIRUVXFFHVVLQ63,
$WKHRUHWLFDOLQYHVWLJDWLRQDQGDTXDQWLWDWLYHVXUYH\DQVZHUWKHTXHVWLRQ
4 :KDWDUHWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[WDQGPRGHVRI
OHDUQLQJLQVRIWZDUHRUJDQL]DWLRQV"
7KHWKLUGTXHVWLRQIRFXVHVRQILQGLQJWKHUHODWLRQVKLSVEHWZHHQWKHWZRPDMRU
PRGHVRIOHDUQLQJH[SORLWDWLRQDQGH[SORUDWLRQDQGWKHVRIWZDUHRUJDQL]D
WLRQV¶FRQWH[W7KHTXHVWLRQLVDQVZHUHGE\WKHTXDQWLWDWLYHVXUYH\

7DNHQWRJHWKHUWKHDQVZHUVWRWKHVHTXHVWLRQVFRQVWLWXWHWKHPDLQFRQWULEXWLRQVRIWKLVWKHVLV
7KHVHFRQWULEXWLRQVDUHSXWIRUZDUGLQWKHQH[WVHFWLRQ

±±
&+$37(5

 &ODLPHG&RQWULEXWLRQV
7KH REMHFWLYH RI WKH WKHVLV LV WR LQYHVWLJDWH WKH LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV LQ 63,
%DVHG RQ WKLV REMHFWLYH DQG WKH DQVZHUV SURYLGHG WR WKH UHVHDUFK TXHVWLRQV SRVHG LQ WKH
SUHYLRXVVHFWLRQ,FODLPWKDWWKHWKHVLVFRQWULEXWHVZLWKXQLTXHWKHRUHWLFDOPHWKRGRORJLFDO
DQGSUDFWLFDONQRZOHGJH7KHPDLQFRQWULEXWLRQVDUH

x $Q LQFUHDVHG DZDUHQHVV RI WKH LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV LQ 63, )RU WKH
PRVW SDUW 63, KDV EHHQ SUHRFFXSLHG ZLWK WHFKQLFDO LVVXHV DW WKH H[SHQVH RI
RUJDQL]DWLRQDO LVVXHV 7KH RYHUDOO FRQWULEXWLRQ RI WKH WKHVLV WKHUHIRUH LV WR HPSLULFDOO\
VKRZWKDWRUJDQL]DWLRQDOLVVXHVDUHLQGHHGLPSRUWDQWIRUVXFFHHGLQJZLWK63,
x $G\QDPLF PRGHO RI 63, %DVHG RQ P\ SHUVRQDO H[SHULHQFH DQG REVHUYDWLRQV DQG WKH
H[WHQVLYH OLWHUDWXUH UHYLHZ , KDYH GHYHORSHG D G\QDPLF PRGHO RI 63, 7KH PRGHO LV
LQVSLUHG E\ VRFLDO FRQVWUXFWLYLVP DQG RSHQ V\VWHPV WKHRU\ DQG LW FRQVLVWV RI WKH
IROORZLQJIRXUPDMRUHOHPHQWVRUJDQL]DWLRQDOFRQWH[WOHDUQLQJF\FOHIDFLOLWDWLQJIDFWRUV
DQGRUJDQL]DWLRQDORXWFRPH7KHPRGHOLVSUHVHQWHGLQ&KDSWHUDQG DQVZHUVUHVHDUFK
TXHVWLRQ4
x .H\ IDFWRUV IRU VXFFHVV LQ 63, $V DQ LPSRUWDQW SDUW RI WKH G\QDPLF PRGHO RI 63, ,
GHILQHGDVHWRINH\IDFWRUVIRUVXFFHVV7KHIDFWRUVDUHWKHRUHWLFDOO\MXVWLILHGDQGGHILQHG
LQ&KDSWHUHPSLULFDOO\MXVWLILHGLQ&KDSWHUDQGYDOLGDWHGLQ&KDSWHUSURYLGLQJWKH
DQVZHUWRUHVHDUFKTXHVWLRQ4
x $Q LPSURYLVDWLRQDO DSSURDFK WR 63, 7KH UHVXOWV RI P\ LQYHVWLJDWLRQV VKRZHG WKDW
WKHUHDUHLPSRUWDQWGLIIHUHQFHVLQWKHZD\ODUJHVXFFHVVIXODQGVPDOO VXFFHVVIXO RUJDQL
]DWLRQV UHDFW WR HQYLURQPHQWDO FRQGLWLRQV DQG KRZ WKH\ GHDO ZLWK 63, &RQVHTXHQWO\ ,
SURSRVHDQDSSURDFKWR63,LQVPDOORUJDQL]DWLRQVEDVHGRQLPSURYLVDWLRQ7KHDSSURDFK
LVGHVFULEHGLQ&KDSWHUDQGSURYLGHVWKHDQVZHUWRUHVHDUFKTXHVWLRQ4

0RUHRYHUVHYHUDOSDSHUVKDYHEHHQSXEOLVKHGGXULQJWKHSHULRGRIWKHGRFWRUDOVWXGLHVZLWK
DGGLWLRQDOFRQWULEXWLRQVWRWKHQDWLRQDODQGLQWHUQDWLRQDOERG\RINQRZOHGJHLQ63,

-RXUQDODUWLFOHV
x '\En7 D $Q ,QVWUXPHQWIRU0HDVXULQJWKH.H\ )DFWRUVRI6XFFHVVLQ6RIWZDUH
3URFHVV ,PSURYHPHQW (PSLULFDO 6RIWZDUH (QJLQHHULQJ 9RO  1R  'HFHPEHU SS

x '\En 7 E  ,PSURYLVDWLRQ LQ 6PDOO 6RIWZDUH 2UJDQL]DWLRQV ,((( 6RIWZDUH 9RO
1R6HSWHPEHU2FWREHUSS
x '\En 7   $VVHVVPHQWEDVHG 6RIWZDUH 3URFHVV ,PSURYHPHQW 7HOHNWURQLNN 9RO
1RSS
x '\En7 DQG 6NRJVWDG ‘   0HDVXUHPHQW%DVHG 6RIWZDUH 3URFHVV ,PSURYHPHQW
7HOHNWURQLNN±6SHFLDO,VVXHRQ6RIWZDUH4XDOLW\9RO1RSS

%RRNVDQGERRNFKDSWHUV
x '\En 7 (G  H  63,4 ± 6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\
0HWKRGRORJ\ +DQGERRN LQ 1RUZHJLDQ  ,', 5HSRUW  7URQGKHLP 1RUZD\

±±
,1752'8&7,21

1RUZHJLDQ 8QLYHUVLW\ RI 6FLHQFH DQG 7HFKQRORJ\ 1718  )DFXOW\ RI 3K\VLFV
,QIRUPDWLFVDQG0DWKHPDWLFV
x '\En 7 F  3ODQQLQJ 2UJDQL]DWLRQDO ,PSURYHPHQW 3URJUDPV LQ 7 '\En (G 
63,4 ± 6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\ 0HWKRGRORJ\ +DQGERRN LQ
1RUZHJLDQ ,',5HSRUW7URQGKHLP1RUZD\1718
x '\En7 G 3ODQQLQJ3URFHVV,PSURYHPHQW([SHULPHQWVLQ7'\En (G 63,4±
6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\ 0HWKRGRORJ\ +DQGERRN LQ
1RUZHJLDQ ,',5HSRUW7URQGKHLP1RUZD\1718

&RQIHUHQFHSDSHUV
x &RQUDGL5DQG'\En7  $Q(PSLULFDO6WXG\RQWKH8WLOLW\RI)RUPDO5RXWLQHVWR
7UDQVIHU .QRZOHGJH DQG ([SHULHQFH 3URFHHGLQJV RI WKH WK (XURSHDQ 6RIWZDUH
(QJLQHHULQJ&RQIHUHQFH (6(&¶ 9LHQQD$XVWULD6HSWHPEHU
x '\En7DQG0RH1%  5HWKLQNLQJWKH&RQFHSWRI6RIWZDUH3URFHVV$VVHVVPHQW
3URFHHGLQJVRI WKH (XURSHDQ 6RIWZDUH 3URFHVV ,PSURYHPHQW &RQIHUHQFH (XUR63,¶ 
3RUL)LQODQG2FWREHU
x 6WnOKDQH 7 :HGGH .- DQG '\En 7   'DWD 'ULYHQ ,PSURYHPHQW IRU 60(V
3URFHHGLQJVRI WKH (XURSHDQ 6RIWZDUH 3URFHVV ,PSURYHPHQW &RQIHUHQFH (XUR63,¶ 
*RWKHQEXUJ6ZHGHQ1RYHPEHU
x '\En 7 6WnOKDQH 7 DQG 3DOPVWU¡P 5   ([SHULHQFH RI *RDO2ULHQWHG
0HDVXUHPHQW XVLQJDPLDQG *40 3URFHHGLQJV RI WKH WK (XURSHDQ 6RIWZDUH &RQWURO
DQG0HWULFV&RQIHUHQFH (6&20¶ %HUOLQ*HUPDQ\0D\
x 6WnOKDQH 7 '\En 7 DQG 3DOPVWU¡P 5   ([SHULHQFH RI ,QWURGXFLQJ *RDO
2ULHQWHG 0HDVXUHPHQW 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO :RUNVKRS RQ 6RIWZDUH
7HFKQRORJ\DQG(QJLQHHULQJ3UDFWLFH 67(3¶ /RQGRQ-XO\

 5HVHDUFK0HWKRG
7KH RYHUDOO UHVHDUFK GHVLJQ IRU WKH VWXG\ LV VKRZQ LQ )LJXUH  ,W LV D VHTXHQWLDO PL[HG
PHWKRGGHVLJQFRQVLVWLQJRIWZRPDLQSKDVHVILUVWDTXDOLWDWLYHPRGHOEXLOGLQJSKDVHWKHQ
WKH PDLQ TXDQWLWDWLYH PRGHOWHVWLQJ SKDVH 7KH PRGHOEXLOGLQJ SKDVH ZDV JURXQGHG LQ P\
SULRUSHUVRQDOH[SHULHQFHDVDFRQVXOWDQWLQP\REVHUYDWLRQVLQWKHFDVHVWXGLHVDQGLQWKH
H[WHQVLYH OLWHUDWXUH UHYLHZ 7KH PRGHOWHVWLQJ SKDVH IRFXVHG RQ WHVWLQJ WKH DVVRFLDWLRQV
EHWZHHQWKHNH\IDFWRUVIRUVXFFHVVDQGWKHRXWFRPHYDULDEOH63,VXFFHVVE\DTXDQWLWDWLYH
VXUYH\
7RJHWKHUWKHVHWZRSKDVHVFRPELQH³SURFHVVUHVHDUFK´ZLWK³IDFWRUUHVHDUFK´ 1HZPDQ
DQG 5REH\   ZKLFK FDQ EH VHHQ DV WZR PDMRU DSSURDFKHV WR 63, UHVHDUFK ZLWK
DQWHFHGHQWVLQ0,6 0DQDJHPHQW,QIRUPDWLRQ6\VWHP UHVHDUFK3URFHVVUHVHDUFKLVW\SLFDOO\
IRFXVHGRQWKHG\QDPLFVRILQGLYLGXDOSURMHFWVXVLQJTXDOLWDWLYHPHWKRGVVXFKDVLQWHUYLHZV
DQG SDUWLFLSDQWREVHUYDWLRQV )DFWRU UHVHDUFK RQ WKH RWKHU KDQG LV W\SLFDOO\ IRFXVHG RQ
DVVHVVLQJ WKH UHODWLRQVKLSV EHWZHHQ NH\ FDXVDO DQG RXWFRPH YDULDEOHV E\ FROOHFWLQJ VXUYH\
GDWDIURPDODUJHQXPEHURIRUJDQL]DWLRQV

±±
&+$37(5

3LORW
&DVH6WXG\
&K

3HUVRQDO /LWHUDWXUH
H[SHULHQFH UHYLHZ

0XOWLSOH
&DVH6WXG\
&K

)RXQGDWLRQVRIWKH/HDUQLQJ6RIWZDUH2UJDQL]DWLRQ
&K
3KDVH,
0RGHOEXLOGLQJ

'\QDPLF0RGHORI63,
&K

2UJDQL]DWLRQDO

0HPRU\

W
[
H
W
Q
R V
& V

O H
D F
Q *HQHUDWLQJ )DFLOLWDWLQJ ,QWHUSUHWLQJ F
R X
LW .QRZOHGJH )DFWRUV 6
.QRZOHGJH ,
D
L] 3
Q 6
D
J
U
2

/RFDO

.QRZLQJ

3KDVH,,
0RGHOWHVWLQJ
)DFLOLWDWLQJ 63,
)DFWRUV 6XFFHVV

4XDQWLWDWLYH
2UJDQL]DWLRQDO
UHVHDUFKPRGHO &RQWH[W
&K

,QVWUXPHQWDQG6XUYH\
&K &K


 W F S
5 ]
D 
U!
SU =
E 
)

Figure 1.1: Overall research design consisting of a qualitative model-building phase followed
by a quantitative model-testing phase.

±±
,1752'8&7,21

7KHXQLWRIDQDO\VLVIURPZKLFKRULJLQDOGDWDREVHUYDWLRQVZHUHREWDLQHGZDVWKHVRIWZDUH
RUJDQL]DWLRQZKLFKZDVGHILQHGDVDZKROHFRPSDQ\RUDQLQGHSHQGHQWEXVLQHVVXQLWLQVLGHD
ODUJHUFRPSDQ\WKDWKDVVRIWZDUHGHYHORSPHQWDVLWVSULPDU\EXVLQHVV
7KH SURFHVV UHVHDUFK DSSURDFK LQ WKH PRGHOEXLOGLQJ SKDVH LQFOXGHG D VLQJOH
H[SORUDWRU\ LQGHSWK SLORW FDVH VWXG\ &DVH VWXG\ $ 7(/0(7 6HFWLRQ   IROORZHG E\ D
PRUHH[SODQDWRU\FURVVFDVHDQDO\VLVRIWZHOYHVRIWZDUHRUJDQL]DWLRQV &DVHVWXGLHV$DQG%
63,46HFWLRQVDQG'\EnH &ROOHFWLYHO\WKHVHFDVHVWXGLHVKDGDFRQVLGHUDEOH
LQIOXHQFHRQWKHPRGHOXOWLPDWHO\PHDVXUHGDQGWHVWHGE\WKHIROORZLQJVXUYH\7RJHWKHUZLWK
WKHOLWHUDWXUHUHYLHZDQGP\SULRUH[SHULHQFHDVDFRQVXOWDQWWKHH[SHULHQFHJDLQHGDQGGDWD
FROOHFWHGGXULQJWKLVSKDVHRIWKHUHVHDUFKSURYLGHGWKHIRXQGDWLRQV &KDSWHU IRUGHYHORS
LQJWKHG\QDPLFPRGHORI63,ZKLFKLVGHVFULEHGLQ&KDSWHU
7KH K\SRWKHVHV UHJDUGLQJ WKH NH\ IDFWRUV RI VXFFHVV LQ 63, GHYHORSHG LQ WKH PRGHO
EXLOGLQJ SDUW RI WKH VWXG\ ZHUH WHVWHG XVLQJ DQ H[SODQDWRU\ FURVVVHFWLRQDO ILHOG VXUYH\
GHVLJQ VHH6HFWLRQ ,WLQYROYHGVRIWZDUHRUJDQL]DWLRQVLQYHVWLJDWLQJWRZKDWH[WHQW
WKHLGHQWLILHGSUDFWLFHVZHUHLPSOHPHQWHGDQGZKDWLPSDFWWKH\KDGRQ63,VXFFHVV,QWKLV
PDLQ SDUW RI WKH VWXG\ , XVHG D PDLOHG TXHVWLRQQDLUH DV WKH GDWD FROOHFWLRQ LQVWUXPHQW VHH
$SSHQGL[ )  7KH LQVWUXPHQW ZDV GHYHORSHG VSHFLILFDOO\ IRU WKLV VWXG\ DQG UHVXOWV RI
UHOLDELOLW\ DQG YDOLGLW\ DQDO\VHV VKRZHG WKDW WKH LQVWUXPHQW KDV GHVLUDEOH SV\FKRPHWULF
SURSHUWLHV VHH&KDSWHU 
7KH SULPDU\ LQWHQW RI WKH VXUYH\ ZDV WR WHVW WKH H[LVWHQFH RI VWDWLVWLFDO DVVRFLDWLRQV
DPRQJ WKH LGHQWLILHG IDFWRUV DQG 63, VXFFHVV WKXV SURYLGLQJ TXDQWLWDWLYH HYLGHQFH IRU WKH
LPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,DQGWKHJHQHUDOL]DELOLW\RIUHVXOWV
,QDGGLWLRQWRWKHH[WHQVLYHOLWHUDWXUHUHYLHZP\SHUVRQDOH[SHULHQFHDQGJHQHUDOREVHU
YDWLRQVLQ7(/0(763,4DQG352),7WKHLQYHVWLJDWLRQLQFOXGHGHLJKWHPSLULFDOVWXGLHV

  $SLORWFDVHVWXG\RQJRDORULHQWHGPHDVXUHPHQW &DVH$6HFWLRQ 
  $PXOWLSOHFDVHVWXG\RQSDUWLFLSDWLYHVRIWZDUHSURFHVVDVVHVVPHQW &DVH%6HFWLRQ 
  $PXOWLSOHFDVHVWXG\RQWKHXWLOLW\RIIRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJHDQGH[SHUL
HQFH &DVH&6HFWLRQ 
  $QH[SORUDWRU\VWXG\RQ63,VXFFHVVIDFWRUV &DVH'6HFWLRQ 
  $QH[SHUWUHYLHZRISURSRVHGIDFWRUV 6HFWLRQ 
  7KHGHYHORSPHQWRIDPHDVXUHPHQWLQVWUXPHQW 6HFWLRQV 
  $SLORWWHVWRIWKHPHDVXUHPHQWVFDOHVDQGWKHRYHUDOOLQVWUXPHQW 6HFWLRQ 
  7KHPDLQTXDQWLWDWLYHVXUYH\ 6HFWLRQ 

 2XWOLQHRIWKH7KHVLV
7KHWKHVLVLVRUJDQL]HGLQILYHSDUWVZKLFKUHIOHFWVWKHSKDVHVRIWKHUHVHDUFKRXWOLQHGLQWKH
SUHYLRXVVHFWLRQ

3DUW , 6WDWH RI WKH 3UDFWLFH DQG 6WDWH RI WKH $UW FRQWDLQV WZR FKDSWHUV UHODWHG WR WKH
WKHRUHWLFDOLQYHVWLJDWLRQRIWKHFXUUHQWSUDFWLFHVDQGUHVHDUFKLQ63,

±±
&+$37(5

x &KDSWHU$SSURDFKHVWR6RIWZDUH3URFHVV,PSURYHPHQW7KLVFKDSWHUVXUYH\VWKHPDMRU
DSSURDFKHV WDNHQ WR 63, 0RGHOEDVHG DSSURDFKHV DUH FRPSDUHG ZLWK DQDO\WLFDO
DSSURDFKHV NH\ IDFWRUV IRU VXFFHVV DUH UHYLHZHG UHOHYDQW WHUPV DUH GHILQHG DQG WKH
UHODWLRQVKLSVEHWZHHQ63,DQGRUJDQL]DWLRQDORXWFRPHDUHH[DPLQHG
x &KDSWHU  $SSURDFKHV WR (PSLULFDO 6RIWZDUH (QJLQHHULQJ 5HVHDUFK 7KLV FKDSWHU VXU
YH\VDQGFRPSDUHVWKHPDMRUUHVHDUFK DSSURDFKHVLQHPSLULFDOVRIWZDUHHQJLQHHULQJ ,Q
DGGLWLRQ WKH FKDSWHU SUHVHQWV DQ RYHUYLHZ RI VRPH RI WKH PRVW LPSRUWDQW UHVHDUFK
LQLWLDWLYHVLQ63,

3DUW,,7KHRUHWLFDO)UDPHZRUNFRQWDLQVWZRFKDSWHUVDERXWWKHPRGHOUHVXOWLQJIURPWKH
PRGHOEXLOGLQJSKDVHRIWKHLQYHVWLJDWLRQWKHWKHRUHWLFDOIRXQGDWLRQVDQGWKHRYHUDOOPRGHO
LQFOXGLQJDQXPEHURIK\SRWKHVHVUHJDUGLQJWKHNH\IDFWRUVIRUVXFFHVVLQ63,
x &KDSWHU  )RXQGDWLRQV RI WKH /HDUQLQJ 6RIWZDUH 2UJDQL]DWLRQ 7KLV FKDSWHU GHVFULEHV
WKHXQGHUO\LQJDVVXPSWLRQVDQGIRXQGDWLRQVRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQZKLFK
IRUPWKHEDVLVXSRQZKLFKWKHG\QDPLFPRGHORI63,LVFRQVWUXFWHG7KHIROORZLQJIRXQ
GDWLRQVDUHGHVFULEHG6RFLDOOHDUQLQJZKLFKLVIRFXVHGRQ63,DVDVRFLDOFROODERUDWLYH
DFWLYLW\ ZLWKLQ WKH FRQWH[W RI D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ 6HQVHPDNLQJ ZKLFK LV
DLPHGDWFRQVWUXFWLQJPHDQLQJDQGH[SUHVVLQJWKHEDVLFDVVXPSWLRQVDQGYDOXHVWKDWDUH
YLWDOWRWKHVRIWZDUHRUJDQL]DWLRQDQGLWVPHPEHUV.QRZOHGJHFUHDWLRQZKLFKLVDLPHG
DWJHQHUDWLQJQHZNQRZOHGJHDQGQHZFRPSHWHQFLHVWKDWHQDEOHRUEURDGHQWKHVRIWZDUH
RUJDQL]DWLRQ¶VSRWHQWLDOUDQJHRIDFWLRQV3XUSRVHIXODFWLRQZKLFKLVDLPHGDWXVLQJWKH
QHZLQWHUSUHWDWLRQVDQGQHZNQRZOHGJHWRFRQVWUXFWLPSURYHGFRXUVHVRIDFWLRQ
x &KDSWHU$'\QDPLF0RGHORI6RIWZDUH3URFHVV,PSURYHPHQW7KLVFKDSWHUSURSRVHVD
G\QDPLF PRGHO RI 63, IRU H[DPLQLQJ D VRIWZDUH RUJDQL]DWLRQ¶V OHDUQLQJ FDSDELOLW\ DQG
WKH SURFHVVHV WKDW IDFLOLWDWH VHQVHPDNLQJ NQRZOHGJH FUHDWLRQ DQG SXUSRVHIXO DFWLRQV
ZLWKLQWKHFRQWH[WRIDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ)XUWKHUPRUHWKHFKDSWHUGHVFULEHV
WKHMXVWLILFDWLRQFRQFHSWXDOL]DWLRQDQGGHILQLWLRQRIHDFKRIWKHIDFLOLWDWLQJIDFWRUVLQWKH
PRGHO DQG GHYHORSV D QXPEHU RI K\SRWKHVHV UHJDUGLQJ WKHLU DVVRFLDWLRQV ZLWK 63,
VXFFHVV7KHPRGHOLVJURXQGHGLQP\SHUVRQDOH[SHULHQFHDQGREVHUYDWLRQVLQWKHFDVH
VWXGLHV UHODWHG WR WKH H[WHQVLYH OLWHUDWXUH UHYLHZ DQG IRFXVHG RQ WKH WKUHH UHVHDUFK
TXHVWLRQVSRVHGLQ6HFWLRQ

3DUW ,,, (PSLULFDO ,QYHVWLJDWLRQ FRQWDLQV WKH GHWDLOV RI WKH UHVHDUFK PHWKRGRORJ\ WKH
GHYHORSPHQW RI WKH PHDVXUHPHQW LQVWUXPHQW XVHG LQ WKH VXUYH\ WKH UHVXOWV RI WHVWLQJ WKH
K\SRWKHVHVLQWKHPRGHODQGDGLVFXVVLRQRIWKHUHVXOWV
x &KDSWHU  5HVHDUFK 0HWKRGRORJ\ 7KLV FKDSWHU GHVFULEHV WKH MXVWLILFDWLRQ IRU DQG WKH
DVVXPSWLRQVEHKLQGWKHUHVHDUFKDSSURDFKXVHGLQWKLVVWXG\DVZHOODVWKHGHWDLOVRIWKH
PHWKRGVXVHGWRGHYHORSWKHWKHRU\RSHUDWLRQDOL]HWKHPHDVXUHVFROOHFWWKHGDWDWHVWWKH
K\SRWKHVHVDQGDQVZHUWKHUHVHDUFKTXHVWLRQV
x &KDSWHU0HDVXUHPHQW,QVWUXPHQW7KLVFKDSWHUGHWDLOVWKHUHVHDUFKPHWKRGIXUWKHUDQG
GHVFULEHVWKHGHVLJQRIWKHLQVWUXPHQWXVHGWRPHDVXUHWKHNH\IDFWRUVRIVXFFHVVLQ63,
7KHFKDSWHUSURYLGHVDV\QWKHVLVRIWKHSUHVFULSWLRQVIRUVXFFHVVIRXQGIURPWKHOLWHUDWXUH
UHYLHZ ZKLFK ZDV DOVR FRQILUPHG E\ HPSLULFDO VWXGLHV DPRQJ ERWK UHVHDUFKHUV DQG
SUDFWLWLRQHUV7KHUHVXOWVRIUHOLDELOLW\DQGYDOLGLW\DQDO\VHVVKRZWKDWWKHLQVWUXPHQWKDV
GHVLUDEOHSV\FKRPHWULFSURSHUWLHV

±±
,1752'8&7,21

x &KDSWHU(PSLULFDO 5HVXOWV 7KLV FKDSWHU UHSRUWV RQ WKH UHVXOWV RI XVLQJ WKH PHDVXUH
PHQWLQVWUXPHQWWRWHVW WKH K\SRWKHVHV UHJDUGLQJ WKH NH\ IDFWRUV IRU VXFFHVV LQ 63, DQG
H[SORUH WKH UHODWLRQVKLSV EHWZHHQ WKH VXFFHVV IDFWRUV DQG D VHW RI FRQWH[WXDO YDULDEOHV
$GGLWLRQDOO\ WKH FKDSWHU UHSRUWV RQ WKUHH VHSDUDWH VWXGLHV UHJDUGLQJ   WKH H[SHULHQFH
ZLWK JRDORULHQWHG PHDVXUHPHQW   WKH H[SHULHQFH ZLWK SDUWLFLSDWLYH VRIWZDUH SURFHVV
DVVHVVPHQWDQG  WKHXWLOLW\RIIRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJHDQGH[SHULHQFH
x &KDSWHU  'LVFXVVLRQ DQG ,PSOLFDWLRQV 7KLV FKDSWHU FRQWDLQV WKH GLVFXVVLRQ RI WKH
UHVXOWV RI WKH LQYHVWLJDWLRQV LQ WKH WKHVLV 7KH GLVFXVVLRQ LV UHODWHG WR WKH OHDUQLQJ
SURFHVVHV LQ 63, WR WKH NH\ IDFWRUV RI VXFFHVV DQG WR WKH HIIHFWV RI RUJDQL]DWLRQDO
FRQWH[W)XUWKHUPRUHWKHLPSOLFDWLRQVIRUWKHRU\DQGPHWKRGRORJ\DUHGLVFXVVHGXVLQJD
GLDOHFWLFDO DSSURDFK )LQDOO\ WKH LPSOLFDWLRQV IRU SUDFWLFH DUH GLVFXVVHG LQ WHUPV RI
SUDFWLFDOUHFRPPHQGDWLRQVIRUVXFFHVVIXO63,

3DUW,9&RQFOXVLRQVVXPPDUL]HVWKHPDMRUILQGLQJVRIWKHWKHVLV
x &KDSWHU&RQFOXVLRQV7KLVFKDSWHUSUHVHQWVWKHFRQFOXVLRQVRQWKHUHVHDUFKSUREOHP
DQGTXHVWLRQVDQGVWDWHVWKHFODLPHGFRQWULEXWLRQVRIWKHWKHVLV)XUWKHUPRUHLWLQFOXGHV
DQ HYDOXDWLRQ RI WKH WKHVLV ZLWK UHVSHFW WR ERWK ULJRU DQG UHOHYDQFH )LQDOO\ WKH
OLPLWDWLRQVWRWKHVWXG\DUHGHVFULEHGDORQJZLWKUHFRPPHQGDWLRQVIRUIXUWKHUUHVHDUFK

3DUW9$SSHQGLFHVFRQWDLQVDGGLWLRQDOPDWHULDOWKDWKDVQRWEHHQLQFOXGHGLQWKHRWKHUSDUWV
RIWKHWKHVLV
x $SSHQGL[$7HUPLQRORJ\7KLVDSSHQGL[SURYLGHVDOLVWRIDEEUHYLDWLRQVDQGGHILQLWLRQV
RIWKHPRVWFHQWUDOWHUPVXVHGLQWKHWKHVLV
x $SSHQGL[%,QWHUYLHZ*XLGH7KLVDSSHQGL[FRQWDLQVWKHLQWHUYLHZJXLGHXVHGLQILYHRI
WKHTXDOLWDWLYHFDVHVWXGLHVUHJDUGLQJWKHXWLOLW\RIIRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJH
DQGH[SHULHQFH
x $SSHQGL[ & ([DPSOH RI 5HVXOWV IURP DQ ([SORUDWRU\ 6WXG\ LQ &; 7KLV DSSHQGL[
LQFOXGHV WKH UHVXOWV IURP RQH RI WKH IRXU H[SORUDWRU\ VWXGLHV WKDW ZHUH FRQGXFWHG WR
YDOLGDWHWKHOLWHUDWXUHGHULYHGIDFWRUVHQDEOLQJ63,VXFFHVV
x $SSHQGL['2ULJLQDO/LVWRI)DFLOLWDWLQJ)DFWRUVDQG,QGLFDWRUV7KLVDSSHQGL[FRQWDLQV
WKHRULJLQDOOLVWRIIDFLOLWDWLQJIDFWRUVDQGLQGLFDWRUVEDVHGRQWKHOLWHUDWXUHUHYLHZDQGWKH
H[SORUDWRU\VWXGLHVLQWKH63,4FRPSDQLHV
x $SSHQGL[(0HDVXUHPHQW,QVWUXPHQW7KLVDSSHQGL[LQFOXGHVWKHLQVWUXPHQWGHYHORSHG
WRPHDVXUHWKHNH\IDFWRUVRIVXFFHVVLQVRIWZDUHSURFHVVLPSURYHPHQW
x $SSHQGL[)4XHVWLRQQDLUH7KLVDSSHQGL[FRQWDLQVWKHVXUYH\TXHVWLRQQDLUHXVHGLQWKH
TXDQWLWDWLYHSDUWRIWKHLQYHVWLJDWLRQEDVHGRQWKHPHDVXUHPHQWLQVWUXPHQW$OVRLWFRQ
WDLQV TXHVWLRQV UHJDUGLQJ WKH FKDUDFWHULVWLFV RI WKH UHVSRQGHQW DQG WKH UHVSRQGHQW¶V
FRPSDQ\
x $SSHQGL[*6XUYH\'DWD7KLVDSSHQGL[FRQWDLQVWKHUDZVXUYH\GDWDFROOHFWHGIURPWKH
VRIWZDUHRUJDQL]DWLRQVDQVZHULQJWKHTXHVWLRQQDLUHXVHGLQWKHTXDQWLWDWLYHVXUYH\

)LQDOO\ WKH WKHVLV LQFOXGHV D OLVW RI DOO UHIHUHQFHV FLWHG WKURXJKRXW WKH WKHVLV )RU VW\OLVWLF
UHDVRQV,ZLOOXVHWKHWHUP³ZH´LQVWHDGRI³,´LQWKHUHVWRIWKHWKHVLV

±±
&+$37(5 
$SSURDFKHVWR
6RIWZDUH3URFHVV,PSURYHPHQW

³(YROJDWRLPSHULLDUFDQR±IRUQRZKDGEHHQGLYXOJHGWKDWVHFUHWRIWKHHPSLUHWKDW
HPSHURUVFRXOGEHPDGHHOVHZKHUHWKDQDW5RPH´
±3XEOLXV&RUQHOLXV7DFLWXV

8QGHUVWDQGLQJ WKH ³TXDOLW\ UHYROXWLRQ´ LV DQ LPSRUWDQW SUHUHTXLVLWH IRU XQGHUVWDQGLQJ
VRIWZDUH SURFHVV LPSURYHPHQW KHQFHIRUWK 63,  +RZHYHU TXDOLW\ PDQDJHPHQW LV RIWHQ
REVFXUHG E\ ERWK FRQIXVLRQ DQG PLVXQGHUVWDQGLQJ 7KLV SRWHQWLDO IRU PLVXQGHUVWDQGLQJ LV
SDUWO\ UHODWHG WR TXDVLUHOLJLRXV DQG VHFWDULDQ FRQWURYHUVLHV DQG SDUWO\ UHODWHG WR WKH PRVW
LPSRUWDQWIHDWXUH RI PRGHUQ TXDOLW\ PDQDJHPHQW LW GLUHFWV DWWHQWLRQ WR WKH LPSURYHPHQW RI
SURGXFWLRQ SURFHVVHV DQG QRW VLPSO\ WR WKH FKDUDFWHULVWLFV RI WKH SURGXFW ,Q WKLV UHVSHFW
PRGHUQ TXDOLW\ PDQDJHPHQW RSSRVHV WKH RULJLQDO TXDOLW\ FRQWURO SULQFLSOHV RI DVVXULQJ WKDW
WKHFKDUDFWHULVWLFVRIWKHHQGSURGXFWIDOOZLWKLQSUHDVVLJQHGWROHUDQFHOLPLWV
$ORQJ ZLWK WUDGLWLRQDO HQJLQHHULQJ WKH TXDOLW\ PDQDJHPHQW WUDGLWLRQ IRFXVHV SULPDULO\
RQ WKH PDQXIDFWXULQJ RI PDWHULDO VWUXFWXUHV DQG WKHLU SK\VLFDO HIIHFWV +RZHYHU VRIWZDUH
GHYHORSPHQW LV VWULNLQJO\ GLIIHUHQW PDLQO\ FRQFHUQHG ZLWK IOH[LEOH V\PEROLF VWUXFWXUHV DQG
WKHLU FRJQLWLYH HIIHFWV ,Q DGGLWLRQ WR FRPSXWHU LQVWUXFWLRQV VRIWZDUH FDQ DOVR LQFOXGH D
FRUUHVSRQGLQJVHWRILQVWUXFWLRQVIRUKXPDQV7RKDYHDPHDQLQJIXOGLVFXVVLRQRI63,ZHQHHG
WR EH FOHDU DERXW WKH FKDUDFWHULVWLFV RI VRIWZDUH LWV XVDJH DQG WKH VRIWZDUH GHYHORSPHQW
SURFHVV KHQFHIRUWKWKHVRIWZDUHSURFHVV 
,QWKLVFKDSWHUWKHUHIRUHZHILUVW GHVFULEH WKH FRQFHSWV UHODWHG WR WKH VRIWZDUH SURFHVV
%DVHGRQWKHVHFRQFHSWVZHGHVFULEHWKUHHLQWHUYHQWLRQVWUDWHJLHVRUDSSURDFKHVWRFKDQJHWKH
VRIWZDUH SURFHVV LQ RUGHU WR EULQJ DERXW LPSURYHPHQWV LQ RUJDQL]DWLRQDO SHUIRUPDQFH ,Q
)LJXUH  WKH GHJUHHV RI FKDQJH WR WKH VRIWZDUH SURFHVV DUH VKRZQ IRU HDFK RI WKHVH
DSSURDFKHV
)LUVWSURFHVVDVVHVVPHQWLVDQLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVDQDSSUDLVDORUUHYLHZ
RIDQRUJDQL]DWLRQ¶VVRIWZDUHSURFHVVHVZLWKRXWFKDQJLQJWKHP6HFRQGSURFHVVLPSURYHPHQW

±±
&+$37(5

LVDQLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVFRQWLQXRXVRULQFUHPHQWDOFKDQJHWRWKHRUJDQL]DWLRQ
DQGLWVSURFHVVHV)LQDOO\SURFHVVLQQRYDWLRQLVDQLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVUDGLFDO
FKDQJHWRWKHRUJDQL]DWLRQZLWKHQWLUHRUSDUWLDOUHSODFHPHQWRILWVSURFHVVHV
3URFHVV&KDQJH

3URFHVV&KDQJH

3URFHVV&KDQJH
7LPH 7LPH 7LPH

3URFHVV$VVHVVPHQW 3URFHVV,PSURYHPHQW 3URFHVV,QQRYDWLRQ

)LJXUH'HJUHHVRISURFHVVFKDQJHIRUGLIIHUHQWLQWHUYHQWLRQVWUDWHJLHV

 6RIWZDUH3URFHVV
7KH VRIWZDUH SURFHVV GHILQHV WKH ZD\ LQ ZKLFK VRIWZDUH GHYHORSPHQW DQG PDLQWHQDQFH LV
RUJDQL]HG PDQDJHG PHDVXUHG VXSSRUWHG DQG LPSURYHG )HLOHU DQG +XPSKUH\ 
0RQWDQJHUR   'DYHQSRUW   IRU H[DPSOH GHILQHG SURFHVV DV ³D VWUXFWXUHG
PHDVXUHGVHWRIDFWLYLWLHVGHVLJQHGWRSURGXFHDVSHFLILFRXWSXW IRU D SDUWLFXODU FXVWRPHU RU
PDUNHW´ LELGS ZKLOH)XJJHWWD  GHILQHGDVRIWZDUHSURFHVVDV³DFRKHUHQWVHWRI
SROLFLHVRUJDQL]DWLRQDOVWUXFWXUHVWHFKQRORJLHVSURFHGXUHVDQGDUWLIDFWVWKDWDUHQHHGHGWR
FRQFHLYHGHYHORSGHSOR\DQGPDLQWDLQDVRIWZDUHSURGXFW´ LELGSLWDOLFVLQRULJLQDO 
)XUWKHUPRUH'RZVRQ  QRWHGWKDW³$OOSURFHVVZRUNLVXOWLPDWHO\GLUHFWHGDWµVRIWZDUH
SURFHVVDVVHVVPHQWDQGLPSURYHPHQW¶´ LELGS 
&RQVHTXHQWO\ VRIWZDUH RUJDQL]DWLRQV KDYH JUDGXDOO\ FRPH WR UHDOL]H WKDW WKH NH\ WR
VXFFHVVIXO GHOLYHU\ ZLWK H[SHFWHG TXDOLW\ RQ WLPH DQG RQ EXGJHW  OLHV LQ WKH HIIHFWLYH
PDQDJHPHQWRIWKHLUVRIWZDUHSURFHVVHV7KLVLVDOVRUHIOHFWHGLQPRGHUQTXDOLW\PDQDJHPHQW
DQGLQWKHXQGHUO\LQJSUHPLVHRIVRIWZDUHSURFHVVPDQDJHPHQWWKDW³WKHTXDOLW\RIDVRIWZDUH
SURGXFW LV ODUJHO\ JRYHUQHG E\ WKH TXDOLW\ RI WKH SURFHVV XVHG WR GHYHORS DQG PDLQWDLQ LW´
3DXONHWDOS 7KLVUHODWLRQVKLSEHWZHHQSURFHVVDQGRXWFRPH HJWLPHWRPDUNHW
FRVWRUFXVWRPHUVDWLVIDFWLRQ FDQEHH[SOLFLWO\H[SUHVVHGE\WKHFDXVDOUHODWLRQ

4XDOLW\ 3URFHVV Ÿ4XDOLW\ 2XWFRPH 

+RZHYHUWKHVDPHFKDQJHWRDSURFHVVGRHVQRWDOZD\VOHDGWRDVLPLODUFKDQJHLQRXWFRPH
7KH UHODWLRQVKLS GHSHQGV RQ WKH SDUWLFXODU FRQWH[W HJ H[SHULHQFH RUJDQL]DWLRQDO VL]H RU
HQYLURQPHQWDOWXUEXOHQFH 
)LJXUH  VKRZV D SDWK GLDJUDP ZLWK WKLV UHODWLRQVKLS EHWZHHQ SURFHVV FRQWH[W DQG
RXWFRPH ,Q JHQHUDO ZH DUH QRW UHDOO\ LQWHUHVWHG LQ WKH SURFHVV LWVHOI UDWKHU ZH DUH PRVW
FRQFHUQHG DERXW WKH SURFHVV RXWFRPHV %XW LQ RUGHU WR DFKLHYH WKH GHVLUHG RXWFRPHV ZH
KDYHWRLPSOHPHQWWKHDSSURSULDWHSURFHVV VHH6HFWLRQDQGWKHSDWKGLDJUDPLQ)LJXUH
IRUDJHQHUDOIRUPRIWKLVWKHRU\RIDFWLRQ 

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

3URFHVV 2XWFRPH

&RQWH[W

)LJXUH5HODWLRQVKLSEHWZHHQSURFHVVFRQWH[WDQGRXWFRPH

 3URFHVVPRGHOV
3URFHVV PRGHOV KHOS XV WR EHFRPH DZDUH RI DQG JDLQ DQ LQFUHDVHG XQGHUVWDQGLQJ RI WKH
VRIWZDUH SURFHVV WKH\ IDFLOLWDWH KXPDQ XQGHUVWDQGLQJ DQG FRPPXQLFDWLRQ DQG SURYLGH
SURFHVVJXLGDQFH &RQUDGLHWDO&XUWLVHWDO0DGKDYML 7KH\IRFXVRQ
WKH VWDJHV DFWLYLWLHV DQG G\QDPLFV RI VRIWZDUH GHYHORSPHQW E\ SURYLGLQJ DEVWUDFW
GHVFULSWLRQVRIWKHWDVNVRIVRIWZDUHGHYHORSPHQWWKHLULQWHUGHSHQGHQFLHV DQGWKH UHVXOWLQJ
DUWLIDFWV
2YHUDOO WKH YDOXH RI D SURFHVV PRGHO LV LQ GHILQLQJ WKH SKDVHV DQG DFWLYLWLHV WKDW OHQG
VWUXFWXUHWRWKHDSSDUHQWFKDRVWKDWFKDUDFWHUL]HVWKHVRIWZDUHSURFHVV 3DUQDVDQG&OHPHQWV
  %\ FODULI\LQJ WKH DFWLYLWLHV URXWLQHV DQG G\QDPLF IDFWRUV WKDW GHWHUPLQH WKH WLPLQJ
DQG WUDMHFWRU\ RI WKH GHYHORSPHQW SURFHVV SURFHVV PRGHOV SURYLGH D IUDPHZRUN E\ ZKLFK
VRIWZDUHRUJDQL]DWLRQVFDQEHWWHUPDQDJHWKHG\QDPLFQDWXUHDQGWKHLQWURGXFWLRQRIQHZRU
LPSURYHGPHWKRGVWRROVDQGWHFKQLTXHV$OLPLWDWLRQRIWKHVHPRGHOVKRZHYHULVWKDWWKH\
KLGHLPSRUWDQWSURFHVVGHWDLOVWKDWDUHFUXFLDOIRUWKHVXFFHVVRIVRIWZDUHSURMHFWV 0DGKDYML
 
6RIWZDUHSURFHVVHVFDQEHUHSUHVHQWHGDWYDULRXVOHYHOVRIJUDQXODULW\DQGSUHFLVLRQ HJ
JHQHULFOLIHF\FOHPRGHOVRUJDQL]DWLRQVSHFLILFPRGHOVSURMHFWVSHFLILFPRGHOV IURPVHYHUDO
SHUVSHFWLYHV HJ IXQFWLRQDO EHKDYLRUDO RUJDQL]DWLRQDO RU LQIRUPDWLRQDO  DQG GLIIHUHQW
GHJUHHVRIVFULSWLYHQHVV HJGHVFULSWLYHSUHVFULSWLYHRUQRUPDWLYH  'HUQLDPHHWDO
)LQNHOVWHLQHWDO $OVRWKH\UHSUHVHQWGLIIHUHQWSKLORVRSKLHVWRZDUGSUDFWLFHHJ³GR
LWULJKWWKHILUVWWLPH´YV³IDLOIDVW´ 6RWLURYVNL 
7UDGLWLRQDOH[DPSOHV RI SURFHVV PRGHOV LQFOXGH WKH ZDWHUIDOO PRGHO 5R\FH   WKH
LWHUDWLYHHQKDQFHPHQWPRGHO %DVLOLDQG7XUQHU   WKHWUDQVIRUPDWLRQDO PRGHO %DO]HU
  DQG WKH VSLUDO PRGHO %RHKP   &RPSDULVRQV RI WKHVH PRGHOV DUH SURYLGHG LQ
HJ 'DYLV HW DO   0RUH UHFHQW H[DPSOHV RI SURFHVV PRGHOV DUH WKH 5DWLRQDO 8QLILHG
3URFHVV .UXFKWHQ   H;WUHPH 3URJUDPPLQJ %HFN   WKH '\QDPLF 6\VWHPV
'HYHORSPHQW0HWKRG 6WDSOHWRQ DQG6FUXP 6FKZDEHUDQG%HHGOHIRUWKFRPLQJ 
$OVRWKH,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQ ,62 KDVGHYHORSHGDPRGHOIRU
VRIWZDUH OLIH F\FOH SURFHVVHV ,62,(&    DQG SURFHVV DVVHVVPHQW ,62,(& &'
 0RUHRYHUWKHUHFHQWUHYLVLRQRIWKH,62IDPLO\RIVWDQGDUGVHQFRXUDJHV
WKH DGRSWLRQ RI D SURFHVV DSSURDFK WR TXDOLW\ PDQDJHPHQW DQG LPSURYHPHQW ZKLFK LV DOVR
UHIOHFWHGLQWKHSURSRVHG UHYLVLRQ RI WKH JXLGHOLQHV IRU WKH DSSOLFDWLRQ RI ,62  WR
VRIWZDUH ,62,(& :'    $GGLWLRQDOO\ %HFKWROG   SURYLGHV D JXLGHERRN
RQKRZWRLPSURYHWKHVRIWZDUHSURFHVVWKURXJKSURFHVVGHILQLWLRQDQGPRGHOLQJ

±±
&+$37(5

 3URFHVVLQIUDVWUXFWXUH
$QDSSURSULDWHSURFHVVLQIUDVWUXFWXUHLQWHUPVRIUHVRXUFHVDQGUHVSRQVLELOLWLHVLVDQHFHVVDU\
SUHUHTXLVLWH IRU SURFHVV PDQDJHPHQW DQG LPSURYHPHQW 7ZR W\SHV RI LQIUDVWUXFWXUHV KDYH
EHHQZLGHO\GHVFULEHGLQWKHOLWHUDWXUHWKH([SHULHQFH)DFWRU\ %DVLOL DQG 5RPEDFK 
%DVLOLHWDOD DQGWKH6RIWZDUH(QJLQHHULQJ3URFHVV*URXS )RZOHUDQG5LINLQ 
)XUWKHUPRUHWKH6RIWZDUH(QJLQHHULQJ/DERUDWRU\¶V63,*XLGHERRN -HOHWLFHWDO WKH
6RIWZDUH (QJLQHHULQJ ,QVWLWXWH¶V ,'($/ +DQGERRN 0F)HHOH\   WKH 63,4 +DQGERRN
'\EnH DQGWKH352)(68VHU0DQXDO 352)(6 SURYLGHJRRGGHVFULSWLRQVRI
LQIUDVWUXFWXUHIRUSURFHVVLPSURYHPHQWLQJHQHUDO

6RIWZDUH(QJLQHHULQJ3URFHVV*URXS
7KH6RIWZDUH(QJLQHHULQJ3URFHVV*URXS 6(3* LVPHDQWWREH D FHQWUDO IRUFH IRU SURFHVV
LPSURYHPHQW ZLWKLQ DQ RUJDQL]DWLRQ ,WV UROH LV WR PDLQWDLQ WKH RYHUDOO YLHZ RI FXUUHQW 63,
HIIRUWV DQGWRIDFLOLWDWH WKHVH HIIRUWV RQ D FRQWLQXLQJ EDVLV E\ IRVWHULQJ FROODERUDWLRQ DPRQJ
HYHU\RQHLQWKHRUJDQL]DWLRQZKRLVLQYROYHGZLWK63,

7KH6(3*W\SLFDOO\KDVWKHIROORZLQJRQJRLQJDFWLYLWLHV )RZOHUDQG5LINLQ 

x 2EWDLQVDQGPDLQWDLQVWKHVXSSRUWRIDOOOHYHOVRIPDQDJHPHQW
x )DFLOLWDWHVVRIWZDUHSURFHVVDVVHVVPHQWV
x :RUNV ZLWK OLQH PDQDJHUV ZKRVH SURMHFWV DUH DIIHFWHG E\ FKDQJHV LQ VRIWZDUH
HQJLQHHULQJ SUDFWLFH SURYLGLQJ D EURDG SHUVSHFWLYH RI WKH LPSURYHPHQW HIIRUW DQG
KHOSLQJWKHPVHWH[SHFWDWLRQV
x 0DLQWDLQV FROODERUDWLYH ZRUNLQJ UHODWLRQVKLSV ZLWK VRIWZDUH HQJLQHHUV HVSHFLDOO\ WR
REWDLQSODQIRUDQGLQVWDOOQHZSUDFWLFHVDQGWHFKQRORJLHV
x $UUDQJHVIRUDQ\WUDLQLQJRUFRQWLQXLQJHGXFDWLRQUHODWHGWRSURFHVVLPSURYHPHQWV
x 7UDFNVPRQLWRUVDQGUHSRUWVRQWKHVWDWXVRISDUWLFXODULPSURYHPHQWHIIRUWV
x )DFLOLWDWHV WKH FUHDWLRQ DQG PDLQWHQDQFH RI SURFHVV GHILQLWLRQV LQ FROODERUDWLRQ ZLWK
PDQDJHUVDQGHQJLQHHULQJVWDII
x 0DLQWDLQVDSURFHVVGDWDEDVH
x 3URYLGHVSURFHVVFRQVXOWDWLRQWRGHYHORSPHQWSURMHFWVDQGPDQDJHPHQW

7KH 6(3* LV QRW SDUW RI SURGXFW GHYHORSPHQW EXW LV QHYHUWKHOHVV VWDIIHG E\ SUDFWLWLRQHUV
ZKRKDYHH[SHUWLVHLQVRIWZDUHHQJLQHHULQJ,WPD\DOVRKDYHDQGDWDQ\UDWHVKRXOGGHYHORS
H[SHUWLVHLQSURFHVVGHILQLWLRQRUJDQL]DWLRQDOFKDQJHDQGWHFKQRORJ\UHODWHGWRLPSURYLQJRU
PHDVXULQJTXDOLW\

([SHULHQFH)DFWRU\
7KH ([SHULHQFH )DFWRU\ ()  LV DQ RUJDQL]DWLRQ WKDW VXSSRUWV UHXVH RI H[SHULHQFH DQG
FROOHFWLYHOHDUQLQJZLWKLQDVRIWZDUHRUJDQL]DWLRQ7KHIRFXVRIWKH()LVRQFROOHFWLQJGDWD
DQG OHVVRQV OHDUQHG IURP SURMHFWV DQG H[SHULPHQWV DQG WKHQ DQDO\]LQJ WKHVH GDWD DQG

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

SDFNDJLQJWKHPLQWRJXLGHERRNVPRGHOVDQGWUDLQLQJFRXUVHVWKDWFDQEHVSUHDGWRDOODUHDV
RI WKH GHYHORSPHQW RUJDQL]DWLRQ %DVLOL   7KH () LV GLIIHUHQW IURP WKH 3URMHFW
2UJDQL]DWLRQ ZKLFK IRFXVHV RQ WKH GHYHORSPHQW DQG PDLQWHQDQFH RI DSSOLFDWLRQV 7KHLU
UHODWLRQVKLSLVGHSLFWHGLQ)LJXUH
,Q DGGLWLRQ WR WKH 6RIWZDUH (QJLQHHULQJ /DERUDWRU\ 6(/  IXUWKHU H[DPSOHV RI
RSHUDWLRQDO()VLQFOXGHWKH6RIWZDUH([SHULHQFH&HQWHU 6(& VHWXSE\)UDXQKRIHU,(6(LQ
.DLVHUVODXWHUQ DQG WKH )UDXQKRIHU &HQWHU IRU ([SHULPHQWDO 6RIWZDUH (QJLQHHULQJ LQ
0DU\ODQG

 3URFHVVPHDVXUHPHQW
(YDOXDWLRQRIFKDQJHVWR WKH VRIWZDUH SURFHVV UHTXLUHV PHDVXUHPHQW $ QXPEHU RI SUDFWLFDO
JXLGHVIRUVXFKPHDVXUHPHQWDUHDYDLODEOHHJWKHDPL+DQGERRN 3XOIRUGHWDO WKH
*400HWKRG %ULDQGHWDOD*UHVVHHWDOYDQ6ROLQJHQDQG%HUJKRXW 
WKH6RIWZDUH0HDVXUHPHQW*XLGHERRN *DIIQH\HWDO WKH*RDOGULYHQ 0HDVXUHPHQW
*XLGHERRN 3DUN HW DO   WKH *XLGH WR 3UDFWLFDO 6RIWZDUH 0HDVXUHPHQW 0F*DUU\
 DQGWKH3UDFWLFDO6RIWZDUH0HDVXUHPHQW*XLGHERRN )ORUDFHWDO 
&RPPRQWRWKHVHJXLGHVLVWKDWWKH\DUHEDVHGRQJRDORULHQWHGPHDVXUHPHQW %DVLOLHW
DOE ZKLFKKHOSVHQVXUHDGHTXDF\FRQVLVWHQF\DQGFRPSOHWHQHVVRIWKHPHDVXUHPHQW
SODQDQGWKHGDWDFROOHFWLRQSURFHGXUHV
*RDO4XHVWLRQ0HWULF *40 LVDSUDJPDWLFDSSURDFKIRUJRDORULHQWHGPHDVXUHPHQWLQ
VRIWZDUHSURMHFWVWRVHOHFWDQGLPSOHPHQWUHOHYDQWPHDVXUHVDQGLQGLFDWRUV %DVLOLDQG:HLVV
%DVLOLDQG5RPEDFK ,WUHSUHVHQWVDQDSSURDFKIRUWDLORULQJDQGLQWHJUDWLQJJRDOV
ZLWK PRGHOV RI WKH VRIWZDUH SURFHVVHV SURGXFWV DQG TXDOLW\ SHUVSHFWLYHV RI LQWHUHVW EDVHG
XSRQWKHVSHFLILFQHHGVRIWKHSURMHFWDQGWKHRUJDQL]DWLRQ

3URMHFW2UJDQL]DWLRQ ([SHULHQFH)DFWRU\
'HYHORS$SSOLFDWLRQV &DSWXUH$QDO\]HDQG
3DFNDJH([SHULHQFHV 'DWD%DVH
3HUVRQQHO
0HWULFV
/HVVRQV
0LVVLRQ /HDUQHG 5HVHDUFKHUV
$QDO\VWV

3DFNDJHUV

$SSOLFDWLRQ
'HYHORSHUV
*XLGHERRNV
0RGHOV
7UDLQLQJ
$SSOLFDWLRQ
7HVWHUV

$SSOLFDWLRQ

)LJXUH7KHUHODWLRQVKLSEHWZHHQWKH([SHULHQFH)DFWRU\DQGWKH3URMHFW2UJDQL]DWLRQDV
LPSOHPHQWHGDW1$6$*6)& %DVLOLHWDOS 

±±
&+$37(5

7KH*40PRGHOKDVWKUHHOHYHOV %DVLOLHWDOE 

  &RQFHSWXDO OHYHO JRDO  $ JRDO LV GHILQHG ZLWK UHVSHFW WR YDULRXV PRGHOV RI TXDOLW\
IURP YDULRXV SRLQWV RI YLHZ UHODWLYH WR D SDUWLFXODU HQYLURQPHQW 7\SLFDO REMHFWV RI
PHDVXUHPHQWDUHSURGXFWVSURFHVVHVDQGUHVRXUFHV
  2SHUDWLRQDO OHYHO TXHVWLRQ  $ VHW RI TXHVWLRQV LV XVHG WR FKDUDFWHUL]H WKH ZD\ WKH
DVVHVVPHQWDFKLHYHPHQW RI D VSHFLILF JRDO LV JRLQJ WR EH SHUIRUPHG EDVHG RQ VRPH
FKDUDFWHUL]LQJ PRGHO 4XHVWLRQV WU\ WR FKDUDFWHUL]H WKH REMHFW RI PHDVXUHPHQW ZLWK
UHVSHFW WR D VHOHFWHG TXDOLW\ LVVXH DQG WR GHWHUPLQH LWV TXDOLW\ IURP WKH VHOHFWHG
YLHZSRLQW
  4XDQWLWDWLYHOHYHO PHWULF $VHWRIGDWDLV DVVRFLDWHGZLWK HYHU\ TXHVWLRQ LQ RUGHU WR
DQVZHULWLQDTXDQWLWDWLYHZD\7KHGDWDFDQEHHLWKHUREMHFWLYHRUVXEMHFWLYH

$*40PRGHOLVDKLHUDUFKLFDOVWUXFWXUHVWDUWLQJZLWKDJRDODVVKRZQLQ)LJXUH7KHJRDO
LVVXEVHTXHQWO\UHILQHGLQWRDVHWRITXHVWLRQVDQGHDFKTXHVWLRQLVWKHQUHILQHGLQWRPHWULFV
7KHPHWULFVUHIOHFW WKH DFWXDO GDWD QHHGHG WR DQVZHU WKH TXHVWLRQV 7KH VDPH PHWULF FDQ EH
XVHGLQRUGHUWRDQVZHUGLIIHUHQWTXHVWLRQVXQGHUWKHVDPHJRDO
$VDQDLGLQWKHSURFHVVRIGHILQLQJWKHJRDOVTXHVWLRQVDQGPHWULFVWKH&(03SURMHFWKDV
SURYLGHGDSURFHVVPRGHODQGDVHULHVRIXVHIXOWHPSODWHV *UHVVHHWDO 
$SUDFWLFDOWH[WRQHVWDEOLVKLQJDPHDVXUHPHQWSURJUDPKDVEHHQPDGHE\WKH6RIWZDUH
(QJLQHHULQJ /DERUDWRU\ %DVVPDQQ HW DO   )XUWKHUPRUH WKH ,62 6RIWZDUH 0HDVXUH
PHQW3URFHVV)UDPHZRUN ,62,(&&' GHILQHVDJHQHULFPHDVXUHPHQWSURFHVV
7H[WV WKDW SUHVHQW H[SHULHQFH ZLWK WKH LPSOHPHQWDWLRQ RI PHDVXUHPHQW LQ VRIWZDUH
RUJDQL]DWLRQV LQFOXGH )HQWRQ DQG 3IOHHJHU  *UDG\  *UDG\ DQG &DVZHOO 
.LWFKHQKDP0|OOHUDQG3DXOLVK 
([SHULHQFH ZLWK JRDORULHQWHG PHDVXUHPHQW XVLQJ WKH %DODQFHG 6FRUHFDUG %6&  LV
SUHVHQWHGLQ .DSODQDQG1RUWRQ ,QWKHQH[WVHFWLRQZHORRNDWDVSHFLILFIRUP
RISURFHVVPHDVXUHPHQWWKDWKDVEHFRPHLQFUHDVLQJO\SRSXODUVRIWZDUHSURFHVVDVVHVVPHQW

*RDO *RDO

4XHVWLRQ 4XHVWLRQ 4XHVWLRQ 4XHVWLRQ 4XHVWLRQ

0HWULF 0HWULF 0HWULF 0HWULF 0HWULF 0HWULF

)LJXUH*40KLHUDUFKLFDOVWUXFWXUH %DVLOLHWDOE 

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

3URFHVV

LV
H[DPLQHG
LGHQWLILHV E\ LGHQWLILHV
FKDQJHVWR FDSDELOLW\
DQGULVNRI
3URFHVV
$VVHVVPHQW

OHDGVWR OHDGVWR

3URFHVV &DSDELOLW\
,PSURYHPHQW PRWLYDWHV 'HWHUPLQDWLRQ

)LJXUH7KHFRQWH[WRIVRIWZDUHSURFHVVDVVHVVPHQW ,62,(&75 

 6RIWZDUH3URFHVV$VVHVVPHQW
$ VRIWZDUH SURFHVV DVVHVVPHQW KHQFHIRUWK 63$  LV DQ DSSUDLVDO RU UHYLHZ RI D VRIWZDUH
RUJDQL]DWLRQ WR DGYLFH LWV PDQDJHPHQW DQG SURIHVVLRQDOV RQ KRZ WKH\ FDQ LPSURYH WKHLU
RSHUDWLRQ +XPSKUH\   ,W FDQ EH XVHG IRU SURFHVV LPSURYHPHQW RU FDSDELOLW\
GHWHUPLQDWLRQDVVKRZQLQ)LJXUH*HQHUDOLQWURGXFWRU\RYHUYLHZVRISURFHVVDVVHVVPHQW
DUHSURYLGHGLQ +XPSKUH\=DKUDQ DQH[WHQVLYHHPSLULFDOUHYLHZLVSURYLGHGLQ
(O (PDP DQG *ROGHQVRQ   DQG DQ RYHUYLHZ RI WKH DSSOLFDWLRQ WR 63, LV SURYLGHG LQ
'\En 

 $VVHVVPHQWSULQFLSOHV
%DVLFDOO\WKHUHDUHWKUHHZD\VLQZKLFKDVRIWZDUHRUJDQL]DWLRQFDQPDNHDQDVVHVVPHQWRILWV
VRIWZDUHSURFHVVHV

x %HQFKPDUNDJDLQVWRWKHURUJDQL]DWLRQV
x %HQFKPDUNDJDLQVW³EHVWSUDFWLFH´PRGHOV
x $VVHVVPHQWJXLGHGE\WKHVSHFLILFJRDOVDQGQHHGVRIWKHRUJDQL]DWLRQ

7KH ILUVW ZD\ RI GRLQJ DQ DVVHVVPHQW LV D WUDGLWLRQDO EHQFKPDUN H[HUFLVH XVHG WR JDLQ DQ
RXWVLGHSHUVSHFWLYHRQSUDFWLFHVDQGWRERUURZRU³VWHDO´LGHDVIURPEHVWLQFODVVFRPSDQLHV
7KLVW\SHRIEHQFKPDUNLQJFDQEHVHHQ DVDQRQJRLQJLQYHVWLJDWLRQDQGOHDUQLQJ H[SHULHQFH
WKDW HQVXUHV WKDW EHVW SUDFWLFHV DUH XQFRYHUHG DQDO\]HG DGRSWHG DQG LPSOHPHQWHG $Q
LQWURGXFWRU\ RYHUYLHZ RI EHQFKPDUNLQJ LV SURYLGHG LQ &DPS   $OVR WKH 6HSWHPEHU
2FWREHULVVXHRI,(((6RIWZDUHKDGDIRFXVRQEHQFKPDUNLQJRIVRIWZDUHRUJDQL]DWLRQV
7KHVHFRQGZD\RISHUIRUPLQJDQDVVHVVPHQWLVWREHQFKPDUNWKHFRPSDQ\DJDLQVWRQH
RUPRUHRIWKH³EHVWSUDFWLFH´PRGHOVRQWKHPDUNHW VHHQH[WVHFWLRQIRUDQRYHUYLHZ 7KHVH
PRGHOVIRFXVRQGLIIHUHQWDVSHFWVRIWKHVRIWZDUHSURFHVVDQGWKHRUJDQL]DWLRQDQGWKH\DUH

±±
&+$37(5

DOODVVRFLDWHGZLWKVSHFLILFVWUHQJWKVDQGZHDNQHVVHV6SHFLILFDOO\WKH\KDYHEHHQFULWLFL]HG
IRUEHLQJDUWLILFLDOO\GHULYHGDQGEDVHGRQLGHDOL]HGOLVWVRIXQYDOLGDWHGSUDFWLFHV )D\DGDQG
/DLWLQHQ  *UD\ DQG 6PLWK   7KH\ DUH DVVRFLDWHG ZLWK ERWK VWDWLVWLFDO DQG
PHWKRGRORJLFDO SUREOHPV %ROOLQJHU DQG 0F*RZDQ   DQG WKH\ HPSKDVL]H DQ
LPSURYHPHQWDSSURDFKEDVHGRQ6WDWLVWLFDO3URFHVV&RQWURO 63& ZKLFKKDVEHHQFULWLFL]HG
E\VHYHUDODXWKRUV HJ'\EnE2XOG 
'XULQJ WKH V ³VRIWZDUH SURFHVV DVVHVVPHQW´ KDV EHFRPH V\QRQ\PRXV ZLWK WKH
PRGHOEDVHGDSSURDFK7KHPRVWZHOONQRZQPHWKRGIRUSHUIRUPLQJVXFKDVVHVVPHQWVLVWKH
&00%DVHG$SSUDLVDOIRU,QWHUQDO3URFHVV,PSURYHPHQW &%$,3,  'XQDZD\DQG0DVWHUV
 7KLVPHWKRGIRFXVHVRQDVVHVVPHQWVIRUWKHSXUSRVHRISURFHVVLPSURYHPHQWXVLQJWKH
&DSDELOLW\0DWXULW\0RGHOIRU6RIWZDUH 6:&00  3DXONHWDO 0RUHUHFHQWO\WKH
6WDQGDUG&00,$VVHVVPHQW0HWKRGIRU3URFHVV ,PSURYHPHQW 6&$03,  6(,D KDV
EHHQ GHYHORSHG IRU DVVHVVPHQWV UHODWLYH WR RQH RU PRUH RI WKH &00 ,QWHJUDWLRQ &00,
PRGHOV HJ6(,EF )XUWKHUPRUH,62,(&&'  SURYLGHVJXLGDQFHRQ
KRZ WR SHUIRUP D PRGHOEDVHG DVVHVVPHQW SURFHVV DFFRUGLQJ WR WKH HPHUJLQJ VWDQGDUG VHH
)LJXUH 
7KHWKLUGZD\RISHUIRUPLQJDQDVVHVVPHQWLVZLWKDSDUWLFLSDWLYHDSSURDFKWDLORUHGWRWKH
VSHFLILF QHHGV RI WKH FRPSDQ\ IRFXVLQJ RQ ZKDW LV XQLTXH WR HDFK FRPSDQ\ DQG KRZ WKLV
XQLTXHQHVV FDQ EH H[SORLWHG WR JDLQ FRPSHWLWLYH DGYDQWDJH 7KLV DSSURDFK LV OHVV WLPH
FRQVXPLQJWKDQWKHWUDGLWLRQDOEHQFKPDUNDSSURDFKDQGLWLVFOHDUO\PRUHUHOHYDQWDQGYDOLG
WKDQWKHPRGHOEDVHGDSSURDFK '\EnDQG0RH 

3URFHVV5HIHUHQFH0RGHO 0HDVXUHPHQW)UDPHZRUN
ƒ 3URFHVV3XUSRVH ƒ &DSDELOLW\/HYHOV
ƒ 3URFHVV2XWFRPHV ƒ 3URFHVV$WWULEXWHV
ƒ 5DWLQJ6FDOH
&RQIRUPDQW3URFHVV
$VVHVVPHQW0RGHO

,13876 $66(660(17352&(66 2873876


ƒ 6SRQVRU ƒ ,GHQWLILFDWLRQRI
3ODQQLQJ
ƒ 3XUSRVH (YLGHQFH
'DWD&ROOHFWLRQ
ƒ 6FRSH ƒ $VVHVVPHQW
'DWD9DOLGDWLRQ
ƒ &RQVWUDLQWV $SSURDFKWDNHQ
3URFHVV5DWLQJ
ƒ $VVHVVPHQW7HDP ƒ 3URFHVV3URILOHV
5HSRUWLQJ

5ROHVDQG5HVSRQVLELOLWLHV
ƒ 6SRQVRU
ƒ &RPSHWHQW$VVHVVRU
ƒ $VVHVVRU

)LJXUH0RGHOEDVHGDVVHVVPHQWSURFHVV ,62,(&&' 

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

7DEOH0RGHOEDVHGYVSDUWLFLSDWLYHDSSURDFKWRSURFHVVDVVHVVPHQW '\EnDQG0RH
 

)HDWXUH 0RGHOEDVHG$SSURDFK 3DUWLFLSDWLYH$SSURDFK

)RFXVDUHDVDQG ³%HVWSUDFWLFHV´DFFRUGLQJWRWKH 7DLORUPDGHWRWKHQHHGVRIWKH


FULWHULDIURP UHIHUHQFHPRGHO RUJDQL]DWLRQ

'DWDFROOHFWHGIURP 6HOHFWHGJURXSRIPDQDJHUVDQG (YHU\RQHLQWKHRUJDQL]DWLRQRU


UHSUHVHQWDWLYHVIURPVSHFLILF GHSDUWPHQW
SURMHFWV

'DWDUHSRUWHGWR 6SRQVRU WRSPDQDJHPHQWDQG (YHU\RQHZKRSDUWLFLSDWHG


GHSDUWPHQWPDQDJHUV  LQFOXGLQJPDQDJHPHQW 

5ROHRIUHVHDUFKHU $GPLQLVWUDWLRQRITXHVWLRQQDLUHV 2EWDLQDJUHHPHQWRQDVVHVVPHQW


RUFRQVXOWDQW GRFXPHQWLQJILQGLQJVDQG DSSURDFKMRLQWGHVLJQDQG
UHFRPPHQGDWLRQV DGPLQLVWUDWLRQRITXHVWLRQQDLUH
GHVLJQRIZRUNVKRSV

$FWLRQSODQQLQJ 7RSPDQDJHPHQW 7HDPVDWDOOOHYHOV


GRQHE\

3UREDEOHH[WHQWRI /RZ +LJK


FKDQJHDQG63,

7KHSDUWLFLSDWLYHDSSURDFKWRVRIWZDUHSURFHVVDVVHVVPHQWLVSDUWRIWKHPHWKRGRORJLFDOEDVLV
XVHGLQ 63,4 '\En H  7KH REMHFWLYH RI WKLV DSSURDFK LV WR IRFXV RQ WKH QHFHVVLW\ RI
SDUWLFLSDWLRQ DQG WDLORULQJ LQ SURFHVV DVVHVVPHQW IRU 63, WR WDNH SODFH %DVLFDOO\ WKHUH DUH
WKUHH UHDVRQV IRU WKLV   GHYHORSHUV DQG PDQDJHUV DOLNH PXVW DFFHSW WKH GDWD IURP WKH
DVVHVVPHQWDVYDOLG   WKH\ PXVW DFFHSW UHVSRQVLELOLW\ IRU WKH SUREOHPV LGHQWLILHG DQG 
WKH\PXVWVWDUWVROYLQJWKHLUSUREOHPV VHH6HFWLRQIRUDQRYHUYLHZRIWKHDSSURDFK DQG
OHVVRQVOHDUQHGIURPLWVXVH 

$ VXPPDU\ DQG FRPSDULVRQ RI WKH PRGHOEDVHG DSSURDFK DQG WKH SDUWLFLSDWLYH DSSURDFK WR
VRIWZDUHSURFHVVDVVHVVPHQWLVJLYHQLQ7DEOH

 $VVHVVPHQWPRGHOV
7KH PRVW FRPPRQO\ XVHG DVVHVVPHQW PRGHOV LQ WKH VRIWZDUH FRPPXQLW\ LV WKH 6:&00
3DXON HW DO   DQG WKH HPHUJLQJ LQWHUQDWLRQDO VWDQGDUG ,62,(&  ,62,(& &'
 ,62,(&LVDOVRNQRZQ DV63,&(±WKHQDPHRIWKHSURMHFWGHYHORSLQJ
WKHVWDQGDUG (O(PDPHWDO %RWKRIWKHVHLQLWLDWLYHVKDGDVWKHLUREMHFWLYHWRLPSURYH
WKHVHOHFWLRQFULWHULD¶VIRUSRWHQWLDOVRIWZDUHFRQWUDFWRUVWRWKH86DQG8.PLOLWDU\UHVSHF
WLYHO\LQRUGHUWRUHGXFHWKHULVNVDVVRFLDWHGZLWKVRIWZDUHSURMHFWVDQGLPSURYHWKHTXDOLW\RI
WKHGHOLYHUHGVRIWZDUH
2WKHUQRWDEOHH[DPSOHVRIDVVHVVPHQWPRGHOVLQFOXGH ,62  DQGLWVDSSOLFD
WLRQ WR VRIWZDUH ,62,(& :'    7LFN,7 %6,   WKH ()40 ([FHOOHQFH
0RGHO ()40   %RRWVWUDS .XYDMD HW DO   DQG 7ULOOLXP &RDOOLHU HW DO  

±±
&+$37(5

7LQJH\   FRPSDUHV DQG FRQWUDVWV WKH 0DOFROP %DOGULGJH QDWLRQDO TXDOLW\ DZDUG ,62
DQGWKH&00IRUVRIWZDUH
7KHUHLVDOVRDQXPEHURIVSHFLDOSXUSRVHPDWXULW\PRGHOVDYDLODEOHVXFKDVIRUV\VWHPV
HQJLQHHULQJ %DWH   VRIWZDUH DFTXLVLWLRQ &RRSHU HW DO   SHRSOH PDQDJHPHQW
&XUWLV HW DO   UHTXLUHPHQWV HQJLQHHULQJ 6RPPHUYLOOH DQG 6DZ\HU   WHVWLQJ
%XUQVWHLQ HW DO   PDLQWHQDQFH 'UHZ   PHDVXUHPHQW %XGORQJ DQG 3HWHUVRQ
 DQGUHXVH .DUOVVRQ 7KHDSSOLFDELOLW\RIDVVHVVPHQWPRGHOVWRVPDOORUJDQL]D
WLRQVLVDGGUHVVHGLQ -RKQVRQDQG%URGPDQ6DQGHUV 
7KHDUFKLWHFWXUHRI³EHVWSUDFWLFH´PRGHOVFDQEHFODVVLILHGDVHLWKHUVWDJHGRUFRQWLQXRXV
3DXON DQG .RQUDG   $ VWDJHG DUFKLWHFWXUH OLNH WKDW RI WKH 6:&00 LV XQL
GLPHQVLRQDOVLQFHLWGHILQHVDVHWRI.H\3URFHVV$UHDV .3$V DWHDFKPDWXULW\OHYHOH[FHSW
OHYHO VHH7DEOH $PDWXULW\OHYHOLVGHILQHGLQWHUPVRIVDWLVIDFWLRQRIWKHJRDOVRIWKH
.3$VZLWKLQWKHFXUUHQW DQGWKHXQGHUO\LQJ OHYHO
7KHFRQWLQXRXVDUFKLWHFWXUHRQWKHRWKHUKDQGOLNHWKDWRIWKH ,62,(&LVWZR
GLPHQVLRQDO VHH )LJXUH   2QH GLPHQVLRQ FRQVLVWV RI WKH SURFHVVHV WKDW DUH DFWXDOO\
DVVHVVHG ZKLOH WKH VHFRQG GLPHQVLRQ FRQVLVWV RI WKH FDSDELOLW\ VFDOH WKDW LV XVHG WR DVVHVV
SURFHVV FDSDELOLW\ 7KXV FDSDELOLW\ OHYHOV DSSO\ WR DQ RUJDQL]DWLRQ¶V SURFHVVLPSURYHPHQW
DFKLHYHPHQW IRU HDFK SURFHVV DUHD ZKLOH PDWXULW\ OHYHOV DSSO\ WR DQ RUJDQL]DWLRQ¶V RYHUDOO
SURFHVVFDSDELOLW\DQGRUJDQL]DWLRQDOPDWXULW\

7DEOH.H\3URFHVV$UHDVLQWKH6:&00 3DXONHWDO 

/HYHO )RFXV .H\3URFHVV$UHDV

 &RQWLQXDOSURFHVV 'HIHFW3UHYHQWLRQ
2SWLPL]LQJ LPSURYHPHQW 7HFKQRORJ\&KDQJH0DQDJHPHQW
3URFHVV&KDQJH0DQDJHPHQW
 5HGXFHSURFHVVYDULDWLRQ 4XDQWLWDWLYH3URFHVV0DQDJHPHQW
0DQDJHG 6RIWZDUH4XDOLW\0DQDJHPHQW

 6WDQGDUGHQJLQHHULQJ 2UJDQL]DWLRQ3URFHVV)RFXV
'HILQHG SURFHVVHV 2UJDQL]DWLRQ3URFHVV'HILQLWLRQ
7UDLQLQJ3URJUDP
,QWHJUDWHG6RIWZDUH0DQDJHPHQW
6RIWZDUH3URGXFW(QJLQHHULQJ
,QWHUJURXS&RRUGLQDWLRQ
3HHU5HYLHZV
 %DVLFSURMHFWPDQDJHPHQW 5HTXLUHPHQWV0DQDJHPHQW
5HSHDWDEOH 6RIWZDUH3URMHFW3ODQQLQJ
6RIWZDUH3URMHFW7UDFNLQJDQG
2YHUVLJKW
6RIWZDUH6XEFRQWUDFW0DQDJHPHQW
6RIWZDUH4XDOLW\$VVXUDQFH
6RIWZDUH&RQILJXUDWLRQ0DQDJHPHQW
 &RPSHWHQWSHRSOHDQG 1RQH
,QLWLDO LQGLYLGXDOHIIRUW

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

&$3$%,/,7<
&RQWLQXRXV,PSURYHPHQW
3URFHVV&KDQJH
/HYHO
3URFHVV&RQWURO /HYHO
3URFHVV0HDVXUHPHQW
3URFHVV5HVRXUFH /HYHO
3URFHVV'HILQLWLRQ
:RUN3URGXFW0DQDJHPHQW
3HUIRUPDQFH0DQDJHPHQW
/HYHO
3URFHVV3HUIRUPDQFH
/HYHO 352&(66

&XVWRPHU
6XSSOLHU

(QJLQHHULQJ

6XSSRUW

0DQDJHPHQW

2UJDQL]DWLRQ
)LJXUH$QRYHUYLHZRIWKH,62,(&WZRGLPHQVLRQDODUFKLWHFWXUH (O(PDPDQG
%LUNS 

&XUUHQW ZRUN LQ WKH 6RIWZDUH (QJLQHHULQJ ,QVWLWXWH¶V &00, SURMHFW DLPV WR KDUPRQL]H WKH
WZRDUFKLWHFWXUHVVRWKDW&00,PRGHOVFDQKDYHERWKVWDJHGDQGFRQWLQXRXVUHSUHVHQWDWLRQV
HJ6(,EF 

 $VVHVVPHQWVXFFHVVIDFWRUV
:KLOHUHOLDELOLW\ DQGYDOLGLW\DUHQHFHVVDU\FRQGLWLRQVIRUVXFFHVVIXOSURFHVV DVVHVVPHQW (O
(PDP DQG %LUN  )XVDUR HW DO  6LPRQ HW DO   WKH\ DUH E\ QR PHDQV
VXIILFLHQW '\En +XPSKUH\  IRUH[DPSOHLGHQWLILHGD FRPSHWHQWWHDPVRXQG
OHDGHUVKLS DQG D FRRSHUDWLYH RUJDQL]DWLRQ DV WKH EDVLF UHTXLUHPHQWV IRU VXFFHVVIXO SURFHVV
DVVHVVPHQWV )XUWKHUPRUH KH HPSKDVL]HG WKH QHHG IRU D SURFHVV PRGHO DV D EDVLV IRU WKH
DVVHVVPHQWWKHUHTXLUHPHQWIRU FRQILGHQWLDOLW\ VHQLRU PDQDJHPHQW LQYROYHPHQW DQ DWWLWXGH
RI UHVSHFW IRU WKH YLHZV RI WKH SHRSOH LQ WKH RUJDQL]DWLRQ EHLQJ DVVHVVHG DQG ILQDOO\ DQ
DFWLRQRULHQWDWLRQ
$OVREDVHGRQDUHYLHZRIWKH63$OLWHUDWXUH HJ.XYDMDHWDO2OVRQHWDO
3DXONHWDO3UHVVPDQ =DKUDQ  PHQWLRQHGWKHIROORZLQJFULWLFDOVXFFHVV
IDFWRUV 6SRQVRUVKLS DQG RZQHU FRPPLWPHQW PRWLYDWLRQ DFWLRQ RULHQWDWLRQ FRQILGHQWLDOLW\
UHOHYDQFHFUHGLELOLW\DQGWHDPEXLOGLQJ
+RZHYHUDVVHVVPHQWDORQHGRHVQRWFUHDWHSURFHVV FKDQJHRULPSURYHPHQW VHH )LJXUH
  ,W MXVW PDNHV LW SRVVLEOH DQG VXSSRUWV LW 7KHUHIRUH WR KDYH HIIHFW EH\RQG PHUH
H[SORUDWLRQDQDVVHVVPHQW PXVW EH GLUHFWHG WRZDUG DFWLRQ ,Q WKLV FRQWH[W DVVHVVPHQWV FDQ
RQO\EHFRQVLGHUHGVXFFHVVIXOLIWKH\FRQWULEXWHWRVXFFHVVIXOSURFHVVLPSURYHPHQW

±±
&+$37(5

 6RIWZDUH3URFHVV,PSURYHPHQW
$EURDGGHILQLWLRQRI63,ZRXOGLQFOXGHDFWLYLWLHVWR  GHILQHDQGPRGHODVRIWZDUHSURFHVV
  WR DVVHVV WKH SURFHVV   WR UHILQH WKH SURFHVV DQG   WR LQQRYDWH D QHZ SURFHVV VHH
)LJXUH 7KHIXQGDPHQWDODVVXPSWLRQLVWKDWFKDQJHVWRWKHSURFHVVFDXVHLPSURYHPHQWV
LQ WKH RXWFRPH +RZHYHU WKH WHUP ³SURFHVV LPSURYHPHQW´ LV DPELJXRXV 5HIHUULQJ WR WKH
SDWK GLDJUDP LQ )LJXUH  LW FRXOG PHDQ HLWKHU LPSURYHPHQWV LQ WKH SURFHVV RU LPSURYH
PHQWVLQWKHRXWFRPH
*HQHUDO LQWURGXFWRU\ RYHUYLHZV DQG JXLGHOLQHV IRU 63, DUH JLYHQ LQ HJ %ULDQG HW DO
&DVVLG\DQG*XJJHQEHUJHU'\EnH*UDG\+XPSKUH\-HOHWLF
HW DO  352)(6  6DQGHUV  =DKUDQ   &ROOHFWLRQV RI WKHRUHWLFDO DQG
H[SHULHQWLDO63,DUWLFOHVDUHSURYLGHGLQ (O(PDPHWDO(O(PDPDQG0DGKDYML
+XQWHUDQG7KD\HU0HVVQDU]DQG7XOO\ 
2YHUYLHZVRQWKHHYDOXDWLRQRI63,DQGFRUUHVSRQGLQJH[DPSOHVRIHPSLULFDOVWXGLHVFDQ
EHIRXQGLQ (O(PDPDQG%ULDQG*ROGHQVRQHWDOD-RQHV.LWFKHQKDP
 .UDVQHU   $ PRUH SUDJPDWLF ORRN DW ZKDW FDQ EH DFKLHYHG IURP VXFK
HYDOXDWLRQVWXGLHVLVSURYLGHGE\ +HUEVOHE 

 ,PSURYHPHQWSULQFLSOHV
7KH 3ODQ'R&KHFN$FW 3'&$  F\FOH )LJXUH   GHYHORSHG E\ :DOWHU 6KHZKDUW LQ WKH
V SURYLGHV WKH EDVLF SKLORVRSK\ IRU D GLVFLSOLQHG F\FOLFDO DSSURDFK WR FRQWLQXRXV
LPSURYHPHQW3'&$LVDOVRUHIHUUHGWRDVWKH³VFLHQWLILFPHWKRG´DQGWKH³6KHZKDUWF\FOH´
7KHF\FOH ZDVODWHU LQWURGXFHG E\ :LOOLDP (GZDUGV 'HPLQJ LQ KLV ZRUN ZLWK WKH -DSDQHVH
LQGXVWU\DIWHU:RUOG:DU,,
:KLOHWKHUHDUHLPSRUWDQWGLIIHUHQFHVWKHLGHDVRITXDOLW\RUSURFHVVLPSURYHPHQWLVMXVW
DV DSSOLFDEOH WR VRIWZDUH GHYHORSPHQW DV WKH\ DUH WR PDQXIDFWXULQJ +RZHYHU TXDOLW\
PDQDJHPHQW DV D GLVFLSOLQH LV GHHSO\ URRWHG LQ WKH PDQXIDFWXULQJ SURFHVV 7KH FKDOOHQJH
WKHUHIRUH LV WR DSSO\ WKHVH JHQHUDO SULQFLSOHV WR D ³GHYHORSPHQW HQYLURQPHQW´ LQVWHDG RI D
³SURGXFWLRQHQYLURQPHQW´ %DVLOLDQG&DOGLHUD 

3 ± 3ODQ DFWLYLWLHV LH GHILQH WKH SUREOHP DQG


VWDWHWKHLPSURYHPHQWREMHFWLYHV 3/$1

' ± ,PSOHPHQW WKH SODQ LH LGHQWLI\ SRVVLEOH


SUREOHPFDXVHVHVWDEOLVKEDVHOLQHVDQGWHVW
FKDQJHV $&7 '2
& ± &KHFN WKH UHVXOW LH FROOHFW DQG HYDOXDWH
GDWD
$ ± ,PSURYHWKHSURFHVV LH LPSOHPHQW V\VWHP
&+(&.
FKDQJHDQGGHWHUPLQHHIIHFWLYHQHVV

)LJXUH7KH6KHZDUWLPSURYHPHQWF\FOH 'HPLQJ 

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

7DEOH%HQFKPDUNLQJDSSURDFKYHUVXVDQDO\WLFDODSSURDFK DGDSWHGIURP-HOHWLFHWDO
S 

$UHD %HQFKPDUNLQJ$SSURDFK $QDO\WLFDO$SSURDFK

*RDOV )RFXVRQLPSURYLQJSURFHVV )RFXVRQLPSURYLQJSURGXFW


*HQHUDOL]HGJRDO JHWWROHYHO *RDOVYDU\DFURVVRUJDQL]DWLRQV
'RPDLQLQGHSHQGHQW 'RPDLQGHSHQGHQW
&RPPRQPHDVXUHRIVXFFHVV 0HDVXUHVRIVXFFHVVYDU\IURP
KLJKHUOHYHO RUJDQL]DWLRQWRRUJDQL]DWLRQ

,QLWLDO%DVHOLQH 3HUIRUPDVVHVVPHQWRISURFHVV 8QGHUVWDQGSURFHVVDQGSURGXFW


&RPPRQ\DUGVWLFN
ZKDWLVWKHPDWXULW\OHYHO"

,QLWLDO$QDO\VLV &KDQJHSURFHVVWRDGYDQFHWRD &KDQJHSURFHVVWRLPSURYHSURGXFW


KLJKHUOHYHOUHDVVHVVSURFHVV UHDVVHVVSURFHVVDQGSURGXFW
ZKDWLVWKHPDWXULW\OHYHOQRZ"
2UJDQL]DWLRQVSHFLILFQRZD\WR
&DQFRPSDUHDFURVVRUJDQL]DWLRQV" FRPSDUHDFURVVRUJDQL]DWLRQV

,PSURYHPHQW 3URFHVVEDVHG 3URGXFWEDVHG


$SSURDFK
&RPPRQ\DUGVWLFNGULYHVFKDQJH 2UJDQL]DWLRQDOH[SHULHQFHDQGJRDOV
GULYHFKDQJH

7ZREDVLFDSSURDFKHVWR63,KDYHHPHUJHG&DUG  UHIHUUHGWRWKHVHDSSURDFKHVDVWKH


³EHQFKPDUNLQJ´ DQG WKH ³DQDO\WLF´ DSSURDFK ZKLOH 7KRPDV DQG 0F*DUU\   XVHG WKH
WHUPV ³WRSGRZQ´ DQG ³ERWWRPXS´ SURFHVV LPSURYHPHQW UHVSHFWLYHO\ VHH 7DEOH  IRU D
FRPSDULVRQ 
7KH EHQFKPDUNLQJ DSSURDFK FRPSDUHV DQ RUJDQL]DWLRQ¶V SURFHVV ZLWK RQH RI WKH ³EHVW
SUDFWLFH´DVVHVVPHQWPRGHOV VHH6HFWLRQ 3URFHVVLPSURYHPHQWLVWKHQWKHHOLPLQDWLRQ
RIGLIIHUHQFHVEHWZHHQWKHH[LVWLQJSURFHVVDQGWKHVWDQGDUGSURFHVV7KHDVVXPSWLRQLVWKDW
RQFHWKHSURFHVVLVFKDQJHGWKHJHQHUDWHGSURGXFWVZLOOEHLPSURYHG±RUDWOHDVWWKHTXDOLW\
ULVNV RI JHQHUDWLQJ QHZ VRIWZDUH ZLOO EH UHGXFHG 7KH PRVW ZHOO NQRZQ EHQFKPDUNLQJ
DSSURDFKWR63,LVWKH ,'($/PRGHO 0F)HHOH\ ZKLFKLV EDVHG RQ WUDQVLWLRQLQJ WKH
&00LQWRDQRUJDQL]DWLRQ¶VSUDFWLFH 3HWHUVRQ 
,Q FRQWUDVW WR WKH EHQFKPDUNLQJ DSSURDFK WKH DQDO\WLF DSSURDFK DVVXPHV WKDW WKH
RUJDQL]DWLRQ¶VLQGLYLGXDOJRDOVFKDUDFWHULVWLFVSURGXFWDWWULEXWHVDQGH[SHULHQFHVPXVWGULYH
SURFHVVFKDQJHWKDWFKDQJHLVGHILQHGE\D ORFDO GRPDLQ LQVWHDG RI D XQLYHUVDO VHW RI ³EHVW
SUDFWLFHV´)RUH[DPSOHDQRUJDQL]DWLRQZKRVHSULPDU\JRDOLVLPSURYLQJWLPHWRPDUNHWPD\
WDNHDVLJQLILFDQWO\ GLIIHUHQW DSSURDFK WR SURFHVV FKDQJH WKDQ RQH ZKRVH SULPDU\ JRDO LV WR
SURGXFHGHIHFWIUHHVRIWZDUH7KHPRVWSURPLQHQWH[DPSOHRIWKHDQDO\WLFDSSURDFKWR63,LV
WKH4XDOLW\,PSURYHPHQW3DUDGLJP 4,3  %DVLOL%DVLOLDQG&DOGLHUD 

±±
&+$37(5

 ,PSURYHPHQWPRGHOV
7KHPRVWFRPPRQO\XVHG63,PRGHOVLQWKHVRIWZDUHFRPPXQLW\DUHWKHDOUHDG\PHQWLRQHG
,'($/ PRGHO DQG 4,3 2WKHU H[DPSOHV LQFOXGH WKH DPL PHWKRG 3XOIRUG HW DO   WKH
SURMHFWSODQQLQJDQGGHYHORSPHQWSURFHVV 3$'5(  5HWWLJDQG6LPRQV DQG*UDG\¶V
 VSLUDOPRGHOIRUSURFHVVLPSURYHPHQWDGRSWLRQZKLFK FRPELQHV WKH 6KHZKDUW F\FOH
ZLWK%RHKP¶V  VSLUDOPRGHORIVRIWZDUHGHYHORSPHQWDQGHQKDQFHPHQW$OVRWKH63,4
SURMHFW '\EnH GHYHORSHGDQLPSURYHPHQWPRGHOEDVHGRQWKH6KHZKDUWF\FOHZKLOH
WKH352)(6SURMHFW 352)(6 GHYHORSHGDPRGHOEDVHGRQ4,3
)XUWKHUPRUHWKHQHZSDUWRIWKH ,62,(&GRFXPHQWVHW ,62,(&:'
  SURYLGH JXLGDQFH RQ XWLOL]LQJ SURFHVV DVVHVVPHQW IRU WKH SXUSRVH RI SURFHVV
LPSURYHPHQWDQGFDSDELOLW\GHWHUPLQDWLRQ,WUHSODFHVWKHROG,62,(&75DQG
,62,(& 75  7KH JXLGDQFH SURYLGHV DQ HLJKWVWHS SURFHVV IRU FRQWLQXRXV
LPSURYHPHQW EXW GRHV QRW SUHVXPH VSHFLILF RUJDQL]DWLRQDO VWUXFWXUHV PDQDJHPHQW
SKLORVRSKLHVVRIWZDUHOLIHF\FOHPRGHOVRUVRIWZDUHGHYHORSPHQWPHWKRGV
2I WKH LPSURYHPHQW PRGHOV ,'($/ PRVW FOHDUO\ ORFDWHV VSHFLILF OHDUQLQJ DFWLYLWLHV LQ
WKH ODVW SKDVH ± WKH OHDUQLQJ SKDVH +RZHYHU LW LV RXU FRQWHQWLRQ WKDW OHDUQLQJ VKRXOG QRW
UHVLGHLQRQHSKDVHDVDQDIWHUWKHIDFWUHIOHFWLRQ5DWKHUOHDUQLQJVKRXOGEHUHFRJQL]HGDVDQ
LQWHJUDOSDUWRIDOOSKDVHVRIWKHLPSURYHPHQWF\FOH VHH&KDSWHUVDQG 

7KH,'($/PRGHO
7KH6(,¶VUHFRPPHQGHGIUDPHZRUN IRUVRIWZDUHSURFHVVLPSURYHPHQWLVWKH ,'($/PRGHO
0F)HHOH\ VKRZQLQ)LJXUH7KH,'($/PRGHOZDVGHYHORSHGLQRUGHUWRSUHVHQW
D FRQVLVWHQW YLHZ RI WKH DFWLYLWLHV RI DQ LPSURYHPHQW SURJUDP EDVHG RQ WUDQVLWLRQLQJ WKH
&00LQWRDQRUJDQL]DWLRQ¶VSUDFWLFH 3HWHUVRQ 

7KH,'($/DSSURDFKFRQVLVWVRIWKHIROORZLQJILYHSKDVHV *UHPEDDQG0\HUV 

  ,QLWLDWLQJ WKH LPSURYHPHQW SURJUDP  7KH ,QLWLDWLQJ SKDVH HVWDEOLVKHV WKH EXVLQHVV
UHDVRQV IRU XQGHUWDNLQJ D VRIWZDUH SURFHVV LPSURYHPHQW HIIRUW ,W LGHQWLILHV KLJKOHYHO
FRQFHUQV DQG EXVLQHVV JRDOV WKDW FDQ EH WKH VWLPXOXV IRU DGGUHVVLQJ YDULRXV DVSHFWV RI
TXDOLW\ LPSURYHPHQW &RPPXQLFDWLRQ RI WKHVH FRQFHUQV DQG EXVLQHVV SHUVSHFWLYHV LV
QHHGHG GXULQJ WKH ,QLWLDWLQJ SKDVH LQ RUGHU WR JDLQ H[HFXWLYH FRPPLWPHQW DQG
VSRQVRUVKLSDWWKLVYHU\HDUO\SDUWRIWKHLPSURYHPHQWHIIRUW
  'LDJQRVLQJ WKHFXUUHQWVWDWHRISUDFWLFH 7KH'LDJQRVLQJSKDVHEXLOGVRQWKHLQLWLDWLQJ
SKDVHWRGHYHORSDFRPPRQXQGHUVWDQGLQJRIWKHVWUHQJWKVDQGZHDNQHVVHVRIWKHFXUUHQW
SURFHVVHVRI WKH RUJDQL]DWLRQ DQG WR KHOS LGHQWLI\ SULRULWLHV IRU LPSURYLQJ WKH VRIWZDUH
SURFHVVHV7KLVGLDJQRVLVLVEDVHGRQWKH&00PRGHODQGWKH6&$03,PHWKRG
  (VWDEOLVKLQJ WKHSODQVIRUWKHLPSURYHPHQWSURJUDP 7KH(VWDEOLVKLQJSKDVHILQDOL]HV
WKHVWUDWHJ\DQGVXSSRUWLQJSODQVIRUWKHVRIWZDUHSURFHVVLPSURYHPHQWSURJUDP,WVHWV
WKHGLUHFWLRQDQGJXLGDQFHIRUVKRUWWHUPDQGORQJWHUPLPSURYHPHQWLQFOXGLQJVWUDWHJLF
DQGWDFWLFDOSODQVIRU63,

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

/HDUQLQJ
$QDO\]H

DQG
3URSRVH
9DOLGDWH
)XWXUH
,PSOHPHQW
$FWLRQ
6ROXWLRQ

5HILQH

6ROXWLRQ
6WLPXOXV 6HW %XLOG
&KDUWHU
IRU&KDQJH &RQWH[W 6SRQVRUVKLS
,QIUDVWUXFWXUH
$FWLQJ
3LORW7HVW

6ROXWLRQ

,QLWLDWLQJ &KDUDFWHUL]H

&XUUHQW

'HVLUHG6WDWHV

&UHDWH

6ROXWLRQ

'LDJQRVLQJ 'HYHORS

5HFRPPHQ

GDWLRQV

3ODQ
6HW $FWLRQV
3ULRULWLHV 'HYHORS

$SSURDFK

(VWDEOLVKLQJ

)LJXUH7KH,'($/YPRGHO *UHPEDDQG0\HUV 

  $FWLQJ RQWKHSODQVDQGUHFRPPHQGHGLPSURYHPHQWV 7KH$FWLQJSKDVHWDNHVDFWLRQWR


HIIHFW FKDQJHV LQ RUJDQL]DWLRQDO V\VWHPV WKDW UHVXOW LQ LPSURYHPHQWV LQ WKHVH V\VWHPV
7KHVHLPSURYHPHQWVDUHPDGHLQDQRUGHUO\PDQQHUDQGLQZD\VWKDWZLOOFDXVHWKHPWR
EH VXVWDLQHG RYHU WLPH 7HFKQLTXHV XVHG WR VXSSRUW DQG LQVWLWXWLRQDOL]H FKDQJH LQFOXGH
GHILQLQJVRIWZDUHSURFHVVHVDQGPHDVXUHPHQWVSLORWWHVWLQJDQGLQVWDOOLQJQHZSURFHVVHV
DQGPHDVXUHPHQWVWKURXJKRXWWKHRUJDQL]DWLRQ
  /HDUQLQJ IURP WKH OHVVRQV DQG WKH EXVLQHVV UHVXOWV RI WKH LPSURYHPHQW HIIRUW  7KH
/HDUQLQJSKDVHFRPSOHWHVWKHSURFHVVLPSURYHPHQWF\FOH/HVVRQVOHDUQHGIURPWKHSLORW
SURMHFWVDQGLPSURYHPHQW HIIRUWVDUHGRFXPHQWHG DQG DQDO\]HG LQ RUGHU WR LPSURYH WKH
SURFHVVLPSURYHPHQWSURJUDPIRUWKHIXWXUH7KHEXVLQHVVQHHGVWKDWZHUHGHWHUPLQHGDW
WKHEHJLQQLQJRIWKHF\FOHDUHUHYLVLWHGWRVHHLIWKH\KDYHEHHQPHW6SRQVRUVKLSIRUWKH
SURJUDPLVUHYLVLWHGDQGUHQHZHGIRUWKHQH[WF\FOHRIVRIWZDUHSURFHVVLPSURYHPHQW

7KH4XDOLW\,PSURYHPHQW3DUDGLJP
7KH4XDOLW\,PSURYHPHQW3DUDGLJP 4,3 GHYHORSHGE\%DVLOLHWDO %DVLOL%DVLOLDQG
5RPEDFK%DVLOLDQG&DOGLHUD%DVLOLHWDOD LVWKHUHVXOWRIWKHDSSOLFDWLRQ
RIWKH6KHZKDUWF\FOHWRWKHSUREOHPRIVRIWZDUHTXDOLW\LPSURYHPHQW

±±
&+$37(5

4,3FRQVLVWVRIWKHIROORZLQJVL[VWHSV

  &KDUDFWHUL]H8QGHUVWDQGWKHHQYLURQPHQWEDVHGXSRQDYDLODEOHPRGHOVGDWDLQWXLWLRQ
HWF (VWDEOLVK EDVHOLQHV ZLWK WKH H[LVWLQJ EXVLQHVV SURFHVVHV LQ WKH RUJDQL]DWLRQ DQG
FKDUDFWHUL]HWKHLUFULWLFDOLW\
  6HWJRDOV2QWKHEDVLVRIWKHLQLWLDOFKDUDFWHUL]DWLRQDQGRIWKHFDSDELOLWLHVWKDWKDYHD
VWUDWHJLF UHOHYDQFH WR WKH RUJDQL]DWLRQ VHW TXDQWLILDEOH JRDOV IRU VXFFHVVIXO SURMHFW DQG
RUJDQL]DWLRQ SHUIRUPDQFH DQG LPSURYHPHQW 7KH UHDVRQDEOH H[SHFWDWLRQV DUH GHILQHG
EDVHGXSRQWKHEDVHOLQHSURYLGHGE\WKHFKDUDFWHUL]DWLRQ
  &KRRVHSURFHVV2QWKHEDVLVRIWKHFKDUDFWHUL]DWLRQRIWKHHQYLURQPHQWDQGRIWKHJRDOV
WKDW KDYH EHHQ VHW FKRRVH WKH DSSURSULDWH SURFHVVHV IRU LPSURYHPHQW DQG VXSSRUWLQJ
PHWKRGVDQGWRROVPDNLQJVXUHWKDWWKH\DUHFRQVLVWHQWZLWKWKHJRDOVWKDWKDYHEHHQVHW
  ([HFXWH3HUIRUPWKHSURFHVVHVFRQVWUXFWLQJWKHSURGXFWVDQGSURYLGLQJSURMHFWIHHGEDFN
EDVHGXSRQWKHGDWDRQJRDODFKLHYHPHQWWKDWDUHEHLQJFROOHFWHG
  $QDO\]H $W WKH HQG RI HDFK VSHFLILF SURMHFW DQDO\]H WKH GDWD DQG WKH LQIRUPDWLRQ
JDWKHUHGWRHYDOXDWHWKHFXUUHQWSUDFWLFHVGHWHUPLQHSUREOHPVUHFRUGILQGLQJVDQGPDNH
UHFRPPHQGDWLRQVIRUIXWXUHSURMHFWLPSURYHPHQWV
  3DFNDJH&RQVROLGDWHWKHH[SHULHQFHJDLQHGLQWKHIRUPRIQHZRUXSGDWHGDQGUHILQHG
PRGHOVDQGRWKHUIRUPVRIVWUXFWXUHGNQRZOHGJHJDLQHGIURPWKLVDQGSULRUSURMHFWVDQG
VWRUHLWLQDQH[SHULHQFHEDVHVRLWLVDYDLODEOHIRUIXWXUHSURMHFWV

&RUSRUDWH/HDUQLQJ
3DFNDJHDQG
VWRUHH[SHULHQFH &KDUDFWHUL]H
DQGXQGHUVWDQG

$QDO\]H
6HWJRDOV
UHVXOWV

([HFXWH &KRRVHSURFHVVHV
3URYLGHSURFHVV PHWKRGVWRROV
ZLWKIHHGEDFN DQGWHFKQLTXHV
3URMHFW
/HDUQLQJ

$QDO\]H
UHVXOWV

)LJXUH7KH4XDOLW\,PSURYHPHQW3DUDGLJP %DVLOLDQG&DOGLHUDS 

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

4,3LPSOHPHQWVWZRIHHGEDFNF\FOHV VHH)LJXUH ZKLFKZHUHDOVRXVHGLQ63,4 '\En


H 

x 7KHSURMHFWIHHGEDFN RUFRQWURO F\FOHLVWKHIHHGEDFN WKDW LV SURYLGHG WR WKH SURMHFW


GXULQJWKHH[HFXWLRQSKDVH,WSURYLGHVDQDO\WLFLQIRUPDWLRQDERXWSURMHFWSHUIRUPDQFHDW
LQWHUPHGLDWHVWDJHVRIGHYHORSPHQWE\FRPSDULQJSURMHFWGDWDZLWKWKHQRPLQDOUDQJHIRU
VLPLODUSURMHFWV
x 7KHFRUSRUDWHIHHGEDFN RUFDSLWDOL]DWLRQ F\FOHLVWKHIHHGEDFNWKDWLVSURYLGHGWRWKH
RUJDQL]DWLRQ,WVSXUSRVHLVWRXQGHUVWDQGZKDWKDSSHQHGE\FDSWXULQJH[SHULHQFHDFURVV
DSSOLFDWLRQ GRPDLQV DQG WR DFFXPXODWH UHXVDEOH H[SHULHQFH LQ WKH IRUP RI H[SHULHQFH
SDFNDJHV

7KH*40DSSURDFKDVGLVFXVVHGLQWKHSUHYLRXVVHFWLRQLVWKHPHFKDQLVPXVHGE\4,3IRU
GHILQLQJDQGHYDOXDWLQJDVHWRIRSHUDWLRQDOJRDOVXVLQJPHDVXUHPHQW,QDGGLWLRQWRWKH*40
DSSURDFK4,3XVHVWKH([SHULHQFH )DFWRU\ RUJDQL]DWLRQ IRU EXLOGLQJ VRIWZDUH FRPSHWHQFLHV
DQGVXSSO\LQJWKHPWRSURMHFWV

 ,PSURYHPHQWVXFFHVVIDFWRUV
7KHFXUUHQWVWDWHRIWKHDUWLQTXDOLW\PDQDJHPHQWKDVPRUHWKDQDQ\WKLQJHOVHEHHQVKDSHG
E\ TXDOLW\ JXUXV VXFK DV :LOOLDP (GZDUGV 'HPLQJ    -RVHSK 0 -XUDQ 
-XUDQDQG *RGIUH\   3KLOLS &URVE\     DQG WKHLU TXDOLW\ IUDPHZRUNV
7DEOH  VXPPDUL]HV 'HPLQJ¶V  SULQFLSOHV WKH -XUDQ WULORJ\ DQG &URVE\¶V  TXDOLW\
VWHSV7KHVHDQGRWKHUDXWKRUV HJ$KLUHHWDO%ODFNDQG3RUWHU)HLJHQEDXP
*DUYLQ,VKLNDZD3RZHOO6DUDSKHWDO7DJXFKL
7DJXFKLHWDO<XVRIDQG$VSLQZDOO UHSHDWHGO\GLVFXVVWKHLPSRUWDQFHRI
FULWLFDO IDFWRUV VXFK DV OHDGHUVKLS LQYROYHPHQW HPSOR\HH SDUWLFLSDWLRQ PHDVXUHPHQW DQG
SURFHVVPDQDJHPHQWWRLPSURYHWKHTXDOLW\SHUIRUPDQFHLQRUJDQL]DWLRQV)RUDPRUHGHWDLOHG
UHYLHZRIWKHVHDQGRWKHUHPSLULFDOVWXGLHVRIWKHIDFWRUVIRUVXFFHVVLQTXDOLW\PDQDJHPHQW
RUJDQL]DWLRQDOOHDUQLQJDQG63,VHH '\EnD 
:LWKLQ63,+XPSKUH\  LGHQWLILHGVL[EDVLFSULQFLSOHVRIVRIWZDUHSURFHVVFKDQJH
=DKUDQ  SURSRVHGWHQFULWLFDOIDFWRUVIRUVXFFHVVIXOLPSOHPHQWDWLRQRIVRIWZDUHSURFHVV
LPSURYHPHQW %DVLOL DQG &DOGLHUD   IRFXVHG RQ UHXVH RI H[SHULHQFH DQG OHDUQLQJ E\
XVLQJ4,3 IRU GHYHORSLQJ FRUH FRPSHWHQFLHV DQG E\ VXSSRUWLQJ WKH 4,3 SURFHVV ZLWK JRDO
RULHQWHG PHDVXUHPHQW XVLQJ *40 DQG ZLWK DQ RUJDQL]DWLRQDO LQIUDVWUXFWXUH EDVHG RQ ()
7DEOHVXPPDUL]HVWKHVHFRQFHSWV
*ROGHQVRQDQG+HUEVOHE  FRQGXFWHGDVXUYH\RILQGLYLGXDOVIURPRUJDQL]D
WLRQVLQWKH8QLWHG6WDWHVDQG&DQDGDWRHYDOXDWHRUJDQL]DWLRQDOIDFWRUVWKDWZHUHEHOLHYHGWR
SURPRWHRUKLQGHUVXFFHVVIXO63,DIWHUD&00EDVHGDVVHVVPHQW7KHIDFWRUVWKDWZHUHIRXQG
WREHVWDWLVWLFDOO\VLJQLILFDQWLQWKHLUVWXG\DUHVXPPDUL]HGLQ7DEOH
(O (PDP HW DO   PDGH D UHDQDO\VLV RI *ROGHQVRQ DQG +HUEVOHE¶V   VWXG\
XVLQJPXOWLYDULDWHDQDO\VLVLQVWHDGRIWKHVLPSOHVWDWLVWLFDODQDO\WLFPHWKRGVXVHGLQWKHLQLWLDO
UHSRUW %DVHG RQ WKLV UHDQDO\VLV WKH\ LGHQWLILHG IRFXVHG 63, HIIRUW FRPPLWPHQW WR 63,
SROLWLFVUHVSHFWDQGWXUQRYHUDVWKHNH\IDFWRUV

±±
&+$37(5

7DEOH3HUVSHFWLYHVRQTXDOLW\PDQDJHPHQW

  
'HPLQJ¶VSULQFLSOHV 7KH-XUDQ7ULORJ\ &URVE\¶VTXDOLW\VWHSV

 &RQVWDQF\RISXUSRVH , 4XDOLW\3ODQQLQJ  0DQDJHPHQWFRPPLWPHQW


 $GRSWWKHQHZSKLORVRSK\ (VWDEOLVKTXDOLW\JRDOV  4XDOLW\LPSURYHPHQWWHDPV
 &HDVHGHSHQGHQFHRQ ,GHQWLI\FXVWRPHUVDQGWKHLU  4XDOLW\PHDVXUHPHQW
LQVSHFWLRQ QHHGV
 &RVWRITXDOLW\HYDOXDWLRQ
 'RQ¶WDZDUGEXVLQHVVRQ 'HYHORSSURGXFWVDQG
 4XDOLW\DZDUHQHVV
SULFH SURFHVVHV
 &RUUHFWLYHDFWLRQ
 &RQVWDQWLPSURYHPHQW ,, 4XDOLW\&RQWURO
 =HURGHIHFWVFRPPLWWHH
 ,QVWLWXWHWUDLQLQJRQWKHMRE (YDOXDWHSHUIRUPDQFH
 6XSHUYLVRUWUDLQLQJ
 ,QVWLWXWHOHDGHUVKLS &RPSDUHWRJRDOVDQGDFW
 =HURGHIHFWVGD\
 'ULYHRXWIHDU ,,,4XDOLW\,PSURYHPHQW
*RDOVHWWLQJ
 %UHDNGRZQEDUULHUV (VWDEOLVKLQIUDVWUXFWXUH
(UURUFDXVHUHPRYDO
(OLPLQDWHVORJDQV ,GHQWLI\LPSURYHPHQWSURMHFWV
DQGWHDPV 5HFRJQLWLRQ
(OLPLQDWHZRUNVWDQGDUGV
3URYLGHUHVRXUFHVDQG 4XDOLW\FRXQFLOV
3ULGHRIZRUNPDQVKLS
WUDLQLQJ
'RLWRYHUDJDLQ
(GXFDWLRQDQGUHWUDLQLQJ
(VWDEOLVKFRQWUROV
7DNHDFWLRQ

6RXUFHV'HPLQJ  -XUDQ  &URVE\  

7DEOH)DFLOLWDWLQJIDFWRUVLGHQWLILHGLQVRIWZDUHSURFHVVLPSURYHPHQW

  
+XPSKUH\¶VVL[SULQFLSOHV =DKUDQ¶V&6)V %DVLOL¶VSDUDGLJP

x 0DMRUFKDQJHVWRWKHVRIW  $OLJQPHQWZLWKWKHEXVLQHVV x $FTXLVLWLRQRIFRUHFRPSH


ZDUHSURFHVVPXVWVWDUWDW VWUDWHJ\DQGJRDOV WHQFLHVWKURXJK  DFRQWURO
WKHWRS F\FOHDQG  D
 &RQVHQVXVDQGEX\LQIURP
FDSLWDOL]DWLRQF\FOH
x 8OWLPDWHO\HYHU\RQHPXVW DOOVWDNHKROGHUV
EHLQYROYHG  0DQDJHPHQWVXSSRUW x *RDORULHQWHGPHDVXUHPHQW
x (IIHFWLYHFKDQJHLVEXLOWRQ  'HGLFDWHGUHVRXUFHV x ([SHULHQFHUHXVHDQGRU
NQRZOHGJH JDQL]DWLRQDOVKDULQJ
 6HQVLWLYLW\WRWKHRUJDQL]D
x &KDQJHLVFRQWLQXRXV WLRQDOFRQWH[W
x 6RIWZDUHSURFHVVFKDQJHV  0DQDJHPHQWRIFKDQJH
ZRQ¶WVWLFNE\WKHPVHOYHV
 3ULRULWL]DWLRQRIDFWLRQV
x 6RIWZDUHSURFHVVLPSURYH
PHQWUHTXLUHVLQYHVWPHQW  6XSSRUWLQIUDVWUXFWXUH
 0RQLWRULQJWKHUHVXOWVRI63,
/HDUQLQJIURPWKHIHHGEDFN
UHVXOWV

6RXUFHV+XPSKUH\  =DKUDQ  %DVLOLDQG&DOGLHUD  

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

7DEOH)DFLOLWDWLQJIDFWRUVDQGEDUULHUVWR63, *ROGHQVRQDQG+HUEVOHE 

2UJDQL]DWLRQDO)DFWRUV %DUULHUV

x 6HQLRUPDQDJHPHQWPRQLWRULQJRI63, x 'LVFRXUDJHPHQWDERXW63,SURVSHFWV
x &RPSHQVDWHG63,UHVSRQVLELOLWLHV x 63,JHWVLQWKHZD\RI³UHDO´ZRUN
x 63,JRDOVZHOOXQGHUVWRRG x ³7XUIJXDUGLQJ´LQKLELWV63,
x 7HFKQLFDOVWDIILQYROYHGLQ63, x ([LVWHQFHRIRUJDQL]DWLRQDOSROLWLFV
x 63,SHRSOHZHOOUHVSHFWHG x $VVHVVPHQWUHFRPPHQGDWLRQVWRRDPELWLRXV
x 6WDIIWLPHUHVRXUFHVGHGLFDWHGWRSURFHVV x 1HHGJXLGDQFHDERXWKRZWRLPSURYH
LPSURYHPHQW
x 1HHGPRUHPHQWRULQJDQGDVVLVWDQFH

:LWKLQ WKH 63,&( 7ULDOV D VLPLODU VWXG\ WR WKDW RI *ROGHQVRQ DQG +HUEVOHE   ZDV
FRQGXFWHGE\(O(PDPHWDO  ZLWKRUJDQL]DWLRQVLQ(XURSH&DQDGDDQG$XVWUDOLD
WKDW KDG SHUIRUPHG DVVHVVPHQWV XVLQJ WKH ,62,(&  VWDQGDUG IRU VRIWZDUH SURFHVV
DVVHVVPHQW ,QWKHLU VWXG\ WKUHH W\SHV RI LQGHSHQGHQW YDULDEOHV ZHUH WHVWHG ³RUJDQL]DWLRQDO
IDFWRUV´³SURFHVVIDFWRUV´DQG³EDUULHUV´
5HVXOWVRIWKHELYDULDWHUHODWLRQVKLSDQDO\VLV VKRZHG WKDW QRQH RI WKH LGHQWLILHG EDUULHUV
ZHUHUHODWHGWRVXFFHVVLQDGGUHVVLQJWKHILQGLQJVIURPDQDVVHVVPHQW2IWKHRUJDQL]DWLRQDO
IDFWRUV RQO\ ³63, JRDOV EHLQJ ZHOO XQGHUVWRRG´ DQG ³7HFKQLFDO 6WDII LQYROYHPHQW LQ 63,´
ZHUH IRXQG WR EH FULWLFDO IRU DGGUHVVLQJ WKH ILQGLQJV IURP DQ DVVHVVPHQW )LQDOO\ RQO\ RQH
SURFHVV IDFWRU ³&UHDWLQJ SURFHVV DFWLRQ WHDPV´ ZDV IRXQG WR EH VWDWLVWLFDOO\ VLJQLILFDQW LQ
DGGUHVVLQJWKHDVVHVVPHQWILQGLQJV
6WHO]HUHWDO  LGHQWLILHGWKHIROORZLQJNH\VXFFHVVIDFWRUVLQWKHLUVWXG\RIVRIWZDUH
SURFHVVLPSURYHPHQW YLD ,62    GHILQLWLRQ DQG GRFXPHQWDWLRQ RI WKH VWDWXV TXR 
LGHQWLILFDWLRQRI EHVW SUDFWLFHV   LGHQWLILFDWLRQ RI EXVLQHVV SURFHVVHV   VLPSOLILFDWLRQ RI
URXWLQH SURFHGXUHV   LQWHUQDO DXGLWV   LPSHWXV DQG LQFHQWLYH   WHDP VSLULW 
ZRUNVKRS DQG UHJXODU PHHWLQJV   GHILQLWLRQ RI D FRPPRQ ODQJXDJH DQG   FXVWRPHU
SHUFHSWLRQVXUYH\V
)XUWKHUPRUH 6WHO]HU DQG 0HOOLV   DQDO\]HG SXEOLVKHG H[SHULHQFH UHSRUWV DQG FDVH
VWXGLHVRIVRIWZDUHRUJDQL]DWLRQVWKDWKDGLPSOHPHQWHGDQ,62TXDOLW\V\VWHPRUWKDW
KDGFRQGXFWHGD&00EDVHG63,LQLWLDWLYH7KHUHVXOWRIWKLVPHWDDQDO\VLVZDVDVHWRIWHQ
IDFWRUV WKDW DIIHFW RUJDQL]DWLRQDO FKDQJH LQ 63, ,Q UDQN RUGHU WKHVH IDFWRUV ZHUH 
PDQDJHPHQW FRPPLWPHQW DQG VXSSRUW   VWDII LQYROYHPHQW   SURYLGLQJ HQKDQFHG XQ
GHUVWDQGLQJ  WDLORULQJLPSURYHPHQWLQLWLDWLYHV  PDQDJLQJWKHLPSURYHPHQWSURMHFW 
FKDQJH DJHQWV DQG RSLQLRQ OHDGHUV   VWDELOL]LQJ FKDQJHG SURFHVVHV   HQFRXUDJLQJ
FRPPXQLFDWLRQ DQG FROODERUDWLRQ   VHWWLQJ UHOHYDQW DQG UHDOLVWLF REMHFWLYHV DQG 
XQIUHH]LQJWKHRUJDQL]DWLRQ
0RUHRYHU LQ D VXUYH\ RI  SURMHFWV IURP GLIIHUHQW RUJDQL]DWLRQV 'HHSKRXVH HW DO
  DVVHVVHG WKH HIIHFWLYHQHVV RI VRIWZDUH SURFHVVHV RQ SURMHFW SHUIRUPDQFH 7KH UHVXOWV
IURP WKLV VWXG\ VKRZHG WKDW FHUWDLQ SUDFWLFHV VXFK DV SURMHFW SODQQLQJ DQG FURVVIXQFWLRQDO
WHDPV ZHUH FRQVLVWHQWO\ DVVRFLDWHG ZLWK IDYRUDEOH RXWFRPHV ZKLOH RWKHU SUDFWLFHV VXFK DV
SURFHVVWUDLQLQJVWDEOHHQYLURQPHQWXVHUFRQWDFWGHVLJQUHYLHZVDQGSURWRW\SLQJKDGOLWWOH
LPSDFWRQSURMHFWRXWFRPHV

±±
&+$37(5

)LQDOO\,62,(&:'KLJKOLJKWFXOWXUDOLVVXHVDVIXQGDPHQWDOWRVXFFHHG
ZLWKVRIWZDUHSURFHVVLPSURYHPHQWDQGRUJDQL]DWLRQDOFKDQJH7KHVWDQGDUGDUJXHVWKDW63,
VKRXOG EH VWURQJO\ VXSSRUWHG E\ OHDGHUVKLS FRPPXQLFDWLRQ DQG PRWLYDWLRQ WKURXJKRXW WKH
ZKROHRUJDQL]DWLRQDQGWKDWWKHPDMRUSUREOHPVIRXQGLQVRIWZDUHSURFHVVHVRIWHQDULVHIURP
FXOWXUDO LVVXHV &RQVHTXHQWO\ FXOWXUDO LVVXHV VKRXOG EH RQH RI WKH IDFWRUV FRQVLGHUHG LQ
SULRULWL]LQJLPSURYHPHQWDFWLRQV

 6RIWZDUH3URFHVV,QQRYDWLRQ
3URFHVV LPSURYHPHQW VWUDWHJLHV DV LPSOHPHQWHG E\ WKH 63, DSSURDFKHV GHVFULEHG LQ WKH
SUHYLRXV VHFWLRQ UHSUHVHQW UHODWLYHO\ VPDOO HYROXWLRQDU\ RU LQFUHPHQWDO FKDQJHV LQ WKH
RUJDQL]DWLRQ¶VSURGXFWVSURFHGXUHVRUVHUYLFHV7KH\DUHQHZWRWKHRUJDQL]DWLRQEXWUHIOHFW
DQ DGDSWDWLRQ RU VLPSOH DGMXVWPHQW RI H[LVWLQJ SUDFWLFHV DQG WKHLU LPSOHPHQWDWLRQ UDUHO\
UHTXLUHV FKDQJHV LQ RUJDQL]DWLRQDO VWUXFWXUHV RU SURFHVVHV ,Q FRQWUDVW SURFHVV LQQRYDWLRQ
VWUDWHJLHV UHSUHVHQW ODUJHU FKDQJHV LQ RUJDQL]DWLRQDO SURGXFWV SURFHGXUHV RU VHUYLFHV 7KH\
UHIOHFWEURDGHUVKLIWV LQ SHUVSHFWLYH DQG UHRULHQWDWLRQ RI H[LVWLQJ SUDFWLFHV DQG RIWHQ UHTXLUH
PDMRURUUDGLFDOFKDQJHVLQRUJDQL]DWLRQDOVWUXFWXUHVRUSURFHVVHVWRLPSOHPHQW
7KH GLVWLQFWLRQ EHWZHHQ LQFUHPHQWDO DQG UDGLFDO FKDQJH LV DOVR FRQVLVWHQW ZLWK D
FKDUDFWHUL]DWLRQRIOHDUQLQJVWUDWHJLHVUDQJLQJIURPDGDSWLYHWRLQQRYDWLYH2UJDQL]DWLRQVZLWK
DGDSWLYHVW\OHVZRUN ZLWKLQ H[LVWLQJ VWUXFWXUHV WR PDNH LQFUHPHQWDO FKDQJHV DQG ³GR WKLQJV
EHWWHU´,QFRQWUDVWRUJDQL]DWLRQVZLWKLQQRYDWLYHVW\OHVWUHDWFXUUHQWVWUXFWXUHVDVSDUWRIWKH
SUREOHPDQGPDNHPRUHUDGLFDOFKDQJHVE\³GRLQJWKLQJVGLIIHUHQWO\´
$UHYLHZRILQQRYDWLRQUHVHDUFKFDQEHIRXQGLQ *RSDODNULVKQDQDQG'DPDQSRXU 
$QLQWHJUDWHGVHW RI VWXGLHV RI WKH LQQRYDWLRQ SURFHVV LQ RUJDQL]DWLRQV ZKLFK UHVXOWHG IURP
WKH0LQQHVRWD,QQRYDWLRQ5HVHDUFK3URJUDPLVSURYLGHGE\ 3RROHHWDOYDQGH9HQHW
DOYDQGH9HQHWDO 0RUHPDQDJHPHQWRULHQWHGRYHUYLHZVDQGJXLGHOLQHVRQ
WKH LQQRYDWLRQ SURFHVV FDQ EH IRXQG LQ /HLIHU HW DO  /HRQDUG%DUWRQ  1RQDND
DQG 7DNHXFKL   )XUWKHUPRUH WHFKQRORJLFDO LQQRYDWLRQ DV DQ HYROXWLRQDU\ SURFHVV LV
SURYLGHGE\ =LPDQ 
*HQHUDOJXLGDQFHRQWKHGLIIXVLRQRILQQRYDWLRQVFDQEHIRXQGLQ5RJHUV¶  FODVVLF
WH[W RQ WKH VXEMHFW 6RIWZDUH HQJLQHHULQJ ERRNV DQG DUWLFOHV WKDW GLVFXVV WKH GLIIXVLRQ RI
LQQRYDWLRQVLQFOXGH $UGLVDQG0DUFROLQ3IOHHJHUE3IOHHJHUDQG0HQH]HV
5DJKDYDQ DQG &KDQG   $OVR .DXW] DQG /DUVHQ   GHVFULEHG D (XURSHDQZLGH
SURMHFWIRUWKHGLVVHPLQDWLRQRITXDOLW\PDQDJHPHQWDQG63,LQQRYDWLRQV
)XUWKHUPRUH YDULRXV WKHRUHWLFDO SHUVSHFWLYHV KDYH GHVFULEHG WKH QDWXUH RI WKH
UHODWLRQVKLS EHWZHHQ DGDSWDWLRQ DQG LQQRYDWLRQ IURP DQ RUJDQL]DWLRQDO OHDUQLQJ SHUVSHFWLYH
HJ$UJ\ULVDQG 6FK|Q  )LRO DQG /\OHV  /DQW DQG 0H]LDV  0DUFK 
6HQJH7XVKPDQDQG5RPDQHOOL 

 ,QQRYDWLRQSULQFLSOHV
7KHFRPPRQWKUHDGWKDWUXQVWKURXJKWKHOLWHUDWXUHRQLQQRYDWLRQLV³QHZQHVV´RQWKHPRVW
EDVLF OHYHO LQQRYDWLRQ PHDQV ³VRPHWKLQJ QHZ´ *RSDODNULVKQDQ DQG 'DPDQSRXU  
%XLOGLQJ RQ WKH RUJDQL]DWLRQDO OHDUQLQJ OLWHUDWXUH HJ $UJ\ULV DQG 6FK|Q   SURFHVV

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

LQQRYDWLRQFDQEHGHILQHGDVKLJKHUOHYHOOHDUQLQJWKDWUHVXOWVLQQHZZRUNSUDFWLFHVDVZHOO
DVDUHVWUXFWXULQJRIQRUPVVWUDWHJLHVDQGDVVXPSWLRQVJRYHUQLQJWKHVHSUDFWLFHV
6XFKSURFHVVLQQRYDWLRQVFDQDOVREHVHHQLQEXVLQHVVSURFHVVUHHQJLQHHULQJ %35 DQG
UHGHVLJQSURMHFWV 'DYHQSRUW+DPPHU +DPPHUDQG&KDPS\  IRUH[DP
SOHGHVFULEHGWKHSULQFLSOHEHKLQG³UHHQJLQHHULQJ´DV³WKHIXQGDPHQWDOUHWKLQNLQJDQGUDGLFDO
UHGHVLJQ RI EXVLQHVV SURFHVVHV WR DFKLHYH GUDPDWLF LPSURYHPHQWV LQ FULWLFDO FRQWHPSRUDU\
PHDVXUHVRISHUIRUPDQFHVXFKDVFRVWTXDOLW\VHUYLFHDQGVSHHG´ LELGS 
'DYHQSRUW  SUHIHUULQJWKHWHUP³SURFHVVLQQRYDWLRQ´VWDWHGWKDW³5HHQJLQHHULQJLV
RQO\ SDUW RI ZKDW LV QHFHVVDU\ LQ WKH UDGLFDO FKDQJH RI SURFHVVHV LW UHIHUV H[SOLFLWO\ WR WKH
GHVLJQRIWKHQHZSURFHVV7KHWHUPSURFHVVLQQRYDWLRQHQFRPSDVVHVWKHHQYLVLRQLQJRIQHZ
ZRUNVWUDWHJLHVWKHDFWXDOSURFHVVGHVLJQDFWLYLW\DQGWKHLPSOHPHQWDWLRQRIWKHFKDQJHLQDOO
LWVFRPSOH[WHFKQRORJLFDOKXPDQDQGRUJDQL]DWLRQDOGLPHQVLRQV´ LELGS 
%DVHG RQ RXU UHYLHZ RI WKH LQQRYDWLRQ UHHQJLQHHULQJ DQG RUJDQL]DWLRQDO OHDUQLQJ
OLWHUDWXUHWKHIROORZLQJSULQFLSOHVFDQEHVHHQDVIXQGDPHQWDOWRSURFHVVLQQRYDWLRQ

  3URFHVV 7KH GLVWLQFWLYH HOHPHQW LV EXVLQHVV SURFHVV RU ZRUN SUDFWLFH 5HIHUULQJ WR WKH
VRIWZDUH HQJLQHHULQJ GRPDLQ SURFHVVHV FDQ EH FDWHJRUL]HG DV ³SULPDU\´ ³VXSSRUWLQJ´
RU³RUJDQL]DWLRQDO´ ,62,(& 
  7UDQVIRUPDWLRQ 7KH W\SLFDO SURPLVH RI SURFHVV LQQRYDWLRQ LV WKDW D TXDQWXP OHDS LQ
RUJDQL]DWLRQDOSHUIRUPDQFHLVDYDLODEOHDQGWKDWWKHRUJDQL]DWLRQZLOOKDYHWRLGHQWLI\RU
FUHDWHVXLWDEOHLQQRYDWLRQVWRDFKLHYHWKLVJRDO HJ(DUO2¶1HLOODQG6RKDO 
  (QDEOLQJFRQGLWLRQV7KHFODVVLFWH[WVRQ%35KDYHIRFXVHGRQLQIRUPDWLRQWHFKQRORJ\
,7  DV WKH PRVW LPSRUWDQW HQDEOHU IRU UDGLFDO FKDQJH +RZHYHU DXWRQRP\ GLYHUVLW\
IOH[LELOLW\ DQG WKH DELOLW\ WR TXHVWLRQ HVWDEOLVKHG ³WUXWKV´ KDYH DOVR EHHQ QRWHG DV
SULPDU\ GULYHUV LQ FUHDWLQJ WKH G\QDPLFV RI LQQRYDWLRQ HJ $UJ\ULV DQG 6FK|Q 
1RQDNDDQG7DNHXFKL
  &KDQJH PDQDJHPHQW $ NH\ FKDOOHQJH LQ SURFHVV LQQRYDWLRQ LV FKDQJH PDQDJHPHQW
ZKLFK LQFOXGHV WKH SHRSOH WHFKQRORJ\ QRUPV DVVXPSWLRQV DQG VWUDWHJ\ DORQJ ZLWK
SODQQLQJVWUXFWXULQJDQGHYDOXDWLRQRISURFHVVLQQRYDWLRQV HJ*URYHU 

)XUWKHUPRUHYDQGH9HQ  IRFXVHGRQWKHVRFLDOG\QDPLFVRILQQRYDWLRQQRWLQJWKDW

,QQRYDWLRQ LV QRW WKH HQWHUSULVH RI D VLQJOH HQWUHSUHQHXU ,QVWHDG LW LV D QHWZRUNEXLOGLQJ
HIIRUWWKDWFHQWHUVRQWKHFUHDWLRQDGRSWLRQDQGVXVWDLQHGLPSOHPHQWDWLRQRIDVHWRILGHDV
DPRQJ SHRSOH ZKR WKURXJK WUDQVDFWLRQV EHFRPH VXIILFLHQWO\ FRPPLWWHG WR WKHVH LGHDV WR
WUDQVIRUPWKHPLQWRµJRRGFXUUHQF\¶ LELGS 

 ,QQRYDWLRQPRGHOV
,QQRYDWLRQPRGHOVW\SLFDOO\UHO\RQDVHULHVRIVWDJHVIURPEURDGHUJHQHUDOLGHDVWKDWEHFRPH
PRUHIRUPDOL]HGDQGVSHFLDOL]HGWRIRUPDVSHFLILFLQQRYDWLRQ0DUTXLV  IRUH[DPSOH
PRGHOHGWKHVXFFHVVIXOSURFHVVRILQQRYDWLRQDVDVHULHVRIVL[VWHSVUDQJLQJIURPUHFRJQLWLRQ
WR XWLOL]DWLRQ DQG GLIIXVLRQ 6LPLODUO\ 5RJHUV   GHILQHG WKH LQQRYDWLRQGHYHORSPHQW
SURFHVV DV WKH GHFLVLRQV DQG DFWLYLWLHV WKDW RFFXU IURP UHFRJQLWLRQ RI D QHHG RU D SUREOHP
WKURXJKUHVHDUFKGHYHORSPHQWDQGFRPPHUFLDOL]DWLRQWKURXJKGLIIXVLRQDQGDGRSWLRQRIWKH
LQQRYDWLRQE\XVHUVWRLWVFRQVHTXHQFHV

±±
&+$37(5

$QRWKHU ERG\ RI OLWHUDWXUH H[SUHVVHV WKH LQQRYDWLRQ SURFHVV OHVV DV D VHW RI VHTXHQWLDO
VWDJHV EXW PRUH DV DQ LWHUDWLYH ³QRQOLQHDU´ DSSURDFK /\QQ HW DO   IRU H[DPSOH
GHVFULEHG D ³SUREHDQGOHDUQ´ SURFHVV IRU RSSRUWXQLW\ DQDO\VLV RI LQQRYDWLRQV 2WKHUV KDYH
VWDWHG WKDW LQQRYDWLRQV DUH ERUQ RI FKDRWLF QRQOLQHDU SURFHVVHV ZLWK QR VHW VWDJHV HJ
-HOLQHNDQG6FKRRQKRYHQ.OLQH4XLQQ 
)XUWKHUPRUHYDQGH9HQHWDO  SUHVHQWHGWKHUHVXOWVRIWKH0LQQHVRWD,QQRYDWLRQ
5HVHDUFK3URJUDPDPDMRUORQJLWXGLQDOVWXG\WKDWH[DPLQHGWKHSURFHVVRILQQRYDWLRQIURP
FRQFHSWWRLPSOHPHQWDWLRQRIQHZWHFKQRORJLHVSURGXFWVDQGSURFHVVHV$FFRUGLQJWRWKHLU
ILQGLQJVWKHLQQRYDWLRQMRXUQH\LVQHLWKHUVHTXHQWLDODQGRUGHUO\QRULVLWDPDWWHURIUDQGRP
WULDO DQG HUURU 5DWKHU LW LV EHVW FKDUDFWHUL]HG DV D QRQOLQHDU G\QDPLF V\VWHP 7KLV V\VWHP
FRQVLVWV RI D F\FOH RI GLYHUJHQW DQG FRQYHUJHQW DFWLYLWLHV ZKLFK ZDV IRXQG WR EH WKH
XQGHUO\LQJG\QDPLFWKDWH[SODLQHGWKHGHYHORSPHQWRIFRUSRUDWHFXOWXUHVIRULQQRYDWLRQ
6LPLODUO\ EDVHG RQ D FDVH VWXG\ RQ WKH LQWURGXFWLRQ RI LQQRYDWLYH RUJDQL]DWLRQDO
SURFHVVHV3UHVOH\HWDO  UHFRPPHQGHGDQDSSURDFKIRUSURGXFWDQGSURFHVVLQQRYDWLRQ
EDVHGRQWKH6RIW6\VWHPV0HWKRGRORJ\ &KHFNODQG 
,QWKHIROORZLQJVXEVHFWLRQVZHSUHVHQW'DYHQSRUW¶V  JHQHUDODSSURDFKWRSURFHVV
LQQRYDWLRQ DQG 3IOHHJHU¶V E  DSSURDFK WR WKH GLIIXVLRQ RI LQQRYDWLRQV LQ VRIWZDUH
HQJLQHHULQJ

'DYHQSRUW·VDSSURDFKWRSURFHVVLQQRYDWLRQ
'DYHQSRUW¶V  DSSURDFKWRSURFHVVLQQRYDWLRQFRPELQHVWKHDGRSWLRQRIDSURFHVVYLHZ
RIWKHEXVLQHVVZLWKWKHDSSOLFDWLRQRILQQRYDWLRQWRNH\SURFHVVHVLQRUGHUWRFUHDWH UDGLFDO
FKDQJH7KHSURFHVVLQQRYDWLRQDSSURDFKFRQVLVWVRIILYHPDMRUVWHSV VHH)LJXUH 

  ,GHQWLI\LQJ SURFHVVHV IRU LQQRYDWLRQ 3URFHVV LQQRYDWLRQ EHJLQV ZLWK LGHQWLI\LQJ WKH
SURFHVVHV WKDW DUH FDQGLGDWHV IRU LQQRYDWLRQ DVVHVVLQJ WKHLU VWUDWHJLF UHOHYDQFH DQG
HVWDEOLVKLQJWKHERXQGDULHVRIWKHSURFHVVHVWKDWDUHWREHDGGUHVVHG
  ,GHQWLI\LQJFKDQJHOHYHUV&KDQJHOHYHUDQDO\VLVUHOLHVRQERWKNQRZOHGJHDQGFUHDWLYH
WKLQNLQJDERXW KRZ ,7 DQG LQQRYDWLYH RUJDQL]DWLRQDOKXPDQ UHVRXUFH DSSURDFKHV PLJKW
EHDSSOLHGWR WKH SURFHVV XQGHU DQDO\VLV 7KLV UHTXLUHV NQRZOHGJH DERXW WKH ODWHVW VWDWH
DQG OLNHO\ IXWXUH FDSDELOLWLHV RI NH\ WHFKQRORJLHV RU KXPDQ HQDEOHUV RI FKDQJH DQG
NQRZOHGJH DERXW WKH ZD\V WKHVH FKDQJH HQDEOHUV KDYH EHHQ RU FRXOG EH DSSOLHG WR WKH
WDUJHWSURFHVV
  'HYHORSLQJ SURFHVV YLVLRQV 'HYHORSLQJ D ZRUWKZKLOH SURFHVV YLVLRQ UHOLHV RQ D FOHDU
XQGHUVWDQGLQJRIRUJDQL]DWLRQDOVWUHQJWKVDQGZHDNQHVVHVFRXSOHGZLWKDQXQGHUVWDQGLQJ
RI PDUNHW VWUXFWXUH DQG RSSRUWXQLW\ $OVR LW UHTXLUHV NQRZOHGJH DERXW LQQRYDWLYH
DFWLYLWLHVXQGHUWDNHQE\FRPSHWLWRUVDQGRWKHURUJDQL]DWLRQV
  8QGHUVWDQGLQJ H[LVWLQJ SURFHVVHV 8QGHUVWDQGLQJ H[LVWLQJ SURFHVVHV DUH LPSRUWDQW
EHIRUH GHVLJQLQJ D QHZ RQH ,W IDFLOLWDWHV FRPPXQLFDWLRQ DPRQJ SDUWLFLSDQWV LQ WKH
LQQRYDWLRQ LQLWLDWLYH LW KHOSV HQVXUH WKDW H[LVWLQJ SUREOHPV DUH QRW UHSHDWHG LQ WKH QHZ
SURFHVVDQGLWSURYLGHVDPHDVXUHRIWKHYDOXHRIWKHSURSRVHGLQQRYDWLRQ

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

,GHQWLI\LQJ3URFHVVHVIRU,QQRYDWLRQ

,GHQWLI\LQJ&KDQJH/HYHUV

'HYHORSLQJ3URFHVV9LVLRQV

8QGHUVWDQGLQJ([LVWLQJ3URFHVVHV

'HVLJQLQJDQG3URWRW\SLQJWKH1HZ3URFHVV

)LJXUH'DYHQSRUW¶VDSSURDFKWRSURFHVVLQQRYDWLRQ 'DYHQSRUWS 

  'HVLJQLQJDQGSURWRW\SLQJWKHQHZSURFHVV7KHGHVLJQSURFHVVEHJLQVE\EXLOGLQJRQ
WKH KLJKOHYHO SURFHVV FRQFHSW GHYHORSHG GXULQJ WKH YLVLRQLQJ VWDJH VKLIWLQJ WRZDUG D
GHWDLOHG SURFHVV GHVLJQ 3URWRW\SLQJ HQDEOHV GHVLJQ SRVVLELOLWLHV WR EH SUHVHQWHG
DSSURYHGDQGRUPRGLILHGE\ XVHUV EHIRUH WKH RUJDQL]DWLRQ KDV LQYHVWHG PXFK HIIRUW LQ
GHWDLOHGGHVLJQDQGLPSOHPHQWDWLRQ

3IOHHJHU·VDSSURDFKWRWHFKQRORJ\WUDQVIHULQVRIWZDUHHQJLQHHULQJ
0RVW LQQRYDWLRQ PRGHOV OLNH 'DYHQSRUW¶V   DSSURDFK RXWOLQHG DERYH LV RQO\ WKH ILUVW
VWHSWRZDUGIXOOVFDOHLPSOHPHQWDWLRQRIQHZSURFHVVHV7KHGLIIXVLRQDQGLPSOHPHQWDWLRQRI
LQQRYDWLRQ ZKLFK LV DOVR FDOOHG ³WHFKQRORJ\ WUDQVIHU´ LV EHVW VHHQ LQ WKH ZRUN RI 5RJHUV
 ZKRYLHZHGLQQRYDWLRQVLQWKHEURDGHUFRQWH[WRIRUJDQL]DWLRQDOFKDQJHIRFXVLQJRQ
KRZWKH\FDQEHVXFFHVVIXOO\DGRSWHG
%DVHGRQ5RJHUV¶ZRUNRQWKHGLIIXVLRQRILQQRYDWLRQV3IOHHJHU E GHILQHGDPRGHO
RI WHFKQRORJ\ WUDQVIHU LQ VRIWZDUH HQJLQHHULQJ ,Q WKLV PRGHO ³WHFKQRORJ\´ PHDQV DQ\
PHWKRG WHFKQLTXH WRRO SURFHGXUH RU SDUDGLJP XVHG LQ VRIWZDUH GHYHORSPHQW RU PDLQ
WHQDQFH

7KHWHFKQRORJ\WUDQVIHUSURFHVVFRQVLVWVRIILYHVWHSV VHH)LJXUH 

  7HFKQRORJ\FUHDWLRQ7HFKQRORJ\FUHDWLRQEHJLQVZLWKDEXVLQHVVQHHGDQGDVNVZKHWKHU
D WHFKQRORJ\ H[LVWV WKDW PLJKW DGGUHVV LW 6XFK WHFKQRORJ\ PLJKW H[LVW DQG EH LQ XVH
VRPHZKHUH HOVH LW PLJKW H[LVW EXW LV XQWULHG RQ WKLV SUREOHP RU LW PLJKW QRW H[LVW DQG
PXVWWKXVEHFUHDWHG
  7HFKQRORJ\ HYDOXDWLRQ SUHOLPLQDU\ 2QFH D FDQGLGDWH WHFKQRORJ\ LV IRXQG WKH QH[W
VWHS LV D SUHOLPLQDU\ LQYHVWLJDWLRQ WR GHWHUPLQH ZKHWKHU WKHUH LV HYLGHQFH WKDW WKH
WHFKQRORJ\ZLOOZRUNLQSUDFWLFH

±±
&+$37(5

7HFKQRORJ\ ,VWKHUHDWHFKQRORJ\WKDWPLJKWVROYHWKLVSUREOHP"
FUHDWLRQ

%XVLQHVV
RUWHFKQLFDO 7HFKQRORJ\
SUREOHP HYDOXDWLRQ ,VWKHUHHYLGHQFHWKDWLWZLOOZRUNLQSUDFWLFH"
SUHOLPLQDU\

7HFKQRORJ\ ,VWKHERG\RIHYLGHQFHFRQYLQFLQJVXIILFLHQW
HYDOXDWLRQ IRUDQ\VLWXDWLRQ"
DGYDQFHG

7HFKQRORJ\ ,VWKHWHFKQRORJ\UHDG\IRU
SDFNDJLQJDQG FRPPHUFLDOXVH"
VXSSRUW

7HFKQRORJ\
,VWKHWHFKQRORJ\EHLQJ
GLIIXVLRQ XVHGE\WKRVHZKRQHHGLW"

7HFKQRORJ\DV
VWDQGDUGSUDFWLFH

)LJXUH3IOHHJHU¶VWHFKQRORJ\WUDQVIHUSURFHVV 3IOHHJHUES 

  7HFKQRORJ\HYDOXDWLRQDGYDQFHG2QFHWKHHYLGHQFHLQGLFDWHVWKDWWKHWHFKQRORJ\KDV
ZRUNHGLQSUDFWLFHWKHQH[WVWHSLVDPRUHWKRURXJKHYDOXDWLRQRIWKHERG\RIHYLGHQFH
,VVXHVRILQWHUHVWWRWKLVVWHSLQFOXGHWKHVLWXDWLRQVLQZKLFKWKHWHFKQRORJ\ZRUNHGDQG
WKHPHWKRGRORJLFDOQDWXUHRIWKHVWXGLHV
  7HFKQRORJ\SDFNDJLQJDQGVXSSRUW,IWKHWHFKQRORJ\FRQWLQXHVWRORRNSURPLVLQJWKH
QH[WVWHSLVWRORRNDWWRROVDQGRWKHUSDFNDJLQJDQGVXSSRUWWRDLGWKHWHFKQRORJ\¶VXVH
  7HFKQRORJ\GLIIXLVRQ2QFHWKHUHLVFRQYLQFLQJHYLGHQFHRIWKHHIIHFWLYHQHVVRIWKHQHZ
WHFKQRORJ\SOXVDSSURSULDWHSDFNDJLQJDQGVXSSRUWWKHWHFKQRORJ\FDQEHWUDQVIHUUHGWR
DZLGHUDXGLHQFH

 ,QQRYDWLRQVXFFHVVIDFWRUV
5RJHUV   KDV VKRZQ WKDW WKH UDWH RI DGRSWLRQ RI DQ LQQRYDWLRQ LV GHWHUPLQHG E\ WKH
FKDUDFWHULVWLFVRIDQLQQRYDWLRQDVSHUFHLYHGE\WKHSRWHQWLDODGRSWHUDQGQRWZKHWKHULWKDV
SURGXFHGDQ\DGYDQWDJHVIRUFRPSHWLWRUV+LVUHVHDUFKKDVVKRZQWKDWWKHGLIIXVLRQRILQQR
YDWLRQVGHSHQGVRQWKHIROORZLQJILYHIDFWRUV

  5HODWLYHDGYDQWDJH±WKHGHJUHHWRZKLFKDQLQQRYDWLRQLVSHUFHLYHGDVEHLQJEHWWHUWKDQ
WKHLGHDLWVXSHUVHGHV
  &RPSDWLELOLW\ ± WKH GHJUHH WR ZKLFK DQ LQQRYDWLRQ LV SHUFHLYHG DV FRQVLVWHQW ZLWK WKH
H[LVWLQJYDOXHVSDVWH[SHULHQFHDQGQHHGVRISRWHQWLDODGRSWHUV

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

  &RPSOH[LW\ ± WKH GHJUHH WR ZKLFK DQ LQQRYDWLRQ LV SHUFHLYHG DV UHODWLYHO\ GLIILFXOW WR
XQGHUVWDQGDQGXVH
  7ULDODELOLW\±WKHGHJUHHWRZKLFKDQLQQRYDWLRQPD\EHH[SHULPHQWHGZLWKRQDOLPLWHG
EDVLV
  2EVHUYDELOLW\±WKHGHJUHHWRZKLFKWKHUHVXOWVRIDQLQQRYDWLRQDUHYLVLEOHWRRWKHUV

)XUWKHUPRUHGLIIXVLRQRILQQRYDWLRQPRGHOVHPSKDVL]HWKHLPSRUWDQFHRIKRPRSKLO\ZKLFK
5RJHUV   GHILQHG DV WKH GHJUHH WR ZKLFK WKH LQQRYDWRU DQG WKH SRWHQWLDO DGRSWHU DUH
VLPLODU LQ FHUWDLQ DWWULEXWHV VXFK DV REMHFWLYHV EHOLHIV QRUPV H[SHULHQFH DQG FXOWXUH
+HWHURSKLO\LVWKHRSSRVLWHRIKRPRSKLO\DQGDFFRUGLQJWR5RJHUV  ³RQHRIWKHPRVW
GLVWLQFWLYHSUREOHPV LQ WKH GLIIXVLRQ RI LQQRYDWLRQV LV WKDW WKH SDUWLFLSDQWV DUH XVXDOO\ TXLWH
KHWHURSKLORXV´ LELGS  LWDOLFV LQ RULJLQDO  +HQFH YLWDO GLIIHUHQFHV EHWZHHQ LQQRYDWRUV
DQGSRWHQWLDODGRSWHUVDFWDVNH\EDUULHUVWRLPLWDWLRQ 3RZHOO 
)LQDOO\ WKHUH LV DQ LQFUHDVLQJ UHFRJQLWLRQ WKDW VXFFHVVIXO LQQRYDWLRQ DQG WHFKQRORJ\
WUDQVIHU UHTXLUHV DQ RULHQWDWLRQ WRZDUG RUJDQL]DWLRQDO OHDUQLQJ DQG NQRZOHGJH FUHDWLRQ HJ
/HYLQ1RQDNDDQG7DNHXFKL 7KLVLVDOVRDVZHVKDOOVHHWKHSRVLWLRQWDNHQLQ
WKLVWKHVLVUHJDUGLQJSURFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQLQVRIWZDUHRUJDQL]DWLRQV

 3URFHVVLPSURYHPHQWYHUVXVSURFHVVLQQRYDWLRQ
7KHUH DUH LPSRUWDQW VLPLODULWLHV DV ZHOO DV GLIIHUHQFHV EHWZHHQ SURFHVV LPSURYHPHQW DQG
SURFHVVLQQRYDWLRQ7KHVHVLPLODULWLHVDQGGLIIHUHQFHVFDQEHLOOXVWUDWHGE\FRPSDULQJ 740
ZLWK%35'XULQJWKHVZHKDYHZLWQHVVHGDQLQWHQVHGHEDWHEHWZHHQWKHWZRVFKRROVRI
RUJDQL]DWLRQDOFKDQJH7DEOHVKRZVWKHPDLQGLIIHUHQFHVEHWZHHQ740 SURFHVVLPSURYH
PHQW DQG%35 SURFHVVLQQRYDWLRQ DVSRLQWHGRXWE\'DYHQSRUW  

7DEOH3URFHVVLPSURYHPHQWYHUVXVSURFHVVLQQRYDWLRQ 'DYHQSRUWS 

3URFHVV,PSURYHPHQW 3URFHVV,QQRYDWLRQ

/HYHORI&KDQJH ,QFUHPHQWDO 5DGLFDO


6WDUWLQJ3RLQW ([LVWLQJSURFHVV &OHDQVODWH
)UHTXHQF\RI&KDQJH 2QHWLPHFRQWLQXRXV 2QHWLPH
7LPH5HTXLUHG 6KRUW /RQJ
3DUWLFLSDWLRQ %RWWRPXS 7RSGRZQ
7\SLFDOVFRSH 1DUURZZLWKLQIXQFWLRQV %URDGFURVVIXQFWLRQDO
5LVN 0RGHUDWH +LJK
3ULPDU\(QDEOHU 6WDWLVWLFDOFRQWURO ,QIRUPDWLRQWHFKQRORJ\
7\SHRI&KDQJH &XOWXUDO &XOWXUDOVWUXFWXUDO

±±
&+$37(5

3URFHVV3HUIRUPDQFH
4
5

4
5 4±4XDOLW\3URJUDP
5±5HHQJLQHHULQJ
4

7LPH

)LJXUH3URFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQ +DPPHUS 

$OWKRXJKSURFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQVWUDWHJLHVDUHFOHDUO\ GLIIHUHQW WKH\


QHYHUWKHOHVV VKDUH LPSRUWDQW VLPLODULWLHV ± D IDFW WKDW WKH IRXQGHUV RI %35 KDYH DOZD\V
VWUHVVHG 'DYHQSRUW  +DPPHU DQG &KDPS\  +DPPHU   $OVR SURFHVV
LQQRYDWLRQZDVHQFRXUDJHG E\ WKH HDUO\ TXDOLW\ H[SHUWV HJ -XUDQ   %RWK DSSURDFKHV
IRFXVRQSURFHVVHVERWKVWDUWZLWKWKHFXVWRPHU¶VQHHGVDQGZRUNEDFNZDUGVIURPWKHUHDQG
ERWKUHFRJQL]HWKHLPSRUWDQFHRIWHDPZRUNDQGFXOWXUDOFKDQJH,QDVLPLODUYHLQ%URZQDQG
'XJXLG  HPSKDVL]HGDXQLILHGYLHZRIZRUNLQJOHDUQLQJDQGLQQRYDWLRQ
)LJXUHLOOXVWUDWHVKRZSURFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQILWWRJHWKHURYHU
WLPH LQ WKH OLIHF\FOH RI D SURFHVV )LUVW WKH SURFHVV LV HQKDQFHG XQWLO LWV XVHIXO OLIHWLPH LV
RYHU DW ZKLFK SRLQW LW LV UHHQJLQHHUHG 7KHQ HQKDQFHPHQW LV UHVXPHG DQG WKH HQWLUH F\FOH
VWDUWVDJDLQ +DPPHU  ,WLVLPSRUWDQWWRQRWHKHUHWKDW LPSURYHPHQW DQG LQQRYDWLRQ
DUH FRPSOHPHQWDU\ DSSURDFKHV WR 63, DQG WKDW ERWK IRUPV DUH QHFHVVDU\ IRU VRIWZDUH
RUJDQL]DWLRQV '\EnE 7KLVVLWXDWLRQZKLFKUHTXLUHVWKHPDQDJHPHQWRIERWKVWDELOLW\
DQG FKDQJH KDV DOVR EHHQ GHVFULEHG ZLWK D SXQFWXDWHG HTXLOLEULXP PRGHO 7XVKPDQ DQG
5RPDQHOOL/DQWDQG0H]LDV 
)URP WKLV SHUVSHFWLYH ZH SURSRVH D KLJKOHYHO DSSURDFK IRU 63, WKDW HQFRPSDVVHV
SURFHVV GHILQLWLRQ SURFHVV DVVHVVPHQW SURFHVV LPSURYHPHQW DQG SURFHVV LQQRYDWLRQ VHH
)LJXUH 7KHPDMRUIHDWXUHVRIWKLVDSSURDFKDUHDQDSSURSULDWHXQGHUVWDQGLQJGHILQLWLRQ
DQGVHOHFWLRQRISURFHVVHV HLWKHUIRULPSURYHPHQWRULQQRYDWLRQDFFRUGLQJWRWKHRUJDQL]D
WLRQ¶VYLVLRQDQGJRDOVZLWKIHHGEDFNEDVHGRQWKHPHDVXUHPHQWRUDVVHVVPHQWRIUHVXOWV

 &KDSWHU6XPPDU\
:H VWDUWHG WKLV FKDSWHU E\ GHVFULELQJ WKH FRQFHSWV RI VRIWZDUH SURFHVV %DVHG RQ WKHVH
FRQFHSWVZHWKHQGHVFULEHGWKUHHLQWHUYHQWLRQVWUDWHJLHVRUDSSURDFKHVWRFKDQJHWKHVRIWZDUH
SURFHVV LQ RUGHU WR EULQJ DERXW LPSURYHPHQWV LQ RUJDQL]DWLRQDO SHUIRUPDQFH )LUVW SURFHVV
DVVHVVPHQWZDVGHVFULEHGDVDQLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVDQDSSUDLVDORU UHYLHZRI
DQ RUJDQL]DWLRQ¶V VRIWZDUH SURFHVVHV ZLWKRXW FKDQJLQJ WKHP 6HFRQG ZH GHVFULEHG SURFHVV
LPSURYHPHQWDVDQLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVFRQWLQXRXVRULQFUHPHQWDOFKDQJHWRWKH
RUJDQL]DWLRQ DQG LWV SURFHVVHV )LQDOO\ ZH GHVFULEHG SURFHVV LQQRYDWLRQ DV DQ LQWHUYHQWLRQ
VWUDWHJ\WKDWLQYROYHVUDGLFDOFKDQJHWRWKHRUJDQL]DWLRQZLWKUHSODFHPHQWRILWVSURFHVVHV

±±
$3352$&+(67262)7:$5(352&(66,03529(0(17

'HILQHVWUDWHJLHV
DQGDVVXPSWLRQV

$QDO\]HGHILQH
FXUUHQWSURFHVVHV

6HOHFW
SURFHVV

1R 1HHGUDGLFDO <HV
FKDQJH"

3URFHVV 3URFHVV
LPSURYHPHQW LQQRYDWLRQ

0HDVXUHDVVHVV
SHUIRUPDQFH

)LJXUH$KLJKOHYHOSURSRVDOIRUVXFFHVVIXO63,WKDWLQWHJUDWHVSURFHVVGHILQLWLRQ
SURFHVVDVVHVVPHQWSURFHVVLPSURYHPHQWDQGSURFHVVLQQRYDWLRQ

,QWKHQH[WFKDSWHUZHWDNHDFORVHUORRNDWHPSLULFDOVRIWZDUHHQJLQHHULQJUHVHDUFKDQGWKH
PDMRUUHVHDUFKDSSURDFKHVWKDWDUHDSSOLFDEOHIRULQYHVWLJDWLRQVLQ63,)RXUFODVVHVRIVXFK
DSSURDFKHV DUH UHYLHZHG H[SHULPHQWDO UHVHDUFK VXUYH\ UHVHDUFK FDVH VWXG\ UHVHDUFK DQG
DFWLRQUHVHDUFK,QDGGLWLRQWKHFKDSWHUSUHVHQWVDFRPSDULVRQRIWKHNH\IHDWXUHVVWUHQJWKV
DQGZHDNQHVVHVRIHDFKRIWKHVHUHVHDUFKDSSURDFKHV

±±
&+$37(5 
$SSURDFKHVWR(PSLULFDO
6RIWZDUH(QJLQHHULQJ5HVHDUFK

³,EHOLHYHWKDWWKHSUHVHQWIDVKLRQRIDSSO\LQJWKHPHWKRGVRISK\VLFV
WRKXPDQOLIHLVQRWRQO\DPLVWDNHEXWKHLQRXV´
±$OEHUW(LQVWHLQ

,QWKHSUHYLRXVFKDSWHUZHGHVFULEHGWKHFRQFHSWVRIVRIWZDUHSURFHVVDQGWKUHHLQWHUYHQWLRQ
VWUDWHJLHV RU DSSURDFKHV WR 63, )LUVW SURFHVV DVVHVVPHQW ZDV GHVFULEHG DV DQ LQWHUYHQWLRQ
VWUDWHJ\WKDWLQYROYHVDQDSSUDLVDORUUHYLHZRIDQRUJDQL]DWLRQ¶VVRIWZDUHSURFHVVHVZLWKRXW
FKDQJLQJ WKHP 6HFRQG ZH GHVFULEHG SURFHVV LPSURYHPHQW DV DQ LQWHUYHQWLRQ VWUDWHJ\ WKDW
LQYROYHV FRQWLQXRXV RU LQFUHPHQWDO FKDQJH WR WKH RUJDQL]DWLRQ DQG LWV SURFHVVHV 7KLUG ZH
GHVFULEHG SURFHVV LQQRYDWLRQ DV DQ LQWHUYHQWLRQ VWUDWHJ\ WKDW LQYROYHV UDGLFDO FKDQJH WR WKH
RUJDQL]DWLRQ ZLWK UHSODFHPHQW RI LWV SURFHVVHV )LQDOO\ ZH PDGH D KLJKOHYHO SURSRVDO IRU
VXFFHVVIXO 63, WKDW LQWHJUDWHV SURFHVV GHILQLWLRQ SURFHVV DVVHVVPHQW SURFHVV LPSURYHPHQW
DQGSURFHVVLQQRYDWLRQ
)URP RXU SRLQW RI YLHZ WKHUH LV D FORVH UHODWLRQVKLS EHWZHHQ DSSURDFKHV WR 63,
VSHFLILFDOO\ WKRVH WKDW DUH EDVHG RQ WKH VFLHQWLILF PHWKRG DQG DSSURDFKHV WR HPSLULFDO
VRIWZDUHHQJLQHHULQJ KHQFHIRUWK(6( UHVHDUFK%RWKDUHFRQFHUQHGZLWKWKHLQYHVWLJDWLRQRI
VRIWZDUHSUDFWLFH DQG ERWK DUH FRQFHUQHG ZLWK LPSURYLQJ LW 7KH PDLQ GLIIHUHQFH LV WKDW WKH
63, DSSURDFKHV SULPDULO\ DUH XVHG E\ SUDFWLWLRQHUV ZKLOH WKH (6( UHVHDUFK DSSURDFKHV
SULPDULO\DUHXVHGE\UHVHDUFKHUV
,QWKLVFKDSWHUWKHUHIRUHZHWDNHDFORVHUORRNDW(6(UHVHDUFKDQGWKHPDMRUDSSURDFKHV
WKDWDUHUHOHYDQW IRU LQYHVWLJDWLRQV LQ 63, )RXU FODVVHV RI VXFK UHVHDUFK DSSURDFKHV ZLOO EH
UHYLHZHGH[SHULPHQWDOUHVHDUFKVXUYH\UHVHDUFKFDVHVWXG\UHVHDUFKDQGDFWLRQUHVHDUFK,Q
DGGLWLRQWKHFKDSWHUSUHVHQWVDFRPSDULVRQRIWKHIHDWXUHVVWUHQJWKVDQGZHDNQHVVHVRIHDFK
RIWKHVHDSSURDFKHV

±±
&+$37(5

 (PSLULFDO6RIWZDUH(QJLQHHULQJ5HVHDUFK
(6(UHVHDUFKFDQEHGHILQHGDVDQDO\VLVEDVHGRQWKHLQYHVWLJDWLRQRIDFWXDOSUDFWLFHIRUWKH
SXUSRVH RI GLVFRYHULQJ WKH XQNQRZQ RU WHVWLQJ D K\SRWKHVLV ,W LQYROYHV DQ LQYHVWLJDWRU
JDWKHULQJ GDWD DQG SHUIRUPLQJ DQDO\VLV WR GHWHUPLQH WKH PHDQLQJ RI WKH GDWD 5DWKHU WKDQ
HPSLULFDOUHVHDUFKKRZHYHUFRPSXWHUVFLHQWLVWVJHQHUDOO\WHQGWRDGKHUHWRDPRUH³DGKRF´
HYDOXDWLRQ RI WKHLU UHVHDUFK DGYRFDWLQJ DQG SXEOLVKLQJ LGHDV ZLWK OLWWOH RU QR VFLHQWLILF
DVVHVVPHQW %DVLOL)HQWRQHWDO)XJJHWWD*ODVV3RWWV7LFK\
 
7LFK\HWDO  IRUH[DPSOHPDGHDVXUYH\RIFRPSXWHUVFLHQFHUHVHDUFKSDSHUV
SXEOLVKHG E\ WKH $&0 WR LQYHVWLJDWH WKHLU ULJRU &RQVLGHULQJ WKRVH SDSHUV ZKRVH FODLPV
UHTXLUHG HPSLULFDO HYDOXDWLRQ WKH\ IRXQG WKDW  SHUFHQW RI WKHVH SDSHUV KDG QR HPSLULFDO
VXSSRUWDWDOO,QVRIWZDUHUHODWHGMRXUQDOVWKHIUDFWLRQZDVSHUFHQW)RUFRPSDULVRQLQWKH
RWKHUGLVFLSOLQHVWKDWZHUHFRQVLGHUHGWKHILJXUHZDVPHUHO\SHUFHQW
7KHVWXG\E\ =HONRZLW]DQG:DOODFH  IRXQGVLPLODUUHVXOWV ,Q WKHLU VWXG\ RI 
VRIWZDUH HQJLQHHULQJ UHVHDUFK SDSHUV SXEOLVKHG E\ WKH ,((( WKH\ IRXQG WKDW WKH PRVW
SUHYDOHQWYDOLGDWLRQPRGHOVZHUHOHVVRQVOHDUQHGDQGFDVHVWXGLHVHDFKDWDOHYHORIDERXW
SHUFHQW $ERXW D WKLUG RI WKH SDSHUV KRZHYHU KDG QR HPSLULFDO YDOLGDWLRQ )XUWKHUPRUH
=HONRZLW]DQG:DOODFH  REVHUYHGWKDWWKHDXWKRUVRIWHQIDLOHGWRVWDWHWKHLUJRDOVFOHDUO\
RUWRSRLQWRXWWKHYDOXHRIWKHLUPHWKRGVDQGWRROVWRWKHHPSLULFDOYDOLGDWLRQWKDWWKH\RIWHQ
IDLOHG WR VWDWH KRZ WKH\ YDOLGDWHG WKHLU K\SRWKHVHV DQG WKDW WKH\ RIWHQ XVHG WHUPV YHU\
ORRVHO\
(6( UHVHDUFK VHHNV WR DGGUHVV WKLV GHILFLHQF\ E\ HQFRXUDJLQJ D PRUH VFLHQWLILF DQG LQ
RXU YLHZ UHIOHFWLYH DSSURDFK WR VRIWZDUH HQJLQHHULQJ ZKLFK DOORZV XV WR LQYHVWLJDWH DQG
XQGHUVWDQGQHZWHFKQRORJLHVDQGWKHLUDSSOLFDWLRQVWRSUDFWLFH
$JURZLQJLQWHUHVWLQ(6(UHVHDUFKLVDOVRUHIOHFWHGE\WKHQXPEHURILQLWLDWLYHVGHYRWHG
VSHFLILFDOO\ WR WKH UROH RI HPSLULFDO VWXGLHV DV D PHDQV IRU LPSURYLQJ VRIWZDUH HQJLQHHULQJ
UHVHDUFKDQGSUDFWLFHHJ

x $QLQWHUQDWLRQDOUHVHDUFKQHWZRUNFDOOHG³,QWHUQDWLRQDO6RIWZDUH(QJLQHHULQJ5HVHDUFK
1HWZRUN ,6(51 ´ZKLFKZDVHVWDEOLVKHGLQ VHHZZZLHVHIKJGH,6(51 
x $Q LQWHUQDWLRQDO MRXUQDO HQWLWOHG ³(PSLULFDO 6RIWZDUH (QJLQHHULQJ $Q ,QWHUQDWLRQDO
-RXUQDO´ ZKLFK ZDV ODXQFKHG E\ .OXZHU $FDGHPLF 3XEOLVKHUV LQ  ZLWK 9LFWRU 5
%DVLOL DQG :DUUHQ +DUULVRQ DV WKH HGLWRUVLQFKLHI VHH NDSLVZZZZNDSQONDSLV&*,
%,1:25/'MRXUQDOKRPHKWP" 
x $Q LQWHUQDWLRQDO FRQIHUHQFH FDOOHG ³(PSLULFDO $VVHVVPHQW LQ 6RIWZDUH (QJLQHHULQJ
($6( ´ZKLFKZDVFUHDWHGDW.HHOH8QLYHUVLW\8.DQGKHOGIRUWKHILUVWWLPHLQ
VHHZZZNHHOHDFXNGHSWVFVHDVH 
x $ FHQWHU IRU HPSLULFDOO\ EDVHG VRIWZDUH HQJLQHHULQJ FDOOHG &H%$6( ZKLFK ZDV
RUJDQL]HGLQ VHHZZZFHEDVHRUJ 

 'LPHQVLRQVRIHPSLULFDOVRIWZDUHHQJLQHHULQJUHVHDUFK
(6(UHVHDUFKFRPHVLQVHYHUDOVKDSHVDQGVL]HV%HIRUHDVWXG\EHJLQVWKH UHVHDUFKHUPXVW
PDNHVHYHUDOGHFLVLRQV VXFK DV GHFLGLQJ WKH SXUSRVH RI WKH VWXG\ WKH PDLQ DSSURDFK WR EH

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

WDNHQ ZKHWKHU LW VKRXOG EH EDVHG RQ TXDOLWDWLYH RU TXDQWLWDWLYH PHWKRGV DQG KRZ WKH WLPH
GLPHQVLRQ VKRXOG EH WUHDWHG %\ XQGHUVWDQGLQJ WKHVH GLPHQVLRQV RI (6( UHVHDUFK WKH
VRIWZDUHUHVHDUFKHUZLOOEHEHWWHUSUHSDUHGWRPDNHGHFLVLRQVDERXWWKHFRQGXFWRIKLVRUKHU
LQYHVWLJDWLRQ

7KHSXUSRVHRIWKHVWXG\
7KHPDLQSXUSRVHRIDVWXG\FDQEHRUJDQL]HGLQWRWKUHHJURXSVEDVHGRQZKDWWKHUHVHDUFKHU
LVWU\LQJWRDFFRPSOLVK7KDWLVHLWKHUWRH[SORUHDQHZWRSLFWRGHVFULEHDSKHQRPHQRQRUWR
H[SODLQZK\VRPHWKLQJRFFXUV VHH7DEOH 

7DEOH3XUSRVHRIUHVHDUFK 1HXPDQS 

([SORUDWRU\ 'HVFULSWLYH ([SODQDWRU\

x %HFRPHIDPLOLDUZLWKWKH x 3URYLGHDGHWDLOHGKLJKO\ x 7HVWDWKHRU\¶VSUHGLFWLRQV


EDVLFIDFWVVHWWLQJDQG DFFXUDWHSLFWXUH RUSULQFLSOH
FRQFHUQV
x /RFDWHQHZGDWDWKDW x (ODERUDWHDQGHQULFKD
x &UHDWHDJHQHUDOPHQWDO FRQWUDGLFWSDVWGDWD WKHRU\¶VH[SODQDWLRQ
SLFWXUHRIFRQGLWLRQV
x &UHDWHDVHWRIFDWHJRULHV x ([WHQGDWKHRU\WRQHZ
x )RUPXODWHDQGIRFXVTXHV RUFODVVLI\W\SHV LVVXHVRUWRSLFV
WLRQVIRUIXWXUHUHVHDUFK
x &ODULI\DVHTXHQFHRIVWHSV x 6XSSRUWRUUHIXWHDQ
x *HQHUDWHQHZLGHDVFRQ RUVWDJHV H[SODQDWLRQRUSUHGLFWLRQ
MHFWXUHVRUK\SRWKHVHV
x 'RFXPHQWDFDXVDOSURFHVV x /LQNLVVXHVRUWRSLFVZLWK
x 'HWHUPLQHWKHIHDVLELOLW\ RUPHFKDQLVP DJHQHUDOSULQFLSOH
RIFRQGXFWLQJUHVHDUFK
x 5HSRUWRQWKHEDFNJURXQG x 'HWHUPLQHZKLFKRIVHYHUDO
x 'HYHORSWHFKQLTXHVIRU RUFRQWH[WRIDVLWXDWLRQ H[SODQDWLRQVLVEHVW
PHDVXULQJDQGORFDWLQJ
IXWXUHGDWD

7KHWKHRU\EXLOGLQJDQGWHVWLQJGLPHQVLRQ
7KHEXLOGLQJDQGWHVWLQJRIWKHRULHVLQ(6(UHVHDUFKFDQEHDSSURDFKHGIURPWZRGLUHFWLRQV
VHH )LJXUH   7KH LQGXFWLYH DSSURDFK EHJLQV ZLWK GHWDLOHG REVHUYDWLRQV RI WKH ZRUOG
PRYLQJ WRZDUG DEVWUDFW JHQHUDOL]DWLRQV DQG WKHRULHV DQG HYHQWXDOO\ WR WKH IRUPXODWLRQ RI
K\SRWKHVHV$QH[DPSOHRIVXFKDQLQGXFWLYHDSSURDFKWRWKHRU\EXLOGLQJLVJURXQGHGWKHRU\
6WUDXVVDQG&RUELQ 
7KH RWKHU GHGXFWLYH DSSURDFK EHJLQV ZLWK DQ DEVWUDFW ORJLFDO UHODWLRQVKLS DPRQJ
FRQFHSWVIRUPXODWHGDVDK\SRWKHVLVDQGWKHQPRYHVWRZDUGFRQFUHWHHPSLULFDOHYLGHQFHE\
WHVWLQJWKHK\SRWKHVLV 7KH HYLGHQFH FDQ HLWKHU OHDG WR D FRQILUPDWLRQ RU IDOVLILFDWLRQ RI WKH
K\SRWKHVLV DQG VXEVHTXHQWO\ WR UHILQHPHQWV WR WKH WKHRU\ 7KLV K\SRWKHWLFRGHGXFWLYH
DSSURDFK LV DW WKH KHDUW RI DOO H[SHULPHQWDO UHVHDUFK HJ :RKOLQ HW DO   ,Q SUDFWLFH
KRZHYHUPRVW(6(UHVHDUFKSURMHFWVXVHERWKDSSURDFKHVGXULQJWKHVWXG\

±±
&+$37(5

+<327+(6,6

,QGXFWLRQ 'HGXFWLRQ

&RQILUPDWLRQ
2EVHUYDWLRQV
RUIDOVLILFDWLRQ

)LJXUH,QGXFWLYHDQGGHGXFWLYHDSSURDFKHVWRUHVHDUFK

7KHTXDOLWDWLYHTXDQWLWDWLYHGLPHQVLRQ
&ORVHO\OLQNHGWRWKHWKHRU\EXLOGLQJDQGWHVWLQJGLPHQVLRQRI(6(UHVHDUFKDGLVWLQFWLRQFDQ
DOVR EH PDGH EHWZHHQ TXDOLWDWLYH DQG TXDQWLWDWLYH UHVHDUFK )RU WKH PRVW SDUW TXDOLWDWLYH
UHVHDUFK FRQVLVWV RI VWXGLHV WKDW FDQQRW EH PHDQLQJIXOO\ TXDQWLILHG 7KHVH VWXGLHV DUH
W\SLFDOO\LQGHSWKDQDO\VHVRIRQHRUD IHZREVHUYDWLRQVLQYROYLQJXQVWUXFWXUHGTXHVWLRQLQJ
RUREVHUYDWLRQRIWKHUHVSRQGHQWV2YHUYLHZVRIWKHPDQ\IDFHWVRITXDOLWDWLYHUHVHDUFKFDQEH
IRXQGLQ 'HQ]LQDQG/LQFROQ 
4XDQWLWDWLYH UHVHDUFK RQ WKH RWKHU KDQG W\SLFDOO\ XVHV ODUJHU VDPSOHV DQG LQYROYHV
VWUXFWXUHG TXHVWLRQLQJ RU REVHUYDWLRQV ZKLFK LV VXEVHTXHQWO\ QXPHULFDOO\ DQG VWDWLVWLFDOO\
DQDO\]HG $ QRWHG ³ELEOH´ RI TXDQWLWDWLYH UHVHDUFK LV &RRN DQG &DPSEHOO   ZKLOH
DSSURDFKHVWKDWDUHPRUHDSSOLFDEOHIRUWKHJHQHUDOEXVLQHVVVLWXDWLRQFDQEHIRXQGLQ &RRSHU
DQG6FKLQGOHU'DYLV 
$OWKRXJK WKHUH LV RIWHQ D KHDWHG GHEDWH EHWZHHQ WKRVH ZKR GR TXDOLWDWLYH UHVHDUFK DQG
WKRVHZKRGRTXDQWLWDWLYHUHVHDUFK 5HLFKDUGWDQG5DOOLV LWLVRXUFRQWHQWLRQWKDW(6(
UHVHDUFKHUVVKRXOGVHHNLQWHUSOD\EHWZHHQTXDOLWDWLYHDQGTXDQWLWDWLYHPHWKRGV7KHVHLVVXHV
DUHGLVFXVVHGLQPRUHGHWDLOLQ6HFWLRQDVSDUWRIWKHMXVWLILFDWLRQIRUDQGWKHDVVXPSWLRQV
EHKLQGWKHUHVHDUFKDSSURDFKXVHGLQWKLVVWXG\

7KHWLPHGLPHQVLRQ
$QRWKHUGLPHQVLRQRI(6(UHVHDUFKLVWKHWUHDWPHQWRIWLPHZKLFKEDVLFDOO\WDNHVWZRIRUPV
'DYLV 

x &URVVVHFWLRQDOUHVHDUFK ,QFURVVVHFWLRQDOUHVHDUFKGHVLJQVWKH PHDVXUHPHQWV RQ WKH


YDULDEOHVRILQWHUHVWDUHWDNHQDWRQHSRLQWLQWLPH,QHVVHQFHVXFKGHVLJQVSURYLGHWKH
UHVHDUFKHU ZLWK D VQDSVKRW RI YDULDEOHV DW RQH LQVWDQW LQ WLPH &URVVVHFWLRQDO GHVLJQV
OLPLWFDXVDOLQIHUHQFHVEHFDXVHWKHVWXG\LVFRQGXFWHGDWRQHSRLQWLQWLPHDQGWHPSRUDO
SULRULW\LVGLIILFXOWWRREWDLQ
x /RQJLWXGLQDOUHVHDUFK,QORQJLWXGLQDOUHVHDUFKGHVLJQVPHDVXUHVRIWKHVDPHVDPSOHRU
SRSXODWLRQ DUH WDNHQ UHSHDWHGO\ DW OHDVW WZLFH  WKURXJK WLPH 7\SLFDO ORQJLWXGLQDO
UHVHDUFK W\SHV LQFOXGH WLPHVHULHV DQDO\VLV SDQHO VWXGLHV DQG FRKRUW VWXGLHV 3DQHO
VWXGLHVLQYROYH WKH FROOHFWLRQ RI GDWD IURP WKH VDPH UHVSRQGHQWV RYHU D SHULRG RI WLPH
&RKRUW VWXGLHV LQYROYH WKH FROOHFWLRQ RI GDWD DERXW WKH VDPH VSHFLILF SRSXODWLRQ RYHU
WLPHEXWDQHZVDPSOHLVGUDZQIURPWKHSRSXODWLRQDWHYHU\GDWDFROOHFWLRQSRLQW

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

 )XQGDPHQWDOVRIUHVHDUFKGHVLJQ
7KHSULPDU\SXUSRVHRIDUHVHDUFKGHVLJQLVWRJXLGHWKHUHVHDUFKHUVLQWKHLUTXHVWWRDQVZHU
WKHUHVHDUFKTXHVWLRQDQGVROYHWKHSUREOHPVXQGHUVWXG\7KLVLVDFFRPSOLVKHGWKURXJKWKH
FDUHIXOFRQVWUXFWLRQRI DUHVHDUFKGHVLJQVRWKDWWKHUHVXOWVREWDLQHGDUH DVIUHHRI HUURUVDV
SRVVLEOH7KLVLVDFRPSOH[XQGHUWDNLQJEHFDXVHRIWKHQXPHURXVVRXUFHVRISRWHQWLDOHUURUV
WKDWPD\DIIHFWWKHUHVXOWVRIDQ\LQYHVWLJDWLRQ VHH6HFWLRQ 

7\SHVRIYDULDEOHV
7KHYDULDEOHVLQ(6(UHVHDUFKFDQEHFODVVLILHGLQWRRQHRIIRXUFDWHJRULHVGHSHQGLQJRQWKHLU
SUHVXPHGUHODWLRQWRWKHSKHQRPHQRQXQGHUVWXG\ 'DYLV 

x ,QGHSHQGHQWYDULDEOH7KHLQGHSHQGHQWYDULDEOHLQDVWXG\LVWKHSUHVXPHGFDXVHRIWKH
SUHVXPHGHIIHFW7KHLQGHSHQGHQWYDULDEOHLV³LQGHSHQGHQWRI´SULRUFDXVHVWKDWDFWRQLW
,W SURGXFHV D FKDQJH LQ WKH GHSHQGHQW YDULDEOH DQG LV WKH RQH RU PRUH LQ WKH FDVH RI
PXOWLYDULDWH PRGHOV  WKDW WKH UHVHDUFKHU EHOLHYHV SUHFHGHV DQG DIIHFWV WKH GHSHQGHQW
YDULDEOH
x 'HSHQGHQWYDULDEOH7KHGHSHQGHQWYDULDEOHLQDVWXG\LVWKHYDULDEOHWKDWLVWKHHIIHFWRU
RXWFRPHRIWKHLQGHSHQGHQWYDULDEOH7KHGHSHQGHQWYDULDEOH³GHSHQGVRQ´WKHFDXVH,Q
RWKHUZRUGVWKHFKDQJHVLQWKHGHSHQGHQWYDULDEOHDUHZKDWWKHUHVHDUFKHUWU\WRSUHGLFW
XQGHUVWDQGRUH[SODLQE\XVLQJWKHLQGHSHQGHQWYDULDEOH
x 0RGHUDWLQJ YDULDEOH $ PRGHUDWLQJ YDULDEOH LV RQH WKDW KDV D VWURQJ HIIHFW RQ DQ
LQGHSHQGHQWGHSHQGHQWUHODWLRQVKLS$QH[DPSOHKHUHLVDVZHGLVFXVVHGLQWKHSUHYLRXV
FKDSWHUWKHLQIOXHQFHRIFRQWH[WRQWKHSURFHVVRXWFRPHUHODWLRQVKLSLQ63, VHH)LJXUH
 
x ,QWHUYHQLQJ YDULDEOH $Q LQWHUYHQLQJ YDULDEOH LV RQH WKDW HPHUJHV DV D IXQFWLRQ RI WKH
LQGHSHQGHQW YDULDEOH RSHUDWLQJ LQ D VLWXDWLRQ DQG KHOSV WR H[SODLQ WKH LQIOXHQFH RI WKH
LQGHSHQGHQWYDULDEOHRQWKHGHSHQGHQWYDULDEOH

7\SHVRIGHVLJQV
7KHUH DUH VHYHUDO ZD\V WR FODVVLI\ (6( UHVHDUFK GHVLJQV %URDGO\ VSHDNLQJ WKH\ FDQ EH
GLYLGHG LQWR H[ SRVW IDFWR DQG H[SHULPHQWDO GHVLJQV &DPSEHOO DQG 6WDQOH\   7KH
GLVWLQFWLRQ EHWZHHQ WKHVH W\SHV LV ODUJHO\ FRQFHUQHG ZLWK WKH UHVHDUFKHUV¶ FRQWURO RYHU WKH
LQGHSHQGHQWYDULDEOHVFKRVHQLQWKHVWXG\

x ([ SRVW IDFWR GHVLJQV ,Q H[ SRVW IDFWR GHVLJQV WKH UHVHDUFKHU GRHV QRW DWWHPSW WR
PDQLSXODWH WKH LQGHSHQGHQW YDULDEOH EHFDXVH LW LV QRW PDQLSXODEOH IRU VRPH UHDVRQ RU
DQRWKHU
x ([SHULPHQWDO GHVLJQV ,Q H[SHULPHQWDO GHVLJQV WKH UHVHDUFKHU PDQLSXODWHV RU LQ VRPH
ZD\ FRQWUROV WKH LQGHSHQGHQW YDULDEOH DQG WKHQ PHDVXUHV WKH HIIHFW RQ WKH GHSHQGHQW
YDULDEOHRILQWHUHVW

$VZHVKDOOVHHLQ6HFWLRQH[SHULPHQWDOGHVLJQVFDQEHIXUWKHUGLYLGHGLQWRVHYHUDOVXE
JURXSV

±±
&+$37(5

 *HQHUDOWKUHDWVWRYDOLGLW\
9DOLGLW\KDVWRGRZLWKOLPLWLQJUHVHDUFKHUURULQRUGHUWRSURGXFHDFFXUDWHDQGXVHDEOHUHVXOWV
$IXQGDPHQWDOTXHVWLRQFRQFHUQLQJHPSLULFDOUHVHDUFKWKHUHIRUHLVKRZYDOLGWKHUHVXOWVDUH
7KHUHDUHGLIIHUHQWFODVVLILFDWLRQVFKHPHVIRUGLIIHUHQWW\SHVRIWKUHDWVWRYDOLGLW\LQHPSLULFDO
UHVHDUFK &DPSEHOO DQG 6WDQOH\   IRU H[DPSOH GHILQHG WZR W\SHV WKUHDWV WR LQWHUQDO
YDOLGLW\DQGWKUHDWVWRH[WHUQDOYDOLGLW\&RRNDQG&DPSEHOO  H[WHQGHGWKHOLVWWRIRXU
WKUHDWV WR YDOLGLW\ VWDWLVWLFDO FRQFOXVLRQ YDOLGLW\ LQWHUQDO YDOLGLW\ FRQVWUXFW YDOLGLW\ DQG
H[WHUQDOYDOLGLW\
7KHVSHFLILFWKUHDWVWRYDOLGLW\IRUWKHGLIIHUHQWUHVHDUFKDSSURDFKHVDUHGLVFXVVHGODWHULQ
WKLVFKDSWHULQWKHVHFWLRQVGHVFULELQJHDFKSDUWLFXODUDSSURDFK +HUHKRZHYHUZH JLYH DQ
RYHUYLHZRIWKHPRVWEDVLFW\SHVEDVHGRQ&DPSEHOODQG6WDQOH\¶V  FODVVLILFDWLRQ

7KUHDWVWRLQWHUQDOYDOLGLW\
,QWHUQDOYDOLGLW\LVWKHVLQHTXDQRQRIDUHVHDUFKGHVLJQDQGFDQEHGHILQHGDVWKHGHJUHHRI
FRQILGHQFHWKDWWKH UHVXOWV DUH WUXH JLYHQ WKH VWXG\ VLWXDWLRQ :LWKRXW LQWHUQDO YDOLGLW\ WKHUH
FDQEHQRFRQILGHQFHWKDWWKHUHODWLRQVKLSVLGHQWLILHGLQWKHLQYHVWLJDWLRQDUHUHDOO\MXVWLILDEOH
$ GLIILFXOW\ KRZHYHU FRPHV LQ DVVHVVLQJ LQWHUQDO YDOLGLW\ EHFDXVH LW LV QHYHU IXOO\
PHDVXUDEOH7KHUHDUHVLPSO\WRRPDQ\VRXUFHVRILQYDOLGLW\WRPHDVXUHRUHYHQLGHQWLI\LQ
WKHVRIWZDUHHQJLQHHULQJUHVHDUFKHQYLURQPHQW7KHPDMRUFODVVHVRIYDULDEOHVWKDWPD\DIIHFW
DVWXG\¶VLQWHUQDOYDOLGLW\LQFOXGH &DPSEHOODQG6WDQOH\ 

x +LVWRU\ WKH VSHFLILF HYHQWV RFFXUULQJ EHWZHHQ WKH ILUVW DQG VHFRQG PHDVXUHPHQW LQ
DGGLWLRQWRWKHH[SHULPHQWDOYDULDEOH
x 0DWXUDWLRQSURFHVVHVZLWKLQWKHUHVSRQGHQWVRSHUDWLQJDV DIXQFWLRQRIWKHSDVVDJHRI
WLPHSHUVHLQFOXGLQJJURZLQJROGHUJURZLQJKXQJULHUJURZLQJPRUHWLUHGDQGWKHOLNH
x 7HVWLQJWKHHIIHFWVRIWDNLQJDWHVWXSRQWKHVFRUHVRIDVHFRQGWHVW
x ,QVWUXPHQWDWLRQ LQ ZKLFK FKDQJHV LQ WKH FDOLEUDWLRQ RI D PHDVXULQJ LQVWUXPHQW RU
FKDQJHV LQ WKH REVHUYHUV RU VFRUHUV XVHG PD\ SURGXFH FKDQJHV LQ WKH REWDLQHG
PHDVXUHPHQWV
x 6WDWLVWLFDO UHJUHVVLRQ RSHUDWLQJ ZKHUH JURXSV KDYH EHHQ VHOHFWHG RQ WKH EDVLV RI WKHLU
H[WUHPHVFRUHV
x 6HOHFWLRQ ELDVHV UHVXOWLQJ LQ GLIIHUHQWLDO VHOHFWLRQ RI UHVSRQGHQWV IRU WKH FRPSDULVRQ
JURXSV
x 0RUWDOLW\RUGLIIHUHQWLDOORVVRIUHVSRQGHQWVIURPWKHFRPSDULVRQJURXSV
x 6HOHFWLRQPDWXUDWLRQLQWHUDFWLRQHWFZKLFKLQFHUWDLQH[SHULPHQWDOGHVLJQVPLJKWEH
PLVWDNHQIRUWKHHIIHFWRIWKHH[SHULPHQWDOYDULDEOH

7KHVHDUHE\QRPHDQVDOOWKHWKUHDWVWRLQWHUQDOYDOLGLW\ VHHHJ&RRNDQG&DPSEHOO 
EXWWKH\GRUHSUHVHQWWKHPDMRUFODVVHVRIYDULDEOHVWKDWKDYHEHHQNQRZQWRDIIHFWDVWXG\¶V
UHVXOWV

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

7KUHDWVWRH[WHUQDOYDOLGLW\
([WHUQDOYDOLGLW\FDQEHGHILQHGDVWKHGHJUHHWRZKLFKWKHVWXG\¶VUHVXOWVFDQEHJHQHUDOL]HG
DFURVV SRSXODWLRQV VHWWLQJV DQG RWKHU VLPLODU FRQGLWLRQV +RZHYHU D VWXG\ FDQQRW KDYH
H[WHUQDOYDOLGLW\ZLWKRXWHYLGHQFHRILQWHUQDOYDOLGLW\7KHPDMRUFODVVHVRIYDULDEOHVWKDWPD\
DIIHFWDVWXG\¶VH[WHUQDOYDOLGLW\LQFOXGH &DPSEHOODQG6WDQOH\ 

x 7HVWLQJ LQWHUDFWLRQ LQ ZKLFK D SUHWHVW PLJKW LQFUHDVH RU GHFUHDVH WKH UHVSRQGHQW¶V
VHQVLWLYLW\RUUHVSRQVLYHQHVVWRWKHH[SHULPHQWDOYDULDEOHPDNLQJWKHUHVXOWVREWDLQHGIRU
DSUHWHVWHGSRSXODWLRQXQUHSUHVHQWDWLYHRIWKHHIIHFWVRIWKHH[SHULPHQWDOYDULDEOH
x 6HOHFWLRQLQWHUDFWLRQLQZKLFKWKH HIIHFWWKDW WKH W\SH RI UHVSRQGHQWV KDV RQ D VWXG\¶V
UHVXOWVPD\OLPLWLWVJHQHUDOL]DELOLW\
x 6HWWLQJLQWHUDFWLRQLQZKLFKWKHDUWLILFLDOHIIHFWVWKDWDUHFUHDWHGE\WKHVSHFLILFVHWWLQJ
RIWKHVWXG\PD\QRWEHUHSOLFDWHGLQRWKHUVLWXDWLRQV
x 0XOWLSOHWUHDWPHQWLQWHUIHUHQFHZKLFKLVOLNHO\WRRFFXUZKHQHYHUPXOWLSOHWUHDWPHQWV
DUH DSSOLHG WR WKH VDPH UHVSRQGHQWV EHFDXVH WKH HIIHFWV RI SULRU WUHDWPHQWV DUH QRW
XVXDOO\HUDVDEOH

 *XLGHOLQHVIRULQFUHDVLQJYDOLGLW\
,QDQDWWHPSWWRLQFUHDVHWKHYDOLGLW\RIHPSLULFDOVRIWZDUHHQJLQHHULQJUHVHDUFK.LWFKHQKDP
HWDO IRUWKFRPLQJ KDYHRIIHUHGDVHWRISUHOLPLQDU\JXLGHOLQHVWKDWFDQEHXVHGWRLPSURYH
WKHTXDOLW\RIRQJRLQJDQGSURSRVHGHPSLULFDOVWXGLHVDQGWRHQFRXUDJHFULWLFDODVVHVVPHQWRI
H[LVWLQJVWXGLHV VHH7DEOH 
)XUWKHUPRUH JHQHUDO JXLGHOLQHV IRU FRQGXFWLQJ DQG SUHVHQWLQJ HPSLULFDO VRIWZDUH
HQJLQHHULQJ FDQ EH IRXQG LQ )HQWRQ   DQG IRU DSSO\LQJ VRIWZDUH HQJLQHHULQJ UHVHDUFK
UHVXOWVLQ 3IOHHJHU $VHWRISULQFLSOHVIRUFRQGXFWLQJDQGHYDOXDWLQJLQWHUSUHWLYHILHOG
VWXGLHV LQ LQIRUPDWLRQ V\VWHPV ,6  LV SUHVHQWHG LQ .OHLQ DQG 0\HUV   ZKLOH VSHFLILF
UHFRPPHQGDWLRQVIRULQFUHDVLQJWKHUHOHYDQFHRI ,6UHVHDUFKFDQEH IRXQGLQ %HQEDVDWDQG
=PXG   VHH 7DEOH   )LQDOO\ JXLGHOLQHV IRU UHSRUWLQJ H[SHULPHQWDO VRIWZDUH
HQJLQHHULQJ UHVXOWV EDVHG RQ WKH $PHULFDQ 3V\FKRORJLFDO $VVRFLDWLRQ¶V $3$  3XEOLFDWLRQ
0DQXDOFDQEHIRXQGLQ 6LQJHU 
7KHDGRSWLRQRIVXFKJXLGHOLQHVZLOOQRWRQO\LPSURYHWKHTXDOLW\RILQGLYLGXDOVWXGLHVLW
ZLOO DOVR LQFUHDVH WKH OLNHOLKRRG WKDW ZH FDQ XVH PHWDDQDO\VLV WR FRPELQH WKH UHVXOWV RI
UHODWHGVWXGLHV

 (PSLULFDO5HVHDUFK$SSURDFKHV
7KUHH PHWKRGV RI LQYHVWLJDWLRQ WHQG WR GRPLQDWH (6( UHVHDUFK IRUPDO RU ODERUDWRU\
H[SHULPHQWVFDVHVWXGLHVDQGVXUYH\V )HQWRQDQG3IOHHJHU.LWFKHQKDP
3IOHHJHU  :RKOLQ HW DO   ,Q WKLV VHFWLRQ ZH GHVFULEH WKH IHDWXUHV DQG
DSSOLFDELOLW\RIHDFKRIWKHVHDSSURDFKHV,QDGGLWLRQZHGHVFULEHWZRDGGLWLRQDODSSURDFKHV
WKDWZHFRQVLGHURIVSHFLILFUHOHYDQFHIRU63,ILHOGH[SHULPHQWVDQGDFWLRQUHVHDUFK

±±
&+$37(5

 ([SHULPHQWDOUHVHDUFK
$QH[SHULPHQWLVDQHPSLULFDOLQTXLU\WKDWLQYHVWLJDWHVH[SODQDWRU\UHODWLRQV,WLVHVSHFLDOO\
ZHOO VXLWHG IRU DQVZHULQJ TXHVWLRQV DERXW KRZ DQG ZK\ <LQ   ([SHULPHQWV DUH
ODXQFKHG ZKHQ WKH LQYHVWLJDWRU ZDQWV FRQWURO RYHU WKH VLWXDWLRQ ZLWK GLUHFW SUHFLVH DQG
V\VWHPDWLFPDQLSXODWLRQRIEHKDYLRU :RKOLQHWDO 
$OO H[SHULPHQWV LQYROYH DW OHDVW D WUHDWPHQW DQ RXWFRPH PHDVXUH XQLWV RI DVVLJQPHQW
DQG VRPH FRPSDULVRQ IURP ZKLFK FKDQJH FDQ EH LQIHUUHG DQG KRSHIXOO\  DWWULEXWHG WR WKH
WUHDWPHQW 5DQGRPL]HG RU WUXH  H[SHULPHQWV DUH FKDUDFWHUL]HG E\ WKH XVH RI LQLWLDO UDQGRP
DVVLJQPHQWIRULQIHUULQJWUHDWPHQWFDXVHFKDQJH4XDVLH[SHULPHQWVRQWKHRWKHUKDQG DOVR
KDYH WUHDWPHQWV RXWFRPH PHDVXUHV DQG H[SHULPHQWDO XQLWV EXW WKH\ GR QRW XVH UDQGRP
DVVLJQPHQW WR FUHDWH WKH FRPSDULVRQV IURP ZKLFK WUHDWPHQWFDXVHG FKDQJH LV LQIHUUHG
,QVWHDGWKHFRPSDULVRQVGHSHQGRQQRQHTXLYDOHQWJURXSVWKDWGLIIHUIURPHDFKRWKHULQPDQ\
ZD\V RWKHU WKDQ WKH SUHVHQFH RI D WUHDWPHQW ZKRVH HIIHFWV DUH EHLQJ WHVWHG 7KH WDVN RI
LQWHUSUHWLQJWKHUHVXOWVIURPDTXDVLH[SHULPHQWLVWKXVEDVLFDOO\RQHRIVHSDUDWLQJWKHHIIHFWV
RI D WUHDWPHQW IURP WKRVH GXH WR WKH LQLWLDO QRQFRPSDUDELOLW\ EHWZHHQ WKH DYHUDJH XQLWV LQ
HDFKWUHDWPHQWJURXSVLQFHRQO\WKHHIIHFWVRIWKHWUHDWPHQWDUHRIUHVHDUFKLQWHUHVW &RRNDQG
&DPSEHOO 
([SHULPHQWDO UHVHDUFK LV NQRZQ DV WKH VWDQGDUG PHWKRG IRU HPSLULFDO VWXG\ LQ VFLHQFHV
VXFKDVSK\VLFVFKHPLVWU\DQGELRORJ\EXWLWLVDOVRDQLPSRUWDQWSDUWRIGLVFLSOLQHVVXFKDV
PHGLFLQHDQGSV\FKRORJ\ VHHHJ$QDVWDVLDDQG8UELQD 
7KHQHHGIRUH[SHULPHQWDWLRQLQVRIWZDUHHQJLQHHULQJZDV ILUVWHPSKDVL]HGE\%DVLOLHW
DO  9LFWRU5%DVLOLKDVVLQFHWKHQEHHQRQHRIWKHPRVWSURPLQHQWH[SHULPHQWDOLVWVLQ
VRIWZDUHHQJLQHHULQJ VHH HJ%DVLOL%DVLOL DQG 6HOE\   2WKHUV KDYH DOVR
DUJXHGIRUDQH[SHULPHQWDODSSURDFKWRVRIWZDUHHQJLQHHULQJ HJ7LFK\=HONRZLW]DQG
:DOODFH 
:KLOHH[SHULPHQWVFDQKHOSZLWKLQGXFWLRQWKHLUPRVWLPSRUWDQWDSSOLFDWLRQLVLQWHVWLQJ
WKHRULHV DQG K\SRWKHVHV DFFRUGLQJ WR WKH K\SRWKHWLFRGHGXFWLYH DSSURDFK ,Q (6(
H[SHULPHQWVDUHW\SLFDOO\XVHGWRFRQILUPWKHFODLPVRIWKHRULHVRU³FRQYHQWLRQDOZLVGRP´WR
H[SORUHUHODWLRQVKLSVDPRQJGDWDSRLQWVGHVFULELQJRQHYDULDEOHRUDFURVVPXOWLSOHYDULDEOHV
WRHYDOXDWHWKHDFFXUDF\RIPRGHOVRUWRYDOLGDWHPHDVXUHV )HQWRQDQG3IOHHJHU 6LQFH
H[SHULPHQWV PXVW EH FDUHIXOO\ FRQWUROOHG WKH\ DUH RIWHQ VPDOO LQ VFDOH ³UHVHDUFKLQWKH
VPDOO´ .LWFKHQKDPHWDO 
*HQHUDOJXLGHOLQHVIRUH[SHULPHQWDOGHVLJQDQGDQDO\VLVFDQEHIRXQGLQ &DPSEHOODQG
6WDQOH\&RRN DQG &DPSEHOO   $Q LQWURGXFWLRQ WR VWDWLVWLFV IRU H[SHULPHQWHUV LV
SURYLGHG E\ %R[ HW DO   6SHFLILF JXLGHOLQHV IRU FRQGXFWLQJ VRIWZDUH HQJLQHHULQJ
H[SHULPHQWVFDQEHIRXQGLQ %DVLOLHWDO)HQWRQDQG3IOHHJHU3IOHHJHU
  )XUWKHUPRUH :RKOLQ HW DO   KDYH ZULWWHQ D SUDJPDWLF DQG VKRUW LQWURGXFWRU\
WH[WERRN RQ H[SHULPHQWDWLRQ LQ VRIWZDUH HQJLQHHULQJ 2YHUYLHZV RI SXEOLVKHG VRIWZDUH
HQJLQHHULQJH[SHULPHQWVDQGWKHLUUHVXOWVFDQEHIRXQGLQ %DVLOLHWDO=HQGOHU 

([SHULPHQWDOPRGHOV
,Q FRQWUDVW WR WKH DQDO\WLF SDUDGLJP ZKLFK %DVLOL   LOOXVWUDWHG E\ WKH PDWKHPDWLFDO
PHWKRG RI PRGHO PDQLSXODWLRQ KH GLVFXVVHG WKUHH H[SHULPHQWDO PRGHOV RU YHUVLRQV RI WKH
H[SHULPHQWDOSDUDGLJPLQVRIWZDUHHQJLQHHULQJ

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

x 7KHVFLHQWLILFPHWKRGZKLFKLVDQDSSURDFKWRPRGHOEXLOGLQJDQLQGXFWLYHSDUDGLJP
WKDWPLJKWEHVWEHXVHGZKHQWU\LQJWRXQGHUVWDQGWKHVRIWZDUHSURFHVVSURGXFWSHRSOH
RUHQYLURQPHQW,WDWWHPSWVWRH[WUDFWIURPWKHZRUOGVRPHIRUPRIPRGHOZKLFKWULHVWR
H[SODLQWKHXQGHUO\LQJSKHQRPHQDDQGE\PHDVXUHPHQWDQGDQDO\VLVHYDOXDWHZKHWKHU
WKHPRGHOLVUHSUHVHQWDWLYHIRUWKHSKHQRPHQRQEHLQJREVHUYHG
x 7KHHQJLQHHULQJPHWKRGZKLFKLVDOVRUHIHUUHGWRDVWKHHYROXWLRQDU\SDUDGLJPLVDQ
LPSURYHPHQWRULHQWHG DSSURDFK WKDW DVVXPHV WKDW ZH DOUHDG\ KDYH PRGHOV RI WKH
VRIWZDUH SURFHVV SURGXFW SHRSOH DQG HQYLURQPHQW %DVHG RQ REVHUYDWLRQV RI WKHVH
PRGHOVEHWWHUVROXWLRQVDUHVXJJHVWHGGHYHORSHGDQGWHVWHGLQDQLWHUDWLYHPDQQHUXQWLO
QR PRUH LPSURYHPHQWV VHHP SRVVLEOH 7KLV LV VLPLODU WR WKH LPSURYHPHQW DSSURDFK
GHVFULEHGLQWKHSUHYLRXVFKDSWHU
x 7KH HPSLULFDO PHWKRG ZKLFK LV DOVR UHIHUUHG WR DV WKH UHYROXWLRQDU\ SDUDGLJP LV DQ
LPSURYHPHQWRULHQWHG DSSURDFK WKDW EHJLQV E\ SURSRVLQJ D QHZ PRGHO QRW QHFHVVDULO\
EDVHGXSRQDQH[LVWLQJPRGHODQGDWWHPSWVWRVWXG\WKHHIIHFWVRIWKHSURFHVVRUSURGXFW
VXJJHVWHG E\ WKH PRGHO 6LPLODU WR WKH LQQRYDWLRQ DSSURDFK GHVFULEHG LQ WKH SUHYLRXV
FKDSWHU REVHUYDWLRQV RU FXUUHQW VROXWLRQV DUH QRW WKH EDVLV IRU WKH PRGHO SURSRVDO
:RKOLQHWDO¶V  PRGHORIWKHH[SHULPHQWDOSURFHVVZKLFKEXLOGVRQ%DVLOLHWDO¶V
  IUDPHZRUN IRU H[SHULPHQWDWLRQ LQ VRIWZDUH HQJLQHHULQJ LV DQ H[DPSOH RI WKH
HPSLULFDOPHWKRG

&RPPRQWRWKHVHPRGHOVLVWKDWWKH\DUHJXLGHGE\VRPHUDWLRQDOIRUFROOHFWLQJGDWDRQHLWKHU
WKH VRIWZDUH SURFHVV RU WKH UHVXOWLQJ SURGXFW 7KDW LV WKH\ UHTXLUH DQ H[SHULPHQWDO GHVLJQ
REVHUYDWLRQGDWDFROOHFWLRQDQGYDOLGDWLRQRQWKHSURFHVVRUSURGXFWEHLQJVWXGLHG

([SHULPHQWDOGHVLJQV
7KHUHDUHWKUHHJHQHUDOSULQFLSOHVWKDWJXLGHH[SHULPHQWDOGHVLJQV )HQWRQDQG3IOHHJHU
:RKOLQHWDO 

x 5DQGRPL]DWLRQ 5DQGRPL]DWLRQ LV WKH UDQGRP DVVLJQPHQW RI VXEMHFWV WR JURXSV RU RI
WUHDWPHQWVWRH[SHULPHQWDOXQLWVVRWKDWLQGHSHQGHQFH DQGWKXV YDOLGLW\  RI UHVXOWV FDQ
EHDVVXPHG7KLV LV RQH RI WKH PRVW LPSRUWDQW H[SHULPHQWDO GHVLJQ SULQFLSOHV VLQFH DOO
VWDWLVWLFDO PHWKRGV XVHG IRU DQDO\]LQJ WKH GDWD UHTXLUH WKDW WKH REVHUYDWLRQV DUH IURP
LQGHSHQGHQWUDQGRPYDULDEOHV%\UDQGRPO\ DVVLJQLQJWUHDWPHQWVWR H[SHULPHQWDO XQLWV
WUHDWPHQW UHVXOWV ZLOO EH OHVV OLNHO\ WR EH ELDVHG E\ VRXUFHV RI YDULDWLRQ RXWVLGH WKH
FRQWURORIWKHH[SHULPHQW
x %ORFNLQJ %ORFNLQJ LV WKH DOORFDWLRQ RI H[SHULPHQWDO XQLWV WR EORFNV RU JURXSV VR WKH
XQLWV ZLWKLQ D EORFN DUH UHODWLYHO\ KRPRJHQHRXV 7KH EORFNV DUH GHVLJQHG VR WKDW WKH
SUHGLFWDEOH YDULDWLRQ DPRQJ XQLWV KDV EHHQ FRQIRXQGHG ZLWK WKH HIIHFWV RI WKH EORFNV
7KDW LV WKH H[SHULPHQWDO GHVLJQ FDSWXUHV WKH DQWLFLSDWHG YDULDWLRQ LQ WKH EORFNV E\
JURXSLQJOLNHYDULHWLHVVRWKDWWKHYDULDWLRQGRHVQRWFRQWULEXWHWRWKHH[SHULPHQWDOHUURU
,QWKLVZD\ZHLQFUHDVHWKHSUHFLVLRQRIWKHH[SHULPHQW
x %DODQFLQJ %DODQFLQJ LV WKH EORFNLQJ DQG DVVLJQPHQW RI WUHDWPHQWV VR WKDW DQ HTXDO
QXPEHU RI VXEMHFWV LV DVVLJQHG WR HDFK WUHDWPHQW ZKHUHYHU SRVVLEOH %DODQFLQJ LV

±±
&+$37(5

GHVLUDEOHEHFDXVHLWVLPSOLILHVWKHVWDWLVWLFDODQDO\VLVRIWKHGDWDEXWLWLVQRWQHFHVVDU\
([SHULPHQWDOGHVLJQVFDQUDQJHIURPFRPSOHWHO\EDODQFHGWROLWWOHRUQREDODQFH

,QH[SHULPHQWVLQYHVWLJDWLQJRQO\RQHIDFWRUEORFNLQJDQGEDODQFLQJSOD\LPSRUWDQWUROHV,I
WKHGHVLJQLQFOXGHVQREORFNVWKHQLWPXVWEHFRPSOHWHO\UDQGRPL]HG,IRQHEORFNLQJIDFWRU
LV XVHG VXEMHFWV DUH GLYLGHG LQWR EORFNV DQG WKHQ UDQGRPO\ DVVLJQHG WR HDFK WUHDWPHQW ,Q
VXFK UDQGRPL]HG EORFN GHVLJQV EDODQFLQJ LV HVVHQWLDO IRU DQDO\VLV DQG WKH\ DUH WKHUHIRUH
RIWHQUHIHUUHGWRDVFRPSOHWHEDODQFHGEORFNGHVLJQV,IXQLWVDUHEORFNHGZLWKUHVSHFWWRWZR
GLIIHUHQWYDULDEOHVDQGWKHQDVVLJQHGDWUDQGRPWRWUHDWPHQWVVRWKDWHDFKEORFNLQJYDULDEOH
FRPELQDWLRQ LV DVVLJQHG WR HDFK WUHDWPHQW DQ HTXDO QXPEHU RI WLPHV WKHQ EDODQFLQJ LV
PDQGDWRU\IRUFRUUHFWDQDO\VLV6XFKGHVLJQVDUHFDOOHG/DWLQ6TXDUHGHVLJQV
+RZHYHU DOO H[SHULPHQWDO GHVLJQV FDQ EH VHHQ DV YDULDWLRQV RI WKH FODVVLF SUHWHVW
SRVWWHVWFRQWUROJURXSGHVLJQ7KLVGHVLJQKDVUDQGRPDVVLJQPHQWDSUHWHVWDQGDSRVWWHVWDQ
H[SHULPHQWDO JURXS DQG D FRQWURO JURXS 8VLQJ &DPSEHOO DQG 6WDQOH\¶V   QRWDWLRQDO
V\VWHPWKHGHVLJQFDQEHUHSUHVHQWHGDV

5 2 ; 2
5 2 2 

ZKHUH 2 UHIHUV WR D PHDVXUHPHQW RU REVHUYDWLRQ RI WKH GHSHQGHQW YDULDEOH EHLQJ WDNHQ RQ
VRPHLQGLYLGXDOJURXSRUREMHFW;UHSUHVHQWVWKHH[SRVXUHRIDWHVWJURXSWRDQH[SHULPHQWDO
WUHDWPHQW LQGHSHQGHQW YDULDEOH  VXFK DV WKH LQWURGXFWLRQ RI D QHZ PHWKRG WRRO RU
WHFKQLTXH5PHDQVWKDWLQGLYLGXDOVRUJURXSVKDYHEHHQVHOHFWHGDQGDVVLJQHGDWUDQGRPIRU
WKHVWXG\¶VSXUSRVHV
$ VLPSOLILHG YHUVLRQ RI WKH SUHWHVWSRVWWHVW FRQWURO JURXS GHVLJQ LV WKH SRVWWHVWRQO\
FRQWUROJURXSGHVLJQZKLFKFDQEHUHSUHVHQWHGDV

5 ; 2
5 2 

7KLVGHVLJQLVXVHIXOLQVLWXDWLRQVLQZKLFKSUHWHVWVDUHXQDYDLODEOHLQFRQYHQLHQWRUOLNHO\WR
EHUHDFWLYH7KHSULPDU\VWUHQJWKRIWKLVGHVLJQLVHQVXUHGE\WKHUDQGRPL]DWLRQRIJURXSV$
WKLUG EXW OHVV XVHG H[SHULPHQWDO GHVLJQ LV WKH 6RORPRQ IRXUJURXS GHVLJQ ZKLFK LV D
FRPELQDWLRQRIGHVLJQ  DQG  GHVFULEHGDERYH

7\SHVRIH[SHULPHQWV
6HYHUDOWD[RQRPLHVKDYHEHHQSURSRVHGWRFODVVLI\VRIWZDUHH[SHULPHQWV%DVLOLHWDO  
IRUH[DPSOHFKDUDFWHUL]HGH[SHULPHQWVE\WKHQXPEHURIGLIIHUHQWSURMHFWVDQDO\]HGDQGWKH
QXPEHU RI WHDPV UHSOLFDWLQJ HDFK SURMHFW 7KLV FODVVLILFDWLRQ UHVXOWHG LQ IRXU FODVVHV RI
H[SHULPHQWV VLQJOH SURMHFW UHSOLFDWHG SURMHFW PXOWLSURMHFW YDULDWLRQ DQG EORFNHG VXEMHFW
SURMHFW%ORFNHGVXEMHFWSURMHFWDQGUHSOLFDWHGSURMHFWH[SHULPHQWVUHSUHVHQWZKDW&DPSEHOO
DQG6WDQOH\  FDOOHGWUXHH[SHULPHQWDOGHVLJQVZKLOHPXOWLSURMHFWYDULDWLRQDQGVLQJOH
SURMHFWH[SHULPHQWVUHSUHVHQWTXDVLH[SHULPHQWDORUSUHH[SHULPHQWDOGHVLJQV

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

.LWFKHQKDP  GLIIHUHQWLDWHGEHWZHHQTXDOLWDWLYHDQGTXDQWLWDWLYHH[SHULPHQWV


ZKLOH =HONRZLW] DQG :DOODFH   GHILQHG IRXU W\SHV RI H[SHULPHQWV UHSOLFDWHG
H[SHULPHQWV\QWKHWLFHQYLURQPHQWH[SHULPHQWVG\QDPLFDQDO\VLVDQGVLPXODWLRQ
)RURXUSXUSRVHVKRZHYHUZHILQGLWPRUHXVHIXOWRGLIIHUHQWLDWHEHWZHHQWKHGHJUHHRI
UHDOLVPLQWKHUHVHDUFKVHWWLQJ %DVLOL*DOOLHUV 

x /DERUDWRU\ H[SHULPHQWV ± DOVR FDOOHG LQ YLWUR H[SHULPHQWV 7KH NH\ IHDWXUH RI
ODERUDWRU\H[SHULPHQWVLVWKHLGHQWLILFDWLRQRIWKHSUHFLVHUHODWLRQVKLSVEHWZHHQYDULDEOHV
LQDQLVRODWHG FRQWUROOHG VHWWLQJ XVLQJ TXDQWLWDWLYH DQDO\WLFDO WHFKQLTXHV 7KH LGHD LV WR
PDNHJHQHUDOL]DEOHVWDWHPHQWVIURPWKHODERUDWRU\DSSOLFDEOHWRUHDOZRUOGVLWXDWLRQV
7KH SULPDU\ VWUHQJWK RI WKH ODERUDWRU\ H[SHULPHQW LV WKDW WKH UHVHDUFKHU KDV DOPRVW
FRPSOHWHFRQWURORIWKHVWXG\VLWXDWLRQ+RZHYHUWKHDUWLILFLDOLW\RIWKHUHVHDUFKVHWWLQJ
PD\DFWXDOO\JHQHUDWHFKDQJHVLQWKHGHSHQGHQWYDULDEOHWKDWPLJKWQRWKDSSHQLQWKHUHDO
ZRUOG $OVR WKH DUWLILFLDOLW\ RI WKH H[SHULPHQWDO SURFHVV PD\ DFWXDOO\ FKDQJH WKH
EHKDYLRU RI WKH VXEMHFWV LQ WKH H[SHULPHQW 'DYLV   $ IDPRXV H[DPSOH LV WKH
+DZWKRUQH6WXGLHVZKHUHLWKDVEHHQDUJXHGWKDWLWZDVWKHH[SHULPHQWDWLRQSURFHGXUHV
WKHPVHOYHVWKDWFKDQJHGWKHEHKDYLRURIWKHZRUNHUV &DUH\ 
x )LHOGH[SHULPHQWV±DOVRFDOOHGLQYLYRH[SHULPHQWV)LHOGH[SHULPHQWVDUHDQH[WHQVLRQ
RIODERUDWRU\ H[SHULPHQWV LQWRWKH UHDO ZRUOG RI RUJDQL]DWLRQV WKH\ DUH UXQ LQ WKH ILHOG
XQGHU QRUPDO FRQGLWLRQV 7KH LGHD LV WR FRQVWUXFW DQ H[SHULPHQW LQ D PRUH UHDOLVWLF
HQYLURQPHQWWKDQLVSRVVLEOHLQWKHDUWLILFLDOVDQLWL]HGODERUDWRU\VLWXDWLRQ
7KHSULPDU\VWUHQJWKVRIDILHOGH[SHULPHQWDUHWKDW  WKHVWXG\VLWXDWLRQLVXVXDOO\
KLJKO\ UHDOLVWLF DOORZLQJ WKH HIIHFWV RI WKH LQGHSHQGHQW YDULDEOHV WR EH DFFXUDWHO\
DVVHVVHGDQG  FRPSDUHGZLWKH[SRVWIDFWRUHVHDUFKDVWURQJHULQIHUHQFHFDQEHPDGH
DERXW WKH UHODWLRQVKLS EHWZHHQ WKH YDULDEOHV XQGHU VWXG\ +RZHYHU WKH UHDOLVWLF
HQYLURQPHQW FDQ DOVR EH D ZHDNQHVV EHFDXVH LW PD\ EH WRR FRVWO\ RU LPSRVVLEOH WR
PDQLSXODWHDQLQGHSHQGHQWYDULDEOHRUWRUDQGRPL]HWUHDWPHQWVLQUHDOOLIH

7KH (XURSHDQ &RPPLVVLRQ VSRQVRUHG PRUH WKDQ  63, ILHOG H[SHULPHQWV WKURXJK WKH
(XURSHDQ 6\VWHPV DQG 6RIWZDUH ,QLWLDWLYH (66,  GXULQJ WKH V ZKLFK LV SUREDEO\ WKH
VLQJOHODUJHVW63,HIIRUWXQGHUWDNHQDQ\ZKHUH$UHYLHZRIUHVXOWVIURPWKHVHH[SHULPHQWVFDQ
EHIRXQGLQ &RQVROLQLDQG)RQDGH ZKLOHDOLEUDU\RIDFWXDOUHVXOWVLVFRQWDLQHGLQWKH
9$6,(/LEUDU\ VHHZZZHVLHV9$6,( 

7KUHDWVWRH[SHULPHQWDOYDOLGLW\
)RXU FULWHULD DUH FRPPRQO\ XVHG WR MXGJH WKH TXDOLW\ RI H[SHULPHQWDO GHVLJQV &RRN DQG
&DPSEHOO 

x 6WDWLVWLFDOFRQFOXVLRQYDOLGLW\ZKLFKLVFRQFHUQHGZLWKLVVXHVWKDWDIIHFW WKH DELOLW\ WR


GUDZWKHFRUUHFWVWDWLVWLFDOFRQFOXVLRQDERXWUHODWLRQVKLSVEHWZHHQWKHWUHDWPHQWDQGWKH
RXWFRPHRIDQH[SHULPHQW7KUHDWVWRVWDWLVWLFDOFRQFOXVLRQYDOLGLW\LQFOXGHORZVWDWLVWLFDO
SRZHUYLRODWHG DVVXPSWLRQV RI VWDWLVWLFDO WHVWV WKH HUURU UDWH SUREOHP WKH UHOLDELOLW\ RI
PHDVXUHV WKH UHOLDELOLW\ RI WUHDWPHQW LPSOHPHQWDWLRQ UDQGRP LUUHOHYDQFLHV LQ WKH
H[SHULPHQWDOVHWWLQJDQGUDQGRPKHWHURJHQHLW\RIUHVSRQGHQWV VHH  LQ)LJXUH 

±±
&+$37(5

([SHULPHQWREMHFWLYH

7KHRU\

&DXVHHIIHFWFRQVWUXFW
&DXVH (IIHFW
FRQVWUXFW  FRQVWUXFW

2EVHUYDWLRQ  

7UHDWPHQWRXWFRPH
FRQVWUXFW
7UHDWPHQW 2XWFRPH
 
,QGHSHQGHQWYDULDEOH 'HSHQGHQWYDULDEOH
([SHULPHQWRSHUDWLRQ

)LJXUH7KUHDWVWRH[SHULPHQWDOYDOLGLW\ :RKOLQHWDOS 

x ,QWHUQDO YDOLGLW\ ZKLFK LV FRQFHUQHG ZLWK LQIOXHQFHV WKDW FDQ DIIHFW WKH LQGHSHQGHQW
YDULDEOH ZLWK UHVSHFW WR FDXVDOLW\ ZLWKRXW WKH UHVHDUFKHU¶V NQRZOHGJH 7KH LQWHUQDO
YDOLGLW\WKUHDWVDUHVRPHWLPHVVRUWHGLQWRWKUHHFDWHJRULHVVLQJOHJURXSWKUHDWVPXOWLSOH
JURXSWKUHDWVDQGVRFLDOWKUHDWV VHH  LQ)LJXUH 
x &RQVWUXFWYDOLGLW\ZKLFKLVFRQFHUQHGZLWKJHQHUDOL]LQJWKHUHVXOWVRIWKHH[SHULPHQWWR
WKH FRQFHSW RU WKHRU\ EHKLQG WKH H[SHULPHQW 7KUHDWV WR FRQVWUXFW YDOLGLW\ LQFOXGH
LQDGHTXDWH SUHRSHUDWLRQDO H[SOLFDWLRQ RI FRQVWUXFWV PRQRRSHUDWLRQ DQG PRQRPHWKRG
ELDV K\SRWKHVLV JXHVVLQJ ZLWKLQ H[SHULPHQWDO FRQGLWLRQV HYDOXDWLRQ DSSUHKHQVLRQ
H[SHULPHQWHUH[SHFWDQFLHVFRQIRXQGLQJFRQVWUXFWVDQGOHYHOVRIFRQVWUXFWVLQWHUDFWLRQRI
GLIIHUHQW WUHDWPHQWV LQWHUDFWLRQ RI WHVWLQJ DQG WUHDWPHQW DQG UHVWULFWHG JHQHUDOL]DELOLW\
DFURVVFRQVWUXFWV VHH  LQ)LJXUH 
x ([WHUQDOYDOLGLW\ZKLFKLVFRQFHUQHGZLWKFRQGLWLRQVWKDWOLPLWWKHUHVHDUFKHU¶VDELOLW\
WR JHQHUDOL]H WKH UHVXOWV RI WKH H[SHULPHQW WR LQGXVWULDO SUDFWLFH 7KUHDWV WR H[WHUQDO
YDOLGLW\ LQFOXGH LQWHUDFWLRQ RI VHOHFWLRQ DQG WUHDWPHQW LQWHUDFWLRQ RI VHWWLQJ DQG
WUHDWPHQWDQGLQWHUDFWLRQRIKLVWRU\DQGWUHDWPHQW VHH  LQ)LJXUH 

7KHUH DUH SRWHQWLDO FRQIOLFWV EHWZHHQ VRPH RI WKH W\SHV RI WKUHDWV WR YDOLGLW\ LQ DQ
H[SHULPHQWDO GHVLJQ 3ULRULWL]LQJ DPRQJ WKHP LV WKHUHIRUH DQ RSWLPL]DWLRQ SUREOHP JLYHQ
WKHSXUSRVHRIWKHH[SHULPHQW&RPSDUHGZLWKODERUDWRU\H[SHULPHQWVILHOGH[SHULPHQWVDUH
JHQHUDOO\ZHDNHULQWHUPVRIFRQWURORIH[WUDQHRXVYDULDEOHVWKDWFDQWKUHDWHQYDOLGLW\$OVR
WKHGLIIHUHQWVXEW\SHVRIH[SHULPHQWDOGHVLJQVIRFXVRQGLIIHUHQWWKUHDWVWRYDOLGLW\

 6XUYH\UHVHDUFK
$VXUYH\LVDUHWURVSHFWLYHVWXG\RIDVLWXDWLRQWKDWLQYHVWLJDWHVUHODWLRQVKLSVDQGRXWFRPHV,W
LV XVHIXO IRU VWXG\LQJ D ODUJH QXPEHU RI YDULDEOHV XVLQJ D ODUJH VDPSOH VL]H DQG ULJRURXV
VWDWLVWLFDODQDO\VLV %\FRPELQLQJWKHDGYDQWDJHVRI H[SHULPHQWV UHSOLFDWLRQ WKDW PLQLPL]HV

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

WKH SUREOHPV RI XQXVXDO UHVXOWV  ZLWK WKRVH RI FDVH VWXGLHV DSSOLFDELOLW\ WR UHDOZRUOG
SURMHFWV DVXUYH\LVDSDUWLFXODUO\XVHIXOHPSLULFDOVWUDWHJ\ )HQWRQDQG3IOHHJHU 
6XUYH\VFRQGXFWHGIRUUHVHDUFKSXUSRVHVKDYHWKUHHGLVWLQFWFKDUDFWHULVWLFV 3LQVRQQHDXOW
DQG.UDHPHU )LUVWWKHSXUSRVHRIWKHVXUYH\LVWRSURGXFHTXDQWLWDWLYHGHVFULSWLRQVRI
VRPHDVSHFWVRIWKHVWXGLHGSRSXODWLRQ6HFRQGWKHPDLQZD\RIFROOHFWLQJGDWDLVE\DVNLQJ
SHRSOHVWUXFWXUHGDQGSUHGHILQHGTXHVWLRQV7KLUGGDWDLVJHQHUDOO\FROOHFWHGDERXWDIUDFWLRQ
RIDVWXG\SRSXODWLRQ±DVDPSOH±EXWLWLVFROOHFWHGLQVXFKDZD\DVWREHDEOHWRJHQHUDOL]H
WKH ILQGLQJV WR WKH SRSXODWLRQ 8VXDOO\ WKH VDPSOH LV ODUJH HQRXJK WR DOORZ H[WHQVLYH
VWDWLVWLFDODQDO\VLV
6XUYH\V DUH HVSHFLDOO\ ZHOO VXLWHG IRU DQVZHULQJ TXHVWLRQV DERXW ZKDW KRZ PXFK DQG
KRZPDQ\DVZHOODVTXHVWLRQVDERXWKRZDQGZK\ 3LQVRQQHDXOWDQG.UDHPHU 7KH\
DUH XVHG ZKHQ FRQWURO RI WKH LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV LV QRW SRVVLEOH RU QRW
GHVLUDEOHZKHQWKHSKHQRPHQDRILQWHUHVWPXVWEHVWXGLHGLQWKHLUQDWXUDOVHWWLQJDQGZKHQ
WKHSKHQRPHQDRILQWHUHVWRFFXULQFXUUHQWWLPHRUWKHUHFHQWSDVW
6XUYH\UHVHDUFKLVDVWDQGDUGPHWKRGRIHPSLULFDOVWXG\LQGLVFLSOLQHVVXFKDVPDUNHWLQJ
PHGLFLQHSV\FKRORJ\DQGVRFLRORJ\7KHUHLVDOVRDORQJWUDGLWLRQIRUWKHXVHRIVXUYH\VDV
DQLQWHUYHQWLRQVWUDWHJ\IRURUJDQL]DWLRQDOFKDQJH HJ%DXPJDUWHO1HII.UDXW
 ,Q(6(VXUYH\VXVXDOO\SROODVHWRIGDWDIURPDQHYHQWWKDWKDVRFFXUUHGWRGHWHUPLQH
KRZWKHSRSXODWLRQUHDFWHGWRDSDUWLFXODUPHWKRGWRRORUWHFKQLTXHRUWRGHWHUPLQHWUHQGV
RUUHODWLRQVKLSV7KH\WU\WRFDSWXUHZKDWLVKDSSHQLQJEURDGO\RYHUODUJHJURXSVRISURMHFWV
³UHVHDUFKLQWKHODUJH´ .LWFKHQKDPHWDO 7KHPRVWFRPPRQIRUPVRI(6(VXUYH\V
DUHEDVHGRQGLVWULEXWLQJTXHVWLRQQDLUHVWRHOLFLWRSLQLRQVDERXWWKHEHQHILWVRIWHFKQRORJ\RU
WRDVVHVVWKHHIIHFWVRISURFHVVFKDQJHVWKURXJKRXWDQRUJDQL]DWLRQ
7RJHWKHU ZLWK H[SHULPHQWDO UHVHDUFK VXUYH\ UHVHDUFK LV D WUDGLWLRQDO ³KDUGVFLHQFH´
DSSURDFKWKDWLVVXSSRUWHGE\DULFKOLWHUDWXUHGHVFULELQJKRZWRGHVLJQDQGDGPLQLVWHULW$
JHQHUDO UHYLHZ RI VXUYH\ UHVHDUFK IURP WKH YDQWDJH SRLQW RI SV\FKRORJ\ LV SURYLGHG E\
.URVQLFN   *HQHUDO LQWURGXFWLRQV DQG JXLGHOLQHV IRU VXUYH\ UHVHDUFK FDQ EH IRXQG LQ
'DYLV  )LQN DQG .RVHFRII  1HXPDQ   ZKLOH DQ DVVHVVPHQW RI VXUYH\
UHVHDUFK LQ PDQDJHPHQW LQIRUPDWLRQ V\VWHPV FDQ EH IRXQG LQ 3LQVRQQHDXOW DQG .UDHPHU
 'HWDLOVUHJDUGLQJLQVWUXPHQWGHVLJQDQGVFDOHGHYHORSPHQWLVJLYHQLQ &DUPLQHVDQG
=HOOHU'H9HOOLV6SHFWRU $QH[DPSOHRIWKHFRQVWUXFWLRQRIDQLQVWUXPHQW
IRU(6(VXUYH\UHVHDUFKFDQEHIRXQGLQ&KDSWHUDQGDOVRLQ '\EnD 

6XUYH\GHVLJQV
6XUYH\ GHVLJQV PD\ EH GLVWLQJXLVKHG DV FURVVVHFWLRQDO RU ORQJLWXGLQDO GHSHQGLQJ XSRQ
ZKHWKHU WKH\ H[FOXGH RU LQFOXGH H[SOLFLW DWWHQWLRQ WR WKH WLPH GLPHQVLRQ 3LQVRQQHDXOW DQG
.UDHPHU 

x &URVVVHFWLRQDOGHVLJQ$FURVVVHFWLRQDOGHVLJQLVXVHGZKHQWKHUHVHDUFKHU¶VDLPLVWR
GHVFULEHDSRSXODWLRQRUGRFXPHQWDQGWHVWGLIIHUHQFHVLQVXEVHWVRIWKHSRSXODWLRQDWRQH
SRLQWLQWLPH7KHFODVVLFFURVVVHFWLRQDOVXUYH\GHVLJQFROOHFWVGDWDDWRQHSRLQWLQWLPH
IURPDVDPSOHVHOHFWHGWRUHSUHVHQWWKHSRSXODWLRQRILQWHUHVWDWWKDWWLPH
x /RQJLWXGLQDO GHVLJQ $ ORQJLWXGLQDO GHVLJQ LV XVHG ZKHQ WKH TXHVWLRQ RU SUREOHP RI
LQWHUHVW LV WKH H[DPLQDWLRQ RI D G\QDPLF SURFHVV WKDW LQYROYHV FKDQJH RYHU WLPH DQG
XQGHUVWDQGLQJ RI WKH VRXUFHV DQG FRQVHTXHQFHV RI D SKHQRPHQRQ 7KH FODVVLF

±±
&+$37(5

ORQJLWXGLQDO VXUYH\ GHVLJQ FROOHFWV GDWD IRU DW OHDVW WZR SRLQWV LQ WLPH 7KH XQGHUO\LQJ
SULQFLSOH RI ORQJLWXGLQDO GHVLJQV OLNH WKDW RI WKH RQHJURXS SUHWHVWSRVWWHVW GHVLJQ
&DPSEHOODQG6WDQOH\ LVWRPHDVXUHVRPHGLPHQVLRQVRILQWHUHVWRIDJLYHQHQWLW\
EHIRUHDQGDIWHUDQLQWHUYHQLQJSKHQRPHQRQWRGHWHUPLQHZKHWKHURUQRWWKHSKHQRPHQRQ
KDVVRPHHIIHFWV

$QRWKHUFULWLFDOLVVXHLQVXUYH\UHVHDUFKGHVLJQLVGHWHUPLQLQJWKHXQLW V RIDQDO\VLV,WPD\
EH DQ LQGLYLGXDO JURXS GHSDUWPHQW RU RUJDQL]DWLRQ RU LW PD\ EH DQ DSSOLFDWLRQ V\VWHP
VRIWZDUHSURMHFWRUDQ\RIWKHSURFHVVHVRIDVRIWZDUHSURMHFW7KHUHFDQDOVREHPRUHWKDQ
RQHXQLWRIDQDO\VLVLQDVXUYH\7KHSRLQWLVWKDWWKHFKRVHQXQLWUHODWHVWRWKHTXHVWLRQVDQG
K\SRWKHVHVLQWKHUHVHDUFK
<HWDQRWKHULVVXHLVGDWDFROOHFWLRQZKLFK FDQEH HLWKHUSDVVLYHRUDFWLYH3DVVLYH GDWD
FROOHFWLRQ LQYROYHV WKH REVHUYDWLRQ RI FKDUDFWHULVWLFV E\ KXPDQ RU FRPSXWHUL]HG PHDQV RI
WKHHOHPHQWVXQGHUVWXG\$FWLYHGDWDFROOHFWLRQRQWKHRWKHUKDQGLQYROYHVWKHTXHU\LQJRI
UHVSRQGHQWVE\SHUVRQDORUQRQSHUVRQDOPHDQVXVLQJVXFKPHWKRGVDVSHUVRQDOLQWHUYLHZLQJ
RUPDLOHGTXHVWLRQQDLUHV
$ILQDOLVVXHLVGDWD DQDO\VLV:KHQH[SORUDWLRQRUGHVFULSWLRQLVWKHDLPRIWKHVXUYH\
DQDO\VLVIUHTXHQWO\LQYROYHVQRPRUHWKDQGHYHORSLQJWKHPDUJLQDODQGFURVVWDEXODWLRQVIRU
WKH YDULDEOHV XVLQJ VLPSOH GHVFULSWLYH VWDWLVWLFV :KHQ H[SODQDWLRQ LV WKH DLP DQDO\VLV
LQFOXGHVWKHWHVWLQJRIK\SRWKHVHVZLWKFURVVVHFWLRQDOGDWD7KLVUHTXLUHVWKDWWKHUHVHDUFKHU
GHVLJQVWKHVXUYH\WRLQFOXGHGDWDRQWKH LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV DQG RQ VXFK
DQWHFHGHQWYDULDEOHVDVWKHRU\ZRXOGVXJJHVWPLJKWH[SODLQWKHH[SHFWHGRULJLQDOUHODWLRQ

6DPSOLQJGHVLJQ
6DPSOLQJLVFRQFHUQHGZLWKGUDZLQJLQGLYLGXDOVRUHQWLWLHVIURPDSRSXODWLRQLQVXFKDZD\
DVWRSHUPLWJHQHUDOL]DWLRQDERXWWKHSKHQRPHQDRILQWHUHVWIURPWKHVDPSOHWRWKHSRSXODWLRQ
$JRRGVDPSOHKDVWKHIROORZLQJJHQHUDOFKDUDFWHULVWLFV 'DYLV 

x ,WHQDEOHVWKHUHVHDUFKHUWRPDNHGHFLVLRQVFRQFHUQLQJZKDWVDPSOHVL]HWRWDNHWRREWDLQ
WKHDQVZHUVGHVLUHG
x ,WLGHQWLILHVWKHFKDQFHRUSUREDELOLW\WKDWDQ\SULPDU\XQLWRIDQDO\VLVZLOOEHLQFOXGHG
LQWKHILQDOVWXG\VDPSOH
x ,WHQDEOHVWKHUHVHDUFKHUVWRTXDQWLI\WKHDFFXUDF\DQGLPSUHFLVLRQ HUURUV LQFKRRVLQJD
VDPSOHUDWKHUWKDQWDNLQJDFRPSOHWHFDQYDVRIWKHSRSXODWLRQ DFHQVXV 
x ,W HQDEOHV WKH UHVHDUFKHUV WR TXDQWLI\ WKH GHJUHH RI FRQILGHQFH WKDW FDQ EH SODFHG LQ
SRSXODWLRQHVWLPDWHVPDGHIURPVDPSOHVWDWLVWLFV

7KHVHFKDUDFWHULVWLFVDUHDSSOLFDEOHRQO\IRUSUREDELOLW\GHVLJQVZKLFKDUHGHVLJQVLQZKLFK
HDFKHOHPHQWLQWKHSRSXODWLRQKDVDNQRZQQRQ]HURFKDQFHRIEHLQJVHOHFWHGIRULQFOXVLRQLQ
WKH VWXG\ VDPSOH ,Q QRQSUREDELOLW\ GHVLJQV RQ WKH RWKHU KDQG WKH FKDQFH RI HDFK HOHPHQW
EHLQJVHOHFWHGLVQRWNQRZQ
7KHPRVWFULWLFDOHOHPHQWRIWKHVDPSOLQJSURFHVVLVWKHVHOHFWLRQRIWKHVDPSOLQJIUDPH
'DYLV EHFDXVHLIWKHFKRVHQVDPSOLQJIUDPHGRHVQRWDGHTXDWHO\UHSUHVHQWWKHXQLWRI
DQDO\VLVWKHJHQHUDOL]DELOLW\RIWKHUHVXOWVRIWKHVWXG\ZLOOEHTXHVWLRQDEOH

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

,QVWUXPHQWGHVLJQ
,QVWUXPHQW GHVLJQ LV YHU\ PXFK DQ DUW 3D\QH   'LIILFXOWLHV GR QRW RQO\ LQFOXGH WKH
SKUDVLQJRITXHVWLRQVEXWDOVRWKHGHWHUPLQDWLRQRIZKDWWRLQFOXGHDQGH[FOXGH)RUPDOO\ZH
FDQGHILQHLQVWUXPHQWGHVLJQDVWKHSURFHVVRIGHYHORSLQJWKHGDWDFROOHFWLRQGHYLFH XVXDOO\D
TXHVWLRQQDLUH  LQ RUGHU WR GHILQH DQG REWDLQ UHOHYDQW GDWD IRU D JLYHQ UHVHDUFK TXHVWLRQ
'\EnD 
7KHUH DUH PDQ\ UHDVRQV ZK\ UHVHDUFKHUV LQ 63, VKRXOG SD\ FORVHU DWWHQWLRQ WR
LQVWUXPHQWDWLRQ )LUVW FRQFHUQV DERXW LQVWUXPHQWDWLRQ DUH FORVHO\ FRQQHFWHG ZLWK FRQFHUQV
DERXW ULJRU LQ (6( UHVHDUFK 6HFRQG JUHDWHU DWWHQWLRQ WR LQVWUXPHQWDWLRQ SHUPLWV
FRQILUPDWRU\ IROORZXS UHVHDUFK WR XVH WHVWHG LQVWUXPHQWV KHQFH SURPRWLQJ FRRSHUDWLYH
UHVHDUFKHIIRUWV +XQWHUDQG6FKPLGW 7KLUGFORVHUDWWHQWLRQWRLQVWUXPHQWDWLRQEULQJV
JUHDWHU FODULW\ WR WKH IRUPXODWLRQ DQG LQWHUSUHWDWLRQ RI UHVHDUFK TXHVWLRQV 6WUDXE  
)LQDOO\ODFNRIYDOLGDWHGPHDVXUHVLQFRQILUPDWRU\UHVHDUFKUDLVHVVHULRXVTXHVWLRQVDERXWWKH
WUXVWZRUWKLQHVVRIWKHILQGLQJVRIWKHVWXG\
0HDVXUHPHQW RI UHVHDUFK FRQVWUXFWV LV QHLWKHU VLPSOH QRU VWUDLJKWIRUZDUG +RZHYHU LQ
VWUXPHQWDWLRQ WHFKQLTXHV DUH DYDLODEOH WKDW DOORZ XV WR FRQVWUXFW UHVHDUFK LQVWUXPHQWV WKDW
FRQVWLWXWHV DFFHSWDEOH OHYHOV RI UHOLDELOLW\ DQG YDOLGLW\ $Q H[DPSOH RI D SURFHVV IRU
GHYHORSLQJDUHVHDUFKLQVWUXPHQWIRU63,EDVHGRQJHQHUDOO\DFFHSWHGSV\FKRPHWULFSULQFLSOHV
FDQEHIRXQGLQ '\EnD DQGDOVRLQ&KDSWHURIWKLVWKHVLV

7KUHDWVWRVXUYH\YDOLGLW\
)RXU FULWHULD DUH FRPPRQO\ XVHG WR MXGJH WKH TXDOLW\ RI VXUYH\ UHVHDUFK GHVLJQV &DUPLQHV
DQG=HOOHU'H9HOOLV6SHFWRU 

x 5HOLDELOLW\ZKLFKUHIHUVWRWKHFRQVLVWHQF\DQGVWDELOLW\RIDVFRUHIURPDPHDVXUHPHQW
VFDOH %DVLFDOO\ IRXU PHWKRGV DUH DYDLODEOH IRU HVWLPDWLQJ WKH UHOLDELOLW\ RI VXUYH\
LQVWUXPHQWVWKHWHVWUHWHVWPHWKRGWKHDOWHUQDWLYHIRUPPHWKRGWKHVSOLWKDOYHVPHWKRG
DQGWKHLQWHUQDOFRQVLVWHQF\PHWKRG
x &RQWHQW YDOLGLW\ ZKLFK UHIHUV WR WKH GHJUHH WR ZKLFK WKH LWHPV LQ WKH PHDVXUHPHQW
LQVWUXPHQW UHSUHVHQW WKH GRPDLQ RU XQLYHUVH RI WKH SURFHVVHV XQGHU VWXG\ &RQWHQW
YDOLGLW\ LV EXLOW LQWR WKH LQVWUXPHQW IURP WKH RXWVHW WKURXJK WKH FKRLFH RI DSSURSULDWH
LWHPVZKLFKFDQEH DFKLHYHG E\ OLWHUDWXUH UHYLHZV H[SORUDWRU\ VWXGLHV H[SHUW UHYLHZV
DQGSLORWWHVWV
x &RQVWUXFW YDOLGLW\ ZKLFK UHIHUV WR WKH GHJUHH WR ZKLFK WKH PHDVXUHPHQW LQVWUXPHQW
UHSUHVHQWVDQGDFWVOLNHWKHSURFHVVHVEHLQJPHDVXUHG&RQVWUXFWYDOLGLW\RIWKHVFDOHVLQD
PHDVXUHPHQW LQVWUXPHQW LV QRUPDOO\ DVVHVVHG ZLWK IDFWRU DQDO\VLV DQG LWHP DQDO\VLV
EDVHGRQ1XQQDOO\¶VPHWKRG 1XQQDOO\1XQQDOO\DQG%HUQVWHLQ 
x &ULWHULRQUHODWHG YDOLGLW\ ZKLFK UHIHUV WR WKH GHJUHH WR ZKLFK WKH PHDVXUHPHQW
LQVWUXPHQWLVDEOHWRSUHGLFWDYDULDEOHWKDWLVGHVLJQDWHGDFULWHULRQ7KHFULWHULRQUHODWHG
YDOLGLW\RIDPHDVXUHPHQWLQVWUXPHQWFDQWKXVEHIRXQGE\DVVHVVLQJWKHHIIHFWVL]HDQG
VLJQLILFDQFH OHYHO RI WKH PXOWLSOH  FRUUHODWLRQ EHWZHHQ WKH LQGHSHQGHQW DQG GHSHQGHQW
YDULDEOHV

±±
&+$37(5

 &DVHVWXG\UHVHDUFK
$FDVHVWXG\LVDQHPSLULFDOLQTXLU\WKDWLQYHVWLJDWHVDFRQWHPSRUDU\SKHQRPHQRQZLWKLQLWV
UHDOOLIH FRQWH[W HVSHFLDOO\ ZKHQ WKH ERXQGDULHV EHWZHHQ SKHQRPHQRQ DQG FRQWH[W DUH QRW
FOHDUO\ HYLGHQW <LQ   6R ZKLOH DQ H[SHULPHQW GHOLEHUDWHO\ GLYRUFHV D SKHQRPHQRQ
IURP LWV FRQWH[W DQG D VXUYH\¶V DELOLW\ WR LQYHVWLJDWH WKH FRQWH[W LV OLPLWHG WKH FDVH VWXG\
GHOLEHUDWHO\DLPVDWFRYHULQJWKHFRQWH[WXDOFRQGLWLRQV
*HQHUDOO\WKHPRVWLPSRUWDQWDSSOLFDWLRQRIFDVHVWXGLHVLVWRH[SODLQWKHFDXVDOOLQNVLQ
UHDOOLIH LQWHUYHQWLRQV WKDW DUH WRR FRPSOH[ IRU WKH VXUYH\ RU H[SHULPHQWDO DSSURDFKHV
$QRWKHU DSSOLFDWLRQ LV WR GHVFULEH DQ LQWHUYHQWLRQ DQG WKH UHDOOLIH FRQWH[W LQ ZKLFK LW
RFFXUUHG )XUWKHUPRUH FDVH VWXGLHV FDQ EH XVHG WR LOOXVWUDWH FHUWDLQ WRSLFV ZLWKLQ DQ
HYDOXDWLRQ RU WR H[SORUH WKRVH VLWXDWLRQV LQ ZKLFK WKH LQWHUYHQWLRQ EHLQJ HYDOXDWHG KDV QR
FOHDUVLQJOHVHWRIRXWFRPHV)LQDOO\DFDVHVWXG\PD\EHD³PHWDHYDOXDWLRQ´±DVWXG\RIDQ
HYDOXDWLRQVWXG\ LELG 
&DVHVWXG\UHVHDUFKLVDVWDQGDUGPHWKRGRIHPSLULFDOVWXG\LQPDQDJHPHQWEXWDOVRLQ
UHODWHG GLVFLSOLQHV VXFK DV RUJDQL]DWLRQ GHYHORSPHQW DQG LQIRUPDWLRQ V\VWHPV UHVHDUFK ,Q
(6( FDVH VWXGLHV XVXDOO\ ORRN DW ZKDW LV KDSSHQLQJ RQ D W\SLFDO SURMHFW ³UHVHDUFKLQWKH
W\SLFDO´ .LWFKHQKDPHWDO 
<LQ   QRWHG WKDW D FDVH VWXG\ KDV D GLVWLQFW DGYDQWDJH ZKHQ ³D µKRZ¶ RU µZK\¶
TXHVWLRQLV EHLQJ DVNHG DERXW D FRQWHPSRUDU\ VHW RI HYHQWV RYHU ZKLFK WKH LQYHVWLJDWRU KDV
OLWWOH RU QR FRQWURO´ LELG S   )RU VRIWZDUH HQJLQHHULQJ FDVH VWXGLHV DUH DOVR XVHIXO LQ
DQVZHULQJD³ZKLFKLVEHWWHU´TXHVWLRQ .LWFKHQKDPHWDO 
6WDQGDUGWH[WVRQFDVHVWXG\ UHVHDUFKLQFOXGH 6WDNH<LQ $GLVFXVVLRQ RI
WKHFDVHUHVHDUFKVWUDWHJ\LQVWXGLHVRILQIRUPDWLRQV\VWHPVFDQEHIRXQGLQ %HQEDVDWHWDO
  $ VFLHQWLILF PHWKRGRORJ\ IRU PDQDJHPHQW LQIRUPDWLRQ V\VWHP 0,6  FDVH VWXGLHV LV
SURYLGHGE\ /HH   ZKLOH WKH SURFHVV RI EXLOGLQJ WKHRULHV IURP FDVH VWXG\ UHVHDUFK LV
FRYHUHG E\ (LVHQKDUGW   *XLGHOLQHV DQG FKHFNOLVWV IRU FDVH VWXGLHV LQ VRIWZDUH
HQJLQHHULQJFDQEHIRXQGLQ *ODVV.LWFKHQKDP.LWFKHQKDPHWDO 

&DVHVWXG\GHVLJQV
,Q JHQHUDO FDVH VWXG\ GHVLJQV FDQ EH VLQJOHFDVH RU PXOWLSOHFDVH VWXGLHV DQG WKH\ FDQ
LQYROYH D VLQJOH XQLW KROLVWLF  RU PXOWLSOH XQLWV HPEHGGHG  RI DQDO\VLV <LQ   7KHUH
DUHWKXVIRXUJHQHUDOGHVLJQVIRUFDVHVWXGLHV  VLQJOHFDVHKROLVWLFGHVLJQ  VLQJOHFDVH
HPEHGGHGGHVLJQ  PXOWLSOHFDVHKROLVWLFGHVLJQDQG  PXOWLSOHFDVHHPEHGGHGGHVLJQ
,QVRIWZDUHHQJLQHHULQJFDVHVWXGLHVDUH SDUWLFXODUO\ LPSRUWDQW IRU LQGXVWULDO HYDOXDWLRQ
RIVRIWZDUHHQJLQHHULQJPHWKRGVDQGWRROVEHFDXVHWKH\FDQDYRLGWKHVFDOHXSSUREOHPVWKDW
RIWHQ DUH DVVRFLDWHG ZLWK H[SHULPHQWV 7R DYRLG ELDV DQG HQVXUH LQWHUQDO YDOLGLW\ LW LV
QHFHVVDU\WRLGHQWLI\DYDOLGEDVLVIRUDVVHVVLQJWKHUHVXOWVRIWKHFDVHVWXG\%DVLFDOO\WKHUH
DUHWKUHHZD\VRIGHVLJQLQJDVRIWZDUHHQJLQHHULQJFDVHVWXG\WRIDFLOLWDWHWKLV .LWFKHQKDPHW
DO 

x &RPSDQ\ EDVHOLQH FDVH VWXGLHV 7KLV GHVLJQ FDQ EH XVHG LI WKH VRIWZDUH RUJDQL]DWLRQ
JDWKHUVGDWDIURPLWVSURMHFWVDVDVWDQGDUGSUDFWLFHDQGPDNHVWKHPDYDLODEOHWRWKHUHVW
RI WKH RUJDQL]DWLRQ :LWK WKLV GHVLJQ WKH UHVSRQVH YDULDEOH YDOXHV IURP WKH FDVH VWXG\
SURMHFWDUHFRPSDUHGZLWKWKHFRUUHVSRQGLQJYDULDEOHVIURPSUHYLRXVSURMHFWVRUDVXEVHW
RIVLPLODUSURMHFWV

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

x 6LVWHUSURMHFWFDVHVWXGLHV$VLVWHUSURMHFWGHVLJQFRPSULVHV DWOHDVW WZRSURMHFWVRQH


XVLQJ WKH QHZ PHWKRG DQG WKH RWKHU XVLQJ WKH FXUUHQW PHWKRG (DFK SURMHFW VKRXOG EH
W\SLFDOIRUWKH RUJDQL]DWLRQ KDYLQJ VLPLODU FKDUDFWHULVWLFV DFFRUGLQJ WR WKH FKRVHQ VWDWH
YDULDEOHV 7KH SURMHFWV DUH UXQ LQ SDUDOOHO DQG WKH UHVSRQVH YDULDEOHV IURP HDFK DUH
FRPSDUHG
$VSHFLDONLQGRIVLVWHUSURMHFWGHVLJQLVWKHUHSOLFDWHGSURGXFWGHVLJQZKLFKFDQEH
XVHG LQ VLWXDWLRQV LQ ZKLFK D SURGXFW LV GHYHORSHG D VHFRQG WLPH XVLQJ D GLIIHUHQW
GHYHORSPHQWPHWKRG
x :LWKLQSURMHFW FRPSRQHQW FRPSDULVRQ FDVH VWXGLHV ,Q WKLV GHVLJQ FRPSRQHQWV HJ
PRGXOHV RU VXEV\VWHPV  LQ D VLQJOH SURMHFW DUH DVVLJQHG DW UDQGRP WR HDFK RI WKH
WUHDWPHQWV ,Q WKLV FDVH WKH FDVH VWXG\ UHVHPEOHV D IRUPDO H[SHULPHQW VLQFH WKH
UHSOLFDWHG YDOXHV DQG VWDQGDUG VWDWLVWLFDO PHWKRGV FDQ EH XVHG WR DQDO\]H WKH UHVSRQVH
YDULDEOHV+RZHYHUVLQFHWKHSURMHFWVDUHQRWGUDZQDWUDQGRPIURPWKHSRSXODWLRQRIDOO
SURMHFWVWKLVGHVLJQLVQRWDWUXHIRUPDOH[SHULPHQW

7KUHDWVWRFDVHVWXG\YDOLGLW\
)RXU FULWHULD DUH FRPPRQO\ XVHG WR MXGJH WKH TXDOLW\ RI FDVH VWXG\ UHVHDUFK GHVLJQV <LQ
 

x &RQVWUXFW YDOLGLW\ ZKLFK LV FRQFHUQHG ZLWK HVWDEOLVKLQJ FRUUHFW RSHUDWLRQDO PHDVXUHV
IRUWKHFRQFHSWVEHLQJVWXGLHG&ULWLFVRIFDVHVWXG\UHVHDUFKRIWHQSRLQWWRLQVXIILFLHQWO\
RSHUDWLRQDO VHWV RI PHDVXUHV DQG WR WKH VXEMHFWLYH MXGJHPHQWV RIWHQ XVHG WR FROOHFW WKH
GDWD +RZHYHU WKUHH WDFWLFV DUH DYDLODEOH WR LQFUHDVH FRQVWUXFW YDOLGLW\ LQ FDVH VWXG\
UHVHDUFKXVLQJPXOWLSOHVRXUFHVRIHYLGHQFHHVWDEOLVKLQJDFKDLQRIHYLGHQFHDQGKDYLQJ
WKHGUDIWFDVHVWXG\UHSRUWUHYLHZHGE\NH\LQIRUPDQWV
x ,QWHUQDO YDOLGLW\ ZKLFK LV FRQFHUQHG ZLWK HVWDEOLVKLQJ FDXVDO UHODWLRQVKLSV DV
GLVWLQJXLVKHG IURP VSXULRXV UHODWLRQVKLSV WKXV PLQLPL]LQJ WKH HIIHFWV RI FRQIRXQGLQJ
IDFWRUV7KHUHTXLUHPHQWVIRULQWHUQDOYDOLGLW\ZKLFKDUHRQO\DSSOLFDEOHIRUH[SODQDWRU\
FDVHVWXGLHVFDQEHPHWE\WKHXVHRISDWWHUQPDWFKLQJH[SODQDWLRQEXLOGLQJDQGWLPH
VHULHVDQDO\VLV
x ([WHUQDOYDOLGLW\ ZKLFK LV FRQFHUQHG ZLWK HVWDEOLVKLQJ WKH GRPDLQ WR ZKLFK D VWXG\¶V
ILQGLQJVFDQEHJHQHUDOL]HG&ULWLFVW\SLFDOO\VWDWHWKDWVLQJOHFDVHVRIIHUDSRRUEDVLVIRU
JHQHUDOL]LQJ ,Q FRQWUDVW WR VXUYH\ UHVHDUFK WKDW UHOLHV RQ VWDWLVWLFDO JHQHUDOL]DWLRQ FDVH
VWXG\UHVHDUFKUHOLHVRQDQDO\WLFDOJHQHUDOL]DWLRQXVLQJUHSOLFDWLRQORJLFLQPXOWLSOHFDVH
VWXGLHV
x 5HOLDELOLW\ZKLFKLVFRQFHUQHG ZLWKGHPRQVWUDWLQJWKDWWKHRSHUDWLRQV RI WKH VWXG\ FDQ
EHUHSHDWHGZLWKWKHVDPHUHVXOWV)RUFDVHVWXG\UHVHDUFKWKHHPSKDVLVKHUHLVRQGRLQJ
WKHVDPHFDVHRYHUDJDLQQRWRQ³UHSOLFDWLQJ´ WKH UHVXOWV RI RQH FDVH E\ GRLQJDQRWKHU
FDVHVWXG\7KH JRDORIUHOLDELOLW\LVWKXVWRPLQLPL]HWKHHUURUVDQGELDVHVLQDVWXG\
ZKLFKFDQEHDFKLHYHGE\WKHXVHRIDFDVHVWXG\SURWRFRODQGDFDVHVWXG\GDWDEDVH

,QGLVFXVVLQJERXQGHG UDWLRQDOLW\ DQGRUJDQL]DWLRQDOOHDUQLQJWKHZLQQHURIWKH1REHO


3UL]HLQ(FRQRPLFV+HUEHUW$6LPRQPDGHWKHIROORZLQJFRPPHQWUHJDUGLQJWKHYDOLGLW\RI
FDVHVWXG\GDWD

±±
&+$37(5

,IZHDUHFRQFHUQHGDERXWWKHLPSUHFLVLRQRIFDVHVWXGLHVDVUHVHDUFKGDWDZHFDQFRQVROH
RXUVHOYHVE\QRWLQJWKDWDPDQQDPHG'DUZLQZDVDEOHWRZULWHDYHU\SHUVXDVLYH SHUKDSV
HYHQFRUUHFW ERRNRQWKHRULJLQRIVSHFLHVRQWKHEDVLVRIDVWXG\RIWKH*DODSDJRV,VODQGV
DQGDIHZRWKHUFDVHV7RWKHEHVWRIP\UHFROOHFWLRQWKHUHDUHQRVWDWLVWLFVLQ'DUZLQ¶VERRN
6LPRQ 

 $FWLRQUHVHDUFK
$FWLRQ UHVHDUFK LV SDUWLFXODUO\ IRFXVHG RQ FRPELQLQJ WKHRU\ DQG SUDFWLFH *UHHQZRRG DQG
/HYLQ    ,W DWWHPSWV WR DFKLHYH SUDFWLFDO YDOXH WR WKH FOLHQW RUJDQL]DWLRQ ZKLOH
VLPXOWDQHRXVO\FRQWULEXWLQJWRWKHJHQHUDWLRQRIQHZWKHRUHWLFDONQRZOHGJH *DOOLHUV 
,WFDQEHFKDUDFWHUL]HGDV³DQLWHUDWLYHSURFHVVLQYROYLQJUHVHDUFKHUVDQGSUDFWLWLRQHUVDFWLQJ
WRJHWKHURQDSDUWLFXODUF\FOHRIDFWLYLWLHVLQFOXGLQJSUREOHPGLDJQRVLVDFWLRQLQWHUYHQWLRQ
DQGUHIOHFWLYHOHDUQLQJ´ $YLVRQHWDOSHPSKDVLVDGGHG 7KHPDMRUVWUHQJWKRI
DFWLRQUHVHDUFKLVWKXVWKHLQGHSWKDQGILUVWKDQGXQGHUVWDQGLQJWKHUHVHDUFKHUREWDLQV2Q
WKH RWKHU KDQG WKH ZHDNQHVV LV WKH SRWHQWLDO ODFN RI REMHFWLYLW\ VWHPPLQJ IURP WKH
UHVHDUFKHUV LQ HIIHFWLQJ D VXFFHVVIXO RXWFRPH IRU WKH FOLHQW RUJDQL]DWLRQ %HQEDVDW HW DO
 
*HQHUDO LQWURGXFWLRQV WR DFWLRQ UHVHDUFK DQG LWV YDULHWLHV FDQ EH IRXQG LQ (OGHQ DQG
&KLVKROP *UHHQZRRG DQG /HYLQ   $ JHQHUDO GLVFXVVLRQ RQ WKH DSSOLFDELOLW\ RI
DFWLRQUHVHDUFKWR,6UHVHDUFKLVSURYLGHGE\ $YLVRQHWDO0DWKLDVVHQ VSHFLILF
IUDPHZRUNV IRU DFWLRQ UHVHDUFK LQ ,6 LV SUHVHQWHG E\ %DVNHUYLOOH DQG :RRG+DUSHU 
/DX ZKLOHDFULWLFDOSHUVSHFWLYHRQDFWLRQUHVHDUFKDVDPHWKRGIRU,6UHVHDUFKFDQEH
IRXQGLQ %DVNHUYLOOHDQG:RRG+DUSHU 
,QRXUYLHZDFWLRQUHVHDUFKLVDKLJKO\XQGHUUDWHGVWUDWHJ\IRU(6(UHVHDUFK,QFRQWUDVW
WR WKH RWKHU HPSLULFDO DSSURDFKHV GHVFULEHG LQ WKLV FKDSWHU WKH DFWLRQ UHVHDUFKHU LV QRW D
QHXWUDOREVHUYHUGHWDFKHGIURPSUDFWLFH5DWKHUWKHDFWLRQUHVHDUFKHUWDNHVDFWLYHSDUWLQWKH
RUJDQL]DWLRQ¶VFKDQJHSURFHVV7KLVLV DOVR DQ LPSRUWDQW SDUW RI WKH LQGXVWU\¶V PRWLYDWLRQ WR
SDUWLFLSDWH LQ (6( UHVHDUFK SURMHFWV ± WKDW WKH UHVHDUFKHUV DFWLYHO\ SDUWLFLSDWH ZLWK UHOHYDQW
NQRZOHGJHDQGH[SHULHQFHWRKHOSWKHRUJDQL]DWLRQVLPSURYHWKHPVHOYHV VHH&KDSWHU 
$OVRXQOLNHWKHRWKHUHPSLULFDODSSURDFKHVGHVFULEHGLQWKLVFKDSWHUZKLFKIRUWKHPRVW
SDUW UHVWV LQ WKH SRVLWLYLVW SDUDGLJP DFWLRQ UHVHDUFK UHVWV LQ DQ LQWHUSUHWLYH SKLORVRSKLFDO
IUDPHZRUN *DOOLHUV ,Q&KDSWHUZHGLVFXVVWKHUHODWLRQVKLSEHWZHHQWKLVIUDPHZRUN
DQGWKHSRVLWLYLVWIUDPHZRUNDQGKRZWKH\DUHPL[HGWRIRUPDSUDJPDWLFUHVHDUFKGHVLJQIRU
WKLV VWXG\ $W WKLV SRLQW KRZHYHU LW FRXOG EH XVHIXO WR GHVFULEH WKH EDVLF SULQFLSOHV IRU
LQWHUSUHWLYHILHOGUHVHDUFK

3ULQFLSOHVIRULQWHUSUHWLYHILHOGUHVHDUFK
,Q GLVFXVVLQJ WKH FRQGXFW DQG HYDOXDWLRQ RI LQWHUSUHWLYH UHVHDUFK LQ ,6 .OHLQ DQG 0\HUV
 SURSRVHGDVHWRIVHYHQSULQFLSOHVDORQJZLWKWKHLUSKLORVRSKLFDOUDWLRQDOH VHH7DEOH
  )XUWKHUPRUH WKH\ LOOXVWUDWHG WKH XVHIXOQHVV RI WKHVH SULQFLSOHV E\ HYDOXDWLQJ WKUHH
SXEOLVKHGLQWHUSUHWLYHILHOGVWXGLHVGUDZQIURPWKH,6UHVHDUFKOLWHUDWXUH

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

7DEOH3ULQFLSOHVIRULQWHUSUHWLYHILHOGUHVHDUFK .OHLQDQG0\HUV 

 7KH)XQGDPHQWDO3ULQFLSOHRIWKH+HUPHQHXWLF&LUFOH
7KLVSULQFLSOHVXJJHVWVWKDWDOOKXPDQXQGHUVWDQGLQJLVDFKLHYHGE\LWHUDWLQJEHWZHHQ
FRQVLGHULQJWKHLQWHUGHSHQGHQWPHDQLQJRISDUWVDQGWKHZKROHWKDWWKH\IRUP7KLVSULQFLSOHRI
KXPDQXQGHUVWDQGLQJLVIXQGDPHQWDOWRDOORWKHUSULQFLSOHV

 7KH3ULQFLSOHRI&RQWH[WXDOL]DWLRQ
5HTXLUHVFULWLFDOUHIOHFWLRQRIWKHVRFLDODQGKLVWRULFDOEDFNJURXQGRIWKHUHVHDUFKVHWWLQJVRWKDW
WKHLQWHQGHGDXGLHQFHFDQVHHKRZWKHFXUUHQWVLWXDWLRQXQGHULQYHVWLJDWLRQHPHUJHG

 7KH3ULQFLSOHRI,QWHUDFWLRQ%HWZHHQWKH5HVHDUFKHUVDQGWKH6XEMHFWV
5HTXLUHVFULWLFDOUHIOHFWLRQRQKRZWKHUHVHDUFKPDWHULDOV RU³GDWD´ ZHUHVRFLDOO\FRQVWUXFWHG
WKURXJKWKHLQWHUDFWLRQEHWZHHQWKHUHVHDUFKHUVDQGSDUWLFLSDQWV

 7KH3ULQFLSOHRI$EVWUDFWLRQDQG*HQHUDOL]DWLRQ
5HTXLUHVUHODWLQJWKHLGLRJUDSKLFGHWDLOVUHYHDOHGE\WKHGDWDLQWHUSUHWDWLRQWKURXJKWKH
DSSOLFDWLRQRISULQFLSOHVRQHDQGWZRWRWKHRUHWLFDOJHQHUDOFRQFHSWVWKDWGHVFULEHWKHQDWXUHRI
KXPDQXQGHUVWDQGLQJDQGVRFLDODFWLRQ

 7KH3ULQFLSOHRI'LDORJLFDO5HDVRQLQJ
5HTXLUHVVHQVLWLYLW\WRSRVVLEOHFRQWUDGLFWLRQVEHWZHHQWKHWKHRUHWLFDOSUHFRQFHSWLRQVJXLGLQJWKH
UHVHDUFKGHVLJQDQGDFWXDOILQGLQJV ³WKHVWRU\ZKLFKWKHGDWDWHOO´ ZLWKVXEVHTXHQWF\FOHVRI
UHYLVLRQ

 7KH3ULQFLSOHRI0XOWLSOH,QWHUSUHWDWLRQV
5HTXLUHVVHQVLWLYLW\WRSRVVLEOHGLIIHUHQFHVLQLQWHUSUHWDWLRQVDPRQJWKHSDUWLFLSDQWVDVDUH
W\SLFDOO\H[SUHVVHGLQPXOWLSOHQDUUDWLYHVRUVWRULHVRIWKHVDPHVHTXHQFHRIHYHQWVXQGHUVWXG\
6LPLODUWRPXOWLSOHZLWQHVVDFFRXQWVHYHQLIDOOWHOOLWDVWKH\VDZLW

 7KH3ULQFLSOHRI6XVSLFLRQ
5HTXLUHVVHQVLWLYLW\WRSRVVLEOH³ELDVHV´DQGV\VWHPDWLF³GLVWRUWLRQV´LQWKHQDUUDWLYHVFROOHFWHG
IURPWKHSDUWLFLSDQWV

$FWLRQUHVHDUFKPRGHOV
7KUHHGLVWLQFWW\SHVRIPRGHOVFDQEHVHHQLQDFWLRQUHVHDUFK %DVNHUYLOOHDQG:RRG+DUSHU
 

x ,WHUDWLYH PRGHOV ZKLFK LQYROYH D UHSHDWLQJ VHTXHQFH RI DFWLYLWLHV W\SLFDOO\ F\FOLQJ
EHWZHHQ DFWLRQ DFWLYLWLHV DQG SUREOHP GLDJQRVLV DFWLYLWLHV HJ &KHFNODQG DQG 6FKROHV
6XVPDQ 
x 5HIOHFWLYHPRGHOVZKLFKDUHQHFHVVDULO\LWHUDWLYHEXWIRFXVPRUHRQUHIOHFWLYHDQDO\VLV
RIWKHRU\LQXVHYHUVXVHVSRXVHGWKHRU\ VHH6HFWLRQIRUDQRYHUYLHZ $UHIOHFWLYH
SURFHVV PRGHO WKXV FRQFHQWUDWHV RQ WKH GLVFRYHU\ RI GLIIHUHQFHV EHWZHHQ WKH WZR
WKHRULHV HJ*UHHQZRRGDQG/HYLQ1DXU 
x /LQHDUPRGHOVZKLFKGRQRWLQYROYHLWHUDWLRQEXWDVLQJOHVHTXHQFHRIDFWLYLWLHVVXFKDV
HQJDJHGLDJQRVHXQIUHH]HFKDQJHIUHH]HDQGGLVHQJDJH HJ0XPIRUG 

±±
&+$37(5

3UREOHPGHILQLWLRQ

,QVLGHU 2XWVLGHU

&RPPXQLFDWLYH

DFWLRQLQDUHQDV

0XWXDOUHIOHFWLRQ

DQGOHDUQLQJ

5HIOHFWLRQ 5HIOHFWLRQ

6ROYLQJSUREOHP

WKURXJKDFWLQJ

&UHDWLRQRI

RSSRUWXQLWLHVIRU

OHDUQLQJDQG

UHIOHFWLRQLQDQG

RQDFWLRQV

)LJXUH7KH&RJHQHUDWLYH$FWLRQ5HVHDUFK0RGHO *UHHQZRRGDQG/HYLQS 

$VDQH[DPSOHRIDQDFWLRQUHVHDUFKPRGHO)LJXUHVKRZV*UHHQZRRGDQG/HYLQ¶V 
&RJHQHUDWLYH$FWLRQ5HVHDUFK0RGHO7KLVLVDUHIOHFWLYHPRGHOZKLFKLGHQWLILHVWZRPDLQ
JURXSVRIDFWRUVWKHLQVLGHUVDQGWKHRXWVLGHUVRIWKHRUJDQL]DWLRQ7KHLQVLGHUVDUHWKHIRFDO
SRLQWRIWKHDFWLRQUHVHDUFKWKH\³RZQ´WKHSUREOHP7KHRXWVLGHUVRQWKHRWKHUKDQGDUHWKH
SURIHVVLRQDO UHVHDUFKHUV ZKR VHHN WR IDFLOLWDWH D FROHDUQLQJ SURFHVV DLPHG DW VROYLQJ ORFDO
SUREOHPV

x 3UREOHPGHILQLWLRQ7KHSUREOHPGHILQLWLRQSURFHVVLVWKHILUVWVWHSLQDPXWXDOOHDUQLQJ
SURFHVVEHWZHHQLQVLGHUVDQGRXWVLGHUV$ILUVWZRUNLQJGHILQLWLRQRIWKHSUREOHPXQGHU
VWXG\ FRPHV RXW RI D GLVFRXUVH ZKHUH NQRZOHGJH KHOG E\ LQVLGHUV DQG RXWVLGHUV
FRJHQHUDWHVDQHZPXWXDOXQGHUVWDQGLQJWKURXJKFRPPXQLFDWLRQZLWKHDFKRWKHU
x &RPPXQLFDWLYH DFWLRQ LQ DUHQDV &HQWUDO WR WKH FRJHQHUDWLYH SURFHVV LV LWV DELOLW\ WR
FUHDWHFRQWH[WVRUDUHQDVWKDWDOORZFRPPXQLFDWLYHDFWLRQVWR WDNH SODFH ([DPSOHV RI
VXFK DUHQDV LQFOXGH YDULRXV IRUPV RI PHHWLQJV WHDP EXLOGLQJ VHVVLRQV DQG VHDUFK
FRQIHUHQFHV
x 0XWXDOUHIOHFWLRQDQGOHDUQLQJ7KHLQLWLDOSUREOHPIRFXVVXJJHVWVDGHVLJQIRUDQDUHQD
IRU GLVFRXUVH 7KH VXEVHTXHQW FRPPXQLFDWLRQ SURGXFHV XQGHUVWDQGLQJV WKDW KHOS PRYH
WRZDUG SUREOHP VROXWLRQV FUHDWLQJ QHZ H[SHULHQFHV WR UHIOHFW RQ IRU ERWK LQVLGHUV DQG
SURIHVVLRQDOUHVHDUFKHUV
x 6ROYLQJSUREOHPWKURXJKDFWLQJ7KHVWUXJJOHWRVROYHLPSRUWDQWORFDOSUREOHPVVKDSHV
WKH JURXQG IRU QHZ XQGHUVWDQGLQJV KHQFH WKH GRXEOH IHHGEDFN ORRSV LQ )LJXUH 
$FWLRQV WDNHQ WR VROYH ORFDO SUREOHPV FRPH DV D UHVXOW RI WKH FRJHQHUDWLYH SURFHVV
WKURXJKZKLFKWKHSDUWLFLSDQWVOHDUQQHZWKLQJVDERXWWKHSUREOHPVWKH\DUHIDFLQJ7KH
RXWFRPH RI WKLV FROOHFWLYH SURFHVV RI DFWLRQ DQG UHIOHFWLRQ VXSSRUW WKH FUHDWLRQ RI QHZ
VKDUHGXQGHUVWDQGLQJ

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

x 5HIOHFWLRQ 7KH IHHGEDFN ORRSV DUH VLPLODU IRU ERWK LQVLGHUV DQG RXWVLGHUV EXW WKH
LQWHUHVWV DQG HIIHFWV FDQ EH TXLWH GLIIHUHQW )RU LQVLGHUV LW PLJKW EH FHQWUDO WR LPSURYH
WKHLUDFWLRQNQRZOHGJHFDSDELOLWLHVZKHUHDVWKHRXWVLGHUVPD\IRFXVPRUHRQSURGXFLQJ
PHDQLQJ WKURXJK SXEOLFDWLRQV  WR WKH UHVHDUFK FRPPXQLW\ %RWK RI WKHVH UHIOHFWLYH
SURFHVVHVDUHWKHQIHGEDFNLQWRWKHFRPPXQLFDWLYHSURFHVVVKDSLQJWKHDUHQDVIRUQHZ
GLDORJXHVDLPHGDWHLWKHUUHGHILQLQJWKHLQLWLDOSUREOHPVWDWHPHQWRULPSURYLQJWKHORFDO
SUREOHPVROYLQJFDSDFLW\

7KUHDWVWRDFWLRQUHVHDUFKYDOLGLW\
5DWKHU WKDQ WKH WUDGLWLRQDO FRQFHSWV RI UHOLDELOLW\ DQG YDOLGLW\ DFWLRQ UHVHDUFKHUV DUJXH WKDW
DFWLRQ UHVHDUFK VKRXOG EH MXGJHG DFFRUGLQJ WR LWV FUHGLELOLW\ ZKLFK *UHHQZRRG DQG /HYLQ
  GHILQHG DV ³WKH DUJXPHQWV DQG WKH SURFHVVHV QHFHVVDU\ IRU KDYLQJ VRPHRQH WUXVW
UHVHDUFKUHVXOWV´ LELGS 7ZRW\SHVRIFUHGLELOLW\FDQEHGLVWLQJXLVKHG

x ,QWHUQDOFUHGLELOLW\ZKLFKLVFRQFHUQHGZLWKWKHFUHGLELOLW\RINQRZOHGJHWRWKH JURXS
JHQHUDWLQJ LW 7KLV W\SH RI FUHGLELOLW\ LV IXQGDPHQWDOO\ LPSRUWDQW WR DFWLRQ UHVHDUFK
EHFDXVHRIWKHFROODERUDWLYHFKDUDFWHURIWKHUHVHDUFKSURFHVV0HPEHUVRIFRPPXQLWLHV
RURUJDQL]DWLRQVDUHXQOLNHO\WRDFFHSWDVFUHGLEOHWKH³REMHFWLYH´WKHRULHVRIRXWVLGHUVLI
WKH\FDQQRWUHFRJQL]H WKH FRQQHFWLRQ WR WKH ORFDO VLWXDWLRQ RU EHFDXVH ORFDO NQRZOHGJH
PDNHVLWFOHDUWKDWWKHIUDPHZRUNVDUHHLWKHUWRRDEVWUDFWRUVLPSO\ZURQJIRUWKHVSHFLILF
FRQWH[W
x ([WHUQDO FUHGLELOLW\ ZKLFK LV FRQFHUQHG ZLWK FRQYLQFLQJ VRPHRQH ZKR GLG QRW
SDUWLFLSDWH LQ WKH LQTXLU\ WKDW WKH UHVXOWV DUH EHOLHYDEOH 7KLV LV D GLIILFXOW FKDOOHQJH
KRZHYHUVLQFH DFWLRQ UHVHDUFK GHSHQGV RQ WKH FRQMXJDWLRQ RI UHIOHFWLRQ DQG DFWLRQ DQG
WKHFRJHQHUDWLRQRIQHZNQRZOHGJHLQVSHFLILFFRQWH[WV

:KLOH FRQYHQWLRQDO UHVHDUFK PHWKRGV IRFXV RQ YDOLGLW\ WKURXJK VWDWLVWLFDO RU DQDO\WLFDO
JHQHUDOL]DWLRQ DFWLRQ UHVHDUFK EHOLHYHV WKDW RQO\ NQRZOHGJH JHQHUDWHG IURP DQG WHVWHG LQ
SUDFWLFHLVFUHGLEOH7KLVLQYROYHV DWOHDVW WKUHHFKDOOHQJHV LELG 
x :RUNDELOLW\ 7KLV FUHGLELOLW\ FKDOOHQJH UHODWHV WR WKH VROXWLRQ RI WKH DFWLRQ UHVHDUFK
TXHVWLRQ XQGHU H[DPLQDWLRQ ORFDOO\ DQG ZKHWKHU WKH DFWLRQV WDNHQ GXULQJ WKH UHVHDUFK
SURFHVVUHVXOWLQDZRUNDEOHVROXWLRQWRWKHSUREOHP
x 6HQVHPDNLQJ 7KH VHFRQG DQG FRPSOHPHQWDU\ FKDOOHQJH LV PDNLQJ VHQVH RXW RI WKH
WDQJLEOHUHVXOWVRIWKHDFWLRQUHVHDUFKSURFHVVILQGLQJZD\VRILQWHJUDWLQJWKHRXWFRPHLQ
DVHQVHPDNLQJSURFHVVWKDWFUHDWHVQHZNQRZOHGJH([DPSOHVRIVXFKSURFHVVHVLQFOXGH
+DEHUPDV¶V  LGHDOVSHHFKVLWXDWLRQDQG*DGDPHU¶V  KHUPHQHXWLFV
x 7UDQVFRQWH[WXDO FUHGLELOLW\ $FWLRQ UHVHDUFK GRHV QRW JHQHUDOL]H WKURXJK DEVWUDFWLRQ
DQGWKHORVVRIKLVWRU\DQGFRQWH[W5DWKHUPHDQLQJVFUHDWHGLQRQHFRQWH[WDUHH[DPLQHG
IRUWKHLUFUHGLELOLW\LQDQRWKHUVLWXDWLRQWKURXJKDFRQVFLRXVUHIOHFWLRQRQVLPLODULWLHVDQG
GLIIHUHQFHVEHWZHHQFRQWH[WXDOIHDWXUHVDQGKLVWRULFDOIDFWRUV7KH\DUHPRYHGIURPWKH
RULJLQDO FRQWH[W WKURXJK D FROODERUDWLYH DQDO\VLV RI WKH VLWXDWLRQ ZKHUH WKH NQRZOHGJH
PLJKW EH DSSOLHG %DVHG RQ KLVWRULFDO DQG FRQWH[WXDO DQDO\VHV MXGJHPHQWV DUH PDGH
DERXWWKHSRVVLELOLW\RIDSSO\LQJNQRZOHGJHIURPRQHVLWXDWLRQLQDQRWKHU

±±
&+$37(5

 &RPSDULVRQRI5HVHDUFK$SSURDFKHV
7KHGLYHUVLW\LQ(6(UHVHDUFKDSSURDFKHVDSSOLFDEOHWR63,LVDVZHKDYHVHHQFRQVLGHUDEOH
7KLVLVXVHIXOVLQFHWKHFRPSOH[LW\DQGG\QDPLFVRIWKHVRIWZDUHHQJLQHHULQJSUREOHPVXQGHU
VWXG\ RIWHQ UHTXLUH WKDW PXOWLSOH DSSURDFKHV EH DSSOLHG 7KLV GLYHUVLW\ LV XQIRUWXQDWHO\
FRPELQHG ZLWK D QXPEHU RI LQVWLWXWLRQDOL]HG VSHFLDOL]DWLRQV ZLWK UDWKHU OLWWOH H[FKDQJH
EHWZHHQ WKHP 0DWKLDVVHQ   )LUVW UHVHDUFK FRQFHUQHG ZLWK 63, LV GLYLGHG LQWR WZR
UHVHDUFKFRPPXQLWLHVVRIWZDUHHQJLQHHULQJZKLFKLVSUDFWLFHGZLWKLQFRPSXWHUVFLHQFHDQG
HQJLQHHULQJGHSDUWPHQWVDQGLQIRUPDWLRQV\VWHPVGHYHORSPHQWZKLFKLVPDLQO\SUDFWLFHGDV
SDUWRILQIRUPDWLRQDQGPDQDJHPHQWVFLHQFHV$QRWDEOHH[FHSWLRQLV1718ZKHUHWKHWZR
FRPPXQLWLHV KDYH EHHQ PHUJHG LQWR RQH FRRSHUDWLYH UHVHDUFK GHSDUWPHQW 'HSDUWPHQW RI
&RPSXWHUDQG,QIRUPDWLRQ6FLHQFH
6HFRQG WZR GLIIHUHQW UHVHDUFK WUDGLWLRQV KDYH HPHUJHG D SRVLWLYLVW ZKLFK LV SULPDULO\
RFFXSLHGZLWKVWUXFWXUHGTXDQWLWDWLYHDSSURDFKHVEDVHGRQREVHUYDWLRQVDQGDQLQWHUSUHWLYLVW
ZKLFK XVHV OHVV VWUXFWXUHG PRUH TXDOLWDWLYH DSSURDFKHV EDVHG RQ LQWHUSUHWDWLRQV DQG
LQWHUYHQWLRQ)RUWKHPRVWSDUW(6(UHVHDUFKKDVEHHQFRQFHUQHGZLWKSRVLWLYLVWDSSURDFKHV
VXFKDVODERUDWRU\H[SHULPHQWV7KLVELDVWRZDUGDQGLGHDOL]DWLRQRISRVLWLYLVWDSSURDFKHVLV
PRVWYLVLEOHWKURXJKWKHFKRLFHRIWHUPLQRORJ\,QIDFWVHYHUDORIWKHOHDGLQJ(6(UHVHDUFKHUV
VHHP WR PL[ WKH WHUP ³HPSLULFDO´ ZLWK ³H[SHULPHQWDO´ =HONRZLW] DQG :DOODFH   IRU
H[DPSOHFODVVLILHGDQXPEHURIUHVHDUFKDSSURDFKHVDV³H[SHULPHQWDOPRGHOV´ZKLFKLQRXU
YLHZ KDV QRWKLQJ GR WR ZLWK H[SHULPHQWV HJ SURMHFW PRQLWRULQJ DVVHUWLRQ  RU HYHQ ZLWK
HPSLULFDOUHVHDUFK HJOLWHUDWXUHUHYLHZ 
)LQDOO\WKHUHDUHFRQVLGHUDEOHGLIIHUHQFHVLQZKDWLVFRQVLGHUHGWKHSULPDU\RXWFRPHRI
UHVHDUFKRQHJURXSLVIRFXVLQJSULPDULO\RQFRQFHSWVPHWKRGVDQGWRROVWRVXSSRUWSUDFWLFH
DQGDQRWKHULVVWULYLQJWRGHYHORSWKHRULHVDQGIUDPHZRUNVWRLPSURYHRXUXQGHUVWDQGLQJRI
SUDFWLFH
(DFKRIWKHUHODWHGFRPPXQLWLHVKDYHGHYHORSHGVWURQJDQGUHOHYDQWSRVLWLRQVDQGRQHRI
WKHNH\FKDOOHQJHVLQDGYDQFLQJ(6(UHVHDUFKLVWRLPSURYHWKHGLDORJXHEHWZHHQWKHP

5DWKHU WKDQ DUJXLQJ IRU WKH JHQHUDO VXSUHPDF\ RI RQH UHVHDUFK DSSURDFK RU VHDUFK IRU D
V\QWKHVLV RU FRPPRQ JURXQG IRU WKH ³EHVW ZD\´ RI GRLQJ UHVHDUFK ZH DUJXH WKDW WKH
UHVHDUFKHUPXVWHQJDJHLQDUHIOHFWLYHSURFHVVDFWLYHO\H[DPLQLQJWKHUHVHDUFKSUREOHPDQG
WKHHQYLURQPHQWLQZKLFKLWZLOOEHVWXGLHG%DVHGRQVXFKUHIOHFWLRQ(6(UHVHDUFKHUVVKRXOG
WDNH UHVSRQVLELOLW\ IRU PDNLQJ LQWHOOLJHQW FKRLFHV DERXW WKH DSSURDFK RU FRPELQDWLRQ RI
DSSURDFKHVWKH\DGRSWDQGWKHHQGVWKH\VHUYHLQHDFKVSHFLILFVLWXDWLRQ
)URP DQ DFDGHPLF SRLQW RI YLHZ WKH XOWLPDWH FULWHULRQ IRU PDNLQJ VXFK FKRLFHV LV
VFLHQWLILFULJRUZKLFK LV RIWHQ OLQNHG WR WKH UHOLDELOLW\ RI WKH LQVWUXPHQWV IRU GDWD FROOHFWLRQ
DQG DQDO\VLV XVHG LQ WKH UHVHDUFK DQG WR WKH LQWHUQDO DQG H[WHUQDO YDOLGLW\ RI WKH UHVHDUFK
ILQGLQJV+RZHYHULQDQDSSOLHGGLVFLSOLQHVXFKDV63,UHOHYDQFHLVDWOHDVWDVLPSRUWDQWDV
ULJRU ,Q RXU RSLQLRQ WKHUHIRUH LW LV QHFHVVDU\ WKDW WKH (6( UHVHDUFK FRPPXQLW\ YDOXHV WKH
GLYHUVLW\LQDYDLODEOHUHVHDUFKDSSURDFKHVDFWLYHO\WU\LQJWRXQGHUVWDQGDQGLPSURYHWKHPWR
EHWWHUVHUYHERWKUHVHDUFKHUVDQGSUDFWLWLRQHUV
$V ZLOO EHFRPH PRUH HYLGHQW WKURXJKRXW WKH WKHVLV ZH FRQVLGHU WKH WRSLF RI 63, DV D
VRFLRWHFKQLFDO VXEMHFW QRW VLPSO\ D WHFKQLFDO RQH ,W LV EHFDXVH RI WKLV WKDW ZH KDYH
XQGHUWDNHQ WKH SUHVHQW LQYHVWLJDWLRQ RI WKH LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV LQ HQDEOLQJ
63, &RQVHTXHQWO\ RQH PLJKW FDOO LQWR TXHVWLRQ WKH DSSURSULDWHQHVV RI WKH ELDVHG IRFXV RQ

±±
$3352$&+(672(03,5,&$/62)7:$5((1*,1((5,1*5(6($5&+

SRVLWLYLVWDSSURDFKHVLQSUHVHQW(6(UHVHDUFK,QRXUYLHZ(6(UHVHDUFKHUVVKRXOGFRRSHUDWH
ZLWK SUDFWLWLRQHUV DQG XQGHUWDNH PRUH UHVHDUFK ZLWK D SUDJPDWLF SKLORVRSK\ FRPELQLQJ
SRVLWLYLVW DQG LQWHUSUHWLYH DSSURDFKHV LQ UHDOZRUOG VLWXDWLRQV UDWKHU WKDQ HPSKDVL]LQJ
H[SHULPHQWDOHOHJDQFHLQWKHVDQLWL]HGHQYLURQPHQWRIWKHODERUDWRU\ VHH&KDSWHUVDQG 
7KH NH\ IHDWXUHV RI WKH (6( UHVHDUFK DSSURDFKHV GHVFULEHG LQ WKLV FKDSWHU ZKLFK DUH
VXPPDUL]HGLQ7DEOHWRJHWKHUZLWKWKHLUPDMRUVWUHQJWKVDQGZHDNQHVVHVFDQEHVHHQDVD
VWHS WRZDUG IDPLOLDUL]LQJ (6( UHVHDUFKHUV ZLWK VRPH RI WKH DSSURDFKHV DYDLODEOH IRU WKHLU
UHVHDUFK3RVVLEOHZD\VRIFRPELQLQJWKHVHDSSURDFKHVLQWKHSURFHVVRIEXLOGLQJH[WHQGLQJ
DQGWHVWLQJWKHRU\LVSUHVHQWHGLQ)LJXUH

&DVHVWXG\DFWLRQUHVHDUFK 5HVHDUFKTXHVWLRQ

5HVHDUFKTXHVWLRQ 6XUYH\UHVHDUFK

7KHRU\EXLOGLQJ 7KHRU\EXLOGLQJ

7KHRU\WHVWLQJ &DVHVWXG\

ODERUDWRU\H[SHULPHQW DFWLRQUHVHDUFK

7KHRU\WHVWLQJ 7KHRU\WHVWLQJ

ILHOGH[SHULPHQW ILHOGH[SHULPHQW

7KHRU\H[WHQVLRQ 7KHRU\H[WHQVLRQ

)LJXUH7KHXVHRIDOWHUQDWLYH(6(UHVHDUFKDSSURDFKHVLQWKHSURFHVVRIWKHRU\EXLOGLQJ
WHVWLQJDQGH[WHQVLRQ *DOOLHUVS 

 &KDSWHU6XPPDU\
,Q WKLV FKDSWHU ZH KDYH GHVFULEHG WKH UROH RI (6( UHVHDUFK DV RQH RI HQFRXUDJLQJ D PRUH
VFLHQWLILFDQGUHIOHFWLYHDSSURDFKWRVRIWZDUHHQJLQHHULQJZKLFKDOORZVXVWRLQYHVWLJDWHDQG
XQGHUVWDQG QHZ WHFKQRORJLHV DQG WKHLU DSSOLFDWLRQV WR SUDFWLFH )XUWKHUPRUH IRXU (6(
UHVHDUFK DSSURDFKHV WKDW VHHNV WR DGGUHVV WKLV ZHUH LGHQWLILHG DQG UHYLHZHG H[SHULPHQWDO
UHVHDUFK VXUYH\ UHVHDUFK FDVH VWXG\ UHVHDUFK DQG DFWLRQ UHVHDUFK )LQDOO\ ZH PDGH D
FRPSDULVRQRIWKHPDLQIHDWXUHVVWUHQJWKVDQGZHDNQHVVHVRIHDFKRIWKHVHDSSURDFKHV
7KH QH[W FKDSWHU LQWURGXFHV WKH PRGHO EXLOGLQJ SKDVH RI WKH SUHVHQW LQYHVWLJDWLRQ E\
GHVFULELQJWKHXQGHUO\LQJDVVXPSWLRQVDQGIRXQGDWLRQVRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
ZKLFKIRUPWKHEDVLVXSRQZKLFKRXUG\QDPLFPRGHORI63,LVFRQVWUXFWHG

±±
&+$37(5

7DEOH$VXPPDU\RIWKHNH\IHDWXUHVVWUHQJWKVDQGZHDNQHVVHVRIDOWHUQDWLYH(6(
UHVHDUFKDSSURDFKHV DGDSWHGIURP*DOOLHUVSS 

$SSURDFK .H\)HDWXUHV 6WUHQJWKV :HDNQHVVHV

/DERUDWRU\ ,GHQWLILFDWLRQRISUHFLVH 7KHVROXWLRQDQGFRQWURORI 7KHOLPLWHGH[WHQWWRZKLFK


H[SHULPHQWV UHODWLRQVKLSVEHWZHHQ DVPDOOQXPEHURIYDUL LGHQWLILHGUHODWLRQVKLSV
FKRVHQYDULDEOHVYLDD DEOHVZKLFKPD\WKHQEH H[LVWVLQWKHUHDOZRUOGGXH
GHVLJQHGODERUDWRU\VLWXD VWXGLHGLQWHQVLYHO\ WRRYHUVLPSOLILFDWLRQRIWKH
WLRQXVLQJTXDQWLWDWLYH H[SHULPHQWDOVLWXDWLRQDQG
DQDO\WLFDOWHFKQLTXHVZLWK WKHLVRODWLRQRIVXFKVLWXD
DYLHZWRPDNLQJJHQHU WLRQVIURPPRVWRIWKH
DOL]DEOHVWDWHPHQWVDSSOL YDULDEOHVWKDWDUHIRXQGLQ
FDEOHWRUHDOOLIHVLWXDWLRQV WKHUHDOZRUOG

)LHOG ([WHQVLRQRIODERUDWRU\ *UHDWHUUHDOLVPOHVV )LQGLQJRUJDQL]DWLRQVSUH


H[SHULPHQWV H[SHULPHQWVLQWRWKHUHDO DUWLILFLDOVDQLWL]HGWKDQWKH SDUHGWREHH[SHULPHQWHG
OLIHVLWXDWLRQRIRUJDQL]D ODERUDWRU\VLWXDWLRQ RQ$FKLHYLQJVXIILFLHQW
WLRQVDQGRUVRFLHW\ FRQWUROWRHQDEOHUHSOLFD
WLRQZLWKRQO\WKHVWXG\
YDULDEOHVEHLQJDOWHUHG

6XUYH\V 2EWDLQLQJVQDSVKRWVRI *UHDWHUQXPEHURIYDUL /LNHO\WKDWOLWWOHLQVLJKW


SUDFWLFHVVLWXDWLRQVRU DEOHVPD\EHVWXGLHGWKDQ REWDLQHGUHJDUGLQJWKH
YLHZVDWDSDUWLFXODUSRLQW LQWKHFDVHRIH[SHULPHQWDO FDXVHVSURFHVVHVEHKLQG
LQWLPH YLDTXHVWLRQQDLUHV DSSURDFKHV'HVFULSWLRQRI WKHSKHQRPHQDEHLQJ
RULQWHUYLHZV IURPZKLFK UHDOZRUOGVLWXDWLRQV0RUH VWXGLHG3RVVLEOHELDVLQ
LQIHUHQFHVDUHPDGH XV HDV\DSSURSULDWHJHQHUDOL UHVSRQGHQWV FIVHOIVH
LQJTXDQWLWDWLYHDQDO\WLFDO ]DWLRQV OHFWLQJQDWXUHRITXHVWLRQ
WHFKQLTXHV UHJDUGLQJWKH QDLUHUHVSRQGHQWV WKH
UHODWLRQVKLSVWKDWH[LVWLQ UHVHDUFKHUDQGWKHPR
WKHSDVWSUHVHQWDQGIX PHQWLQWLPHZKLFKWKH
WXUH UHVHDUFKLVXQGHUWDNHQ

&DVH $QDWWHPSWDWGHVFULELQJ &DSWXULQJ³UHDOLW\´LQ 5HVWULFWLRQWRDVLQJOH


VWXGLHV WKHUHODWLRQVKLSVZKLFK JUHDWHUGHWDLODQGDQDO\] HYHQWRUJDQL]DWLRQ'LIIL
H[LVWLQUHDOLW\XVXDOO\ LQJPRUHYDULDEOHVWKDQLV FXOW\LQJHQHUDOL]LQJJLYHQ
ZLWKLQDVLQJOHRUJDQL]DWLRQ SRVVLEOHXVLQJDQ\RIWKH SUREOHPVRIDFTXLULQJ
RURUJDQL]DWLRQDOJURXSLQJ DERYHDSSURDFKHV VLPLODUGDWDIURPDVWDWLVWL
FDOO\PHDQLQJIXOQXPEHURI
FDVHV/DFNRIFRQWURORI
YDULDEOHV'LIIHUHQWLQWHU
SUHWDWLRQVRIHYHQWVE\
LQGLYLGXDOUHVHDUFKHUV
VWDNHKROGHUV

$FWLRQ $SSOLHGUHVHDUFKZKHUH 3UDFWLFDODVZHOODVWKHR 6LPLODUWRFDVHVWXG\UH


UHVHDUFK WKHUHLVDQDWWHPSWWRRE UHWLFDORXWFRPHVPRVW VHDUFKEXWDGGLWLRQDOO\
WDLQUHVXOWVRISUDFWLFDO RIWHQDLPHGDWHPDQFLSD SODFHVDFRQVLGHUDEOH
YDOXHWRJURXSVZLWKZKRP WRU\RXWFRPHV%LDVHVRI UHVSRQVLELOLW\RQWKHUH
WKHUHVHDUFKHULVDOOLHG UHVHDUFKHUPDGHNQRZQ VHDUFKHUZKHQREMHFWLYHV
ZKLOHDWWKHVDPHWLPH DUHDWRGGVZLWKRWKHU
DGGLQJWRWKHRUHWLFDO JURXSLQJV7KHHWKLFVRI
NQRZOHGJH WKHSDUWLFXODUUHVHDUFKDUH
DNH\LVVXH

±±
&+$37(5 
)RXQGDWLRQVRIWKH
/HDUQLQJ6RIWZDUH2UJDQL]DWLRQ

³5HDOLW\LVPHUHO\DQLOOXVLRQDOEHLWDYHU\SHUVLVWHQWRQH´
±$OEHUW(LQVWHLQ

,QWKLVFKDSWHUZHGHVFULEHWKHXQGHUO\LQJDVVXPSWLRQVDQGIRXQGDWLRQVRIWKHOHDUQLQJVRIW
ZDUHRUJDQL]DWLRQZKLFKIRUPWKHEDVLVXSRQZKLFKRXUG\QDPLFPRGHORI63,LVFRQVWUXFWHG
VHH&KDSWHU 7KHVHIRXQGDWLRQVRULJLQDWHIURPRXUH[SHULHQFHDQGREVHUYDWLRQVZKLFKOHG
XVWRDQHPSKDVLVRQ63,DVRUJDQL]DWLRQDOOHDUQLQJ±DVDFROOHFWLYHDELOLW\H[SUHVVHGLQDQG
WKURXJKWKHRUJDQL]DWLRQV¶ SURGXFW DQG VHUYLFHRULHQWHG SUDFWLFHV UHODWHG WR VRIWZDUH GHYHO
RSPHQW)XUWKHUPRUHLWOHGXVWRHPSKDVL]HDPRUH DGDSWLYHDQG DFWLYHYLHZRINQRZOHGJH
UDWKHUWKDQWKHWUDGLWLRQDOVWDWLFDQGSDVVLYHYLHZ7KHIROORZLQJSUHPLVHVDUHLGHQWLILHG

x 6RFLDO OHDUQLQJ ZKLFK LV IRFXVHG RQ 63, DV D VRFLDO FROODERUDWLYH DFWLYLW\ ZLWKLQ WKH
FRQWH[WRIDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ VHH6HFWLRQ 
x 6HQVHPDNLQJ ZKLFK LV DLPHG DW FRQVWUXFWLQJ PHDQLQJ DQG H[SUHVVLQJ WKH EDVLF
DVVXPSWLRQVDQGYDOXHVWKDWDUHYLWDOWRWKH VRIWZDUH RUJDQL]DWLRQ DQG LWV PHPEHUV VHH
6HFWLRQ 
x .QRZOHGJHFUHDWLRQZKLFKLVDLPHGDWJHQHUDWLQJQHZNQRZOHGJHDQGQHZFRPSHWHQ
FLHV WKDW HQDEOH RU EURDGHQ WKH VRIWZDUH RUJDQL]DWLRQ¶V SRWHQWLDO UDQJH RI DFWLRQV VHH
6HFWLRQ 
x 3XUSRVHIXODFWLRQZKLFKLVDLPHGDWXVLQJWKHQHZLQWHUSUHWDWLRQVDQGQHZNQRZOHGJH
WRFRQVWUXFWLPSURYHGFRXUVHVRIDFWLRQ VHH6HFWLRQ 

,QWKHUHVWRIWKLVFKDSWHUZHGHVFULEHWKHWKHRUHWLFDOIRXQGDWLRQVIRUHDFKRIWKHVHSUHPLVHV
ZKLFKOLHEHKLQGRXUG\QDPLFPRGHORIWKHOHDUQLQJSURFHVVHVDQGWKHNH\IDFWRUVIRUVXFFHVV
LQ63,)LQDOO\ZHVXPPDUL]HWKHFKDSWHUE\OLQNLQJWKHVHIRXQGDWLRQVWRWKHG\QDPLFPRGHO
RI63,ZKLFKLVGHILQHGLQWKHQH[WFKDSWHU

±±
&+$37(5

 6RFLDO/HDUQLQJ
$Q\RQH HQJDJHG LQ FRQVWUXFWLQJ DQ HQYLURQPHQW IRU 63, LV IDFHG ZLWK WKH TXHVWLRQ RI WKH
SURSHUNLQGRIRYHUDOOSHUVSHFWLYHWRFKRRVHDVDJXLGHOLQH$FFRUGLQJWR0RUJDQ  VXFK
SHUVSHFWLYHV FDQ EH FUHDWHG WKURXJK WKH XVH RI PHWDSKRUV +H LQYLWHV DQG FKDOOHQJHV XV WR
UHFRJQL]HDQGFRSHZLWKWKHLGHDWKDWDOOWKHRULHVRIRUJDQL]DWLRQDQGPDQDJHPHQWDUHEDVHG
RQLPSOLFLWLPDJHVRIPHWDSKRUVWKDWSHUVXDGHXVWRVHHXQGHUVWDQGDQGLPDJLQHVLWXDWLRQVLQ
SDUWLDO ZD\V +H DUJXHG WKDW PHWDSKRUV ERWK FUHDWH LQVLJKW DQG GLVWRUW DW WKH VDPH WLPH E\
KLJKOLJKWLQJSDUWLFXODUIDFHWVDQGREVFXULQJRWKHUV0RUJDQ¶V  PDLQDUJXPHQWZDVWKDW
RQFH ZH KDYH OHDUQHG KRZ WR JHQHUDWH LQWHJUDWH DQG XVH WKH LQVLJKWV RI FRPSHWLQJ
PHWDSKRUVWKH\ FRXOG EH XVHG WR XQGHUVWDQG DQG VKDSH WKH VLWXDWLRQ WKDW ZH DUH VHHNLQJ WR
RUJDQL]HDQGPDQDJH
,QWKLVVHFWLRQZHILUVWWDNHDFORVHUORRNDWWKHUDWLRQDOLVWLFSHUVSHFWLYHWKDWGRPLQDWHV
WHFKQRORJ\GHYHORSPHQWWRGD\DQGWKHFRQVHTXHQFHVWKDWWKLVSHUVSHFWLYHKDVRQ63,7KHQ
ZH SURSRVH DQ DOWHUQDWLYH SHUVSHFWLYH WKDW VRIWZDUH GHYHORSPHQW DQG 63, FDQ EH VHHQ DV D
VRFLDOFRQVWUXFWLRQRIUHDOLW\DQGDUJXHWKDWWKLVLVDQHFHVVDU\SHUVSHFWLYHIRUDPHDQLQJIXO
FRQFHSWLRQRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
5DWKHU WKDQ WKH QDUURZ GHILQLWLRQV RI WHFKQRORJ\ IRXQG ZLWKLQ HQJLQHHULQJ ZH DGRSW
0DF.HQ]LHDQG:DMFPDQ¶V  WKUHHOHYHOGHILQLWLRQRIWHFKQRORJ\DV  SK\VLFDOREMHFWV
RUDUWLIDFWV  DFWLYLWLHVRUSURFHVVHVDQG  NQRZOHGJHRUSRWHQWLDODFWLRQV,QWKLVUHVSHFW
ERWK VRIWZDUH VRIWZDUH GHYHORSPHQW DQG VRIWZDUH SURFHVV LPSURYHPHQW FDQ FOHDUO\ EH
UHJDUGHG DV WHFKQRORJ\ 0RUHRYHU WKLV GHILQLWLRQ DOVR PDNHV DQ LPSRUWDQW FRQQHFWLRQ
EHWZHHQWHFKQRORJ\DQGKXPDQDFWLYLW\

 7KHUDWLRQDOLVWLFWUDGLWLRQ
7RGD\ WKH GRPLQDQW SHUVSHFWLYH RQ VRIWZDUH GHYHORSPHQW LV URRWHG LQ WKH ³EHVW SUDFWLFH´
SDUDGLJP SURPRWLQJ D SURGXFWOLQH DSSURDFK WR VRIWZDUH GHYHORSPHQW ZLWK D VWDQGDUGL]HG
FRQWUROODEOH DQG SUHGLFWDEOH VRIWZDUH HQJLQHHULQJ SURFHVV :LWKLQ WKH ³EHVW SUDFWLFH´
SDUDGLJP ZH ILQG WKDW VWDQGDUGL]HG URXWLQHV DQG DXWRPDWLRQ UHSODFH KXPDQ UHDVRQLQJ DQG
WKDWWKHZKROHSURFHVVLVDLPHGDWDQHFRQRPLFDORSWLPL]DWLRQRIUHSURGXFWLRQ
7KH FKLHI V\PERO RI WKH UDWLRQDOLVWLF DSSURDFK WR PDQDJHPHQW ZDV )UHGHULFN :LQVORZ
7D\ORUDQGKLVSULQFLSOHVRIVFLHQWLILFRU³WDVN´PDQDJHPHQW7D\ORU¶V  SURMHFWZDVWR
PD[LPL]H SURGXFWLYLW\ LQ IDFWRU\ RSHUDWLRQV E\   H[WHUQDOL]LQJ WKH ZRUNHUV NQRZOHGJH
WKURXJKREVHUYDWLRQDQGPHDVXUHPHQW  VHSDUDWHSODQQLQJIURPWDVNH[HFXWLRQDQG  LQ
WURGXFLQJ VSHFLILF FRQWURO PHFKDQLVPV 7KH LGHD ZDV WR KDYH FRPSOHWH NQRZOHGJH RI HDFK
WDVNDQGWRSUHSDUHGHWDLOHGLQVWUXFWLRQVDERXWWKHZRUNWREHGRQHEHIRUHLWZDVVWDUWHG7KLV
WKHQZRXOGIUHHWKHZRUNHUVIURPWKLQNLQJDERXWSDVWH[SHULHQFH±DOOWKH\QHHGHGWRGRZDV
WRIROORZPDQDJHULDOGLUHFWLRQV7KLVYLHZKDVDOVREHHQIRUFHIXOO\ FODLPHG ZLWKLQ VRIWZDUH
GHYHORSPHQW HJ5RHW]KHLP 
)XUWKHUPRUH 0D[ :HEHU REVHUYHG WKH SDUDOOHOV EHWZHHQ WKH PHFKDQL]DWLRQ DQG
VSHFLDOL]DWLRQ RI ZRUN LQ LQGXVWULDO VHWWLQJV DQG WKH SUROLIHUDWLRQ RI EXUHDXFUDWLF IRUPV RI
RUJDQL]DWLRQ+RZHYHU:HEHU  DOVRSHUFHLYHGEXUHDXFUDF\DVDSRZHULQVWUXPHQWDQG
KHZDVFRQFHUQHGWKDWWKHHIILFLHQF\RIEXUHDXFUDWLFRUJDQL]DWLRQVFRXOGDOOWRRHDVLO\ORFNXV
LQWRDQ³,URQ&DJH´RIPDFKLQHOLNHH[LVWHQFH
0DUFKDQG6LPRQ  GHQLHGWKHSRVVLELOLW\RIILQGLQJDQREMHFWLYHWKHRUHWLFDO

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

³EHVW ZD\´ LQ SUDFWLFH DQG WKH\ DWWDFNHG WKH XQERXQG UDWLRQDO PRGHO RI RUJDQL]DWLRQV
&RQVHTXHQWO\ WKH\ DUJXHG WKDW WKH REMHFWLYH SUDFWLFDO JRDO ZDV QRW WR ILQG WKH RSWLPDO
VROXWLRQEXWWRILQGRQHWKDWLVJRRGHQRXJK7KHFHQWUDOWKHPHLQ0DUFKDQG6LPRQ¶V 
 ZRUNLVWKHLGHDRIOLPLWHGFRQVHTXHQWLDOUDWLRQDOLW\ ZKLFKKDVEHFRPHPRUHRUOHVV
VWDQGDUGLQPRGHUQWKHRULHVRIGHFLVLRQPDNLQJ7KHLUPDLQDUJXPHQWZDVWKDWEHFDXVHRIWKH
OLPLWVLQKXPDQXQGHUVWDQGLQJDQGGHFLVLRQPDNLQJRUJDQL]DWLRQVZLOOQHYHUEHIXOO\UDWLRQDO
RUEHDEOHWRDGDSWFRPSOHWHO\WRWKHLUHQYLURQPHQWV
7UDQVODWLQJWKHQRWLRQVRIWKHUDWLRQDOLVWLFWUDGLWLRQLQWRWKHGRPDLQRIVRIWZDUHGHYHORS
PHQW\LHOGVWKHIROORZLQJVHWRIDVVXPSWLRQV :LQRJUDGDQG)ORUHV)OR\G 

x 6RIWZDUHHQJLQHHULQJLVFRQFHUQHGZLWKWKHSURGXFWLRQRIVRIWZDUHRQWKHEDVLVRIIL[HG
UHTXLUHPHQWVWKDWFDQEHVHSDUDWHGIURPLWVXVHDQGWKDWFDQEHREWDLQHGE\DQDO\]LQJWKH
IDFWVRIDJLYHQUHDOLW\
x 7KH HVVHQWLDO WDVN RI VRIWZDUH GHYHORSHUV LV WR ILQG D FRUUHFW VROXWLRQ LQ WKH IRUP RI
VRIWZDUHWRWKHSUREOHPVGHILQHGLQWKHPRGHOVUHSUHVHQWLQJWKDWUHDOLW\
x 7KH SURGXFWLRQ SURFHVV LV LQGHSHQGHQW RI LQGLYLGXDOV DQG KHQFH GHYHORSHUV VKRXOG EH
LQWHUFKDQJHDEOH7KDWLVGLIIHUHQWGHYHORSHUVVKRXOGEHDEOHWRDUULYHDWWKHVDPHUHVXOWV
x 6XEMHFWWRWHFKQLFDOIHDVLELOLW\DQ\GHVLUHGSDUWVRIWKHSURGXFWLRQSURFHVVFDQEHDXWR
PDWHG

2QHRIWKHJUHDWFRQWULEXWLRQVRIWKHUDWLRQDOLVWLFDSSURDFKZDVWKHSUDFWLFHRIFODULI\LQJDQG
PDNLQJ WKH FRQFHSWV RI WDVN PDQDJHPHQW DQG RUJDQL]DWLRQDO VWUXFWXUH RSHUDWLRQDO VR WKDW
PDQDJHUVFRXOGSXWLWLQWRDFWLRQ$OVRWKHYLHZRIVRIWZDUHGHYHORSPHQWUHIOHFWHGLQWKHVH
DVVXPSWLRQV KDV EHHQ LQVWUXPHQWDO LQ EULQJLQJ DERXW LPSUHVVLYH DGYDQFHV LQ VRIWZDUH DQG
VRIWZDUH GHYHORSPHQW PHWKRGV ,W DOORZV XV WR XQGHUVWDQG LPSRUWDQW DVSHFWV RI VRIWZDUH
GHYHORSPHQWSULRUWRLQLWLDWLRQRIWKHGHYHORSPHQWSURFHVVWRDVVHVVPRUHRUOHVVFRPSOHWHG
SURMHFWVRUWR³IDNH´DUDWLRQDOGHVLJQSURFHVVDVVXJJHVWHGE\3DUQDVDQG&OHPHQWV  
'HVSLWH WKHVH DGYDQFHV WKH UDWLRQDOLVWLF DSSURDFK WR VRIWZDUH GHYHORSPHQW KDV VHYHUH
OLPLWDWLRQV)LUVW WKH IUDJPHQWDWLRQ DQG DXWKRULWDULDQ FRQWURO V\VWHPV DUH LQIOH[LEOH DQG FDQ
KDYH JUHDW GLIILFXOW\ LQ DGDSWLQJ WR FKDQJLQJ FLUFXPVWDQFHV 6HFRQG LW FDQ KDYH
GHKXPDQL]LQJHIIHFWVXSRQHPSOR\HHVOHDGLQJ WR JURXS GHIHQVH 7ULVW DQG %DPIRUWK  
DOLHQDWLRQ DQG ORVV RI IUHHGRP LQLWLDWLYH DQG FUHDWLYLW\ %ODXQHU   7KLUG WKH
UDWLRQDOLVWLF DSSURDFK UHPDLQV D P\WK LQ WZR UHVSHFWV %UXQVVRQ     LW UHVWV RQ
VLPSOLI\LQJDVVXPSWLRQVWKDWLJQRUHWKH UDQJH RI OHJLWLPL]LQJ IXQFWLRQV ZKLFK GHFLVLRQV FDQ
IXOILO DQG   LW SUHVXPHV D FDXVDO OLQN EHWZHHQ LGHDV DQG DFWLRQ WKDW LV XVXDOO\ PLVVLQJ LQ
SUDFWLFH)RXUWKWKH UDWLRQDOLVWLFDSSURDFKIDLOVWR RIIHU DQ\ KHOS LQ XQGHUVWDQGLQJ DQ DFWXDO
VRIWZDUH GHYHORSPHQW SURFHVV LQ D JLYHQ VLWXDWLRQ )LQDOO\ WKH ³EHVW SUDFWLFH´ YLHZ RI
VRIWZDUH GHYHORSPHQW LV QHJOHFWLQJ WKH LQKHUHQW VRFLDO FKDUDFWHU RI VRIWZDUH GHYHORSPHQW
DQG WKDW WKH GHYHORSPHQW HQYLURQPHQW LV VRFLDOO\ FRQVWUXFWHG WKURXJK SURFHVVHV RI
FRPPXQLFDWLRQLQZKLFKLQGLYLGXDOGHYHORSHUVGHILQHWKHLUVLWXDWLRQV
&RQVHTXHQWO\LWIROORZVIURPWKHDERYHDUJXPHQWDWLRQWKDWWKHUHDOL]DWLRQRIDQREMHFWLYH
³EHVWZD\´WRVRIWZDUHGHYHORSPHQWLVQRWDSUDFWLFDOSRVVLELOLW\+RZHYHUTXHVWLRQLQJWKH
UDWLRQDOLVWLFDSSURDFKQHFHVVDULO\LQYROYHVH[DPLQLQJDOWHUQDWLYHDSSURDFKHV:HKDYHFKRVHQ
DQ DSSURDFK ZHUH ZH SHUFHLYH VRIWZDUH GHYHORSPHQW DV UHDOLW\ FRQVWUXFWLRQ 7R XQGHUVWDQG
WKLVSRVLWLRQZHPXVWHQWHULQWRWKHFRQVWUXFWLYLVWGLVFRXUVH

±±
&+$37(5

 6RIWZDUHGHYHORSPHQWDVUHDOLW\FRQVWUXFWLRQ
$VRIWZDUHGHYHORSHUDQDO\]LQJDQRUJDQL]DWLRQLQRUGHUWRGHYHORSDVRIWZDUHV\VWHPWRVXS
SRUWLWVEXVLQHVVSURFHVVHVLVDFFRUGLQJWRWKHUDWLRQDOLVWLFDSSURDFKQRUPDOO\HQFRXUDJHGWR
VWDUW IURP WKH ³UHDO ZRUOG´ WR DEVWUDFW DQG WR HODERUDWH D FRUUHFW PRGHO WKDW FDQ EH
PDQLSXODWHGE\WKHFRPSXWHU:KLOHWKLVPD\EHGLIILFXOWWRGRWKHWDVNLWVHOI±GLVFRYHULQJ
WKH FRUUHFW GHVFULSWLRQ ± LV VXSSRVHG WR EH FOHDUO\ GHILQHG DQG LQGHSHQGHQW RI WKH VRIWZDUH
GHYHORSHUDVDQLQGLYLGXDO7KLVSLFWXUHFKDQJHVGUDVWLFDOO\KRZHYHUZKHQZHDFNQRZOHGJH
RXU DFWLYH UROH LQ EULQJLQJ DERXW ZKDW ZH KROG IRU UHDO ZKLFK LV WKH NH\ WR FRQVWUXFWLYLVW
WKLQNLQJ
&RQVWUXFWLYLVPLVDWKHRU\ZKLFKGLIIHUVIURPWKHWUDGLWLRQDOYLHZWKDWNQRZOHGJHH[LVWV
LQGHSHQGHQWO\RIWKHLQGLYLGXDO±WKHYLHZWKDWWKHPLQGLVDWDEXODUDVDDEODQNWDEOHWXSRQ
ZKLFK D SLFWXUH FDQ EH SDLQWHG $ IXQGDPHQWDO SUHPLVH RI FRQVWUXFWLYLVP LV WKDW VRIWZDUH
GHYHORSHUVDFWLYHO\FRQVWUXFWWKHLUNQRZOHGJH5DWKHUWKDQVLPSO\DEVRUELQJLGHDVVSRNHQDW
WKHP E\ RWKHUV FRQVWUXFWLYLVP SRVLWV WKDW VRIWZDUH GHYHORSHUV DFWXDOO\ LQYHQW WKHLU LGHDV
7KH\ DVVLPLODWH QHZ LQIRUPDWLRQ WR VLPSOH SUHH[LVWLQJ QRWLRQV DQG PRGLI\ WKHLU
XQGHUVWDQGLQJLQOLJKWRIQHZGDWD,QWKHSURFHVVWKHLULGHDVJDLQLQFRPSOH[LW\DQGSRZHU
DQGZLWKDSSURSULDWHVXSSRUWWKH\GHYHORSFULWLFDOLQVLJKWLQWRKRZWKH\WKLQNDQGZKDWWKH\
NQRZ DERXW WKH ZRUOG DV WKHLU XQGHUVWDQGLQJ LQFUHDVHV LQ GHSWK DQG GHWDLO &RQVWUXFWLYLVP
HPSKDVL]HV WKH FDUHIXO VWXG\ RI WKH SURFHVVHV E\ ZKLFK LQGLYLGXDOV DQG JURXSV FUHDWH DQG
GHYHORSWKHLULGHDV ,WV 63, DSSOLFDWLRQV OLH LQ FUHDWLQJ D OHDUQLQJ HQYLURQPHQW WKDW PDWFK ±
EXW DOVR FKDOOHQJH ± VRIWZDUH GHYHORSHUV¶ XQGHUVWDQGLQJ IRVWHULQJ IXUWKHU JURZWK DQG
LPSURYHPHQWRIWKHLUZRUN
2XU SDUWLFXODU LQWHUHVW KDV EHHQ WR DSSO\ WKH VRFLDO FRQVWUXFWLRQ SHUVSHFWLYH ZLWKLQ WKH
FRQWH[WRIVRIWZDUHGHYHORSPHQWDQG63,6HYHUDODXWKRUVPD\EHVDLGWRKROGDVLPLODUYLHZ
:LQRJUDG DQG )ORUHV   IRU H[DPSOH LQTXLUHG LQWR WKH SURFHVVHV RI FRPSXWHU DQG
VRIWZDUHGHVLJQXVLQJDFRQVWUXFWLYLVWDSSURDFK6LPLODUO\)OR\GHWDO  GLVFXVVHGKRZ
VRIWZDUHGHYHORSPHQWFRXOGEHVHHQDVUHDOLW\FRQVWUXFWLRQZKLOH*MHUVYLN  VWXGLHGWKH
VRFLDOFRQVWUXFWLRQRILQIRUPDWLRQV\VWHPVLQRUJDQL]DWLRQV$OVR%DHWMHU  %HQQHWWVHW
DO   .URJVWLH   0HVVQDU] D  DQG 6LGGLTL   KDYH UHOLHG RQ D
FRQVWUXFWLYLVWDSSURDFKLQWKHLUVRIWZDUHUHVHDUFK)XUWKHUPRUHWKHUHLVDOVRDODUJHERG\RI
OLWHUDWXUHUHJDUGLQJWKHVRFLDOFRQVWUXFWLRQRIWHFKQRORJ\LQJHQHUDO HJ%LMNHUHWDO
/DWRXU0DF.HQ]LHDQG:DMFPDQ 
3HWHU%HUJHUDQG7KRPDV/XFNPDQQ¶V7KH6RFLDO&RQVWUXFWLRQRI5HDOLW\LVSUREDEO\WKH
PRVW LQIOXHQWLDO VRXUFH IRU UHFHQW FRQVWUXFWLYLVW LGHDV %HUJHU DQG /XFNPDQQ   SODFHG
WKHVRFLRORJ\RINQRZOHGJHLHWKHVWXG\RIWKHVRFLDOFRQGLWLRQVRINQRZOHGJHDWWKHFRUHRI
VRFLRORJLFDOWKHRUL]LQJ³7KHEDVLFFRQWHQWLRQVRIWKHDUJXPHQWRIWKLVERRNDUHWKDWUHDOLW\
LVVRFLDOO\FRQVWUXFWHGDQGWKDWWKHVRFLRORJ\RINQRZOHGJHPXVWDQDO\]HWKHSURFHVVLQZKLFK
WKLVRFFXUV´ S 
$FFRUGLQJ WR %HUJHU DQG /XFNPDQQ   WKH FRQVWUXFWLRQ RI VRFLDO UHDOLW\ LV D
GLDOHFWLFDOSURFHVV EHWZHHQH[WHUQDOL]DWLRQ RI LQGLYLGXDO VXEMHFWLYH UHDOLWLHV WKURXJK DFWLRQ
UHVXOWLQJ LQ REMHFWLYH UHDOLW\ DQG WKH LQWHUQDOL]DWLRQ RI WKLV REMHFWLYH UHDOLW\ WKURXJK
VHQVHPDNLQJLQWRVXEMHFWLYHUHDOLW\,QWKHFRQWH[WRIVRIWZDUHGHYHORSPHQWZHILQGLWPRUH
KHOSIXOWKRXJKWRXVH*MHUVYLN¶V  WHUPV³ORFDO´DQG³RUJDQL]DWLRQDOUHDOLW\´LQVWHDGRI
%HUJHUDQG/XFNPDQQ¶V  FRQFHSWVRI³VXEMHFWLYH´DQG³REMHFWLYHUHDOLW\´DVVKRZQLQ
)LJXUH

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

25*$1,=$7,21$/
5($/,7<

(;7(51$/,=$7,21 ,17(51$/,=$7,21
$FWLRQ 6HQVHPDNLQJ

/2&$/
5($/,7<

)LJXUH7KHFRQVWUXFWLRQRIVRFLDOUHDOLW\ DGDSWHGIURP*MHUVYLNS 

/RFDOUHDOLW\LVWKHZD\DQLQGLYLGXDORUDJURXSRILQGLYLGXDOVSHUFHLYHWKHZRUOGLQZKLFK
WKH\ OLYH ,W LV D NLQG RI NQRZOHGJH DERXW KRZ WKH GLIIHUHQW SDUWV RI WKH ZRUOG ILW WRJHWKHU
ZKDWLVUHODWHGWRZKDWDQGKRZWRLQWHUSUHWDFWLRQVDQGHYHQWV *MHUVYLN /RFDOUHDOLW\
LVWKHNQRZOHGJHWKDWVKRZVXSLQDFWLRQRUZKDWZHPLJKWFKDUDFWHUL]HDV³NQRZLQJ´
7KHUHDUHVHYHUDOVRFLDOJURXSVZLWKLQDVRIWZDUHRUJDQL]DWLRQWKDWVKDUHNQRZOHGJHDQG
WKDWPD\EHLGHQWLILHGDVKDYLQJDGLVWLQFWORFDOUHDOLW\([DPSOHVRIVXFKJURXSVDUHIRUPDO
SURMHFW WHDPV DQG LQIRUPDO JURXSV RI VRIWZDUH GHYHORSHUV DQG PDQDJHUV 7KH JURXS¶V ORFDO
UHDOLW\ FDQ EH VHHQ DV D ZD\ RI DFWLQJ LQ UHODWLRQVKLS WR WKH UHVW RI WKH RUJDQL]DWLRQ 7KH
VWUHQJWK RI VXFK ORFDO UHDOLWLHV DV ZLWK DOO VRFLDOO\ FRQVWUXFWHG NQRZOHGJH FRPHV IURP WKH
³ZHIHHOLQJ´FUHDWHGE\VKDUHGH[SHULHQFH /\VJDDUG 
7KLV JLYHV ULVH WR WKH LPSRUWDQW SRLQW WKDW VLQFH VRFLDO JURXSV GHILQH WKH SUREOHPV RI
VRIWZDUHGHYHORSPHQWWKHUHLVIOH[LELOLW\LQWKHZD\VRIWZDUHLVGHVLJQHG+HQFHWKHUHLVQRW
MXVWRQHSRVVLEOHZD\RURQHEHVWZD\RIGHVLJQLQJDVRIWZDUHSURGXFWRUGHILQLQJLWVVFRSH

([WHUQDOL]DWLRQLV WKH HQDFWPHQW RI ORFDO UHDOLW\ ,W LV WKH SURFHVV RI FUHDWLQJ RUJDQL]DWLRQDO
LQVWLWXWLRQVV\VWHPVDQGURXWLQHVE\WDNLQJDFWLRQDQGXVLQJODQJXDJHWRH[SUHVVRQHVHOIWR
WKHH[WHUQDOZRUOG,WFDQEHVHHQDVDSURFHVVRIFUHDWLQJVRFLDORUGHU %HUJHUDQG/XFNPDQQ
 

>6@RFLDO RUGHU LV D KXPDQ SURGXFW RU PRUH SUHFLVHO\ DQ RQJRLQJ KXPDQ SURGXFWLRQ ,W LV
SURGXFHGE\PDQLQWKHFRXUVHRIKLVRQJRLQJH[WHUQDOL]DWLRQ«6RFLDORUGHULVQRWSDUW RI
WKHµQDWXUHRIWKLQJV¶DQGLWFDQQRWEHGHULYHGIURPWKHµODZVRIQDWXUH¶6RFLDORUGHUH[LVWV
RQO\DVDSURGXFWRIKXPDQDFWLYLW\ LELGSS 

7KXVWKURXJKWKHSURFHVVRIH[WHUQDOL]DWLRQRUJDQL]DWLRQDOPHPEHUVFRQVWUXFWRUJDQL]DWLRQDO
UHDOLW\

2UJDQL]DWLRQDOUHDOLW\LVWKHVRFLDORUGHURULQVWLWXWLRQWKDWH[LVWVEHFDXVHHYHU\ERG\UHODWHV
WRLWLQWKHLUDFWLRQV,WLVW\SLFDOO\SHUFHLYHGWRKDYHDQH[LVWHQFHDSDUWIURPRXULQWHUSUHWD
WLRQV DQG PHDQLQJV ³,QVWLWXWLRQV JHQHUDOO\ PDQLIHVW WKHPVHOYHV LQ FROOHFWLYLWLHV FRQWDLQLQJ

±±
&+$37(5

FRQVLGHUDEOH QXPEHUV RI SHRSOH´ %HUJHU DQG /XFNPDQQ  S   ,QVWLWXWLRQV ERWK
HQDEOHDQGOLPLWZKDWLVSRVVLEOHWRGRGHSHQGLQJRQWKHLUKLVWRU\DQGGHJUHHRIFRQWURO

,QVWLWXWLRQV DOZD\V KDYH D KLVWRU\ RI ZKLFK WKH\ DUH WKH SURGXFWV ,W LV LPSRVVLEOH WR
XQGHUVWDQG DQ LQVWLWXWLRQ DGHTXDWHO\ ZLWKRXW DQ XQGHUVWDQGLQJ RI WKH KLVWRULFDO SURFHVV LQ
ZKLFK LW ZDV SURGXFHG ,QVWLWXWLRQV DOVR E\ WKH YHU\ IDFW RI WKHLU H[LVWHQFH FRQWURO KXPDQ
FRQGXFW E\ VHWWLQJ XS SUHGHILQHG SDWWHUQV RI FRQGXFW ZKLFK FKDQQHO LW LQ RQH GLUHFWLRQ DV
DJDLQVWWKHPDQ\RWKHUGLUHFWLRQVWKDWZRXOGWKHRUHWLFDOO\EHSRVVLEOH LELGS 

7KXVWKHPRUHFRQGXFWLVLQVWLWXWLRQDOL]HGWKHPRUHSUHGLFWDEOHDQGWKXVWKHPRUHFRQWUROOHG
LWEHFRPHV

,QWHUQDOL]DWLRQLVWKHSURFHVVE\ZKLFKLQGLYLGXDOVRUJURXSVRILQGLYLGXDOVJLYHPHDQLQJWR
RUJDQL]DWLRQDOUHDOLW\PDNLQJLWSDUWRIWKHLURZQORFDOUHDOLW\:KHUHDVH[WHUQDOL]DWLRQFDQEH
VHHQDVWKHZD\ WKDW WKH LQGLYLGXDO SURGXFHV VRFLHW\ LQWHUQDOL]DWLRQ FDQ EH VHHQ DV WKH ZD\
WKDWWKHVRFLDOZRUOGDFWVEDFNXSRQ LWV SURGXFHU ³6RFLHW\ LV D KXPDQ SURGXFW « 0DQ LV D
VRFLDOSURGXFW´ %HUJHUDQG/XFNPDQQSLWDOLFVLQRULJLQDO 
%HUJHUDQG/XFNPDQQ  FRQVLGHUHGWZRGLIIHUHQWSKDVHVRILQWHUQDOL]DWLRQSULPDU\
VRFLDOL]DWLRQDQGVHFRQGDU\VRFLDOL]DWLRQ3ULPDU\VRFLDOL]DWLRQLVDERXWKRZWKHFKLOGDGRSWV
KLVRUKHUZRUOGZKLOHVHFRQGDU\VRFLDOL]DWLRQLVDERXW³WKHLQWHUQDOL]DWLRQRILQVWLWXWLRQDORU
LQVWLWXWLRQEDVHGµVXEZRUOGV¶´ LELGS :LWKLQWKHFRQWH[WRIWKLVWKHVLVZHDUHRQO\
FRQFHUQHGZLWKWKHODWWHUSKDVHRILQWHUQDOL]DWLRQ

$V FDQ EH VHHQ IURP )LJXUH  WKH VRFLDO FRQVWUXFWLRQ RI UHDOLW\ LV D VLPXOWDQHRXV DQG
FRQWLQXRXVSURFHVVRIFRQVWUXFWLRQDQGUHFRQVWUXFWLRQ,WLVDGLDOHFWLFLQWHUSOD\EHWZHHQORFDO
DQG RUJDQL]DWLRQDO UHDOLW\ ZKLFK LV VLPXOWDQHRXVO\ FKDUDFWHUL]HG E\ H[WHUQDOL]DWLRQ DQG
LQWHUQDOL]DWLRQ
&RQVWUXFWLYLVW WKLQNLQJ LQ VRIWZDUH GHYHORSPHQW OHDGV WR DQ HPSKDVLV RQ WKH REVHUYHU
FRQVWLWXWLQJ WKH ZD\ KH RU VKH VHHV UHDOLW\ DQG LQYHQWLQJ D VXLWDEOH GHVFULSWLRQ UDWKHU WKDQ
PDSSLQJD JLYHQ UHDOLW\ 7KXV WKH VRIWZDUH GHYHORSHU LV SRUWUD\HG DV PDNLQJ FKRLFHV LQ DQ
RSHQVLWXDWLRQZKHUHWKHUHLVPRUHWKDQRQHSRVVLELOLW\:KHQGHYHORSLQJDVRIWZDUHSURGXFW
ZH PDNH FKRLFHV LQ VHOHFWLQJ WKH DVSHFWV ZH FRQVLGHU UHOHYDQW IRU PRGHOLQJ LQ PDNLQJ
DYDLODEOH PRGHV RI LQWHUDFWLRQ ZLWK WKH FRPSXWHU LQ GHWHUPLQLQJ WKH VRIWZDUH V\VWHP¶V
DUFKLWHFWXUH DQG LQ WKH ZD\ ZH XVH WKH WHFKQLFDO UHVRXUFHV IRU LPSOHPHQWLQJ WKH V\VWHP
0RUHRYHU ZH PDNH FKRLFHV LQ DQWLFLSDWLQJ KRZ WKH FRPSXWHU ZLOO EH HPEHGGHG LQ LWV XVH
FRQWH[W DQG LQ FUHDWLQJ IDFLOLWLHV DQG FRQVWUDLQWV IRU XVHUV DQG RWKHU FRQFHUQHG SDUWLHV $QG
ILQDOO\ZHPDNHFKRLFHVLQKRZZH FRQGXFWWKHGHYHORSPHQWSURFHVVLWVHOIRIWHQ GHYLDWLQJ
IURPSUHPDGHSODQV
2QO\DVPDOOSDUWRIWKHVHFKRLFHVDUHPDGHH[SOLFLWO\PRUHRIWHQWKH\DUHLPSOLHGE\WKH
FRXUVHRIDFWLRQZHWDNHRUDV6FK|Q  DUJXHG³RXUNQRZLQJLVLQRXUDFWLRQ´ S 
)XUWKHUPRUHHDFKSUDFWLWLRQHUWUHDWVKLVRUKHUFDVHDVXQLTXHDQGFRQVHTXHQWO\FDQQRWGHDO
ZLWKLWE\DSSO\LQJVWDQGDUGWKHRULHVRUWHFKQLTXHVKHQFHWKHSUDFWLWLRQHU³PXVWFRQVWUXFWDQ
XQGHUVWDQGLQJRIWKHVLWXDWLRQDVKHILQGVLW´ LELGS $OVRRXUFKRLFHVDUHFRQVWUDLQHG
E\RXULQWHUDFWLRQVZLWKRWKHUV:KHQVHHQLQWKHVHWHUPVWKHWDVNRIVRIWZDUHGHYHORSPHQW
FOHDUO\LQYROYHVUHIHUHQFHWRWKHLQGLYLGXDOVRIWZDUHGHYHORSHU
6RIWZDUHGHYHORSPHQWLVLQDFFRUGDQFHZLWKWKHDERYH DUJXPHQWDWLRQODUJHO\ DKXPDQ
EDVHG LQWHOOHFWXDO DFWLYLW\ :HLQEHUJ    WKDW LQYROYHV FRQVWDQW QHJRWLDWLRQ DQG
UHQHJRWLDWLRQZLWKLQDQG EHWZHHQ WKH VRFLDO JURXSV VKDSLQJ WKH VRIWZDUH 6RIWZDUH SURGXFWV

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

HPHUJH DV WKH RXWFRPH RI FRPSOH[ VRFLDO SURFHVVHV ZKLFK VHUYH WR HVWDEOLVK D FRPPRQ
XQGHUVWDQGLQJRIWKHSUREOHPVWREHGHDOWZLWKDQGWRDQWLFLSDWHPHDQLQJIXOVROXWLRQVLQWKH
VRIWZDUH¶V LQWHQGHG XVH FRQWH[W 7KXV ZH DUJXH WKDW VRIWZDUH GHYHORSPHQW LV D VRFLDOO\
FRQVWUXFWHGSURFHVVZKHUHWKHGHYHORSHUVFRQVWUXFWWKHSURFHVVRIGHYHORSPHQWWKHSURGXFW
DQG WKH SRVVLELOLWLHV IRU LWV XVH WKURXJK WKHLU FROOHFWLYH FKRLFHV DQG DFWLRQV )XUWKHUPRUH
VLQFHDJURXSRIGHYHORSHUVDFTXLUHWKHNQRZKRZQHFHVVDU\WRFDUU\RXWWKHFROOHFWLYHWDVNRI
VRIWZDUH GHYHORSPHQW ZH FRQWHQG WKDW RUJDQL]DWLRQDO OHDUQLQJ WDNHV SODFH DV SDUW RI WKH
SUDFWLFH

 7KHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
6RIDUZHKDYHDUJXHGIRUDSHUVSHFWLYHRQVRIWZDUHGHYHORSPHQWDVUHDOLW\FRQVWUXFWLRQ ,Q
WKLVVHFWLRQZHDUJXHWKDWWKLV SHUVSHFWLYH UHTXLUHV DFRPPLWPHQW WR OHDUQLQJ UDWKHU WKDQ WR
³EHVWSUDFWLFH´PRGHOVWRDFFRPSOLVKLPSURYHPHQWVLQVRIWZDUHGHYHORSPHQWSURFHVVHV7KH
EDVLFSUHPLVHIRUVXFKLPSURYHPHQWVLVWKDWZHH[SHFWWREHDEOHWRXQGHUVWDQGZK\DQGKRZ
ZHGRZKDWZHGRLQVRIWZDUHGHYHORSPHQWVRWKDWZHFDQGRLWGHOLEHUDWHO\DQGUHSHDWHGO\LQ
GLYHUVHDQGQRYHOVLWXDWLRQV0RUHRYHUZHZDQWWREHDEOHWRH[WHUQDOL]HRXUXQGHUVWDQGLQJRI
WKH GHYHORSPHQW SUDFWLFH WR EH DEOH WR VKDUH LW ZLWK RWKHUV DQG WR ZRUN ZLWK LW GLUHFWO\ WR
LPSURYHLW
&RQFRUGDQW WR WKH UDWLRQDOLVWLF DSSURDFK WKH ³EHVW SUDFWLFH´ SHUVSHFWLYH WR 63, LV WR
FRPSDUH DQ RUJDQL]DWLRQ¶V SURFHVV ZLWK VRPH JHQHUDOO\ DFFHSWHG LGHDO RU VWDQGDUG RI EHVW
SUDFWLFHV±WKHRQHEHVWZD\$FFRUGLQJWRWKLVSHUVSHFWLYHWKHQSURFHVVLPSURYHPHQWLVWKH
PHUH HOLPLQDWLRQ RI GLIIHUHQFHV EHWZHHQ WKH H[LVWLQJ SURFHVV DQG WKH LGHDO PRGHO 7KH DV
VXPSWLRQLVWKDWRQFHWKHSURFHVVLVFKDQJHGWRILWWKHSUHVFULEHGPRGHOWKHJHQHUDWHGSURG
XFWVZLOOEHLPSURYHGRUDWOHDVWWKHTXDOLW\ULVNVRIGHYHORSLQJQHZVRIWZDUHZLOOEHUHGXFHG
VHH&KDSWHU 

2UJDQL]DWLRQV DUH VHHQ DV OHDUQLQJ E\ HQFRGLQJ LQIHUHQFHV IURP KLVWRU\ LQWR URXWLQHV WKDW
JXLGHEHKDYLRU /HYLWWDQG0DUFKS 
$QHQWLW\OHDUQVLIWKURXJKLWVSURFHVVLQJRILQIRUPDWLRQWKHUDQJHRILWVSRWHQWLDOEHKDYLRUV
LVFKDQJHG +XEHUS
2UJDQL]DWLRQDO OHDUQLQJ PHDQV WKH SURFHVV RI LPSURYLQJ DFWLRQV WKURXJK EHWWHU NQRZOHGJH
DQGXQGHUVWDQGLQJ )LRODQG/\OHVS 
2UJDQL]DWLRQDOOHDUQLQJ LVGHILQHGDV LQFUHDVLQJ DQ RUJDQL]DWLRQ¶VFDSDFLW\ WR WDNH HIIHFWLYH
DFWLRQ .LPS 
2UJDQL]DWLRQDO OHDUQLQJ RFFXUV WKURXJK VKDUHG LQVLJKWV NQRZOHGJH DQG PHQWDO PRGHOV 
>DQG@EXLOGVRQSDVWNQRZOHGJHDQGH[SHULHQFH±WKDWLVRQPHPRU\ 6WDWDS 
:HGHILQHRUJDQL]DWLRQDOOHDUQLQJDVDSURFHVVLQZKLFKDQRUJDQL]DWLRQ¶VPHPEHUVDFWLYHO\
XVH GDWD WR JXLGH EHKDYLRU LQ VXFK D ZD\ DV WR SURPRWH WKH RQJRLQJ DGDSWDWLRQ RI WKH
RUJDQL]DWLRQ (GPRQVRQDQG0RLQJHRQS 
:H GHILQH RUJDQL]DWLRQDO OHDUQLQJ DV WKH FDSDFLW\ RU SURFHVVHV ZLWKLQ DQ RUJDQL]DWLRQ WR
PDLQWDLQRULPSURYHSHUIRUPDQFHEDVHGRQH[SHULHQFH 1HYLVHWDOS 

)LJXUH$OWHUQDWLYHGHILQLWLRQVRIRUJDQL]DWLRQDOOHDUQLQJ

±±
&+$37(5

$VZHDUJXHG LQ &KDSWHU  DQG DOVR LQ '\En DQG 6NRJVWDG   VXFK PRGHOEDVHG
LPSURYHPHQW FDQ EH FRQWUDVWHG ZLWK WKH XVH RI LPSURYHPHQW SURFHVVHV WKDW DUH PRUH
FRQFHUQHGZLWKWKHFRQWLQJHQWFKDUDFWHULVWLFVRILQGLYLGXDOPDUNHWVDQGRUJDQL]DWLRQV+HQFH
ZH DUJXH WKDW SURFHVV LPSURYHPHQWV FDQ KDUGO\ EH FODLPHG XQOHVV SURFHVV HIIHFWLYHQHVV LV
FORVHO\ UHODWHG WR WKH VSHFLILF FLUFXPVWDQFHV QHHGV DQG EXVLQHVV JRDOV RI WKH RUJDQL]DWLRQ
)XUWKHUPRUHZHFRQFXUZLWK1LFROLQLDQG0H]QDU¶V  YLHZRQRUJDQL]DWLRQDOOHDUQLQJ
DVDVRFLDOFRQVWUXFWLRQDQGDUJXHWKDWVRIWZDUHSURFHVVLPSURYHPHQWLVDVRFLDOO\FRQVWUXFWHG
OHDUQLQJSURFHVV+RZHYHULQRUGHUWRXQGHUVWDQGKRZVRIWZDUHRUJDQL]DWLRQVPD\EHFRPH
OHDUQLQJRUJDQL]DWLRQVZHPXVWILUVWXQGHUVWDQGZKDWRUJDQL]DWLRQDOOHDUQLQJLV
$UJ\ULVDQG6FK|Q  LQWURGXFHGWKHFRQFHSWRIRUJDQL]DWLRQDOOHDUQLQJLQWKHV
+RZHYHU OHDUQLQJ LV EDVLFDOO\ DQ LQGLYLGXDOLVWLF FRQFHSW GUDZQ GLUHFWO\ IURP SV\FKRORJ\
DQG DV FDQ EH VHHQ IURP )LJXUH  WKHUH LV FRQVLGHUDEOH GLVDJUHHPHQW DPRQJ WKH PRVW
LQIOXHQWLDOVFKRODUVFRQFHUQLQJDJRRGGHILQLWLRQRIZKDWLWPHDQVIRUDQRUJDQL]DWLRQWROHDUQ
6RPH DXWKRUV OLNH +XEHU   .LP   DQG 1HYLV HW DO   FODLP WKDW QHZ
ZD\V RI WKLQNLQJ DUH HQRXJK IRU DQ RUJDQL]DWLRQ WR OHDUQ +RZHYHU ZLWKRXW DFFRPSDQ\LQJ
FKDQJHLQWKHZD\WKDWZRUNJHWVGRQHRQO\WKHSRWHQWLDOIRULPSURYHPHQWH[LVWV$UJ\ULVDQG
6FK|Q  DGGUHVVHGWKLVLPSRUWDQWDVSHFWZKHQWKH\GHILQHGLQVWUXPHQWDOOHDUQLQJDV³DQ
RUJDQL]DWLRQ¶VLPSURYHPHQWRILWVWDVNSHUIRUPDQFHRYHUWLPH´ S DQGZKHQWKH\DVVHUWHG
WKDW³FKDQJHLQEHKDYLRULVD>QHFHVVDU\@FRQGLWLRQIRUOHDUQLQJ´ S :LWKLQWKHFRQWH[WRI
63,ZHKROGWKDWWKHUROHRIRUJDQL]DWLRQDOOHDUQLQJLVWRSURYLGHDIUDPHZRUNIRULPSURYHG
DFWLRQV 7KHUHIRUH ZH DGRSW )LRO DQG /\OHV¶  S   SUREOHPVROYLQJ DSSURDFK WR
RUJDQL]DWLRQDO OHDUQLQJ DQG GHILQH RUJDQL]DWLRQDO OHDUQLQJ ZLWKLQ WKH FRQWH[W RI 63, DV WKH
SURFHVVRILPSURYLQJDFWLRQVWKURXJKEHWWHUNQRZOHGJHDQGXQGHUVWDQGLQJ
7KH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ RIIHUV DQ DOWHUQDWLYH WR WKH SHUYDVLYH IDFWRU\ YLHZ
URRWHG LQ :HEHU¶V   GHVFULSWLRQ RI EXUHDXFUDF\ 7D\ORU¶V   FRQFHSW RI VFLHQWLILF
PDQDJHPHQWDQGWKHPHFKDQLVWLFQRWLRQVRI³EHVWSUDFWLFH´5DWKHUWKHOHDUQLQJRUJDQL]DWLRQ
SHUVSHFWLYHLVEDVHGRQVRFLRWHFKQLFDOSULQFLSOHV 7ULVW7ULVWDQG%DPIRUWK DQG
SDUWLFLSDWRU\ OHDUQLQJ SURFHVVHV *UHHQZRRG DQG /HYLQ   7KH HPSKDVLV LV RQ
VXSSRUWLQJLQGLYLGXDODFWLYLWLHVE\HPSOR\LQJDSSURSULDWHWRROVDQGWHFKQLTXHVDVWKHEDVLVIRU
FRRSHUDWLRQ EHWZHHQ ³PXOWLVNLOOHG´ GHYHORSHUV :KDW¶V PRUH WKH ZRUN RI WKH VRIWZDUH
GHYHORSHUV LQ WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ FDQ EH FKDUDFWHUL]HG E\ WHDPZRUN DQG
FRRSHUDWLRQEDVHGRQ³RSWLPXPWDVNJURXSLQJ´DQG ³PLQLPXP FULWLFDO VSHFLILFDWLRQ´ 7ULVW
 2IFRXUVHWKHUHLVDGLYLVLRQRI ODERU DQG VSHFLDOL]DWLRQ EXW VWLOO WKHUH VHHPV WR EH
OLWWOH FKDQFH RI DUULYLQJ DW DQ RYHUDOO VWDWH RI URXWLQL]HG DQG PHFKDQL]HG ZRUN EDVHG RQ
HVWDEOLVKHGVWDQGDUGVIRUVRIWZDUH³EHVWSUDFWLFH´DQGWKH³RQHEHVWZD\´
7KHOHDUQLQJVRIWZDUHRUJDQL]DWLRQFDQEHFKDUDFWHUL]HGE\LWVLQWHJUDWLRQRILQWHOOHFWXDO
ZRUN FRRUGLQDWLRQ DQG GHVLJQ ,W LV D FROOHFWLYH RI ³VHPLDXWRQRPRXV JURXSV´ WKDW EULQJV
SODQQLQJGHVLJQDQGFRQVWUXFWLRQDFWLYLWLHVWRJHWKHUXQGHUWKHVDPHURRIPDNLQJLWVXLWDEOH
IRU FRSLQJ ZLWK LQGLYLGXDO UHTXLUHPHQWV )XUWKHUPRUH LWV IOH[LEOH IRUPV RI RUJDQL]DWLRQ
SURPRWHDWWXQHPHQWWRLQGLYLGXDOFXVWRPHUQHHGVDQGZLVKHVVHFXULQJ³FRGHWHUPLQDWLRQ´±
WKHGLUHFWSDUWLFLSDWLRQRIGHYHORSHUVDQGXVHUVLQGHFLVLRQVDERXWZKDWVKRXOGEHVWEHGRQHDW
WKHLU RZQ OHYHO 7KH EHVW SUDFWLFH DSSURDFK RQ WKH RWKHU KDQG LV VXLWDEOH IRU UHSURGXFWLYH
ZRUNLQJSURFHVVHVJHDUHGDW HFRQRPLFDOUHSURGXFWLRQRIDPD[LPXPQXPEHURIJRRGVWKDW
DUHVSHFLILHGLQGHWDLOEHIRUHKDQG
6LQFH SODQQLQJ GHYHORSLQJ DQG FRRUGLQDWLRQ DUH WKH FHQWUDO WDVNV LQ VRIWZDUH
GHYHORSPHQW ± DQG QRW WKH PDVV SURGXFWLRQ RI JRRGV ± WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

PD\ EH FRQVLGHUHG D SURSHU PHWDSKRU IRU WKH ZRUNLQJ HQYLURQPHQW RI VRIWZDUH GHYHORSHUV
7KHFUXFLDODVSHFWKHUHLVWKHFORVHUHODWLRQVKLSEHWZHHQGHVLJQSURGXFWLRQDQGHYDOXDWLRQ
DFWLYLWLHVWKDWEHDUWKHLPSULQWRIERWKLQGLYLGXDODQGFRRSHUDWLYHZRUN
7R VXPPDUL]H WKH ³EHVW SUDFWLFH´ DSSURDFK VWDQGV IRU UHSODFLQJ KXPDQ ODERU E\
PDFKLQHU\DQGURXWLQL]DWLRQ7KHOHDUQLQJVRIWZDUHRUJDQL]DWLRQRQWKHRWKHUKDQGSURPRWHV
H[SHULHQFH DQG WKH XVH RI WHFKQRORJ\ WR HQKDQFH WKH VNLOOV RI WKH GHYHORSHUV UDWKHU WKDQ WR
GHVNLOOWKHP &RUEHWW ±WR³LQIRUPDWH´UDWKHUWKDQWR³DXWRPDWH´WDVNV =XERII 
7DEOH  VXPPDUL]HV WKH UHODWLRQVKLS EHWZHHQ WKH ³EHVW SUDFWLFH´ DQG WKH OHDUQLQJ
SHUVSHFWLYHVRIVRIWZDUHRUJDQL]DWLRQV
%DVHG RQ WKH LQVLJKWV RI WKH SUHFHGLQJ VHFWLRQ WKH UHVW RI WKLV FKDSWHU GHVFULEHV WKH
UHPDLQLQJWKUHHIRXQGDWLRQVIRUWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQWKDWHYHQWXDOO\VKDSHGRXU
G\QDPLFPRGHORI63,VHQVHPDNLQJNQRZOHGJHFUHDWLRQDQGSXUSRVHIXODFWLRQ

 6HQVHPDNLQJ
,QWRGD\¶VLQFUHDVLQJO\WXUEXOHQWDQGXQSUHGLFWDEOHHQYLURQPHQWVVRIWZDUHRUJDQL]DWLRQVKDYH
WR PDNH VHQVH RXW RI ZKDW LV KDSSHQLQJ LQ WKHLU VXUURXQGLQJV LQ RUGHU WR GHYHORS VKDUHG
LQWHUSUHWDWLRQV WKDW FDQ JXLGH WKHLU DFWLRQV 7KXV FRQWUDU\ WR WKH HPSKDVLV LQ UDGLFDO
FRQVWUXFWLYLVP RXU IRFXV LV QRW RQ WKH PHDQLQJPDNLQJ DFWLYLW\ RI LQGLYLGXDOV EXW RQ WKH
FROOHFWLYH JHQHUDWLRQ RI PHDQLQJ DV VKDSHG E\ FRQYHQWLRQV RI ODQJXDJH DQG RWKHU VRFLDO
SURFHVVHV

7DEOH³%HVWSUDFWLFH´DSSURDFKYVOHDUQLQJVRIWZDUHRUJDQL]DWLRQ

)HDWXUH ³%HVWSUDFWLFH´$SSURDFK /HDUQLQJ6RIWZDUH2UJDQL]DWLRQ

6\VWHPSHUVSHFWLYH 7HFKQRORJLFDO 6RFLRWHFKQLFDO

+XPDQSHUVSHFWLYH 0DQDVDQH[WHQVLRQRIWKHPDFKLQH 0DQDVFRPSOHPHQWDU\WRWKH


±DQH[SHQGDEOHVSDUHSDUW PDFKLQH±DUHVRXUFHWREH
GHYHORSHG

6NLOO 0D[LPXPWDVNEUHDNGRZQVLPSOH 2SWLPXPWDVNJURXSLQJPXOWLSOH


QDUURZVNLOO±³DXWRPDWH´ EURDGVNLOO±³LQIRUPDWH´

3RZHU ([WHUQDOFRQWURO VXSHUYLVRUV ,QWHUQDOFRQWURO VHOIUHJXODWLQJ


VSHFLDOLVWVWDIIVSURFHGXUHV VXEV\VWHP

&RQILJXUDWLRQ +LHUDUFKLFDORUJDQL]DWLRQ )ODWRUJDQL]DWLRQ

/HDGHUVKLSVW\OH $XWRFUDWLF 3DUWLFLSDWRU\

6RFLDOV\VWHP &RPSHWLWLRQJDPHVPDQVKLS &ROODERUDWLRQFROOHJLDOLW\

3XUSRVH 2UJDQL]DWLRQ¶VRQO\ 2UJDQL]DWLRQ¶VPHPEHU¶VDQG


VRFLHW\¶V

5LVN /RZULVNWDNLQJ ,QQRYDWLRQ

±±
&+$37(5

:H ZLOO ILUVW IRFXV RQ WKH FRQFHSW RI VHQVHPDNLQJ LWVHOI 7KHQ ZH LQWURGXFH WKH PDLQ
RUJDQL]DWLRQDO SURFHVVHV RI VHQVHPDNLQJ )LQDOO\ ZH H[DPLQH WKH FRQFHSW RI VKDUHG
DVVXPSWLRQVZKLFKLVYLWDOIRUFRRUGLQDWHGDQGSXUSRVHIXODFWLRQLQVRIWZDUHRUJDQL]DWLRQV

 7KHFRQFHSWRIVHQVHPDNLQJ
7KHFRQFHSWRIRUJDQL]DWLRQDOVHQVHPDNLQJLVWREHXQGHUVWRRGOLWHUDOO\±LWPHDQVWKHPDNLQJ
RI VHQVH :HLFN   7KRPDV HW DO   IRU H[DPSOH GHVFULEHG VHQVHPDNLQJ DV ³WKH
UHFLSURFDOLQWHUDFWLRQRILQIRUPDWLRQVHHNLQJPHDQLQJDVFULSWLRQDQGDFWLRQ´ LELGS 
0DUFK DQG 2OVHQ   VDZ VHQVHPDNLQJ DV SDUW RI H[SHULHQWLDO OHDUQLQJ LQ ZKLFK
³LQGLYLGXDOVDQGRUJDQL]DWLRQVPDNHVHQVHRIWKHLUH[SHULHQFHDQGPRGLI\EHKDYLRULQWHUPV
RI WKHLU LQWHUSUHWDWLRQV´ LELG S   6WDUEXFN DQG 0LOOLNHQ   REVHUYHG WKDW ³VHQVH
PDNLQJ KDV PDQ\ GLVWLQFW DVSHFWV ± FRPSUHKHQGLQJ XQGHUVWDQGLQJ H[SODLQLQJ DWWULEXWLQJ
H[WUDSRODWLQJDQGSUHGLFWLQJ´ LELGS 
%DVHG RQ KLV FRPSUHKHQVLYH UHYLHZ DQG GLVFXVVLRQ RI WKH UHVHDUFK OLWHUDWXUH :HLFN
  LGHQWLILHG VHYHQ SURSHUWLHV RI VHQVHPDNLQJ XQGHUVWRRG DV DQ RUJDQL]DWLRQDO SURFHVV
ZKLFKVXJJHVWVZKDWVHQVHPDNLQJLVKRZLWZRUNVDQGZKHUHLWFDQIDLO)LUVWVHQVHPDNLQJ
LV JURXQGHG LQ LGHQWLW\ FRQVWUXFWLRQ 7KXV ZKDW WKH VLWXDWLRQ PHDQV LV GHWHUPLQHG E\ WKH
LGHQWLW\ WKDW WKH LQGLYLGXDO DGRSWV LQ GHDOLQJ ZLWK LW 6HFRQG DQG SHUKDSV WKH PRVW
GLVWLQJXLVKLQJFKDUDFWHULVWLFLVWKDWVHQVHPDNLQJLVUHWURVSHFWLYH³SHRSOHFDQNQRZZKDWWKH\
DUHGRLQJRQO\DIWHU WKH\ KDYH GRQH LW´ LELGS   7KH PDLQ SUREOHP KHUH LV WR VHOHFW D
SODXVLEOHPHDQLQJ IURP VHYHUDO DOWHUQDWLYH PHDQLQJV LQ RUGHU WR PDNH VHQVH RI SDVW HYHQWV
7KLUG VHQVHPDNLQJ LV HQDFWLYH VLQFH SHRSOH LQ RUJDQL]DWLRQV RIWHQ SURGXFH SDUW RI WKH
HQYLURQPHQW WKH\ IDFH IXUWKHULQJ WKH DUJXPHQW WKDW VHQVHPDNLQJ LV ZKDW NHHSV DFWLRQ DQG
FRJQLWLRQ WRJHWKHU )RXUWK VHQVHPDNLQJ LV VRFLDO VLQFH PRVW VHQVHPDNLQJ RFFXUV LQ VRFLDO
JURXSV RI PRUH WKDQ RQH LQGLYLGXDO )LIWK VHQVHPDNLQJ LV RQJRLQJ ± LW QHYHU VWRSV EXW LV
FRQWLQXRXVLQWKHIORZRIRUJDQL]DWLRQDODFWLYLWLHVDQGSURMHFWV6L[WKVHQVHPDNLQJLVIRFXVHG
RQ DQG E\ H[WUDFWHG FXHV ZKLFK SURYLGH SRLQWV RI UHIHUHQFH RU VWDUWLQJ QRGHV IURP ZKLFK
LGHDVPD\EHOLQNHGDQGFRQQHFWHGLQWRQHWZRUNVRIPHDQLQJ([SHULHQFHSDFNDJHVDQGWKHLU
UHODWLRQVKLSV ZLWK WKH FRQWH[W ZKLFK WKH\ DUH H[WUDFWHG IURP DQG WKH FRQWH[W WKDW WKH\ DUH
LQWHUSUHWHG LQWR DUH H[DPSOHV RI VXFK FXHV )LQDOO\ VHQVHPDNLQJ LV GULYHQ E\ SODXVLELOLW\
UDWKHUWKDQDFFXUDF\7KXVRUJDQL]DWLRQDOPHPEHUVEHKDYHSUDJPDWLFDOO\DVZKHQDSURMHFW
GHDGOLQHPDNHVVRIWZDUHGHYHORSHUVWUDGHRIIIXQFWLRQDOLW\IRUWLPH
$QHVVHQWLDO LQVLJKW IURP WKH FRQFHSW RI VHQVHPDNLQJ LV WKDW LW FDQ EH VHHQ DV D EULGJH
EHWZHHQWKHRU\DQGSUDFWLFHLQ63,±PXFKOLNH,VHQEHUJ  HPSKDVL]HGWKDWPDQDJHULDO
WKLQNLQJDQGDFWLRQDUHQRWVHSDUDWHRUVHTXHQWLDODFWLYLWLHVRUOLNH6FK|Q  HPSKDVL]HG
WKHFRQFHSWRI³UHIOHFWLRQLQDFWLRQ´&RQVHTXHQWO\ZHFRQVLGHUWKHFRQFHSWRIVHQVHPDNLQJ
DVFULWLFDOO\LPSRUWDQWIRUVXFFHVVIXO63,

 2UJDQL]DWLRQDOSURFHVVHVRIVHQVHPDNLQJ
:HLFN   GHVFULEHG WKH ZD\V LQ ZKLFK RUJDQL]DWLRQDO PHPEHUV OLQN WKHLU WKRXJKWV DQG
LQWHUSUHWDWLRQV WRJHWKHU WR PDNH FROOHFWLYH DFWLRQ SRVVLEOH LQ WHUPV RI EHOLHIGULYHQ DQG
DFWLRQGULYHQSURFHVVHVIRURUJDQL]DWLRQDOVHQVHPDNLQJ VHH7DEOH 

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

7DEOH2UJDQL]DWLRQDOVHQVHPDNLQJSURFHVVHV &KRRS 

%HOLHI'ULYHQ3URFHVVHV $UJXLQJ&UHDWLQJPHDQLQJE\FRQQHFWLQJWKHFRQWUDGLFWRU\

([SHFWLQJ&UHDWLQJPHDQLQJE\FRQQHFWLQJWKHVLPLODU

&RPPLWWLQJ&UHDWLQJPHDQLQJWRMXVWLI\DFWLRQVKLJKLQFKRLFH
YLVLELOLW\DQGLUUHYRFDELOLW\

$FWLRQ'ULYHQ3URFHVVHV 0DQLSXODWLQJ&UHDWLQJPHDQLQJWRH[SODLQDFWLRQVWDNHQWR
PDNHWKLQJVKDSSHQ

6HQVHPDNLQJ FDQ EHJLQ ZLWK EHOLHIV DQG WDNH WKH IRUP RI DUJXLQJ DQG H[SHFWLQJ 2U
VHQVHPDNLQJFDQEHJLQZLWKDFWLRQVDQGWDNHWKHIRUPRIFRPPLWWLQJRUPDQLSXODWLQJ,QDOO
IRXUFDVHVSHRSOHPDNHGRZLWKZKDWHYHUEHOLHIVRUDFWLRQVWKH\VWDUWZLWK6HQVHPDNLQJLV
DQ HIIRUW WR WLH EHOLHIV DQG DFWLRQV PRUH FORVHO\ WRJHWKHU DV ZKHQ DUJXPHQWV OHDG WR
FRQVHQVXVRQDFWLRQFODULILHGH[SHFWDWLRQVSDYHWKH ZD\IRUFRQILUPLQJDFWLRQVFRPPLWWHG
DFWLRQV XQFRYHU DFFHSWDEOH MXVWLILFDWLRQV IRU WKHLU RFFXUUHQFH RU EROG DFWLRQV VLPSOLI\ WKH
ZRUOG DQG PDNH LW FOHDUHU ZKDW LV JRLQJ RQ DQG ZKDW LW PHDQV ,Q HDFK RI WKHVH FDVHV
VHQVHPDNLQJ LQYROYHV WDNLQJ ZKDWHYHU LV FOHDUHU ZKHWKHU LW EH D EHOLHI RU DQ DFWLRQ DQG
OLQNLQJ LW ZLWK WKDW ZKLFK LV OHVV FOHDU 7KHVH DUH IXQGDPHQWDO RSHUDWLRQV RI VHQVHPDNLQJ
7ZR HOHPHQWV D EHOLHI DQG DQ DFWLRQ DUH UHODWHG 7KH DFWLYLWLHV RI UHODWLQJ DUH WKH
VHQVHPDNLQJSURFHVV7KHRXWFRPHRIVXFKDSURFHVVLVDXQLWRIPHDQLQJWZRFRQQHFWHG
HOHPHQWV $QG WKH FRQQHFWHG HOHPHQWV DUH EHOLHIV DQG DFWLRQV WLHG WRJHWKHU E\ VRFLDOO\
DFFHSWDEOHLPSOLFDWLRQV :HLFNS 

%HOLHIGULYHQSURFHVVHVDUHWKRVHLQZKLFKSHRSOHFRQVWUXFWPHDQLQJE\UHODWLQJSDVWPRPHQWV
RIVRFLDOL]DWLRQ WR SUHVHQW PRPHQWV RI H[SHULHQFH RU FXHV :KHQ VXFK FXHV VHHP WR PDWFK
HDFKRWKHUDVZHOODVWKHH[LVWLQJIUDPHVRIUHIHUHQFHWKHVHQVHPDNLQJSURFHVVLVOLNHO\WREH
EDVHG RQ ³H[SHFWLQJ´ 2Q WKH RWKHU KDQG ZKHQ FXHV DQG EHOLHIV FUHDWH D PLVPDWFK WKH
VHQVHPDNLQJSURFHVVLVPRUHOLNHO\WREHEDVHGRQ³DUJXLQJ´
$FWLRQGULYHQ SURFHVVHV DUH WKRVH LQ ZKLFK SHRSOH FRQVWUXFW PHDQLQJ DURXQG WKHLU
DFWLRQV 7ZR NLQGV RI DFWLRQ FDQ GULYH VHQVHPDNLQJ EHKDYLRUDO ³FRPPLWPHQW´ DQG
³PDQLSXODWLRQ´,QERWKFDVHVVHQVHPDNLQJVWDUWVZLWKDFWLRQ7KHSULPDU\GLIIHUHQFHLVWKDW
WKH FRPPLWPHQW SURFHVV LV IRFXVHG RQ VLQJOH DFWLRQ ZKHUHDV PDQLSXODWLRQ LV IRFXVHG RQ
PXOWLSOHVLPXOWDQHRXVDFWLRQV
%RWK EHOLHIV DQG DFWLRQV DUH SRWHQWLDO UHIHUHQFH SRLQWV IRU VHQVHPDNLQJ LQ VRIWZDUH
RUJDQL]DWLRQV%HFDXVHWKH\DUHLQWHUUHODWHGVHQVHPDNLQJFDQVWDUWDWDQ\SRLQWLQWKHILJXUH
LQ7DEOH7KXVWKHJHQHUDWLRQRIQHZXQGHUVWDQGLQJVDQGQHZDFWLRQVLQZKDWHYHURUGHU
WKH\HYROYHDUHLPSRUWDQWHQDEOHUVIRUWKHFRQWH[WXDOFKDQJHQHFHVVDU\IRUVXFFHVVIXO63,

 6KDUHGDVVXPSWLRQV
6HQVHPDNLQJ LQ RUJDQL]DWLRQV FUHDWHV D FRQWH[W RI VKDUHG EHOLHIV DQG DVVXPSWLRQV ZKLFK
HQDEOHV FRRUGLQDWHG DFWLRQ WR WDNH SODFH ,QGHHG WKH FRQVHQVXDO VKDULQJ RI EHOLHIV DQG
EHKDYLRUDPRQJ PHPEHUV RI D JURXS LV UHJDUGHG DV WKH HVVHQFH RI RUJDQL]DWLRQDO ³FXOWXUH´
$OWKRXJK WKH WHUP FXOWXUH ILUVW DQG IRUHPRVW KDYH EHHQ EURXJKW LQWR ZLGHVSUHDG XVH E\
DQWKURSRORJLVWV :DJQHU LWLVDOVRIUHTXHQWO\XVHGZLWKLQWKHFRQWH[WRIRUJDQL]DWLRQDO
OHDUQLQJ 6FKHLQ   IRU H[DPSOH GHILQHG RUJDQL]DWLRQDO FXOWXUH DV WKH VHW RI VKDUHG

±±
&+$37(5

WDNHQIRUJUDQWHG LPSOLFLW DVVXPSWLRQV WKDW D JURXS KROGV DQG WKDW GHWHUPLQHV KRZ LW
SHUFHLYHVWKLQNVDERXWDQGUHDFWVWRLWVYDULRXVHQYLURQPHQWV)XUWKHUPRUHKHDVVHUWHGWKDW
FXOWXUHPDQLIHVWVLWVHOIDWWKUHHOHYHOVWKHOHYHORIGHHSWDFLWDVVXPSWLRQVWKDWDUHWKHHVVHQFH
RIWKHFXOWXUHWKHOHYHORIHVSRXVHGYDOXHVWKDWRIWHQUHIOHFWZKDWDJURXSZLVKHVLGHDOO\WREH
DQGWKHZD\LWZDQWVWRSUHVHQWLWVHOISXEOLFO\DQGWKHGD\WRGD\EHKDYLRUWKDWUHSUHVHQWVD
FRPSOH[FRPSURPLVHDPRQJWKHHVSRXVHGYDOXHVWKHGHHSHUDVVXPSWLRQVDQGWKHLPPHGLDWH
UHTXLUHPHQWVRIWKHVLWXDWLRQ 6FKHLQF 
:LWKLQ DQ RUJDQL]DWLRQDO IUDPHZRUN RI VKDUHG EHOLHIV DQG DVVXPSWLRQV VRIWZDUH
GHYHORSHUV FDQ FRQWLQXRXVO\ PDNH VHQVH RI DQG DGDSW WR WKH H[WHUQDO HQYLURQPHQW DQG
FRQWLQXRXVO\ GHYHORS DQG PDLQWDLQ LQWHUQDO UHODWLRQVKLSV DPRQJ WKHPVHOYHV 3HWHUV DQG
:DWHUPDQ   IRU H[DPSOH HPSKDVL]HG WKDW VXFFHVVIXO RUJDQL]DWLRQV EXLOG FRKHVLYH
FXOWXUHVDURXQGFRPPRQVHWVRIQRUPVYDOXHVDQGLGHDVWKDWFUHDWHDQDSSURSULDWHIRFXVIRU
GRLQJ EXVLQHVV +RZHYHU PDQ\ VRIWZDUH RUJDQL]DWLRQV KDYH VKRUW WXUQDURXQG WLPHV IRU
VRIWZDUH GHYHORSHUV DQG IUDJPHQWHG FXOWXUHV ZLWK PXOWLSOH ORFDO UHDOLWLHV LQ ZKLFK VKDUHG
DVVXPSWLRQVRIWHQDUHEDVHGRQRUJDQL]DWLRQDOPHPEHUV¶VLPLODURUJDQL]DWLRQDOH[SHULHQFHRU
VLPLODUHGXFDWLRQDOEDFNJURXQG
0DUWLQ  SURSRVHGWKUHHLQWHUSUHWLYHSHUVSHFWLYHVWRH[SODLQRUJDQL]DWLRQDOFXOWXUH

x 7KH LQWHJUDWLRQ SHUVSHFWLYH ZKLFK UHVHPEOHV 6FKHLQ¶V   FRQFHSWXDOL]DWLRQ RI


FXOWXUH DV RUJDQL]DWLRQ ZLGH FRQVHQVXV LV GHILQHG E\ RUJDQL]DWLRQDO PHPEHUV
H[SHULHQFLQJDKLJKOHYHORIFRQVHQVXVFRQVLVWHQF\DQGFODULW\
x 7KH GLIIHUHQWLDWLRQ SHUVSHFWLYH DVVXPHV WKDW RUJDQL]DWLRQV FRQVLVW RI D QXPEHU RI
VXEFXOWXUHV EDVHG RQ GLIIHUHQFHV LQ SRZHU DUHDV RI LQWHUHVW DQG ZRUN RU SURIHVVLRQDO
SUDFWLFH,WVGHILQLQJIHDWXUHLVWKDWFRQVHQVXVRQO\H[LVWVORFDOO\ZLWKLQVXEFXOWXUHVDQG
WKXV WKDW FROOHFWLYH DFWLRQ EDVHG RQ FRQVHQVXV LV PRVW OLNHO\ WR KDSSHQ ZLWKLQ ORFDO
VXEFXOWXUHV
x 7KH IUDJPHQWDWLRQ SHUVSHFWLYH VHHV RUJDQL]DWLRQV DV ³ZHEV RI LQGLYLGXDOV´ ZKR DUH
ORRVHO\DQGVSRUDGLFDOO\FRQQHFWHGDV³QHZLVVXHVFRPHLQWRIRFXVGLIIHUHQWSHRSOHDQG
WDVNVEHFRPHVDOLHQWDQGQHZLQIRUPDWLRQEHFRPHVDYDLODEOH´ 0DUWLQ  SS 
 

$GGLWLRQDOO\LQPDQ\RUJDQL]DWLRQVWKHUHDUHW\SLFDOO\WKUHHVXEFXOWXUHVWKDWKDYHJURZQRXW
RIWKHLUUHVSHFWLYHRFFXSDWLRQDOFRPPXQLWLHV 6FKHLQDF 

x 7KH RSHUDWRU FXOWXUH LV EDVHG RQ KXPDQ LQWHUDFWLRQ DQG W\SLFDOO\ LQYROYHV WKH OLQH
PDQDJHUV DQG ZRUNHUV ZKR PDNH DQG GHOLYHU SURGXFWV DQG VHUYLFHV WR IXOILOO WKH
RUJDQL]DWLRQ¶V EDVLF PLVVLRQ ,Q PRVW VRIWZDUH RUJDQL]DWLRQ WKHVH RSHUDWLRQV DUH
FRQJUXHQWZLWK WKH ZRUN RI VRIWZDUH GHYHORSHUV SURMHFW OHDGHUV DQG ILUVW OLQH VRIWZDUH
PDQDJHUV
x $NH\WKHPHLQWKHHQJLQHHULQJFXOWXUHLVWKHGHVLJQ RI WKH WHFKQRORJ\ XQGHUO\LQJ WKH
ZRUN RI WKH RUJDQL]DWLRQ 7\SLFDOO\ WKH HQJLQHHUV KDYH D SUHIHUHQFH IRU GHVLJQLQJ
KXPDQVRXWRIWKHV\VWHPUDWKHUWKDQLQWRWKHP7KLVGULYHVWKHPWRZDUGDXWRPDWLRQDQG
URXWLQL]HGVROXWLRQVWKDWRIWHQLJQRUHWKHVRFLDOUHDOLWLHVRIWKHZRUNSODFH .XQGD
7KRPDV $VVHHQIURPWKHYDQWDJHSRLQWRI63,TXDOLW\PDQDJHUVDQGPHPEHUVRI
6(3*VZRXOGEHUHSUHVHQWDWLYHVRIWKHHQJLQHHULQJFXOWXUH

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

x 7KH H[HFXWLYH FXOWXUH LV ³WKH VHW RI WDFLW DVVXPSWLRQV WKDW &(2V DQG WKHLU LPPHGLDWH
VXERUGLQDWHV VKDUH ZRUOGZLGH´ 6FKHLQ F S   DQG WKH HVVHQFH RI WKLV UROH LV
ILQDQFLDO DFFRXQWDELOLW\ WR WKH RZQHUV RI WKH FRPSDQ\ 7KH H[HFXWLYH FXOWXUH DQG WKH
HQJLQHHULQJ FXOWXUH ERWK WHQG WR VHH SHRSOH DV LPSHUVRQDO UHVRXUFHV WKDW JHQHUDWH
SUREOHPVUDWKHUWKDQVROXWLRQV

2QH FRQVHTXHQFH LV WKDW ZKHQ WKH RSHUDWRU FXOWXUH DWWHPSWV WR LPSURYH HIIHFWLYHQHVV E\
EXLOGLQJ OHDUQLQJ FDSDFLW\ ZKLFK UHTXLUHV WLPH DQG UHVRXUFHV WKH H[HFXWLYHV GLVDOORZ WKH
SURSRVHGDFWLYLWLHVRQWKHJURXQGVWKDWWKHILQDQFLDOUHWXUQVFDQQRWEHGHPRQVWUDWHGRUWKDW
WRRPDQ\H[FHSWLRQVDUHLQYROYHGWKDWZRXOGXQGHUPLQHWKHFRQWUROV\VWHP([HFXWLYHVWKXV
XQFRQVFLRXVO\FROOXGHZLWKWKHHQJLQHHUVLQZDQWLQJWRPLQLPL]HWKHKXPDQIDFWRU,QHIIHFW
DOO RI WKH UHVHDUFK ILQGLQJV DERXW WKH LPSRUWDQFH RI WHDPZRUN FROODERUDWLRQ FRPPLWPHQW
DQG LQYROYHPHQW IDOO RQ GHDI HDUV EHFDXVH LQ WKH H[HFXWLYH FXOWXUH WKRVH DUH QRW WKH
LPSRUWDQWYDULDEOHVWRFRQVLGHU 6FKHLQDS 

2IWHQ LW LV WKLV ODFN RI DOLJQPHQW DPRQJ WKH WKUHH FXOWXUHV WKDW FDXVHV WKH IDLOXUHV RI
RUJDQL]DWLRQDOOHDUQLQJDQG63,$JDLQVWWKLVEDFNJURXQGZHFDQPRUHHDVLO\XQGHUVWDQGWKH
SUHIHUHQFHRIIRUPDOURXWLQHVZLWKLQWKH63,FRPPXQLW\DVHVSRXVHGE\TXDOLW\PDQDJHUVRU
PHPEHUVRI6(3*V VHH&RQUDGLDQG'\EnDQG6HFWLRQ /LNHZLVHPDQDJHUVZLOO
UDWKHU SXW HPSKDVLV RQ UXOHV SURFHGXUHV DQG LQVWUXFWLRQV WKDQ RQ GLDORJ GLVFXVVLRQ DQG
HPSOR\HHSDUWLFLSDWLRQ7KHUHIRUHVKDUHGEHOLHIVDQGDVVXPSWLRQVDUHLPSRUWDQWIRUVRIWZDUH
RUJDQL]DWLRQV¶DELOLW\WRUHODWHDQGHYDOXDWHWKHLUDFWLRQVDQGUHVXOWV

%DVHGRQWKHSUHFHGLQJGLVFXVVLRQZHDUJXHWKDWDOODVSHFWVRIVRIWZDUHRUJDQL]DWLRQVDQGWKH
UHODWLRQVKLSV ZLWK WKHLU HQYLURQPHQWV ± ZKHWKHU VWUXFWXUHV WHFKQRORJLHV RU URXWLQHV ±
HPERG\VRFLDOFRQVWUXFWLRQVDQGPHDQLQJVWKDWDUH FUXFLDOIRUXQGHUVWDQGLQJDQG LPSURYLQJ
WKH VRIWZDUH RUJDQL]DWLRQV¶ SURFHVVHV 8OWLPDWHO\ LW LV WKH RUJDQL]DWLRQV¶ VKDUHG V\VWHPV RI
PHDQLQJWKDWJRYHUQWKHLUDFWLRQVDQGLQWHUSUHWDWLRQVDQGWKHUHIRUHWKHLUDELOLW\WROHDUQ
$VZHZLOOVHHLQ6HFWLRQVRIWZDUHRUJDQL]DWLRQVPXVWDOVREHDEOHWRFRQWLQXRXVO\
DVVHVV WKH YDOLGLW\ RI WKHLU EDVLF EHOLHIV DQG DVVXPSWLRQV EDODQFLQJ WKH QHHG IRU FRQVHQVXV
DQG VWDELOLW\ ZLWK GLYHUVLW\ DQG H[SHULPHQWDWLRQ 7KHUHIRUH DV ZHOO DV FKDQJLQJ VWUXFWXUHV
WHFKQRORJLHVDQGURXWLQHVVXFFHVVIXO63,DOVRGHSHQGVRQFKDQJHVLQWKHEDVLFDVVXPSWLRQV
DQGYDOXHVWKDWDUHWRJXLGHDFWLRQ±ILUVWRUGHUFKDQJHLQIRUPDOV\VWHPVDUHMXVWQRWHQRXJK
7KHUHIRUH ZH FODLP WKDW VHQVHPDNLQJ DQG RUJDQL]DWLRQDO FXOWXUH LV D IRXQGDWLRQ IRU WKH
OHDUQLQJVRIWZDUHRUJDQL]DWLRQWKDWFDQHLWKHUKLQGHURUHQDEOHVXFFHVVIXO63,

 .QRZOHGJH&UHDWLRQ
:LWKLQ WKH FRQWH[W RI 63, ZH DUH SULPDULO\ FRQFHUQHG ZLWK RUJDQL]DWLRQDO NQRZOHGJH WKDW
HQDEOHVRUUHVXOWVLQLPSURYHGSURGXFWVVHUYLFHVSURFHVVHVDQGDFWLRQV:HDUHSDUWLFXODUO\
LQWHUHVWHG LQ WKH SURFHVVHV WKDW FUHDWH DQG GLIIXVH NQRZOHGJH VLQFH NQRZOHGJH FUHDWLRQ LV D
VRFLDO DV ZHOO DV DQ LQGLYLGXDO SURFHVV ,Q WKLV VHFWLRQ ZH ILUVW H[DPLQH PRUH FORVHO\ WKH
FRQFHSW RI RUJDQL]DWLRQDO NQRZOHGJH LWVHOI 7KHQ ZH WDNH D FORVHU ORRN DW LQGLYLGXDO
NQRZOHGJH FUHDWLRQ SURFHVVHV EHIRUH ZH H[DPLQH WKH LPSRUWDQW IHDWXUHV RI RUJDQL]DWLRQDO
NQRZOHGJH FUHDWLRQ )LQDOO\ ZH H[DPLQH YDULRXV HQDEOLQJ FRQGLWLRQV WKDW DUH LPSRUWDQW IRU
HIIHFWLYHNQRZOHGJHFUHDWLRQDQG63,

±±
&+$37(5

 2UJDQL]DWLRQDONQRZOHGJH
.QRZOHGJH LV WKH PRVW GHFLVLYH IDFWRU LQ VRIWZDUH GHYHORSPHQW 7KHUHIRUH 63, VWUDWHJLHV
GHSHQG RQ OHDUQLQJ LH WKH FUHDWLRQ RI QHZ NQRZOHGJH +RZHYHU WR XQGHUVWDQG DQG PDNH
VHQVH RI WKH SURFHVVHV RI VXFK OHDUQLQJ ZH PXVW DOVR XQGHUVWDQG WKH FRQFHSW RI NQRZOHGJH
VHH'LHUNHVHWDOIRUDQRYHUYLHZ 

7RXQGHUVWDQGOHDUQLQJIXOO\ZHPXVWXQGHUVWDQGWKHQDWXUHDQGIRUPVRIKXPDQNQRZOHGJH
DQGWKHSURFHVVHVZKHUHE\WKLVNQRZOHGJHLVFUHDWHGDQGUHFUHDWHG .ROES 

.QRZOHGJHLVERWKVLPLODUWRDQGGLIIHUHQWIURPLQIRUPDWLRQ&RQVHTXHQWO\VRPHDXWKRUVXVH
WKHZRUGV³LQIRUPDWLRQ´DQG³NQRZOHGJH´LQWHUFKDQJHDEO\ HJ+XEHU 6KDQQRQ DQG
:HDYHU  GHILQHGLQIRUPDWLRQDVDUHGXFWLRQLQXQFHUWDLQW\RUDV%DWHVRQ  SXWLW
³LQIRUPDWLRQ FRQVLVWV RI GLIIHUHQFHV WKDW PDNH D GLIIHUHQFH´ LELG S   7KH YLHZ RI
NQRZOHGJH WDNHQ E\ PDQ\ VRIWZDUH HQJLQHHUV DQG VRIWZDUH HQJLQHHULQJ UHVHDUFKHUV FORVHO\
UHVHPEOHVWKHVHGHILQLWLRQVRILQIRUPDWLRQ HJ%DVLOLHWDOD 7KXVZLWKLQWKHVRIWZDUH
HQJLQHHULQJ DQGDOVRWKHDUWLILFLDOLQWHOOLJHQFH FRPPXQLW\NQRZOHGJHLVPRVWRIWHQVHHQDV
EHLQJ RI RQH NLQG ± VRPHWKLQJ WDQJLEOH ± VRPHWKLQJ WKDW FDQ EH DFTXLUHG VKDUHG DQG
GLVWULEXWHG
+RZHYHUWKLVWHQGHQF\WRWUHDWNQRZOHGJHDVEHLQJRIRQHNLQGVHYHUHO\OLPLWVERWKWKH
WKHRUHWLFDODQGSUDFWLFDOSRWHQWLDORI63,7KHRUHWLFDOO\LWIDLOVWRUHFRJQL]HLPSRUWDQWDVSHFWV
RIWKHGLVWLQFWLRQEHWZHHQWDFLWDQGH[SOLFLWNQRZOHGJHDQGEHWZHHQLQGLYLGXDODQGFROOHFWLYH
NQRZOHGJH ± DVSHFWV WKDW ZH FRQVLGHU RI YLWDO LPSRUWDQFH IRU XQGHUVWDQGLQJ DQG LPSURYLQJ
WKHSURFHVVHVRIVRIWZDUHGHYHORSPHQW3UDFWLFDOO\WKHFRQFHSWLRQRINQRZOHGJHDVVRPHWKLQJ
H[SOLFLW DQG TXDQWLILDEOH GUDZV D SUREOHPDWLF GLVWLQFWLRQ EHWZHHQ NQRZOHGJH DV D WDQJLEOH
JRRGDQGWKHXVHRIWKDWJRRGLQSUDFWLFHKHQFHOLPLWLQJRXUDELOLW\WRVXSSRUWSUDFWLWLRQHUVLQ
VROYLQJWKHLUUHDOZRUOGSUREOHPV

3URSULHWDU\NQRZOHGJH 6KDUHGNQRZOHGJH
([SOLFLW
&RGLILHGH[SHULHQFH )RUPDOURXWLQHV

8QFRGLILHGH[SHULHQFH ,QIRUPDOURXWLQHV
7DFLW 0HQWDOPRGHOV 6KDUHGPHQWDOPRGHOV
,QGLYLGXDOSUDFWLFHVNLOOV 2UJDQL]DWLRQDOSUDFWLFH

,QGLYLGXDO &ROOHFWLYH

)LJXUH7KHHSLVWHPRORJLFDODQGRQWRORJLFDOGLPHQVLRQVRINQRZOHGJH

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

6LQFHZHDUHPRVWFRQFHUQHGZLWKDQXQGHUVWDQGLQJRINQRZOHGJHWKDWKDVDFOHDUOLQNWR
63, DQG SUDFWLFDO ZRUN VLWXDWLRQV ZH FRQFHSWXDOL]H NQRZOHGJH DORQJ WZR GLPHQVLRQV VHH
)LJXUH 7KHILUVWGLPHQVLRQLVWKHGHJUHHRIWDFLWRUH[SOLFLWNQRZOHGJHZKLOHWKHVHFRQG
GLPHQVLRQUHODWHVWRZKHWKHUWKHNQRZOHGJHUHVLGHVLQLQGLYLGXDOVJURXSVRUWKHRUJDQL]DWLRQ
DV D ZKROH 1RQDND  1RQDND DQG 7DNHXFKL   WHUPHG WKHVH GLPHQVLRQV DV WKH
³HSLVWHPRORJLFDO´DQGWKH³RQWRORJLFDO´GLPHQVLRQVUHVSHFWLYHO\
2XU XQGHUVWDQGLQJ RI WKH HSLVWHPRORJLFDO GLPHQVLRQ LV EDVHG RQ 3RODQ\L¶V 
GLVWLQFWLRQEHWZHHQWDFLWDQGH[SOLFLWNQRZOHGJH+LVFRQMHFWXUHZDVWKDW³ZHFDQNQRZPRUH
WKDQZHFDQWHOO´ LELGSLWDOLFVLQRULJLQDO DQGWKDWNQRZOHGJHWKDWFDQEHH[SUHVVHGLQ
ZRUGVDQGQXPEHUVRQO\UHSUHVHQWVWKHWLSRIWKHLFHEHUJRIWKHHQWLUHERG\RINQRZOHGJH)RU
H[DPSOHZHFDQUHFRJQL]HDSHUVRQ¶VIDFHDPRQJWKRXVDQGVEXWXVXDOO\ZHFDQQRWWHOOKRZ
ZHUHFRJQL]HDIDFHWKDWZHNQRZ7KXVH[SOLFLWNQRZOHGJHUHIHUVWRNQRZOHGJHWKDWFDQEH
FRGLILHG DQG H[SUHVVHG IRUPDOO\ XVLQJ D V\VWHP RI V\PEROV DQG FDQ WKHUHIRUH EH HDVLO\
FRPPXQLFDWHGRUGLIIXVHG 1RQDNDDQG7DNHXFKL 7DFLWNQRZOHGJHRQWKHRWKHUKDQG
UHIHUV WR LPSOLFLW DQG XQFRGLILHG NQRZOHGJH ZKLFK LV GHHSO\ URRWHG LQ SHUVRQDO H[SHULHQFH
DQGVNLOOVDQGWKHUHIRUHGLIILFXOWWRGLIIXVH
7DFLW NQRZOHGJH LQYROYHV ERWK FRJQLWLYH DQG WHFKQLFDO HOHPHQWV 1RQDND   7KH
FRJQLWLYHHOHPHQWVFHQWHURQZKDW-RKQVRQ/DLUG  DQGRWKHUV HJ6HQJH KDYH
FDOOHG³PHQWDOPRGHOV´ZKLFKLQFOXGHVYDOXHVEHOLHIVYLHZSRLQWVDQGSHUVSHFWLYHVWKDWKHOS
LQGLYLGXDOV WR SHUFHLYH DQG GHILQH WKHLU ZRUOG &RQYHUVHO\ WKH WHFKQLFDO HOHPHQWV RI WDFLW
NQRZOHGJHFRYHUWKHFRQFUHWHNQRZKRZDQGVNLOOVWKDWDSSOLHVWRVSHFLILFFRQWH[WV
-XVW DV WKHUH LV D WHQGHQF\ ZLWKLQ WKH VRIWZDUH HQJLQHHULQJ FRPPXQLW\ WR IDYRU WKH
H[SOLFLWRYHUWKHWDFLWZHVHHDVLPLODUWHQGHQF\WRIDYRUWKHLQGLYLGXDORYHUWKHJURXS7KLVLV
UHIOHFWHG IRU H[DPSOH E\ 6LPRQ   ZKR LQVLVWV WKDW DOO OHDUQLQJ WDNH SODFH LQVLGH WKH
KHDGV RI LQGLYLGXDOV DQG DOVR E\ $UJ\ULV   DQG $UJ\ULV DQG 6FK|Q   +RZHYHU
WKHUHKDVEHHQDWHQGHQF\WRZDUGWUHDWLQJJURXSVDQGRUJDQL]DWLRQVLQWKHLURZQULJKW7KLVLV
VHHQ LQ WKH RUJDQL]DWLRQDO OLWHUDWXUH RQ HJ ³FRPPXQLWLHV RI SUDFWLFH´ %URZQ DQG 'XJXLG
/DYHDQG:HQJHU2UU:HQJHU ³FRUHFRPSHWHQFLHV´ 3UDKDODGDQG
+DPHO   ³OHDUQLQJ RUJDQL]DWLRQ´ 6HQJH   ³WKLQNLQJ RUJDQL]DWLRQ´ +XQW DQG
%X]DQ   ³NQRZLQJ RUJDQL]DWLRQ´ &KRR   ³NQRZOHGJHFUHDWLQJ FRPSDQ\´
1RQDND DQG 7DNHXFKL   DQG RQ WKH SXUVXLW RI ³RUJDQL]DWLRQDO LQWHOOLJHQFH´ 0DUFK
 
6LPLODU WR WKH H[SOLFLWWDFLW GLVWLQFWLRQ LQGLYLGXDOV DQG JURXSV HDFK GR HSLVWHPLF ZRUN
WKDW WKH RWKHU FDQQRW &RRN DQG %URZQ   6R IRU H[DPSOH ZKLOH LQGLYLGXDO VRIWZDUH
GHYHORSHUV KDYH D VHQVH RI KRZ D SDUWLFXODU VXEPRGXOH RI D ODUJH SURJUDP ZRUNV LW LV D
JURXSRIGHYHORSHUVWKDWFROOHFWLYHO\SRVVHVVWKHNQRZOHGJHRIWKHWRWDOV\VWHP7KXVVLPLODU
WRDVRFFHUWHDPWKHERG\RINQRZOHGJHRIDVRIWZDUHGHYHORSPHQWJURXSLVSRVVHVVHGE\WKH
JURXS DV D ZKROH 7KLV OHDGV WR WKH FRQWHQWLRQ WKDW WKH RUJDQL]DWLRQ¶V NQRZOHGJH LV QRW WKH
VXPRIWKHNQRZOHGJHRILWVLQGLYLGXDOVEXWLVVRPHWKLQJPRUHDQGVRPHWKLQJGLIIHUHQW )LRO
DQG/\OHV:DOVKDQG8QJVRQ 
%DVHG RQ WKH SUHFHGLQJ GLVFXVVLRQ ZH IROORZ WUDGLWLRQDO 3ODWRQLDQ HSLVWHPRORJ\ DQG
GHILQH NQRZOHGJH DV MXVWLILHG WUXH EHOLHI 1RQDND  1RQDND DQG 7DNHXFKL  
6LPLODUO\ ZH HPSKDVL]H ³EHOLHI´ DQG ³MXVWLILFDWLRQ´ UDWKHU WKDQ ³WUXWK´ DV ZH UHJDUG
NQRZOHGJHDVDVRFLDOFRQVWUXFWLRQRIUHDOLW\UDWKHUWKDQVRPHWKLQJWKDWLVWUXHLQDQ\DEVROXWH
VHQVH7KHFUHDWLRQRINQRZOHGJHLVWKXVQRWVLPSO\DPDWWHURIFRPSLOLQJIDFWVLWLVUDWKHUD
G\QDPLFKXPDQSURFHVVWKDWLVUHODWHGWRWKHSUDFWLFHRILQGLYLGXDOVDQGJURXSV

±±
&+$37(5

 ,QGLYLGXDONQRZOHGJHFUHDWLRQ
%DVLFDOO\WKHUHDUHWZRZD\VE\ZKLFKLQGLYLGXDOVDFTXLUHNQRZOHGJH

  9HUEDOWUDQVIHU E\RWKHULQGLYLGXDOVRUE\ERRNVDUWLFOHVHWF 
  'LUHFWH[SHULHQFH WKURXJKWKHUHFHLSWRIVHQVRU\GDWD 

7KH FUHDWLRQ RI QHZ LQGLYLGXDO NQRZOHGJH WKURXJK YHUEDO WUDQVIHU FRUUHVSRQGV WR WKH
WUDGLWLRQDOHGXFDWLRQDOZD\RIOHDUQLQJZKLFKYLHZNQRZOHGJHDVVRPHWKLQJWKDWRULJLQDWHVLQ
WKHHQYLURQPHQWVXUURXQGLQJWKHOHDUQHU,WLVZRUWKQRWLQJKRZHYHUWKDWWKHUHLVDZRUOGRI
GLIIHUHQFH EHWZHHQ WUDQVPLWWLQJ LQIRUPDWLRQ HJ WHDFKLQJ  DQG FUHDWLQJ NQRZOHGJH
OHDUQLQJ 6RZKLOHWHDFKHUVERRNVPDQXDOVFROOHDJXHVRUEXVLQHVVSDUWQHUV FDQWUDQVPLW
LQIRUPDWLRQRUKHOSLQDUUDQJLQJWKHFRQGLWLRQVUHTXLUHGIRUOHDUQLQJWRWDNHSODFHWKH\FDQQRW
SURYLGH NQRZOHGJH 7KLV LV DOVR DW WKH KHDUW RI DXWRSRLHWLF WKHRU\ 0DWXUDQD DQG 9DUHOD
 WKDWNQRZOHGJHFDQQRWEHLPSRUWHGLWFDQRQO\EHFUHDWHG
7KHUHIRUH LQ RUGHU WR FUHDWH QHZ YDOLG NQRZOHGJH IURP YHUEDO WUDQVIHU WKH LQGLYLGXDO
VRIWZDUH GHYHORSHU PXVW FRPPLW KLP RU KHUVHOI WR DFWLYHO\ HQJDJH LQ D OHDUQLQJ SURFHVV
FRPELQLQJWKHH[WHUQDOO\WUDQVPLWWHGLQIRUPDWLRQ ZLWK SUHYLRXV NQRZOHGJH DQG LQWHOOLJHQFH
+RZHYHU DQ LPSRUWDQW LQVLJKW IURP VHYHUDO VWXGLHV HJ 3IHIIHU DQG 6XWWRQ   LV WKDW
NQRZOHGJH DFTXLUHG WKURXJK H[SHULHQFH LV PXFK PRUH OLNHO\ WR EH WXUQHG LQWR DFWLRQ WKDQ
NQRZOHGJHDFTXLUHGE\UHDGLQJRUOLVWHQLQJ,QGHHG³7KHPRVWSRZHUIXOOHDUQLQJFRPHVIURP
GLUHFWH[SHULHQFH´ 6HQJHS 
$PRQJWKHPRVWLQIOXHQWLDOWKHRULVWVZKRKDYHH[SORUHGWKHFHQWUDOUROHWKDWH[SHULHQFH
SOD\VLQWKHOHDUQLQJSURFHVVDUH-RKQ'HZH\.XUW/HZLQDQG-HDQ3LDJHW7KH\LQVSLUHGWKH
ZRUN RI ODWHU WKHRULVWV VXFK DV *UHJRU\ %DWHVRQ 'DYLG .ROE &KULV $UJ\ULV DQG 'RQDOG
6FK|Q :H KDYH IRXQG .ROE¶V   PRGHO RI H[SHULHQWLDO OHDUQLQJ XVHIXO LQ VXPPDUL]LQJ
WKHLGHDVRIWKHVHWKHRULVWVDQGLQH[SODLQLQJWKHSURFHVVRILQGLYLGXDOOHDUQLQJ.ROE 
GHILQHGOHDUQLQJDV³WKHSURFHVVZKHUHE\NQRZOHGJHLVFUHDWHGWKURXJKWKHWUDQVIRUPDWLRQRI
H[SHULHQFH´ LELG  S  LWDOLFV LQ RULJLQDO  :KDW¶V PRUH KH HPSKDVL]HG WKH
LPSRUWDQFHRIFULWLFDOUHIOHFWLRQLQOHDUQLQJ
.ROE¶V  WKHRU\RIH[SHULHQWLDOOHDUQLQJVXPPDUL]HVWKHLQGLYLGXDOOHDUQLQJSURFHVV
E\ D F\FOH FRQVLVWLQJ RI IRXU VWDJHV VHH )LJXUH   7KH F\FOH EHJLQV ZLWK DFWXDO RU
³FRQFUHWHH[SHULHQFH´WKDWGHDOVZLWKLPPHGLDWHKXPDQVLWXDWLRQVLQDSHUVRQDOZD\1H[WLV
WKHLQGLYLGXDOV¶DELOLW\WRUHIOHFWRQDQGREVHUYHWKHLUH[SHULHQFHVIURPPDQ\SHUVSHFWLYHVDQG
GHYHORSWKHVHREVHUYDWLRQVLQWRFROOHFWLRQVRIUHODWHGLGHDVLQDSURFHVV ZKLFK .ROE 
FDOOHG³UHIOHFWLYH REVHUYDWLRQ´ 7KH WKLUG VWDJH LQ WKH OHDUQLQJ F\FOH LV PDNLQJ VHQVH RI RXU
H[SHULHQFHV.ROE  FDOOHGWKLVVWDJHLQZKLFKZHFRQVWUXFWPRGHOVWRGHILQHDQGH[SODLQ
RUSUHGLFWZKDWZHREVHUYHIRU³DEVWUDFWFRQFHSWXDOL]DWLRQ´,QWKHILQDOVWDJHZHVHHNWRWHVW
RXU LGHDV LQ QHZ VLWXDWLRQV WKURXJK ³DFWLYH H[SHULPHQWDWLRQ´ WU\LQJ VRPHWKLQJ QHZ  7KH
RXWFRPH RI VXFK DQ H[SHULPHQW EHFRPHV FRQFUHWH H[SHULHQFH DQG WKXV D VSLUDOLQJ F\FOH RI
H[SHULHQWLDOOHDUQLQJEHFRPHVDSSDUHQW

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

&RQFUHWH

([SHULHQFH

*UDVSLQJYLD

$335(+(16,21

$FWLYH 7UDQVIRUPDWLRQ 7UDQVIRUPDWLRQ 5HIOHFWLYH

([SHULPHQWDWLRQ YLD(;7(16,21 YLD,17(16,21 2EVHUYDWLRQ

*UDVSLQJYLD

&2035(+(16,21

$EVWUDFW

&RQFHSWXDOL]DWLRQ

)LJXUH.ROE¶V  H[SHULHQWLDOOHDUQLQJF\FOH S 

$V VKRZQ LQ )LJXUH  WKHUH DUH WZR GLPHQVLRQV LQ .ROE¶V   OHDUQLQJ F\FOH WKH
SUHKHQVLRQGLPHQVLRQDQGWKHWUDQVIRUPDWLRQGLPHQVLRQHDFKUHSUHVHQWLQJWZRGLDOHFWLFDOO\
RSSRVHG DGDSWLYH RULHQWDWLRQV ZKHUH ERWK HQGV FDQ EH SUHVHQW DW WKH VDPH WLPH 7KH
SUHKHQVLRQGLPHQVLRQUHSUHVHQWVWKHDEVWUDFWFRQFUHWHGLDOHFWLFDQGVD\VVRPHWKLQJDERXWKRZ
LQGLYLGXDOV DUH JUDVSLQJ RU WDNLQJ KROG RI H[SHULHQFH LQ WKH ZRUOG 7KH WUDQVIRUPDWLRQ
GLPHQVLRQ UHSUHVHQWV WKH DFWLYHUHIOHFWLYH GLDOHFWLF DQG VD\V VRPHWKLQJ DERXW KRZ WKH
H[SHULHQFHVDUHJLYHQPHDQLQJ$OWKRXJKH[SHULHQFHLVHVVHQWLDOWROHDUQLQJLWLVQRWHQRXJK
RQH KDV WR GR VRPHWKLQJ ZLWK LW WR FRQVWUXFW NQRZOHGJH 7KH WZR EDVLF GLPHQVLRQV RI WKH
OHDUQLQJ SURFHVV UHIOHFW WKLV DQG DFFRUGLQJ WR .ROE   NQRZOHGJH UHVXOWV IURP WKH
FRPELQDWLRQRIJUDVSLQJDQGWUDQVIRUPLQJH[SHULHQFH
'LUHFWH[SHULHQFHLVDOVRFRQQHFWHGWRSURFHVVHVRIVHQVHPDNLQJVLQFHWKHFRPELQDWLRQ
RI D SDVW PRPHQW D FRQQHFWLRQ DQG D SUHVHQW PRPHQW RI H[SHULHQFH LV ZKDW FUHDWHV D
PHDQLQJIXOGHILQLWLRQRIWKHSUHVHQWVLWXDWLRQ :HLFN 7KXVH[SHULHQWLDOOHDUQLQJKDV
LQFRPPRQZLWKVHQVHPDNLQJWKDWLWUHTXLUHVWKUHHWKLQJVWZRHOHPHQWVDQGDUHODWLRQ

 2UJDQL]DWLRQDONQRZOHGJHFUHDWLRQ
:KLOH.ROE¶V   WKHRU\ RI H[SHULHQWLDO OHDUQLQJ LV LQGLYLGXDORULHQWHG ZH DUH SULPDULO\
LQWHUHVWHGLQNQRZOHGJHFUHDWLRQWKHRU\LQD JURXSDQGRUJDQL]DWLRQDOFRQWH[W$OWKRXJKWKH
WHUPLQRORJ\YDULHVWKHVDPHEDVLFVWHSVWRNQRZOHGJHFUHDWLRQDSSHDULQYLUWXDOO\DOOVWXGLHV
RI RUJDQL]DWLRQDO OHDUQLQJ )RU H[DPSOH 'DIW DQG :HLFN   GHVFULEHG WKH SURFHVV LQ
WHUPVRIVFDQQLQJLQWHUSUHWDWLRQDQGOHDUQLQJ:LNVWU|PDQG1RUPDQQ  GLVWLQJXLVKHG
EHWZHHQWKHJHQHUDWLYHSURGXFWLYHDQGUHSUHVHQWDWLYHNQRZOHGJHSURFHVVHV/HRQDUG%DUWRQ
 LGHQWLILHGIRXUPDLQDFWLYLWLHVFDUULHGRXWLQWKHFRXUVHRIGHYHORSLQJQHZSURGXFWVDQG
SURFHVVHV WKURXJK ZKLFK DQ RUJDQL]DWLRQ EXLOGV LWV NQRZOHGJH DQG H[WHQGV RU FUHDWHV QHZ

±±
&+$37(5

FDSDELOLWLHV   VKDUHG FUHDWLYH SUREOHP VROYLQJ   LPSOHPHQWLQJ DQG LQWHJUDWLQJ QHZ


PHWKRGRORJLHVDQGWRROV  H[SHULPHQWDWLRQDQGSURWRW\SLQJDQG  LPSRUWLQJNQRZOHGJH
IURP WKH RXWVLGH ,Q D VLPLODU YHLQ *DUYLQ   PDGH D GLVWLQFWLRQ EHWZHHQ DFTXLULQJ
LQWHUSUHWLQJDQGDSSO\LQJLQIRUPDWLRQLQRUGHUIRUDQRUJDQL]DWLRQWROHDUQ
7RGD\1RQDNDDQG7DNHXFKL¶V  ZRUNRQWKHNQRZOHGJHFUHDWLQJFRPSDQ\KDVEH
FRPHZLGHO\DFFHSWHGDVVWDWHRIWKHDUWLQRUJDQL]DWLRQDONQRZOHGJHFUHDWLRQ%DVHGRQWKHLU
DQDO\VLVRIKRZ-DSDQHVHFRPSDQLHVFUHDWHWKHG\QDPLFVRILQQRYDWLRQWKH\SURSRVHGDILYH
SKDVHPRGHORIWKHRUJDQL]DWLRQDONQRZOHGJHFUHDWLRQSURFHVV VHH)LJXUH 
1RQDNDDQG7DNHXFKL¶V  NQRZOHGJHFUHDWLQJSURFHVVVWDUWVZLWKWKHVKDULQJRIWDFLW
NQRZOHGJH7KLVLVDSKDVHZKHUHLQGLYLGXDOVW\SLFDOO\LQWHUDFWZLWKHDFKRWKHUWKURXJKIDFH
WRIDFH GLDORJXH LQ VHOIRUJDQL]LQJ WHDPV LQ RUGHU WR DFKLHYH D FRPPRQ JRDO DQG GHYHORS
VKDUHGPHQWDOPRGHOV,QWKHVHFRQGSKDVHFUHDWLQJFRQFHSWVWKHWHDPPHPEHUVFROOHFWLYHO\
UHIOHFWRQWKHLUVKDUHGWDFLWNQRZOHGJHDQGDUWLFXODWHLWWKURXJKIXUWKHUGLDORJXHWRYHUEDOL]H
WKH PRGHO LQWR H[SOLFLW FRQFHSWV ,Q WKH WKLUG SKDVH MXVWLI\LQJ FRQFHSWV WKH QHZO\ FUHDWHG
FRQFHSWVDUHHYDOXDWHGDWWKHRUJDQL]DWLRQDOOHYHOWRGHWHUPLQHZKHWKHUWKH\DUHLQOLQHZLWK
WKHRUJDQL]DWLRQ¶VLQWHQWLRQDQGWKXVZKHWKHUWKH\DUHWUXO\ZRUWK\RISXUVXLW,QWKHIRXUWK
SKDVHEXLOGLQJDQDUFKHW\SHWKHMXVWLILHGFRQFHSWVDUHFRQYHUWHGLQWRSURGXFWSURWRW\SHVRU
PRGHOSURFHVVHV)LQDOO\LQWKHILIWKSKDVHFURVVOHYHOLQJNQRZOHGJHWKHFRQFHSWVWKDWKDYH
EHHQ FUHDWHG MXVWLILHG DQG PRGHOHG DUH XVHG WR DFWLYDWH QHZ F\FOHV RI NQRZOHGJH FUHDWLRQ
DFURVVRWKHUJURXSVDQGRUJDQL]DWLRQV
7KXV³$NQRZOHGJHFUHDWLQJFRPSDQ\GRHVQRWRSHUDWHLQDFORVHGV\VWHPEXWLQDQRSHQ
V\VWHPLQZKLFKNQRZOHGJHLVFRQVWDQWO\H[FKDQJHGZLWKWKHRXWVLGHHQYLURQPHQW´ LELGSS
 
7KH RUJDQL]DWLRQDO NQRZOHGJH FUHDWLRQ F\FOH LV EDVHG RQ IRXU PRGHV RI NQRZOHGJH
FRQYHUVLRQ IURP WDFLW WR WDFLW VRFLDOL]DWLRQ  WDFLW WR H[SOLFLW H[WHUQDOL]DWLRQ  H[SOLFLW WR
H[SOLFLW FRPELQDWLRQ  DQG H[SOLFLW WR WDFLW LQWHUQDOL]DWLRQ  7RJHWKHU WKHVH IRXU PRGHV RI
NQRZOHGJHFRQYHUVLRQIHHGRIIHDFKRWKHULQDFRQWLQXRXVVSLUDORINQRZOHGJHFUHDWLRQ

(QDEOLQJ&RQGLWLRQV
,QWHQWLRQ
$XWRQRP\
)OXFWXDWLRQ&UHDWLYHFKDRV
5HGXQGDQF\
5HTXLVLWH9DULHW\

7DFLWNQRZOHGJH ([SOLFLWNQRZOHGJH

6KDULQJWDFLW &UHDWLQJ -XVWLI\LQJ %XLOGLQJDQ &URVVOHYHOLQJ


NQRZOHGJH FRQFHSWV FRQFHSWV DUFKHW\SH NQRZOHGJH

)LJXUH2UJDQL]DWLRQDONQRZOHGJHFUHDWLQJSURFHVV 1RQDNDDQG7DNHXFKLS 

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

+RZHYHU FRQWUDU\ WR 1RQDND   DQG 1RQDND DQG 7DNHXFKL   ZKRVH PDLQ
DVVXPSWLRQ LV WKDW NQRZOHGJH LV FUHDWHG WKURXJK ³FRQYHUVLRQ´ EHWZHHQ WDFLW DQG H[SOLFLW
NQRZOHGJHZHFRQFXUZLWK&RRNDQG%URZQ  DQGDUJXHWKDWRQHIRUPRINQRZOHGJH
FDQQRWEH³FRQYHUWHG´LQWRWKHRWKHU³7DFLWNQRZOHGJHFDQQRWEHWXUQHGLQWRH[SOLFLWQRUFDQ
H[SOLFLW NQRZOHGJH EH WXUQHG LQWR WDFLW´ LELG S   (DFK IRUP RI NQRZOHGJH FDQ
QHYHUWKHOHVVRIWHQEHXVHGWRDLGLQDFTXLULQJWKHRWKHU
7KXVZKHQDVRIWZDUHGHYHORSHUWULHVWRDUWLFXODWHKLVRUKHUH[SHULHQFHVRIXVLQJVRPH
SDUWLFXODUPHWKRGRUVRIWZDUHHQJLQHHULQJSUDFWLFHWKHSHUVRQLQTXHVWLRQLVQRWSHUIRUPLQJ
DQ RSHUDWLRQ RQ WKH WDFLW NQRZOHGJH WKDW WXUQV LW LQWR H[SOLFLW NQRZOHGJH 5DWKHU WKH WDFLW
NQRZOHGJH WKDW FRPHV IURP WKHVH H[SHULHQFHV LV XVHG WR JHQHUDWH QHZ H[SOLFLW NQRZOHGJH
7KHUHIRUHWKHVRIWZDUHGHYHORSHUVWLOOSRVVHVVHVWKHWDFLWNQRZOHGJHDQGFDQFRQWLQXHWRXVH
LWLQSUDFWLFH

 (QDEOLQJFRQGLWLRQV
7KHUHDUHQXPHURXVREVWDFOHVWRHIIHFWLYHNQRZOHGJHFUHDWLRQDQGVXFFHVVIXO63,±LWGRHVQ¶W
MXVWKDSSHQ7KHUHIRUHHIIHFWLYH63,GHSHQGVRQDQHQDEOLQJFRQWH[WVLPLODUWRWKH-DSDQHVH
FRQFHSWRI³ED´ 1RQDNDDQG.RQQR 6XFKDFRQWH[WFDQEHSK\VLFDO HJDQRIILFHRU
DGLVSHUVHGEXVLQHVVSODFH YLUWXDO VXFKDVHPDLOWHOHFRQIHUHQFLQJRUZHEFKDWURRPV RU
PHQWDO HJVKDUHGH[SHULHQFHVLGHDVRULGHDOV WKXVSURYLGLQJWKHQHFHVVDU\FRQGLWLRQVIRU
WKHLQWHUDFWLRQEHWZHHQWDFLWDQGH[SOLFLWDQGLQGLYLGXDODQGFROOHFWLYHNQRZOHGJH
$FRQFHUQIRUHQDEOLQJFRQGLWLRQVLVDOVRVHHQLQ6HQJH¶V  DFFRXQWRIWKHOHDUQLQJ
RUJDQL]DWLRQ+HSURSRVHGILYHQHFHVVDU\GLVFLSOLQHVIRUFUHDWLQJDOHDUQLQJRUJDQL]DWLRQ
x 3HUVRQDO PDVWHU\ LV WKH GLVFLSOLQH RI GHYHORSLQJ RQH¶V RZQ SURILFLHQF\ DQG FODULI\LQJ
WKH FRQQHFWLRQV EHWZHHQ SHUVRQDO DQG RUJDQL]DWLRQDO OHDUQLQJ LQ D PXWXDO FRPPLWPHQW
EHWZHHQLQGLYLGXDOVDQGRUJDQL]DWLRQ
x 0HQWDO PRGHOV DUH FRQFHSWXDO VWUXFWXUHV LQ WKH PLQG WKDW GULYH FRJQLWLYH SURFHVVHV RI
XQGHUVWDQGLQJ 7KH GLVFLSOLQH RI PHQWDO PRGHOV WKHUHIRUH DLPV DW WUDLQLQJ SHRSOH WR
DSSUHFLDWHWKDWVXFKPRGHOVGRLQGHHGRFFXS\WKHLUPLQGVDQGVKDSHWKHLUDFWLRQV
x 6KDUHGYLVLRQUHIHUVWRVKDUHGRSHUDWLQJYDOXHVDFRPPRQVHQVHRISXUSRVHRUDEDVLF
OHYHORIPXWXDOLW\WKXVSURYLGLQJDIRFXVDQGHQHUJ\IRUOHDUQLQJ
x 7HDP OHDUQLQJ WKURXJK GLDORJXH DQG GLVFXVVLRQ LV FRQVLGHUHG DV D YLWDO HQDEOHU IRU
RUJDQL]DWLRQDO OHDUQLQJ VLQFH WHDPV DUH FRQVLGHUHG DV WKH IXQGDPHQWDO OHDUQLQJ XQLW LQ
PRGHUQRUJDQL]DWLRQV
x 6\VWHPV WKLQNLQJ LV WKH ILIWK GLVFLSOLQH WKDW SURYLGHV VXEVWDQFH WR WKH RWKHU IRXU
GLVFLSOLQHV³,WLVWKHGLVFLSOLQHWKDWLQWHJUDWHVWKHGLVFLSOLQHVIXVLQJWKHPLQWRDFRKHUHQW
ERG\RIWKHRU\DQGSUDFWLFH´ LELGS 

&HQWUDO WR KLV LGHD RI WKH ILIWK GLVFLSOLQH LV WKDW ZH FDQ RQO\ XQGHUVWDQG DQ RUJDQL]DWLRQDO
V\VWHPE\FRQWHPSODWLQJWKHZKROHDQGQRWE\VWXG\LQJWKHLQGLYLGXDOSDUWVRIWKHV\VWHPLQ
LVRODWLRQ/LNHZLVHWKHHQDEOLQJFRQGLWLRQVUHSUHVHQWHGE\WKHILYHGLVFLSOLQHVPXVWGHYHORS
WRJHWKHU±DVDQHQVHPEOH

±±
&+$37(5

$VDQLQWHJUDOSDUWRIWKHLUGHVFULSWLRQRIWKHNQRZOHGJHFUHDWLQJFRPSDQ\1RQDNDDQG
7DNHXFKL  GLVFXVVHGILYHHQDEOLQJFRQGLWLRQVUHTXLUHGDWWKHRUJDQL]DWLRQDOOHYHOWRSUR
PRWHWKHNQRZOHGJHVSLUDO VHH)LJXUH 

x 2UJDQL]DWLRQDOLQWHQWLRQZKLFKLVDQRUJDQL]DWLRQ¶VDVSLUDWLRQWRLWVJRDOV,WSURYLGHV
³WKHPRVWLPSRUWDQWFULWHULRQIRUMXGJLQJWKHWUXWKIXOQHVVRIDJLYHQSLHFHRINQRZOHGJH´
LELGS 
x $XWRQRP\ZKLFKLQFUHDVHVWKHFKDQFHRILQWURGXFLQJXQH[SHFWHGRSSRUWXQLWLHV7KLVLV
PDGHSRVVLEOHE\XWLOL]LQJWKH³PLQLPXPFULWLFDOVSHFLILFDWLRQ´SULQFLSOH 7ULVW LQ
VHOIRUJDQL]LQJWHDPV
x )OXFWXDWLRQ DQG FUHDWLYH FKDRV ZKLFK VWLPXODWH WKH LQWHUDFWLRQ EHWZHHQ WKH
RUJDQL]DWLRQDQGLWVHQYLURQPHQW+RZHYHUWKHEHQHILWVRI³FUHDWLYHFKDRV´FDQRQO\EH
UHDOL]HG WKURXJK UHIOHFWLRQ XSRQ RUJDQL]DWLRQDO DFWLRQV ZLWKRXW VXFK UHIOHFWLRQ
IOXFWXDWLRQWHQGVWROHDGWR³GHVWUXFWLYH´FKDRV 1RQDNDDQG7DNHXFKL 
x 5HGXQGDQF\ ZKLFK UHIHUV WR ³LQWHQWLRQDO RYHUODSSLQJ RI LQIRUPDWLRQ DERXW EXVLQHVV
DFWLYLWLHVPDQDJHPHQWUHVSRQVLELOLWLHVDQGWKHFRPSDQ\DVDZKROH´ LELGS WKXV
SURPRWLQJWKHVKDULQJRIWDFLWNQRZOHGJH
x 5HTXLVLWH YDULHW\ ZKLFK KHOSV DGYDQFH WKH NQRZOHGJH VSLUDO E\ PDWFKLQJ WKH
RUJDQL]DWLRQ¶V LQWHUQDO GLYHUVLW\ ZLWK WKH YDULHW\ DQG FRPSOH[LW\ RI WKH HQYLURQPHQW LQ
RUGHUWRGHDOZLWKFKDOOHQJHVSRVHGE\WKHHQYLURQPHQW $VKE\ 

%XLOGLQJ RQ 1RQDND DQG 7DNHXKL¶V   ZRUN RQ RUJDQL]DWLRQDO NQRZOHGJH FUHDWLRQ YRQ
.URJK HW DO   VXJJHVWHG ILYH NQRZOHGJH HQDEOHUV DLPHG DW HQKDQFLQJ WKH NQRZOHGJH
FUHDWLRQ SRWHQWLDO RI D FRPSDQ\ 7KH ILUVW HQDEOHU LQVWLOO D NQRZOHGJH YLVLRQ OHJLWLPL]HV
NQRZOHGJHFUHDWLRQ LQLWLDWLYHV WKURXJKRXW WKH FRPSDQ\ 7KH VHFRQG HQDEOHU PDQDJH
FRQYHUVDWLRQV LV FORVHO\ FRQQHFWHG ZLWK UHODWLRQVKLSV DQG FDUH LQ RUJDQL]DWLRQV DQG WKXV
VWURQJO\ DIIHFWV DOO ILYH NQRZOHGJH FUHDWLRQ VWHSV 7KH WKLUG HQDEOHU PRELOL]H NQRZOHGJH
DFWLYLVWV HPSKDVL]HV WKH SHRSOH ZKR WULJJHU DQG FRRUGLQDWH NQRZOHGJHFUHDWLRQ SURFHVVHV
7KHIRXUWKHQDEOHUFUHDWHWKHULJKWFRQWH[WLVFORVHO\WLHGWRDFRPSDQ\¶VVWUXFWXUHVLQFHWKH
ZD\WHDPVDQGJURXSVDUHIRUPHGDQGLQWHUDFWZLWKLQDQRUJDQL]DWLRQGHWHUPLQHWKHH[WHQWWR
ZKLFK NQRZOHGJH LV YDOXHG )LQDOO\ JOREDOL]H ORFDO NQRZOHGJH HPSKDVL]HV GLVVHPLQDWLRQ
DFURVV RUJDQL]DWLRQDO OHYHOV 7DEOH  VXPPDUL]HV 6HQJH¶V   ILYH GLVFLSOLQHV 1RQDND
DQG 7DNHXFKL¶V   HQDEOLQJ FRQGLWLRQV DQG YRQ .URJK HW DO¶V   NQRZOHGJH
HQDEOHUV
)XUWKHUPRUH*DUYLQ  HPSKDVL]HGILYHEXLOGLQJEORFNVWKDWOHDUQLQJRUJDQL]DWLRQV
DUH VNLOOHG DW V\VWHPDWLF SUREOHP VROYLQJ H[SHULPHQWDWLRQ OHDUQLQJ IURP SDVW H[SHULHQFH
OHDUQLQJIURPRWKHUVDQGWUDQVIHUULQJ NQRZOHGJH 5HFHQWO\ KH KDV H[WHQGHG KLV DQDO\VLV RI
WKH OHDUQLQJ RUJDQL]DWLRQ HPSKDVL]LQJ DQ ³OHDUQLQJ LQ DFWLRQ´ SHUVSHFWLYH *DUYLQ  
7KHODWWHUSHUVSHFWLYHGHVFULEHVERWKWKHEDVLFVWHSVLQWKHOHDUQLQJSURFHVVDQGWKUHHPRGHV
RIOHDUQLQJ±LQWHOOLJHQFHJDWKHULQJH[SHULHQFHDQGH[SHULPHQWDWLRQ
$OVR EDVHG RQ WKH ILQGLQJV LQ DQ HPSLULFDO VWXG\ 1HYLV HW DO   GHVFULEHG DQ
RUJDQL]DWLRQ¶VOHDUQLQJV\VWHPDVDWZRSDUWPRGHO2QHSDUWLVWKHOHDUQLQJRULHQWDWLRQV±WKH
YDOXHVDQGDWWLWXGHV WKDW GHWHUPLQH ZKHUH OHDUQLQJ ZLOO WDNH SODFH DQG WKH QDWXUH RI ZKDW LV
OHDUQHG7KHVHFRQG SDUW LV WKH IDFLOLWDWLQJ IDFWRUV ± WKH VWUXFWXUHV DQG SURFHVVHV WKDW DIIHFW
KRZ HDV\ RU KDUG LW LV IRU OHDUQLQJ WR RFFXU DQG WKH DPRXQW RI HIIHFWLYH OHDUQLQJ WKDW WDNHV

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

SODFH 7HQ IDFLOLWDWLQJ IDFWRUV WKDW H[SHGLWH OHDUQLQJ ZHUH LGHQWLILHG LQ WKHLU VWXG\ 
VFDQQLQJ LPSHUDWLYH   SHUIRUPDQFH JDS   FRQFHUQ IRU PHDVXUHPHQW   H[SHULPHQWDO
PLQGVHW   FOLPDWH RI RSHQQHVV   FRQWLQXRXV HGXFDWLRQ   RSHUDWLRQDO YDULHW\ 
PXOWLSOHDGYRFDWHV  LQYROYHGOHDGHUVKLSDQG  V\VWHPVSHUVSHFWLYH
%DVHGRQWKHSUHFHGLQJGLVFXVVLRQZHDUJXHDORQJWKHOLQHVRIYRQ.URJKHWDO 
WKDW NQRZOHGJH FUHDWLRQ DQG 63, FDQQRW EH PDQDJHG RQO\ HQDEOHG 7KHUHIRUH VRIWZDUH
PDQDJHUVVKRXOGIRFXVRQGHYHORSLQJDQHQDEOLQJFRQWH[WIRUNQRZOHGJHFUHDWLRQUDWKHUWKDQ
WU\LQJ WR FRQWURO WKH NQRZOHGJH FUHDWLRQ SURFHVV :LWK UHIHUHQFH WR RXU GHILQLWLRQ RI
NQRZOHGJHDVMXVWLILHGWUXHEHOLHIDQGLWVG\QDPLFDQGKXPDQHOHPHQWVNQRZOHGJHGHSHQGV
RQ WKH VLWXDWLRQ DQG SHRSOH LQYROYHG UDWKHU WKDQ RQ DEVROXWH WUXWK DQG KDUG IDFWV 7KXV LQ
FRQWUDVW WR LQIRUPDWLRQ RU GDWD NQRZOHGJH GHSHQGV RQ LWV FRQWH[W DQG VKRXOG EH WUHDWHG
FRUUHVSRQGLQJO\

 3XUSRVHIXO$FWLRQ
3XUSRVHIXODFWLRQVDUHDWWKHYHU\KHDUWRIDQ\63,HIIRUW±ZLWKRXWDFWLRQQRLPSURYHPHQW
7KHUHIRUHQHZLQWHUSUHWDWLRQVDQGQHZNQRZOHGJHDUHRIOLPLWHGYDOXHXQOHVVZH FDQPDNH
XVH RI LW WR FRQVWUXFW LPSURYHG FRXUVHV RI DFWLRQ 7KHUH DUH KRZHYHU GLIIHUHQW ZD\V RI
PRYLQJ WRZDUG VXFK SXUSRVHIXO DFWLRQV 6XFKPDQ   IRU H[DPSOH FRQWUDVWHG WKH
(XURSHDQ DQG 7UXNHVH DSSURDFKHV WR RSHQ VHD QDYLJDWLRQ WR HPSKDVL]H WKHVH GLIIHUHQFHV LQ
KHUGLVFXVVLRQRIWHFKQRORJ\GHVLJQ

7KH(XURSHDQQDYLJDWRUEHJLQVZLWKDSODQ±DFRXUVH±ZKLFKKHKDVFKDUWHGDFFRUGLQJWR
FHUWDLQXQLYHUVDOSULQFLSOHVDQGKHFDUULHVRXWKLVYR\DJHE\UHODWLQJKLVHYHU\PRYHWRWKDW
SODQ +LV HIIRUW WKURXJKRXW KLV YR\DJH LV GLUHFWHG WR UHPDLQLQJ
RQ FRXUVH
 ,I XQH[SHFWHG
HYHQWVRFFXUKHPXVWILUVWDOWHUWKHSODQWKHQUHVSRQGDFFRUGLQJO\ 7KH 7UXNHVH QDYLJDWRU
EHJLQVZLWKDQREMHFWLYHDQGUHVSRQGVWRFRQGLWLRQVDVWKH\DULVHLQDQDGKRFIDVKLRQ+H
XWLOL]HVLQIRUPDWLRQSURYLGHGE\WKHZLQGWKHZDYHVWKHWLGHDQGWKHFXUUHQWWKHIDXQDWKH
VWDUVWKHFORXGVWKHVRXQGRIWKHZDWHURQWKHVLGHRIWKHERDWDQGVWHHUVDFFRUGLQJO\+LV
HIIRUWLVGLUHFWHGWRGRLQJZKDWHYHULVQHFHVVDU\WRUHDFKWKHREMHFWLYH,IDVNHGKHFDQSRLQW
WRKLVREMHFWLYHDWDQ\PRPHQWEXWKHFDQQRWGHVFULEHKLVFRXUVH %HUUHPDQS
FLWHGLQ6XFKPDQSYLL 

7DEOH(QDEOLQJFRQGLWLRQVLGHQWLILHGLQRUJDQL]DWLRQDOOHDUQLQJDQGNQRZOHGJHFUHDWLRQ


6HQJH¶VILYHGLVFLSOLQHV 1RQDNDDQG7DNHXFKL¶V YRQ.URJKHWDO¶VNQRZOHGJH
 
HQDEOLQJFRQGLWLRQV HQDEOHUV

x 6\VWHPV7KLQNLQJ x ,QWHQWLRQ x ,QVWLOOD.QRZOHGJH9LVLRQ


x 3HUVRQDO0DVWHU\ x $XWRQRP\ x 0DQDJH&RQYHUVDWLRQV
x 0HQWDO0RGHOV x )OXFWXDWLRQDQG&UHDWLYH x 0RELOL]H.QRZOHGJH$FWLYLVWV
&KDRV
x 6KDUHG9LVLRQ x &UHDWHWKH5LJKW&RQWH[W
x 5HGXQGDQF\
x 7HDP/HDUQLQJ x *OREDOL]H/RFDO.QRZOHGJH
x 5HTXLVLWH9DULHW\

6RXUFHV6HQJH  1RQDNDDQG7DNHXFKL  YRQ.URJKHWDO  

±±
&+$37(5

7KLVGLVWLQFWLRQEHWZHHQDOLQHDUDQGDG\QDPLFDSSURDFKWRQDYLJDWLRQFRXOGDOVRGHVFULEHD
PDMRUVKLIWIURPWKHFXUUHQW ROG SDUDGLJPWRDQHZSDUDGLJPIRU63,LQVRIWZDUHLQWHQVLYH
RUJDQL]DWLRQV ,Q WKH IROORZLQJ VXEVHFWLRQV ZH LOOXVWUDWH WKHVH PRGHV RI WKLQNLQJ E\ D
GHVFULSWLRQRIWKHJHQHUDOWKHRU\RISODQQHGFKDQJHWKDWXQGHUOLHVFXUUHQWPRGHOVRI63, HJ
4,3DQG,'($/ WRJHWKHUZLWKWKHWKHRULHVEHKLQGQHZHUZD\VRIWKLQNLQJUHJDUGLQJFKDQJH
DQGWKHUHODWLRQVKLSVEHWZHHQNQRZOHGJHDQGDFWLRQ HJ'\En E  +RZHYHU ILUVW ZH
ORRNDWKRZWKHVHZD\VRIWKLQNLQJDUHUHIOHFWHGLQFRQWHPSRUDU\WKHRULHVRIDFWLRQ

 7KHRULHVRIDFWLRQ
$Q RUJDQL]DWLRQ¶V WKHRU\ RI DFWLRQ FDQ EH GHILQHG LQ WHUPV RI D SDUWLFXODU VLWXDWLRQ 6 D
SDUWLFXODUFRQVHTXHQFHLQWHQGHGLQWKDWVLWXDWLRQ&DQGWKHRUJDQL]DWLRQ¶VDFWLRQVWUDWHJ\$
IRUREWDLQLQJFRQVHTXHQFH&LQVLWXDWLRQ6 $UJ\ULVDQG6FK|Q 7KHJHQHUDOIRUPRID
WKHRU\RIDFWLRQLVWKXV,I\RXLQWHQGWRSURGXFHFRQVHTXHQFH&LQVLWXDWLRQ6WKHQGR$$
SDWKGLDJUDPRI WKH JHQHUDO IRUP RI D WKHRU\ RI DFWLRQ LV VKRZQ LQ )LJXUH  7ZR IXUWKHU
HOHPHQWV DUH SDUW RI WKLV JHQHUDO VFKHPD ILUVW LV WKH YDOXHV DWWULEXWHG WR & WKDW PDNH LW D
GHVLUDEOH RXWFRPH DQG VHFRQG DUH WKH XQGHUO\LQJ DVVXPSWLRQV RU ZRUOGYLHZ WKDW MXVWLILHV
WKDWDFWLRQ$ZLOOSURGXFHFRQVHTXHQFH&LQVLWXDWLRQ6$WKHRU\RIDFWLRQVSHFLDOL]HGWR63,
ZDVVKRZQLQWKHSDWKGLDJUDPLQ)LJXUHLQ6HFWLRQ

$FWLRQ &RQVHTXHQFH

6LWXDWLRQ

)LJXUH7KHJHQHUDOIRUPRIDWKHRU\RIDFWLRQ

7KHUH DUHWZRGLIIHUHQW IRUPV RI WKHRULHV RI DFWLRQV ³HVSRXVHG WKHRU\´ DQG ³WKHRU\LQXVH´
LELG (VSRXVHGWKHRU\UHIHUVWRWKHWKHRU\RIDFWLRQZKLFKLVDGYDQFHGWRH[SODLQRUMXVWLI\
DJLYHQSDWWHUQRIDFWLYLW\ZKLOHWKHRU\LQXVHUHIHUVWRWKHWKHRU\RIDFWLRQZKLFKLVLPSOLFLW
LQ WKH SHUIRUPDQFH RI WKDW SDWWHUQ RI DFWLYLW\ 2UJDQL]DWLRQDO WKHRULHVLQXVH PD\ EH WDFLW
UDWKHUWKDQH[SOLFLWDQGRIWHQWKH\GRQRWFRLQFLGHZLWKWKHRUJDQL]DWLRQ¶VHVSRXVHGWKHRULHV
,Q 6¡UXPJnUG¶V   WHUPV WKLV FRUUHVSRQGV WR D ODFN RI SURFHVV FRQIRUPDQFH )RU
H[DPSOH D VRIWZDUH RUJDQL]DWLRQ¶V IRUPDO GRFXPHQWV VXFK DV RUJDQL]DWLRQ FKDUWV SROLF\
VWDWHPHQWV RU SURFHVV GHILQLWLRQV IUHTXHQWO\ FRQWDLQ HVSRXVHG WKHRULHV RI DFWLRQ WKDW DUH
LQFRQJUXHQW ZLWK WKH RUJDQL]DWLRQ¶V DFWXDO SDWWHUQV RI DFWLYLW\ RU H[HFXWHG SURFHVVHV VHH
)LJXUH ,WLVLPSRUWDQWWRSRLQWRXWKRZHYHUWKDWVXFKODFNRIFRQIRUPDQFHQHHGQRWEH
DQREVWDFOHIRU63,2QWKHFRQWUDU\ZKHQVXFKJDSVEHWZHHQHVSRXVHGWKHRULHVDQGWKHRULHV
LQXVHDUHUHFRJQL]HGWKH\FUHDWHLPSRUWDQWRSSRUWXQLWLHVIRUOHDUQLQJ±RSSRUWXQLWLHVWKDWFDQ
XOWLPDWHO\EHXVHGWRFKDQJHWKHHVSRXVHGWKHRULHVWKHWKHRULHVLQXVHRUERWK
$VRIWZDUHRUJDQL]DWLRQ¶VWKHRULHVLQXVHODUJHO\DFFRXQWIRULWVLGHQWLW\DQGFXOWXUHRYHU
WLPH +RZHYHU EHFDXVH RI WKH WDFLWQHVV RI WKHVH WKHRULHV VRIWZDUH GHYHORSHUV DUH RIWHQ
XQDZDUH RI WKH GLVFUHSDQF\ EHWZHHQ WKHLU HVSRXVHG WKHRULHV DQG WKHLU WKHRULHVLQXVH 7KH



6HH&KDSWHUIRUDGHWDLOHGWUHDWPHQWRIWKHVHDQGRWKHU63,PRGHOV

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

UHDVRQV IRU WKLV LV SDUWO\ WKDW WKH RUJDQL]DWLRQ¶V PHPEHUV DUH XQDEOH WR H[SUHVV WKHLU WDFLW
NQRZOHGJH DQG SDUWO\ EHFDXVH D ODFN RI FRQIRUPDQFH ZLWK WKH RUJDQL]DWLRQ¶V HVSRXVHG
WKHRULHVFRXOGEHSHUFHLYHGDVWKUHDWHQLQJRUHPEDUUDVVLQJ)RUWKHVHUHDVRQVZHHPSKDVL]H
WKDWWRTXDOLI\DV VXFFHVVIXO 63, DFWLRQV PXVW LQFOXGH HYLGHQFH RI FKDQJH LQ RUJDQL]DWLRQDO
WKHRULHVLQXVHDVZHOODVLQWKHH[SOLFLWO\VWRUHGRUJDQL]DWLRQDOPHPRU\EDVHV
$UJ\ULVDQG6FK|Q  GLVWLQJXLVKHGEHWZHHQWKUHHW\SHVRIRUJDQL]DWLRQDOOHDUQLQJ

  ,QTXLU\WKDWOHDGVWRLPSURYHPHQWLQWKHSHUIRUPDQFHRIRUJDQL]DWLRQDOWDVNV
  ,QTXLU\ WKURXJK ZKLFK DQ RUJDQL]DWLRQ H[SORUHV DQG UHVWUXFWXUHV WKH YDOXHV DQG FULWHULD
WKURXJKZKLFKLWGHILQHVZKDWLWPHDQVE\LPSURYHGSHUIRUPDQFH
  ,QTXLU\WKURXJKZKLFKDQRUJDQL]DWLRQHQKDQFHVLWVFDSDELOLW\IRUOHDUQLQJRIW\SHV  RU
 

7KHILUVWW\SHRIOHDUQLQJLVVLQJOHORRSOHDUQLQJZKLFKLV³LQVWUXPHQWDOOHDUQLQJWKDWFKDQJHV
VWUDWHJLHV RI DFWLRQ RU DVVXPSWLRQV XQGHUO\LQJ VWUDWHJLHV LQ ZD\V WKDW OHDYH WKH YDOXHV RI D
WKHRU\RIDFWLRQXQFKDQJHG´ $UJ\ULVDQG6FK|QS 7KHVHFRQGW\SHRIOHDUQLQJLV
GRXEOHORRSOHDUQLQJZKLFKLV³OHDUQLQJWKDWUHVXOWVLQDFKDQJHLQ WKH YDOXHV RI WKHRU\LQ
XVHDVZHOODVLQLWVVWUDWHJLHVDQGDVVXPSWLRQV´ LELGS 7KHGRXEOHORRSUHIHUVWRWKH
WZR IHHGEDFN ORRSV WKDW FRQQHFW WKH FRQVHTXHQFHV RI DFWLRQ ZLWK XQGHUO\LQJ YDOXHV
VWUDWHJLHVDQGDVVXPSWLRQV VHH)LJXUH 
5HIHUULQJWR)LJXUHOHDUQLQJRFFXUVZKHQDPDWFKEHWZHHQLQWHQWLRQVDQGUHDOLW\LV
DFKLHYHG IRU WKH ILUVW WLPH LH WKH PDWFK LV JHQXLQHO\ QHZ WR WKH VRIWZDUH RUJDQL]DWLRQ
/HDUQLQJDOVRRFFXUVZKHQRUJDQL]DWLRQDOPHPEHUVGHWHFWDQGFRUUHFWPLVPDWFKHVRUHUURUV
WKXVH[SHULHQFLQJDVXUSULVH$FFRUGLQJO\VLQJOHORRSOHDUQLQJRFFXUVZKHQWKHPLVPDWFKLV
FRUUHFWHG E\ FKDQJLQJ WKH DFWLRQV ZKLOH GRXEOHORRS OHDUQLQJ RFFXUV ZKHQ WKH XQGHUO\LQJ
VWUDWHJLHVDQGDVVXPSWLRQVDUHFKDQJHGZKLFKLQWXUQOHDGVWRFKDQJHVLQDFWLRQ

(VSRXVHGWKHRU\ 7KHRU\LQXVH

3URFHVVGHILQLWLRQ 3URFHVVH[HFXWLRQ

)LJXUH7KHRULHVRIDFWLRQZLWKLQWKHFRQWH[WRI63,

±±
&+$37(5

0DWFK
6WUDWHJLHVDQG
$FWLRQV &RQVHTXHQFHV 0LVPDWFK
DVVXPSWLRQV

6LQJOHORRS

'RXEOHORRS

)LJXUH6LQJOHORRSDQGGRXEOHORRSOHDUQLQJ $UJ\ULV 

7KHWKLUGW\SHRIOHDUQLQJLVZKDW%DWHVRQ  FDOOHGGHXWHUROHDUQLQJRU³OHDUQLQJKRZWR


OHDUQ´

$ FULWLFDOO\ LPSRUWDQW NLQG RI RUJDQL]DWLRQDO GRXEOHORRS OHDUQLQJ WKHUHIRUH LV WKH VHFRQG
RUGHUOHDUQLQJWKURXJKZKLFKWKHPHPEHUVRIDQRUJDQL]DWLRQPD\GLVFRYHUDQGPRGLI\WKH
OHDUQLQJ V\VWHP WKDW FRQGLWLRQV SUHYDLOLQJ SDWWHUQV RI RUJDQL]DWLRQDO LQTXLU\ $UJ\ULV DQG
6FK|QS 

:HVKRXOGWKHUHIRUHFRQVLGHUHIIRUWVWRGHYHORSFDSDFLWLHVIRULQGLYLGXDODQGRUJDQL]DWLRQDO
OHDUQLQJDVDNH\SULRULW\LQGHVLJQLQJDQGPDQDJLQJVRIWZDUHRUJDQL]DWLRQVWKDWFDQGHDOZLWK
WKH FKDOOHQJHV RI D FRQVWDQWO\ FKDQJLQJ DQG LQFUHDVLQJO\ XQSUHGLFWDEOH HQYLURQPHQW
&RQVHTXHQWO\WKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQVKRXOGIRFXVRQGHYHORSLQJVNLOOVDQGPLQG
VHWVWKDWHPEUDFHHQYLURQPHQWDOFKDQJHUDWKHUWKDQVHHNLQJDQXQDFKLHYDEOHVWDELOLW\

 0RGHOVRISODQQHGFKDQJH
7UDGLWLRQDOPRGHOVRISODQQHGFKDQJHKDYHWKHLUURRWVLQ/HZLQ¶V  WKUHHVWDJHPRGHORI
³XQIUHH]LQJ´³PRYLQJ´DQG³UHIUHH]LQJ´$FFRUGLQJWRWKLVPRGHOWKHRUJDQL]DWLRQSUHSDUHV
IRU FKDQJH LPSOHPHQWV WKH FKDQJH DQG WKHQ VWULYHV WR UHJDLQ VWDELOLW\ DV VRRQ DV SRVVLEOH
8QIUHH]LQJXVXDOO\LQYROYHVUHGXFLQJWKHIRUFHVWKDWPDLQWDLQVWKHRUJDQL]DWLRQ¶VEHKDYLRUDW
LWVSUHVHQWOHYHO7KHSURFHVVRIXQIUHH]LQJLVRIWHQDFFRPSOLVKHGE\LQWURGXFLQJLQIRUPDWLRQ
WKDW VKRZV GLVFUHSDQFLHV EHWZHHQ GHVLUHG EHKDYLRUV DQG FXUUHQWO\ H[KLELWHG EHKDYLRUV LQ
RUGHU WR PRWLYDWH RUJDQL]DWLRQDO PHPEHUV WR HQJDJH LQ FKDQJH DFWLYLWLHV 0RYLQJ LQYROYHV
GHYHORSLQJQHZEHKDYLRUVYDOXHVDQGDWWLWXGHVWKURXJKFKDQJHVLQRUJDQL]DWLRQDOVWUXFWXUHV
DQG SURFHVVHV 7KXV PRYLQJ WKH RUJDQL]DWLRQ WRZDUG D QHZ VWDWH RI EHKDYLRU 5HIUHH]LQJ
VWDELOL]HVWKHRUJDQL]DWLRQDWWKHQHZVWDWHRIHTXLOLEULXPWKURXJKVXSSRUWLQJPHFKDQLVPVIRU
WKHQHZSUDFWLFHVVXFKDVRUJDQL]DWLRQDOQRUPVSROLFLHVDQGVWUXFWXUHV
%HFDXVH RI LWV EURDGQHVV VHYHUDO HQKDQFHPHQWV KDYH EHHQ SURSRVHG WR HODERUDWH RQ
/HZLQ¶V   WKUHHVWDJH FKDQJH PRGHO HJ /LSSLWW HW DO  6FKHLQ  E 
'HVSLWHLWVEURDGQHVV/HZLQ¶V  PRGHORISODQQHGFKDQJHKDVQHYHUWKHOHVVEHHQXVHG
WRH[SODLQKRZLQIRUPDWLRQWHFKQRORJLHVFDQEHLPSOHPHQWHGPRUHHIIHFWLYHO\ %HQMDPLQDQG
/HYLQVRQ DQGKRZWKHFKDQJHSURFHVVHVLQYROYHGLQ63,FDQEHPDQDJHG +XPSKUH\
 
*UHHQZRRG DQG /HYLQ   FRXQWHUHG WKH VKRUWWHUP LQWHUYHQWLRQ SKLORVRSK\
XQGHUO\LQJ/HZLQ¶V  PRGHODUJXLQJLQVWHDGIRUDFRQWLQXRXVDQGSDUWLFLSDWLYHOHDUQLQJ

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

SURFHVVFRQVLVWLQJRIWZRDQDO\WLFDOO\GLVWLQFWEXWFORVHO\LQWHUUHODWHGSKDVHV7KHILUVWSKDVH
LQYROYHV WKH FODULILFDWLRQ RI DQ LQLWLDO UHVHDUFK TXHVWLRQ ZKHUHDV WKH VHFRQG SKDVH LQYROYHV
WKH LQLWLDWLRQ DQG FRQWLQXDWLRQ RI D VRFLDO FKDQJH DQG PHDQLQJ FRQVWUXFWLRQ SURFHVV VHH
)LJXUHLQ6HFWLRQ $OWKRXJKWKHLUDSSURDFKLVGLIIHUHQWIURP/HZLQ¶V  LWVWLOO
KDV LWV URRWV LQ KLV ZRUN ,Q IDFW FRQWHPSRUDU\ DFWLRQ UHVHDUFK LV VWLOO IRXQGHG RQ /HZLQ¶V
LPSRUWDQWVORJDQV³1RWKLQJLVDVSUDFWLFDODVDJRRGWKHRU\´DQG³7KHEHVWZD\WRXQGHUVWDQG
VRPHWKLQJLVWRWU\WRFKDQJHLW´
7KH%XUNH/LWZLQPRGHORIRUJDQL]DWLRQDOSHUIRUPDQFHDQGFKDQJH %XUNH LVDQ
H[DPSOHRIRQHRIWKHPRUHVRSKLVWLFDWHGPRGHOVRISODQQHGFKDQJH7KHPRGHOFRYHUVERWK
³WUDQVDFWLRQDO´DQG³WUDQVIRUPDWLRQDO´FKDQJH7KHSUHPLVHRIWKHPRGHOLVWKDWLQWHUYHQWLRQV
GLUHFWHGWRZDUGVWUXFWXUHPDQDJHPHQWSUDFWLFHVDQGV\VWHPV SROLFLHVDQGSURFHGXUHV UHVXOW
LQWUDQVDFWLRQDOFKDQJHRUFKDQJHLQRUJDQL]DWLRQDOFOLPDWH2QWKHRWKHUKDQGLQWHUYHQWLRQV
GLUHFWHGWRZDUGPLVVLRQDQGVWUDWHJ\OHDGHUVKLSDQGRUJDQL]DWLRQFXOWXUHUHVXOWLQWUDQVIRU
PDWLRQDOFKDQJHRUIXQGDPHQWDOFKDQJHLQWKHRUJDQL]DWLRQ¶VFXOWXUH
$FRPPRQIHDWXUHRIDOOPRGHOVRISODQQHGFKDQJHDQGWKXVWKHFXUUHQWSDUDGLJPRI63,
LVWKDWFKDQJHLVYLHZHGDVDUDWLRQDOSURFHVVWKDWSURFHHGVLQDOLQHDUIDVKLRQIURPGLDJQRVLV
WR SODQQLQJ WR LPSOHPHQWDWLRQ $V ZLWK /HZLQ¶V   XQIUHH]HPRYHUHIUHH]H PRGHO WKH
EHJLQQLQJDQGHQGLQJSRLQWLVVWDELOLW\±ZKLFKIRUVRPHSHRSOHDQGVRPHRUJDQL]DWLRQVLVD
OX[XU\ )RU RWKHUV KRZHYHU VWDELOLW\ VSHOOV GLVDVWHU ± HYHQ WKH IDVWHVW RI KDUHV LI VWDQGLQJ
VWLOOFDQEHRYHUWDNHQE\DWRUWRLVHRQWKHPRYH

 ,PSURYLVDWLRQDOFKDQJHPRGHOV
7UDGLWLRQDOZD\VRIGHYHORSLQJVRIWZDUHDQGLPSURYLQJWKHVRIWZDUHSURFHVVUHOLHVRQWKHRULHV
RISODQQHGFKDQJHZKLFKDVVXPHWKDWWKHHQYLURQPHQWLVSUHGLFWDEOHDQGWKDWWKHFKDOOHQJHV
RI 63, DUH FRQILQHG WR LVVXHV UHJDUGLQJ WKH LPSOHPHQWDWLRQ RI UDWLRQDO ³EHVW SUDFWLFH´
DSSURDFKHVPDLQO\LQODUJHRUJDQL]DWLRQV+RZHYHUWKHRYHUZKHOPLQJPDMRULW\RIFRPSDQLHV
GHYHORSLQJVRIWZDUHDUHVPDOO )D\DGHWDO DQGIRUPRVWVPDOOVRIWZDUHRUJDQL]DWLRQV
WKHHQYLURQPHQWLVFRQVWDQWO\FKDQJLQJDQGRIWHQXQSUHGLFWDEOH,QGHHGWKHLUHQYLURQPHQWLV
PRUHOLNHWKHFURTXHWJDPHLQ$OLFHLQ:RQGHUODQG±DJDPHZKHUHHYHU\WKLQJLVFRQVWDQWO\
FKDQJLQJ DURXQG WKH SOD\HU &DUUROO   )XUWKHUPRUH ³+RZHYHU SODQQHG SXUSRVHIXO
DFWLRQVDUHLQHYLWDEO\VLWXDWHGDFWLRQV´ 6XFKPDQSYLLL 
6RIWZDUHRUJDQL]DWLRQVIDFLQJHQYLURQPHQWDOWXUEXOHQFHKDYHVHYHUDOFKRLFHV 0RRUPDQ
DQG0LQHU 7KH\FDQLJQRUHWKHH[WHUQDOGHPDQGVRUWXUEXOHQFHWKDWVXJJHVWVWKHQHHG
WRFKDQJHSODQVDQGFRQWLQXHZLWKSUHYLRXVO\SODQQHGDFWLRQV7KH\FDQDWWHPSWWRVSHHGXS
WKHLU SODQQLQJ DQG H[HFXWLRQ F\FOHV VR WKDW WKH\ UHPDLQ GLVWLQFW EXW KDSSHQ PRUH TXLFNO\
(LVHQKDUGW DQG 7DEUL]L   2U WKH\ FDQ PRYH WRZDUG DQ LPSURYLVDWLRQDO DSSURDFK WKDW
PHUJHVSODQQLQJDQG H[HFXWLRQSURFHVVHV:H FRQVLGHUVXFK DQLPSURYLVDWLRQDODSSURDFK DV
IXQGDPHQWDO IRU XQGHUVWDQGLQJ WKH UHODWLRQVKLS EHWZHHQ DFWLRQ DQG OHDUQLQJ LQ VRIWZDUH
RUJDQL]DWLRQV)RUWKDWUHDVRQZHFRQWHQGWKDWVRIWZDUHRUJDQL]DWLRQVQHHGWREHFRPHPRUH
LPSURYLVDWLRQDOLQRUGHUWRVXUYLYHLQDQLQFUHDVLQJO\WXUEXOHQWDQGFRPSOH[HQYLURQPHQW VHH
'\EnE 
,PSURYLVDWLRQ GHDOV ZLWK WKH XQIRUHVHHQ DQG LQYROYHV FRQWLQXDO H[SHULPHQWDWLRQ ZLWK
QHZ SRVVLELOLWLHV LQ RUGHU WR FUHDWH LQQRYDWLYH DQG LPSURYHG VROXWLRQV RXWVLGH FXUUHQW SODQV
DQGURXWLQHV+RZHYHURUJDQL]DWLRQDOLPSURYLVDWLRQGRHVQRWHPHUJHIURPWKLQDLU,QVWHDGLW
LQYROYHV DQG SDUWO\ GHSHQGV RQ WKH H[SORLWDWLRQ RI SULRU URXWLQHV DQG NQRZOHGJH

±±
&+$37(5

³,PSURYLVDWLRQ LQYROYHV UHZRUNLQJ SUHFRPSRVHG PDWHULDO DQG GHVLJQV LQ UHODWLRQ WR XQDQ
WLFLSDWHG LGHDV FRQFHLYHG VKDSHG DQG WUDQVIRUPHG XQGHU WKH VSHFLDO FRQGLWLRQV RI SHU
IRUPDQFHWKHUHE\ DGGLQJ XQLTXH IHDWXUHV WR HYHU\ FUHDWLRQ´ %HUOLQHU  S   6XFK
³VPDUW´ RU ³FRPSHWHQW´ LPSURYLVDWLRQ ZDV DOVR FHQWUDO WR &LERUUD¶V   WKHRU\ RI
LQIRUPDWLRQ V\VWHPV +HQFH LPSURYLVDWLRQ LQYROYHV D PL[ RI H[SORLWLQJ SUHYLRXVO\ OHDUQHG
OHVVRQV DQG H[SORULQJ WKH SRVVLELOLWLHV DQG FRQWLQJHQFLHV RI WKH FXUUHQW VHWWLQJ 7KLV PL[
KRZHYHU SRLQWV WR D FRUH SDUDGR[ RI LPSURYLVDWLRQ ZKLFK LV DOVR DW WKH KHDUW RI 63, 7RR
PXFK UHOLDQFH RQ SUHYLRXVO\ OHDUQHG SDWWHUQV WHQGV WR OLPLW WKH H[SORUDWLYH EHKDYLRU
QHFHVVDU\IRULPSURYLVDWLRQZKLOHWRRPXFKULVNWDNLQJOHDGVWRIUXLWOHVVH[SHULPHQWDWLRQDQG
UHSHDWHGIDLOXUHV '\EnE 
$V DQ H[DPSOH RI DQ LPSURYLVDWLRQDO FKDQJH PRGHO XVHG LQ WKH LQWURGXFWLRQ RI QHZ
VRIWZDUH WHFKQRORJLHV ZH JLYH D VKRUW RYHUYLHZ RI WKH PRGHO GHYLVHG E\ 2UOLNRZVNL DQG
+RIPDQ   7KHLU PRGHO UHVWV RQ WZR PDMRU DVVXPSWLRQV WKDW GLIIHUHQWLDWHV LW IURP WKH
WUDGLWLRQDOPRGHOVRIFKDQJH)LUVWFKDQJHLVSHUFHLYHGDVDQRQJRLQJSURFHVVUDWKHUWKDQDQ
HYHQW ZLWK DQ HQG SRLQW DIWHU ZKLFK WKH RUJDQL]DWLRQ UHWXUQV WR D QHZ VWDWH RI VWDELOLW\
6HFRQG DOO WKH WHFKQRORJLFDO DQG RUJDQL]DWLRQDO FKDQJHV PDGH GXULQJ WKH RQJRLQJ SURFHVV
FDQQRWE\GHILQLWLRQEHDQWLFLSDWHGDKHDGRIWLPH
*LYHQ WKHVH DVVXPSWLRQV 2UOLNRZVNL DQG +RIPDQ¶V   LPSURYLVDWLRQDO FKDQJH
PRGHOUHFRJQL]HVWKUHHGLIIHUHQWW\SHVRIFKDQJHZKLFKEXLOGRQHDFKRWKHULWHUDWLYHO\RYHU
WLPH VHH)LJXUH DQWLFLSDWHGHPHUJHQWDQGRSSRUWXQLW\EDVHG$QWLFLSDWHGFKDQJHVDUH
FKDQJHV WKDW DUH SODQQHG DKHDG RI WLPH DQG RFFXU DV LQWHQGHG OLNH IRU H[DPSOH
RUJDQL]DWLRQDO LPSURYHPHQW SURJUDPV '\En F  RU SURFHVV LPSURYHPHQW H[SHULPHQWV
'\En G  (PHUJHQW FKDQJHV RQ WKH RWKHU KDQG DUH FKDQJHV WKDW DULVH VSRQWDQHRXVO\
IURPORFDOLQQRYDWLRQVDQGWKDWZHUHQRWDQWLFLSDWHGRULQWHQGHG )LQDOO\RSSRUWXQLW\EDVHG
FKDQJHVDUHFKDQJHVWKDWZHUHQRWDQWLFLSDWHGDKHDGRIWLPHEXWDUHLQWURGXFHGSXUSRVHIXOO\
DQGLQWHQWLRQDOO\GXULQJWKHFKDQJHSURFHVVLQUHVSRQVHWRDQXQH[SHFWHGRSSRUWXQLW\HYHQW
RU EUHDNGRZQ 7KH IHHGEDFN VHVVLRQV LQ *40 LV DQ H[DPSOH RI D FRQWH[W IURP ZKLFK
RSSRUWXQLW\EDVHGFKDQJHVRULJLQDWH '\EnH 7KXVERWKDQWLFLSDWHG DQGRSSRUWXQLW\
EDVHG FKDQJHV LQYROYH GHOLEHUDWH DFWLRQ ZKLOH HPHUJHQW FKDQJHV DULVH VSRQWDQHRXVO\ DQG
XVXDOO\WDFLWO\IURPSHRSOH¶VSUDFWLFHZLWKWKHWHFKQRORJ\RYHUWLPH

$QWLFLSDWHG
2SSRUWXQLW\EDVHG &KDQJH 2SSRUWXQLW\EDVHG
&KDQJH &KDQJH

$QWLFLSDWHG
&KDQJH (PHUJHQW
(PHUJHQW &KDQJH
&KDQJH

)LJXUH$QLPSURYLVDWLRQDOPRGHORIFKDQJH 2UOLNRZVNLDQG+RIPDQS 

7KH QRWLRQ RI LPSURYLVDWLRQ RFFXUV LQ VHYHUDO FRQWH[WV VXFK DV PXVLF WKHDWUH WHDFKLQJ
WKHUDS\ DQG VSRUWV 5HFHQWO\ WKH MD]] PHWDSKRU KDV EHHQ LQWURGXFHG DV D VRXUFH RI XQGHU

±±
)281'$7,2162)7+(/($51,1*62)7:$5(25*$1,=$7,21

VWDQGLQJ RUJDQL]DWLRQDO SURFHVVHV RI FUHDWLYLW\ DQG LQQRYDWLRQ DQG RI LQWHUSUHWLQJ FRPSOH[
DQGFKDQJLQJHQYLURQPHQWV %DUUHWW 

:KLOHPHPEHUVRIDMD]]EDQGXQOLNHPHPEHUVRIDV\PSKRQ\RUFKHVWUDGRQRWGHFLGHLQ
DGYDQFHH[DFWO\ZKDWQRWHVHDFKLVJRLQJWRSOD\WKH\GRGHFLGHDKHDGRIWLPHZKDWPXVLFDO
FRPSRVLWLRQ ZLOO IRUP WKH EDVLV RI WKHLU SHUIRUPDQFH 2QFH WKH SHUIRUPDQFH EHJLQV HDFK
SOD\HU LV IUHH WR H[SORUH DQG LQQRYDWH GHSDUWLQJ IURP WKH RULJLQDO FRPSRVLWLRQ <HW WKH
SHUIRUPDQFHZRUNVEHFDXVHDOOPHPEHUVDUHSOD\LQJZLWKLQWKHVDPHUK\WKPLFVWUXFWXUHDQG
KDYH D VKDUHG XQGHUVWDQGLQJ RI WKH UXOHV RI WKLV PXVLFDO JHQUH « 8VLQJ RXU HDUOLHU
WHUPLQRORJ\ WKH MD]] PXVLFLDQV DUH HQJDJLQJ LQ DQWLFLSDWHG RSSRUWXQLW\EDVHG DQG
HPHUJHQW DFWLRQ GXULQJ WKH FRXUVH RI WKHLU SHUIRUPDQFH WR FUHDWH DQ HIIHFWLYH FUHDWLYH
UHVSRQVHWRORFDOFRQGLWLRQV 2UOLNRZVNLDQG+RIPDQS 

6LPLODU WR WKH SHUIRUPDQFH RI D MD]] EDQG DQ LPSURYLVDWLRQDO PRGHO IRU 63, LV QRW D
SUHGHILQHG LPSURYHPHQW SODQ FKDUWHG E\ PDQDJHPHQW DKHDG RI WLPH ,QVWHDG LW UHFRJQL]HV
WKDW LPSURYHPHQWV VWHP IURP DQ LWHUDWLYH VHULHV RI PDQ\ XQSUHGLFWDEOH FKDQJHV WKDW HYROYH
IURPSUDFWLFDOH[SHULHQFHZLWKQHZPHWKRGVDQGWRROV7KHUHIRUHZHZDQWWRHPSKDVL]HWKDW
LPSURYLVDWLRQ DW WKH ORFDO OHYHO LV QRW RQO\ D OHJLWLPDWH DOWHUQDWLYH WR PRGHOV RI SODQQHG
FKDQJHEXWDOVRQHFHVVDU\IRUHIIHFWLYHNQRZOHGJHFUHDWLRQDQG63,7KLVGRHVQRWPHDQWKDW
ZH DEDQGRQ SODQV DQG SODQQLQJ DOWRJHWKHU 2Q WKH FRQWUDU\ ZH FRQVLGHU SODQV DV YDOXDEOH
UHVRXUFHV IRU SXUSRVHIXO DFWLRQ RU DV 6XFKPDQ   IRUPXODWHG KHU YLHZ RI SODQV DV
³IRUPXODWLRQVRIDQWHFHGHQWFRQGLWLRQVDQGFRQVHTXHQFHVRIDFWLRQ´ LELGS :KDWZHDUH
VXJJHVWLQJKRZHYHULVWKDWDSODQVKRXOGEHDFNQRZOHGJHGDVDJXLGHUDWKHUWKDQDEOXHSULQW
DQGWKDWGHYLDWLRQVIURPWKHSODQ UDWKHUWKDQEHLQJVHHQ DVDV\PSWRPRIIDLOXUHDUHWREH
H[SHFWHGDQGDFWLYHO\PDQDJHG3ODQQLQJLQWKHSUHVHQFHRIHQYLURQPHQWDOWXUEXOHQFHVKRXOG
EH UHJDUGHG DV DQ RQJRLQJ HQGHDYRU UHIOHFWLQJ WKH FKDQJLQJ XQIROGLQJ HQYLURQPHQWV ZLWK
ZKLFK VRIWZDUH RUJDQL]DWLRQV LQWHUDFW 0LQW]EHUJ   DQG QRW DV D RQHVKRW H[HUFLVH
&UHDWLQJDQRUJDQL]DWLRQDOFRQWH[WRIHQDEOLQJFRQGLWLRQVLVWKHUHIRUHRIFULWLFDOLPSRUWDQFH
IRUDQLPSURYLVDWLRQDODSSURDFKWRVXFFHHG

 2UJDQL]DWLRQDONQRZLQJ
6R IDU ZH KDYH PDLQWDLQHG WKH SUHGRPLQDQW YLHZ RI NQRZOHGJH DV VRPHWKLQJ WKDW LV
SRVVHVVHG GHVSLWH RXU H[SDQGHG XQGHUVWDQGLQJ RI LW VXJJHVWHG E\ WKH WDFLWH[SOLFLW DQG
LQGLYLGXDOJURXS GLPHQVLRQV VHH 6HFWLRQ   )RU H[DPSOH ZKHQ ZH VD\ WKDW ³$OLFH KDV
NQRZOHGJH RI VRIWZDUH GHYHORSPHQW´ NQRZOHGJH UHIHUV WR VRPHWKLQJ WKDW $OLFH SRVVHVVHV
HJDVFRQFHSWVPHWKRGVDQGSURFHGXUHV +RZHYHUZKLOHNQRZOHGJHLWVHOILVVHHQDVVWDWLF
LWLVFXVWRPDU\WRWKLQNRILWDVVRPHWKLQJZHXVHLQDFWLRQEXWLWLVQRWQRUPDOO\XQGHUVWRRGWR
EH DFWLRQ LWVHOI ,Q D SHUVSHFWLYH ZKHUH ZH FRQVLGHU NQRZOHGJH DV D VRFLDO FRQVWUXFWLRQ ZH
VKRXOG UDWKHU XVH WKH WHUP ³NQRZLQJ´ ZKLFK DOVR LV FORVHO\ FRQQHFWHG WR LPSURYLVDWLRQDO
PRGHOVRIFKDQJH
+HQFH LQ DFFRUGDQFH ZLWK &KRR   DQG &RRN DQG %URZQ   ZH WDNH D
SUDJPDWLFVWDQGSRLQWDQGXVHWKHWHUP³NQRZLQJ´WRUHIHUWRWKHHSLVWHPRORJLFDOGLPHQVLRQ
RIDFWLRQLWVHOI7KDWLVFRQWUDU\WRNQRZOHGJH³%\µNQRZLQJ¶ZHGRQRWPHDQVRPHWKLQJWKDW
LVXVHGLQDFWLRQRUVRPHWKLQJQHFHVVDU\WRDFWLRQEXWUDWKHUVRPHWKLQJWKDWLVDSDUWRIDFWLRQ
ERWKLQGLYLGXDODQGJURXSDFWLRQ «.QRZLQJLVWKDWDVSHFWRIDFWLRQ RUSUDFWLFH WKDWGRHV



6HH6HFWLRQIRUDMXVWLILFDWLRQRIWKHSUDJPDWLFDSSURDFKLQRXUUHVHDUFK

±±
&+$37(5

HSLVWHPLFZRUN´ &RRNDQG%URZQSSHPSKDVLVLQRULJLQDO 7KXVZKHQZH


WDONDERXW3HWHU¶V³NQRZLQJ´LQVRIWZDUHGHYHORSPHQWZHIRFXVRQZKDWKHLVDFWXDOO\GRLQJ
±HJKRZKHGHSOR\VKLVNQRZOHGJHLQWKHSURJUDPPLQJRIDVSHFLILFDOJRULWKP

$FFRUGLQJO\ZKHQLWFRPHVWRTXHVWLRQVRIZKDWZHNQRZDQGKRZZHNQRZWKH3UDJPDWLVW
SHUVSHFWLYH WDNHV D SULPDU\ FRQFHUQ QRW ZLWK µNQRZOHGJH¶ ZKLFK LV VHHQ DV DEVWUDFW DQG
VWDWLF EXW ZLWK µNQRZLQJ¶ ZKLFK LV XQGHUVWRRG DV SDUW RI FRQFUHWH G\QDPLF KXPDQ DFWLRQ
LELGS 

.QRZLQJ WKHUHIRUH LV FORVHO\ UHODWHG WR WKHRU\LQXVH ZKLFK PHDQV WKDW LI ZH ZDQW WR
XQGHUVWDQGWKHHVVHQWLDOVRIKRZWRLPSURYHVRIWZDUHGHYHORSPHQWZHPXVWSD\DWWHQWLRQWR
ZKDW VRIWZDUH GHYHORSHUV GR WKHLU ³NQRZLQJ´  DV ZHOO DV WR ZKDW WKH\ SRVVHVV WKHLU
³NQRZOHGJH´  )XUWKHUPRUH ZH PXVW UHFRJQL]H WKDW NQRZOHGJH RQFH SRVVHVVHG LV QRW
HQRXJKWRHQDEOHNQRZLQJRUDFWLRQ³$VDWRRONQRZOHGJHGLVFLSOLQHVNQRZLQJEXWGRHVQRW
HQDEOH LW DQ\ PRUH WKDQ SRVVHVVLRQ RI D KDPPHU HQDEOHV VNLOOIXO XVH´ LELG S  
/LNHZLVHNQRZOHGJHRIWKHSULQFLSOHVRI63,FDQQRWE\LWVHOIHQDEOHDVRIWZDUHRUJDQL]DWLRQ
WRHQJDJHLQWKHDFWLYLW\RILPSURYLQJLWVSURFHVVHVDQGHQKDQFHLWVFRPSHWLWLYHQHVV
&RQVHTXHQWO\ ZH DUJXH WKDW LQ RUGHU WR VXFFHHG ZLWK 63, ZH PXVW PRYH IURP D
FRQFHSWXDOL]DWLRQ RI NQRZOHGJH DV DQ REMHFW WR EH SRVVHVVHG WRZDUG D EURDGHU YLHZ RI
NQRZLQJDV³DQRQJRLQJSURFHVVRIVRFLDOFRQVWUXFWLRQDQGFROOHFWLYHDFWLRQ´ &KRRS
  WKDW LV HPEHGGHG LQ WKH VRIWZDUH RUJDQL]DWLRQV WDVNV UHODWLRQVKLSV DQG WRROV 7KLV LV
VLPLODUWRWKHSURSHUWLHVGHILQHGE\6FK|Q¶V  UHJDUGLQJ³NQRZLQJLQDFWLRQ´
3IHIIHUDQG6XWWRQ  DOVRIRFXVHGRQWXUQLQJNQRZOHGJHLQWRDFWLRQLQWKHLUVWXG\RI
WKH ³NQRZLQJGRLQJ JDS´ 7KHUHIRUH VRIWZDUH RUJDQL]DWLRQV VKRXOG HPEHG PRUH RI WKHLU
NQRZOHGJHDFTXLVLWLRQDFWLYLWLHVLQWKH³UHDOZRUN´RIGHYHORSLQJVRIWZDUHDQGOHVVLQIRUPDO
WUDLQLQJ SURJUDPV DQG EHQFKPDUNV DJDLQVW VRFDOOHG ³EHVW SUDFWLFH´ PRGHOV WKXV SXWWLQJ
NQRZOHGJHEDFNLQWRWKHFRQWH[WLQZKLFKLWKDVPHDQLQJ

 &KDSWHU6XPPDU\
,Q WKLV FKDSWHU ZH KDYH GHVFULEHG RXU SHUVSHFWLYH RQ RUJDQL]DWLRQDO OHDUQLQJ DQG 63, DV D
FROOHFWLYH DELOLW\ H[SUHVVHG LQ DQG WKURXJK WKH RUJDQL]DWLRQV¶ SURGXFW DQG VHUYLFHRULHQWHG
SUDFWLFHV UHODWHG WR VRIWZDUH GHYHORSPHQW 7KLV SHUVSHFWLYH OHG XV WR HPSKDVL]H D PRUH
DGDSWLYHDQGDFWLYHYLHZRINQRZOHGJHUDWKHUWKDQWKHWUDGLWLRQDOVWDWLFDQGSDVVLYHYLHZ
)XUWKHUPRUH ZH UHFRJQL]HG IRXU IRXQGDWLRQV IRU WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ
VRFLDOOHDUQLQJIRFXVHGRQ63,DVDVRFLDOO\FRQVWUXFWHGFROODERUDWLYHDFWLYLW\VHQVHPDNLQJ
DLPHG DW FRQVWUXFWLQJ PHDQLQJ DQG WR H[SUHVV EDVLF DVVXPSWLRQV DQG YDOXHV NQRZOHGJH
FUHDWLRQ DLPHG DW JHQHUDWLQJ QHZ NQRZOHGJH DQG QHZ FRPSHWHQFLHV DQG ILQDOO\ XVLQJ WKH
QHZLQWHUSUHWDWLRQVDQGQHZNQRZOHGJHWRFRQVWUXFWLPSURYHGFRXUVHVRISXUSRVHIXODFWLRQ
%DVHG RQ WKH LQVLJKWV GHULYHG IURP WKHVH IRXQGDWLRQV WKH QH[W FKDSWHU GHVFULEHV D
G\QDPLFPRGHORI63,ZKLFKHPEUDFHVWKHOHDUQLQJSURFHVVHVDQGWKHNH\IDFWRUVIRUVXFFHVV
UHTXLUHG IRU GHVFULELQJ VRIWZDUH RUJDQL]DWLRQV DV OHDUQLQJ V\VWHPV $ PDMRU FRQFHUQ LV WR
HVWDEOLVKDFRQFHSWXDOIUDPHZRUNZKLFKVWUXFWXUHVWKHRUJDQL]DWLRQDO OHDUQLQJ SURFHVV WKXV
HQDEOLQJWKHGLIIXVLRQ RI NQRZOHGJH DQG H[SHULHQFH ZLWKLQ DQG EHWZHHQ JURXSV RI VRIWZDUH
GHYHORSHUV

±±
&+$37(5 
$'\QDPLF0RGHORI
6RIWZDUH3URFHVV,PSURYHPHQW

³7KRVHZKRFDQQRWUHPHPEHUWKHSDVWDUHFRQGHPQHGWRUHSHDWLW´
±*HRUJH6DQWD\DQD

,QWKHSUHYLRXVFKDSWHU ZH DUJXHG WKDW VXFFHVVIXO VRIWZDUH SURFHVV LPSURYHPHQW UHTXLUHV D


FRPPLWPHQW WR OHDUQLQJ DQG WKDW RUJDQL]DWLRQDO NQRZOHGJH LV FRQVWUXFWHG WKURXJK WKH
FROODERUDWLYH DFWLRQ RI RUJDQL]DWLRQDO PHPEHUV 7KHUHIRUH WR H[SODLQ ZK\ VRPH 63,
LQLWLDWLYHVDUHPRUHVXFFHVVIXOWKDQRWKHUVDUHZHQHHGDPRGHORI63,WKDWLQFRUSRUDWHVWKH
IRXQGDWLRQVRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
,Q WKLV FKDSWHU ZH SURSRVH D G\QDPLF PRGHO RI 63, IRU H[DPLQLQJ D VRIWZDUH
RUJDQL]DWLRQ¶V OHDUQLQJ FDSDELOLW\ DQG WKH SURFHVVHV WKDW HQDEOH VHQVHPDNLQJ NQRZOHGJH
FUHDWLRQDQGSXUSRVHIXO DFWLRQV ZLWKLQ WKH FRQWH[W RI D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ 7KH
PRGHOLVJURXQGHGLQRXUSHUVRQDOH[SHULHQFHDQGREVHUYDWLRQVLQWKHFDVHVWXGLHVUHODWHGWR
WKH H[WHQVLYH OLWHUDWXUH UHYLHZ DQG IRFXVHG RQ WKH WKUHH UHVHDUFK TXHVWLRQV SRVHG LQ WKH
LQWURGXFWRU\ FKDSWHU :KDW DUH WKH NH\ OHDUQLQJ SURFHVVHV LQ VXFFHVVIXO VRIWZDUH
RUJDQL]DWLRQV":KDW DUH WKH NH\ IDFWRUV RI VXFFHVV LQ VRIWZDUH SURFHVV LPSURYHPHQW" :KDW
DUH WKH UHODWLRQVKLSV EHWZHHQ RUJDQL]DWLRQDO FRQWH[W DQG PRGHV RI OHDUQLQJ LQ VRIWZDUH
RUJDQL]DWLRQV"
)XUWKHUPRUH WKH PRGHO SUHVHQWHG LQ WKLV FKDSWHU LQFOXGHV WKH WKHRUHWLFDO MXVWLILFDWLRQV
GHWDLOHGFRQFHSWXDOL]DWLRQVDQGK\SRWKHVHVIRUWKHNH\IDFWRUVRIVXFFHVVLQ63,,QDGGLWLRQ
WR WKHVH WKHRUHWLFDO MXVWLILFDWLRQV ZH FRQGXFWHG H[SORUDWRU\ VWXGLHV LQ IRXU RI WKH FDVH
FRPSDQLHVWRHPSLULFDOO\ MXVWLI\ WKH K\SRWKHVHV &DVH '  )LQDOO\ ZH DUUDQJHG D UHYLHZ RI
WKH FRPELQHG WKHRUHWLFDO DQG HPSLULFDO MXVWLILFDWLRQV E\ SHUIRUPLQJ D VXUYH\ DPRQJ 63,
H[SHUWVIURPERWK DFDGHPLD DQG LQGXVWU\ VHH )LJXUH  LQ 6HFWLRQ   7KH GHWDLOV RI WKH
HPSLULFDO MXVWLILFDWLRQV DQG WKH UHVXOWV RI WKH H[SHUW UHYLHZ DUH GHVFULEHG LQ &KDSWHU 
WRJHWKHUZLWKWKHGHWDLOVRIWKHRSHUDWLRQDOL]DWLRQVQHFHVVDU\IRUWHVWLQJWKHK\SRWKHVHV7KH
K\SRWKHVHVDUHVWDWLVWLFDOO\IRUPXODWHGDQGWHVWHGLQ6HFWLRQ

±±
&+$37(5

 ,QWURGXFWLRQ
6RIWZDUHLQWHQVLYHRUJDQL]DWLRQVWKDWLQWHQGWRH[FHOLQWKHWZHQW\ILUVWFHQWXU\PXVWOHDUQWR
PDQDJHFKDQJHLQG\QDPLFVLWXDWLRQV&XUUHQWPRGHOVRI63,ZKLFKDUHIRXQGHGRQWKHROG
³XQIUHH]HPRYHUHIUHH]H´SDUDGLJPDUHDVZHDUJXHGLQWKHSUHYLRXVFKDSWHULQVXIILFLHQWWR
JXLGH FKDQJH LQ D FRQVWDQWO\ FKDQJLQJ DQG LQFUHDVLQJO\ XQSUHGLFWDEOH HQYLURQPHQW 7KXV
UDWKHUWKDQVHHNLQJDQXQDFKLHYDEOHVWDELOLW\WKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQVKRXOGIRFXV
RQGHYHORSLQJURXWLQHVDQGPLQGVHWVWKDWHPEUDFHHQYLURQPHQWDOFKDQJH
7KHPRGHOGHYHORSHGLQWKLVFKDSWHUVXSSRUWVWKLVVKLIWE\GLUHFWLQJDWWHQWLRQWRWKHQHHGV
IRUFRPPXQLFDWLRQFRRUGLQDWLRQDQGFROODERUDWLRQZLWKLQDQGEHWZHHQVRIWZDUHWHDPV7KH
PRGHOLVDERXWKRZVRIWZDUHWHDPVDFTXLUHDQGXVHNQRZOHGJHLQDQRUJDQL]DWLRQDOVHWWLQJLQ
RUGHU WR LPSURYH WKHLU VRIWZDUH SURFHVVHV 9HUEV OLNH ³NQRZLQJ´ RU ³OHDUQLQJ´ DUH XVHG WR
HPSKDVL]H WKH DFWLRQ RULHQWHG DQG G\QDPLF SURSHUWLHV RI 63, DQG WKH QRXQ ³NQRZOHGJH´ LV
XVHGWRGHVFULEHWKHVWDWLFSURSHUWLHV
7KHPRGHOFDQEHVHHQDVIROORZLQJWKHIXQGDPHQWDOSULQFLSOHRIWKHKHUPHQHXWLFDOFLUFOH
.OHLQDQG0\HUV E\DWWHPSWLQJDQLQLWLDOKROLVWLFXQGHUVWDQGLQJRIDQRUJDQL]DWLRQDO
V\VWHPDQGWKHQXVLQJ WKLV XQGHUVWDQGLQJ DV D EDVLV IRU LQWHUSUHWLQJ WKH SDUWV RI WKH V\VWHP
$FFRUGLQJWRWKLVPRGHONQRZOHGJHLVJDLQHGGLDOHFWLFDOO\E\SURFHHGLQJIURPWKHZKROHWR
LWVSDUWVDQGWKHQ EDFN DJDLQ (DFK WLPH DQ LQFRQJUXHQFH RFFXUV EHWZHHQ SDUW DQG ZKROH D
UHFRQFHSWXDOL]DWLRQ WDNHV SODFH 7KH IUHTXHQF\ RI VXFK UHFRQFHSWXDOL]DWLRQV GHFUHDVH DV WKH
PDWFK LPSURYHV EHWZHHQ WKH FRQFHSWXDOL]DWLRQ RI WKH RUJDQL]DWLRQ DQG WKDW KHOG E\ WKH
RUJDQL]DWLRQ¶VPHPEHUV
7KH PRGHO FDQ DOVR EH VHHQ DV IROORZLQJ D SUDJPDWLVW YLHZSRLQW RQ 63, DQG (6(
UHVHDUFK$FFRUGLQJWRWKHPRGHOWKHNQRZOHGJHWKDWWKHVRIWZDUHRUJDQL]DWLRQDFFXPXODWHV
LWVPHWKRGVIRUDFFXPXODWLQJLWDQGWKHFULWHULDE\ZKLFKWKHVHPHWKRGVDUHFRQVLGHUHGYDOLG
DUH DOO EDVHG RQ WKH RUJDQL]DWLRQ¶V SULRU H[SHULHQFH IRU GHDOLQJ ZLWK ZKDW 'HZH\ 
FDOOHG ³SUREOHPDWLF VLWXDWLRQV´ 7KH PHWKRGV XVHG DQG WKH FULWHULD IRU DSSUDLVLQJ WKHP DV
YDOLG DUH PDWWHUV RI VRFLDO FRQYHQWLRQ $V VLWXDWLRQV ZKLFK WKH RUJDQL]DWLRQ FRQVLGHUV
SUREOHPDWLF FKDQJH VR PD\ LWV PHWKRGV IRU GHDOLQJ ZLWK WKHP DQG WKH FULWHULD IRU MXGJLQJ
WKHPDVYDOLG
7KLVYLHZSRLQWVXJJHVWVWKDWDVRIWZDUHRUJDQL]DWLRQZDQWWRNQRZPRUHDERXWWKHZRUOG
DQG HQJDJH LQ 63, DFWLYLWLHV ZKHQ LW LV XQFHUWDLQ DERXW DFKLHYLQJ GHVLUHG RXWFRPHV 7KLV
RFFXUVEHFDXVHWKHRUJDQL]DWLRQGRHVQRWXQGHUVWDQGWKHVLWXDWLRQVLQZKLFKLWZDQWVWRWDNH
DFWLRQRUEHFDXVHLWLVXQFHUWDLQDERXWZKDWDFWLRQWRWDNHWRDFKLHYHWKHP7KLVXQFHUWDLQW\
DERXWVLWXDWLRQVRU ZKDW DFWLRQV WR WDNH LQ WKHP LV ZKDW PDNHV WKHP SUREOHPDWLF DQG LV WKH
SRLQW IURP ZKLFK 63, EHJLQV 7KLV LV YHU\ GLIIHUHQW IURP WKH PRGHOEDVHG DSSURDFKHV
GHVFULEHG LQ &KDSWHU  LQ ZKLFK 63, LV VHHQ DV VWDUWLQJ ZLWK WKH LPSOHPHQWDWLRQ RI ³EHVW
SUDFWLFHV´DFFRUGLQJWRDSUHGHWHUPLQHGVFKHPHLQGHSHQGHQWRIWKHRUJDQL]DWLRQ¶VH[SHULHQFH
RISUREOHPDWLFVLWXDWLRQV
$ FULWLFDO HOHPHQW LQ RXU PRGHO WKHUHIRUH LV WKH LQWHJUDWLRQ RI 63, DFWLYLWLHV ZLWK WKH
³UHDOZRUN´RIVRIWZDUHGHYHORSPHQW7KLVZD\ZHFRQVLGHUVRIWZDUHWHDPVDQGWKHLUSURMHFWV
DVWKHEDVHOLQHIRULPSURYHPHQW VHH'\EnG DQGWKHILUVWOLQHPDQDJHUDQGWKHVRIWZDUH
GHYHORSHUV ZKR GHYHORS WKH V\VWHPV DV WKH IRUHPRVW UHVSRQVLEOH IRU NHHSLQJ WKH RUJDQL]D
WLRQ¶VSURFHVVHVRQWKHOHDGLQJHGJHRIWHFKQRORJ\

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

2UJDQL]DWLRQDO
PHPRU\
2UJDQL]DWLRQDO&RQWH[W

63,6XFFHVV
*HQHUDWLQJ )DFLOLWDWLQJ ,QWHUSUHWLQJ
NQRZOHGJH IDFWRUV NQRZOHGJH

/RFDO
NQRZLQJ

)LJXUH$G\QDPLFPRGHORIVRIWZDUHSURFHVVLPSURYHPHQW

)LJXUHSUHVHQWVDQRYHUYLHZRIWKHG\QDPLFPRGHORI63,ZKLFKH[SOLFLWO\DGGUHVVHVWKH
UHVHDUFK TXHVWLRQV DVNHG LQ WKH LQWURGXFWRU\ FKDSWHU RI WKH WKHVLV ,Q DGGLWLRQ WR WKH
IRXQGDWLRQV GLVFXVVHG LQ WKH SUHYLRXV FKDSWHU WKH VWUXFWXUH RI WKH PRGHO LV LQVSLUHG E\
V\VWHPVWKLQNLQJ 6HQJH DQGRSHQV\VWHPVWKHRU\ .DW]DQG.DKQ LQZKLFKDQ
RUJDQL]DWLRQLVYLHZHGDVDQLQSXWWKURXJKSXWRXWSXWV\VWHP
7KHPRGHOFRQWDLQVWKHIROORZLQJIRXUPDMRUHOHPHQWV

x 2UJDQL]DWLRQDO FRQWH[W 7KLV LV WKH JHQHUDO HQYLURQPHQW WKDW LPSRVHV FRQVWUDLQWV DQG
RSSRUWXQLWLHV DERXW ZKDW WKH RUJDQL]DWLRQ FDQ DQG FDQQRW GR ZLWK UHVSHFW WR
RUJDQL]DWLRQDOOHDUQLQJDQG63,6LQFHZH SHUFHLYH WKH RUJDQL]DWLRQ DV DQ RSHQ V\VWHP
WKHUHDOLW\H[SHULHQFHGE\WKHYDULRXVVRIWZDUHWHDPVFRQWDLQVHOHPHQWVIURPRXWVLGHWKH
RUJDQL]DWLRQDVZHOODVIURPWKHRUJDQL]DWLRQLWVHOI VHH6HFWLRQ 
x /HDUQLQJ F\FOH 7KH RUJDQL]DWLRQ¶V OHDUQLQJ F\FOH LV D GLDOHFWLF SURFHVV WKDW LQWHJUDWHV
ORFDOH[SHULHQFHDQGRUJDQL]DWLRQDOFRQFHSWV$OOPHPEHUVDQGJURXSVRIPHPEHUVLQWKH
RUJDQL]DWLRQ FRQWULEXWH LQ WKH VRFLDO FRQVWUXFWLRQ RI WKH VRIWZDUH RUJDQL]DWLRQ¶V
NQRZOHGJH$WWKHVDPHWLPHWKHRUJDQL]DWLRQ¶VPHPRU\OLPLWVWKHUDQJHRIWKHSRVVLEOH
DFWLRQV IRU LWV PHPEHUV 7KH SURFHVV RI JHQHUDWLQJ QHZ RUJDQL]DWLRQDO NQRZOHGJH DQG
FROOHFWLYHO\ LQWHUSUHWLQJ WKH NQRZOHGJH LV WKXV D VLPXOWDQHRXV DQG G\QDPLF RQH VHH
6HFWLRQ 
x 63,VXFFHVV7KLVLVWKHSHUIRUPDQFHRUUHVXOWVRIWKHRUJDQL]DWLRQ¶V63,DFWLYLWLHV7KLV
LVWKHGHSHQGHQWYDULDEOHWKDWLVXVHGWRPHDVXUHWKDWJDLQVKDYHLQIDFWEHHQPDGHZLWK
UHVSHFWWRRUJDQL]DWLRQDOEHKDYLRUDQGSHUIRUPDQFHDQGQRWPHUHO\DWWKHFRJQLWLYHOHYHO
VHH6HFWLRQ 
x )DFLOLWDWLQJIDFWRUV7KHVHDUHWKHFRQGLWLRQVWKDWIDFLOLWDWHRUHQDEOHNQRZOHGJHFUHDWLRQ
DQG63,7KH\DUHWKHNH\IDFWRUVIRUVXFFHVVWKDWWKHVRIWZDUHRUJDQL]DWLRQPXVWSXWLQ
SODFHLQRUGHUWRIDFLOLWDWHWKHRUJDQL]DWLRQ¶VOHDUQLQJF\FOHDQGLPSURYHLWVGHYHORSPHQW
SURFHVV VHH6HFWLRQ 

±±
&+$37(5

$FFRUGLQJ WR WKLV PRGHO RUJDQL]DWLRQDO OHDUQLQJ DQG 63, LV GHILQHG DV D G\QDPLF LQWHUSOD\
EHWZHHQWZRSULPDU\GLDOHFWLFV7KHILUVWLVWKDWEHWZHHQ WKH ORFDO DQG RUJDQL]DWLRQDO OHYHO
7KHRWKHULVWKDWEHWZHHQJHQHUDWLQJDQGLQWHUSUHWLQJRUJDQL]DWLRQDONQRZOHGJH7KHGLDOHFWLF
EHWZHHQORFDONQRZLQJDQGRUJDQL]DWLRQDOPHPRU\ LVWKHLQWHUSOD\EHWZHHQWKH NQRZLQJ RI
WKH RUJDQL]DWLRQ¶V PHPEHUV LQ WKHLU UHVSHFWLYH FRQWH[WV DQG WKH NQRZOHGJH WKDW WKH
RUJDQL]DWLRQ KDV HVWDEOLVKHG RYHU WLPH 7KLV LQWHUSOD\ LV D G\QDPLF WZRZD\ UHODWLRQVKLS
EHWZHHQ WKH RUJDQL]DWLRQ DQG LWV PHPEHUV ZKLFK FRPELQHV ORFDO WUDQVIRUPDWLRQ ZLWK WKH
HYROXWLRQ RI WKH RUJDQL]DWLRQ 7KLV LV VLPLODU WR 3LDJHW¶V   GHVFULSWLRQ RI WKH OHDUQLQJ
SURFHVV DV D GLDOHFWLF EHWZHHQ DVVLPLODWLQJ H[SHULHQFH LQWR FRQFHSWV DQG DFFRPPRGDWLQJ
FRQFHSWVWRH[SHULHQFH,QRXUPRGHORUJDQL]DWLRQDOOHDUQLQJUHVXOWVIURPDEDODQFHGWHQVLRQ
EHWZHHQ WKHVH WZR SURFHVVHV 2XU HPSKDVLV LV WKXV RQ 63, DV D GLDOHFWLF SURFHVV WKDW
LQWHJUDWHVORFDOH[SHULHQFHDQGRUJDQL]DWLRQDOFRQFHSWV
7KHPRGHOSUHVHQWHGLQWKLVFKDSWHUKDVVHYHUDODGYDQWDJHV)LUVWLWVKRXOGEHFOHDUWKDW
RUJDQL]DWLRQDONQRZOHGJHLVQRWEHLQJFUHDWHGWRPLUURUDUHDOLW\WKDWLVLQGHSHQGHQWRIKXPDQ
DFWLRQEXWWRGHDOZLWKLW6HFRQGVWDUWLQJ63,IURPSUREOHPDWLFVLWXDWLRQVLQVRIWZDUHWHDPV
UHGXFHVWKHULVNWKDWRUJDQL]DWLRQDOOHDUQLQJZLOOEHGHWDFKHGIURPDFWLRQDQGXQGHUWDNHQWR
EXLOGNQRZOHGJHIRULWVRZQVDNH7KLUGLWLQFUHDVHVWKHOLNHOLKRRGWKDWNQRZOHGJHLQWHQGHG
IRU DSSOLFDWLRQ WR SUDFWLFDO SUREOHPV ZLOO XOWLPDWHO\ VHUYH WKDW SXUSRVH VLQFH NQRZOHGJH
JDLQHG IURP FRQFUHWH VLWXDWLRQV LV PRUH OLNHO\ WR UHPDLQ DSSOLFDEOH WR IXWXUH FRQFUHWH
VLWXDWLRQV

 2UJDQL]DWLRQDO&RQWH[W
*HQHUDOO\ WKH TXDOLW\ PDQDJHPHQW OLWHUDWXUH VXSSRUWV WKH SURSRVLWLRQ WKDW LGHDO TXDOLW\
PDQDJHPHQW VKRXOG QRW EH DIIHFWHG E\ FRQWH[WXDO YDULDEOHV -XUDQ DQG *RGIUH\   IRU
H[DPSOH VWDWHG WKDW LGHDO TXDOLW\ PDQDJHPHQW LV ³XQLYHUVDO´ DQG VXJJHVWHG WKDW WKH
H[SHFWDWLRQVUHJDUGLQJTXDOLW\PDQDJHPHQWVKRXOGEHWKHVDPHUHJDUGOHVVRIWKHFRQWH[W³QR
PDWWHU ZKDW LV WKH LQGXVWU\ IXQFWLRQ FXOWXUH RU ZKDWHYHU´ LELG S   &URVE\ 
 'HPLQJ  DQG)HLJHQEDXP  DOVRVXSSRUWWKLVFRQWH[WIUHHYLHZRITXDOLW\
PDQDJHPHQW +RZHYHU HPSLULFDO VWXGLHV KDYH LQGLFDWHG WKDW RUJDQL]DWLRQDO FRQWH[W
QHYHUWKHOHVV GR LQIOXHQFH PDQDJHU¶V SHUFHSWLRQV RI ERWK LGHDO DQG DFWXDO TXDOLW\
PDQDJHPHQW DQG WKDW FRQWH[WXDO YDULDEOHV DUH XVHIXO IRU H[SODLQLQJ DQG SUHGLFWLQJ TXDOLW\
PDQDJHPHQWSUDFWLFHV %HQVRQHWDO 
/LNH PRVW RI WKH TXDOLW\ PDQDJHPHQW DSSURDFKHV D FRQWH[W IUHH YLHZ RI SURFHVV
LPSURYHPHQWLVDWWKHKHDUWRIWKH³EHVWSUDFWLFH´SDUDGLJPWR63,7KLVSDUDGLJPLVURRWHGLQ
7D\ORU¶V   SULQFLSOHV RI WDVN PDQDJHPHQW ZKLFK KH EHOLHYHG ZDV HTXDOO\ YDOLG IRU DOO
FODVVHV RI ZRUN ³IURP WKH PRVW HOHPHQWDU\ WR WKH PRVW LQWULFDWH´ LELG S   DQG IRU DOO
KXPDQDFWLYLWLHVGHFODULQJWKDWKLVSULQFLSOHV ZHUHDSSOLFDEOH³IURPRXUVLPSOHVWLQGLYLGXDO
DFWV WR WKH ZRUN RI RXU JUHDW FRUSRUDWLRQV´ LELG S   7D\ORU¶V YLHZ ZDV E\ QR PHDQV
XQLTXH +HQU\ )RUG IRU H[DPSOH EHOLHYHG LQ WKH JHQHUDO DSSOLFDELOLW\ RI WKH SULQFLSOHV RI
PDVVPDQXIDFWXULQJ 0RUJDQ DQG:LOOLDP+HQU\/HIILQJZHOOZDV³REVHVVHGZLWKWKH
QRWLRQRIEULQJLQJUDWLRQDOGLVFLSOLQHWRWKHRIILFHLQPXFKWKHVDPHZD\WKDW7D\ORUDQGKLV
PHQZHUHDWWHPSWLQJWRWUDQVIRUPWKHVKRSIORRU´ =XERIIS 6XEVHTXHQWO\WKH
IXQFWLRQDOO\ VSHFLDOL]HG SURFHGXUDO ZRUN PRGHO ZDV DGDSWHG IRU DGPLQLVWUDWLYH DQG FOHULFDO

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

ZRUNLQIRUPRIWKHEXUHDXFUDWLFRUJDQL]DWLRQDQGIXUWKHUPRUHWRVRIWZDUHGHYHORSPHQWDQG
63,LQIRUPRI³EHVWSUDFWLFH´PRGHOVOLNH&00,62,(&7ULOOLXPDQG%RRWVWUDS
,QFRQWUDVWWRWKH³EHVWSUDFWLFH´RUPRGHOEDVHGDSSURDFKWR63,WKHDQDO\WLFDSSURDFK
GHVFULEHG LQ &KDSWHU  LV PRUH FRQFHUQHG ZLWK WKH FRQWLQJHQW FKDUDFWHULVWLFV RI LQGLYLGXDO
RUJDQL]DWLRQV)RUH[DPSOHWKHLPSRUWDQFHRIFRQWH[WLVPDGHH[SOLFLWLQWKHGLIIHUHQWVWHSVRI
4,3DQGDOVRLQWKHYDULRXVWHPSODWHVDQGJXLGHOLQHVIRUWKHXVHRI*40,QDGGLWLRQWRWKH
PHDVXUHPHQWREMHFWWHPSODWHSDUDPHWHUVIRUVHWWLQJJRDOVLQ*40LQFOXGHSXUSRVHTXDOLW\
IRFXV YLHZSRLQW DQG HQYLURQPHQW %DVLOL DQG :HLVV   )XUWKHUPRUH WKH GHILQLWLRQ RI
FRQWH[WXDOSDUDPHWHUVLVD IRUPDOL]HGSDUWRIWKH *40DEVWUDFWLRQVKHHWZKHUHRQHSDUWRI
WKH TXHVWLRQV DQG PHWULFV LV GHYRWHG WR ³TXDOLW\ IRFXV´ ZKLOH WKH RWKHU SDUW LV GHYRWHG WR
TXHVWLRQVDQGPHWULFVUHJDUGLQJ³HQYLURQPHQWDO´RUFRQWH[WXDOYDULDEOHV *UHVVHHWDO 
)LQDOO\DQGPRVWLPSRUWDQWO\LVWKHHYDOXDWLRQRIWKHLPSDFWRIWKHFRQWH[WXDOYDULDEOHVDQG
KRZWKH\PD\DIIHFWWKHRUJDQL]DWLRQ¶VLPSURYHPHQWSUDFWLFHV VHH7DEOHIRUDQH[DPSOH 
'HVSLWHLPSRUWDQWGLIIHUHQFHVERWKWKHPRGHOEDVHGDQGDQDO\WLFDODSSURDFKWR63,VHHP
WREHPRVWFRQFHUQHGZLWKVROYLQJWKHQHHGVRIODUJHRUJDQL]DWLRQVRSHUDWLQJLQKLJKO\VWDEOH
HQYLURQPHQWVZLWKORQJWHUPFRQWUDFWV HJWKH86'HSDUWPHQWRI'HIHQVHDQGWKH1$6$
*6)& 7KLVLVIXUWKHUFRQILUPHGE\IDPRXVFDVHVRIVXFFHVVIXO63,VXFKDV$OFDWHO 'HERX
HW DO   +HZOHWW3DFNDUG *UDG\   +XJKHV +XPSKUH\ HW DO   0RWRUROD
'DVNDODQWRQDNLV   3KLOLSV 5RRLMPDQV HW DO   5D\WKHRQ 'LRQ   DQG
6LHPHQV 0HKQHU   ZKLFK DUH YHULWDEOH JLDQWV FRPSDUHG WR VPDOO DQG PHGLXPVL]HG
HQWHUSULVHV 60(V 
5HSUHVHQWLQJWKHPRGHOEDVHGDSSURDFKWKHDXWKRUVRIWKH&00PDGHLWFOHDUWKDWLWZDV
GHYHORSHGIRUXVHZLWKODUJHJRYHUQPHQWIXQGHGW\SHRISURMHFWV 3DXONHWDO ,WFDQ
EH WDLORUHG DQG WKH GRFXPHQWDWLRQ WR GR VR LV DYDLODEOH IURP WKH 6(, *LQVEHUJ DQG 4XLQQ
 +RZHYHUWKHSURFHVVRIWDLORULQJLVLWVHOIVRFRPSOH[DQGUHVRXUFHGHPDQGLQJWKDWLWLV
RITXHVWLRQDEOHYDOXHWRPRVW60(V 2XOG 
:KDW¶V PRUH +XPSKUH\   SXW WKH FDVH IRU VWDWLVWLFDO FRQWURO RI WKH VRIWZDUH
SURFHVVDUJXLQJWKDW³,IWKHSURFHVVLVQRWXQGHUVWDWLVWLFDOFRQWUROVXVWDLQHGSURJUHVVLVQRW
SRVVLEOHXQWLOLWLV´ LELGS 0RUHRYHUWKH6(,KDVDGYRFDWHGWKHXVHRI63&WHFKQLTXHV
VSHFLILFDOO\FRQWUROFKDUWVLQUHFHQWWHFKQLFDOUHSRUWVDQGSURSRVHGFKDQJHVIRUWKH&00WR
H[SOLFLWO\VXSSRUWWKHXVHRIULJRURXVVWDWLVWLFDOWHFKQLTXHV )ORUDFDQG&DUOHWRQ 7KH
PDLQSUHUHTXLVLWHVIRUWKHDSSOLFDWLRQRI63&KRZHYHUDUHVWDEOHSURFHVVHVDQGORWVRIGDWD
$OWKRXJK H[SHUW NQRZOHGJH LV DQ LPSRUWDQW SDUW RI XVLQJ WKH *40 VHH 6HFWLRQ  
HPSKDVLVLQWKHDQDO\WLFDODSSURDFKLVVWLOORQODUJHRUJDQL]DWLRQVJHQHUDWLQJODUJHDPRXQWVRI
GDWD
7KHVH FRQFHSWV DUH QRW RI PXFK KHOS IRU PRVW 60(V IDFLQJ LQFUHDVLQJO\ FKDQJLQJ
HQYLURQPHQWV ZKHUH WKH SHULRGV RI VWDELOL]DWLRQ DUH FRQVWDQWO\ VKRUWHQHG $V WKH UDWH RI
FKDQJH LQFUHDVHV WKH FRPSOH[LW\ RI WKH SUREOHPV IDFLQJ 60(V DOVR LQFUHDVHV 7KH PRUH
FRPSOH[WKHVHSUREOHPVDUHWKHPRUHWLPHLWWDNHVWRVROYHWKHP7KHPRUHWKHUDWHRIFKDQJH
LQFUHDVHV WKH PRUH WKH SUREOHPV WKDW IDFH 60(V FKDQJH DQG WKH VKRUWHU LV WKH OLIH RI WKH
VROXWLRQV WKH\ ILQG WR WKHP 7KHUHIRUH E\ WKH WLPH WKH\ ILQG VROXWLRQV WR PDQ\ RI WKHLU
SUREOHPVWKHSUREOHPVKDYHFKDQJHGVRWKDWWKHVROXWLRQVWRWKHPDUHQRORQJHUUHOHYDQWRU
HIIHFWLYH ,Q RWKHU ZRUGV PDQ\ RI WKH VROXWLRQV DUH WR SUREOHPV WKDW QR ORQJHU H[LVW LQ WKH
IRUPLQZKLFKWKH\ZHUHVROYHG
&RQVHTXHQWO\PRVW60(VIDFHWZRFKDOOHQJHV  DQHYHUFKDQJLQJHQYLURQPHQWDQG 
IHZSURMHFWVUXQQLQJDWDQ\JLYHQSRLQWLQWLPH$VDUHVXOWRIWKLVWKH\KDYHIHZGDWDZKLFK

±±
&+$37(5

WKH\FDQDQDO\]HDQGXVHWREXLOGXSDQH[SHULHQFHEDVH,QDGGLWLRQFROOHFWHGGDWDZLOOVRRQ
EHRXWGDWHGDQGOHIWLUUHOHYDQWRU±LQWKHEHVWFDVH±XQFHUWDLQ7DNHQWRJHWKHUWKLVLPSOLHV
WKDW 60(V FDQQRW EDVH WKHLU LPSURYHPHQW DFWLRQV RQ FROOHFWLQJ ORQJ WLPH VHULHV RU DPDVV
ODUJHDPRXQWVRIGDWDQHHGHGIRUDWUDGLWLRQVWDWLVWLFDOLPSURYHPHQWDSSURDFK
+RZHYHUWKHVSHFLDOQHHGVRI60(VKDYHEHHQUHFRJQL]HGE\ERWKWKH()40DQGE\WKH
(XURSHDQ&RPPXQLW\WKURXJK(66,$VDUHVXOWWKH()40ODXQFKHGWKH(XURSHDQ4XDOLW\
$ZDUGIRU60(VLQZKLFKLVIRUERWKZKROHFRPSDQLHVDQGLQGHSHQGHQWEXVLQHVVXQLWV
LQVLGH ODUJHU FRPSDQLHV :LWKLQ WKH (66, SURJUDP VHYHUDO KXQGUHG 60(V KDYH SHUIRUPHG
3URFHVV,PSURYHPHQW([SHULPHQWV 3,(V WRGHPRQVWUDWHDQGGLVVHPLQDWHWKHEHQHILWVRI63,
WKURXJKXVHUH[SHULPHQWDWLRQ
7KXVWZRFRQWH[WXDOYDULDEOHVDUHLQFOXGHGLQWKHPRGHOWRFDSWXUHWKHPRVWLQIOXHQWLDO
VRXUFHV RI YDULDWLRQ DQG WR SURYLGH JUHDWHU TXDVLH[SHULPHQWDO FRQWURO HQYLURQPHQWDO
WXUEXOHQFHDQGRUJDQL]DWLRQDOVL]H

 (QYLURQPHQWDOWXUEXOHQFH
7KHVRIWZDUHRUJDQL]DWLRQ¶VHQYLURQPHQWUHIHUVWRYDULRXV FKDUDFWHULVWLFV RXWVLGH WKH FRQWURO
RI WKH RUJDQL]DWLRQ WKDW LV LPSRUWDQW WR LWV SHUIRUPDQFH 7KHVH FKDUDFWHULVWLFV LQFOXGH WKH
QDWXUHRIWKHPDUNHWSROLWLFDOFOLPDWHHFRQRPLFFRQGLWLRQVDQGWKHNLQGRIWHFKQRORJLHVRQ
ZKLFKWKHRUJDQL]DWLRQGHSHQGV
7KHHQYLURQPHQWRIDSDUWLFXODUVRIWZDUHRUJDQL]DWLRQPD\UDQJHIURPVWDEOHWRG\QDPLF
± IURP SUHGLFWDEOH WR XQSUHGLFWDEOH ,Q D VWDEOH HQYLURQPHQW WKH VRIWZDUH RUJDQL]DWLRQ FDQ
SUHGLFWLWVIXWXUH FRQGLWLRQV DQG UHO\ RQ VWDQGDUGL]DWLRQ IRU FRRUGLQDWLRQ 0LQW]EHUJ  
&HUWDLQO\DVWDEOHHQYLURQPHQWPD\FKDQJHRYHUWLPHEXWWKHYDULDWLRQVDUHVWLOOSUHGLFWDEOH
%XWZKHQWKHFRQGLWLRQVEHFRPHG\QDPLF±ZKHQWKHPDUNHWLVXQVWDEOHWKHQHHGIRUSURGXFW
FKDQJH LV IUHTXHQW DQG WXUQRYHU LV KLJK ± VXFK FKDQJH LV KLJKO\ XQSUHGLFWDEOH DQG WKH
VRIWZDUHRUJDQL]DWLRQFDQQRWUHO\RQVWDQGDUGL]DWLRQ,QVWHDGLWPXVWUHPDLQIOH[LEOHWKURXJK
WKHXVHRIGLUHFWVXSHUYLVLRQRUPXWXDODGMXVWPHQWIRUFRRUGLQDWLRQDQGVRLWPXVWXVHDPRUH
RUJDQLF VWUXFWXUH 7KHUHIRUH WKH HIIHFWLYHQHVV RI D VRIWZDUH RUJDQL]DWLRQ¶V VWUXFWXUH ZLOO
GHSHQGRQWKHHQYLURQPHQWRIWKHRUJDQL]DWLRQ

 2UJDQL]DWLRQDOVL]H
7KH RUJDQL]DWLRQDO OLWHUDWXUH VXJJHVWV WKDW ODUJH RUJDQL]DWLRQV DUH OHVV OLNHO\ WR FKDQJH LQ
UHVSRQVHWRHQYLURQPHQWDOFKDQJHVWKDQVPDOORUJDQL]DWLRQV7XVKPDQDQG5RPDQHOOL  
IRUH[DPSOHDUJXHGWKDWLQFUHDVHGVL]HOHDGVWRLQFUHDVHGFRPSOH[LW\LQFUHDVHGFRQYHUJHQFH
DQG WKXV LQFUHDVHG LQHUWLD /LNHZLVH 0LQW]EHUJ   SRVWXODWHG WKDW WKH ODUJHU DQ
RUJDQL]DWLRQ WKH PRUH IRUPDOL]HG LWV EHKDYLRU 6R ZKLOH VPDOO RUJDQL]DWLRQV FDQ UHPDLQ
RUJDQLFODUJHRUJDQL]DWLRQVGHYHORSEXUHDXFUDFLHVZLWKMREVSHFLDOL]DWLRQDQGVKDUSGLYLVLRQV
RI ODERU HPSKDVL]LQJ VWDELOLW\ RUGHU DQG FRQWURO $V D FRQVHTXHQFH WKH\ RIWHQ KDYH JUHDW
GLIILFXOWLHV LQ DGDSWLQJ WR FKDQJLQJ FLUFXPVWDQFHV EHFDXVH WKH\ DUH GHVLJQHG WR DFKLHYH
SUHGHWHUPLQHGJRDOV±WKH\DUHQRWGHVLJQHGIRULQQRYDWLRQ
)URP D OHDUQLQJ SHUVSHFWLYH KRZHYHU LQHUWLD GHYHORSV DV D UHVXOW RI WKH RUJDQL]DWLRQ¶V
SHUIRUPDQFHKLVWRU\ /DQWDQG0H]LDV /DUJHRUJDQL]DWLRQVWHQGWREHVXFFHVVIXOVLQFH
DQ RUJDQL]DWLRQ ZLOO JURZ ODUJHU ZLWK UHSHDWHG VXFFHVV +RZHYHU VLQFH VXFFHVV UHGXFHV WKH

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

SUREDELOLW\RIFKDQJHLQDWDUJHWRULHQWHGRUJDQL]DWLRQ &\HUWDQG0DUFK ODUJH


VRIWZDUHRUJDQL]DWLRQVZLOOEHOHVVOLNHO\WRFKDQJHZKHQWKHHQYLURQPHQWFKDQJHV

 /HDUQLQJ&\FOH
$VZHKDYHDOUHDG\DUJXHGRUJDQL]DWLRQDOOHDUQLQJDQG63,LVGHILQHGDVDG\QDPLFLQWHUSOD\
EHWZHHQWZRSULPDU\ GLDOHFWLFV 7KH ILUVW LV WKDW EHWZHHQ WKH ORFDO DQG RUJDQL]DWLRQDO OHYHO
7KH RWKHU LV WKDW EHWZHHQ JHQHUDWLQJ DQG LQWHUSUHWLQJ RUJDQL]DWLRQDO NQRZOHGJH ,Q WKLV
VHFWLRQZHPDNHDGHWDLOHGGHVFULSWLRQRIHDFKRIWKHVHIRXUHOHPHQWVRIWKHOHDUQLQJF\FOH

 /RFDONQRZLQJ
7KH SULPDU\ FRQWH[W ZLWKLQ ZKLFK PHDQLQJ LV FRQVWUXFWHG QHZ NQRZOHGJH FUHDWHG DQG
LPSURYHG FRXUVHV RI DFWLRQ WDNHQ LV WKH VKDUHG SUDFWLFH ZLWKLQ ORFDO VRIWZDUH GHYHORSPHQW
WHDPV6RIWZDUHGHYHORSHUVGRQRWZRUNLQLVRODWLRQ±WKH\ZRUNWRJHWKHUWRGHYHORSSURGXFWV
WKDW WKH\ FRXOG QRW GHYHORS E\ ZRUNLQJ DV LQGLYLGXDOV 7KLV IRFXV RQ WHDPV DQG WKHLU
FROODERUDWLYH SURFHVVHV DUH LPSRUWDQW EHFDXVH QR RQH GHYHORSHU HPERGLHV WKH EUHDGWK DQG
GHSWKRINQRZOHGJHQHFHVVDU\WRFRPSUHKHQGODUJHDQGFRPSOH[VRIWZDUHV\VWHPVDQGDOVR
EHFDXVH FRGLILHG RU H[SOLFLW RUJDQL]DWLRQDO NQRZOHGJH LV VHOGRP VXIILFLHQW WR VROYH D
SDUWLFXODUSUREOHP7KXVMXVWDVDVLQJOHVRFFHUSOD\HUFDQQRWSOD\DJDPHRIVRFFHUE\KLP
RUKHUVHOIRQO\DJURXSRIVRIWZDUHGHYHORSHUVZRUNLQJDVDWHDPFDQGHYHORSVRIWZDUHRID
FHUWDLQVL]HDQGFRPSOH[LW\
7KH VRIWZDUH WHDPV¶ ZD\ RI JUDVSLQJ WKH ZRUOG DQG IRUPLQJ ORFDO UHDOLWLHV LV E\
DSSUHKHQVLRQ±LQWKHSUHVHQWPRYHPHQWRI³KHUHDQGQRZ´ .ROE 7KH\DUHFRQFHUQHG
ZLWKFRQFUHWHVLWXDWLRQVDVH[SHULHQFHGLQDOOWKHLUFRPSOH[LW\GXULQJVRIWZDUHGHYHORSPHQW
7KH\DFWLQDVSHFLILFFRQWH[WLQZKLFKUHDOLW\LVFRQVWDQWO\EHLQJFUHDWHGDQGUHFUHDWHG/RFDO
UHDOLW\ LV WKHUHIRUH QRW DQ H[SOLFDWHG DQG VWDWLF PRGHO RI FDXVDO UHODWLRQVKLSV IRU VRIWZDUH
GHYHORSPHQW5DWKHULWVKRZVXSLQWKHORFDODFWLRQVWDNHQE\WKHGHYHORSHUVLQWKHWHDPDQG
FDQDVZHDUJXHGLQWKHSUHFHGLQJFKDSWHUEHWWHUEHFKDUDFWHUL]HGDV³NQRZLQJ´
7KXVE\ORFDONQRZLQJZHUHIHUWRWKHNQRZOHGJHLQDFWLRQDVVRFLDWHGZLWKSDUWLFLSDWLQJ
LQ WKH FROOHFWLYH SUDFWLFH RI VRIWZDUH GHYHORSPHQW LQ D VSHFLILF FRQWH[W ,W LV LPSRUWDQW WR
VWUHVV WKLV VLQFH D VRIWZDUH RUJDQL]DWLRQ¶V SULPDU\ FRQFHUQ LV WKH DFWXDO SUDFWLFH RI
GHYHORSLQJ VRIWZDUH DQG QRW PHUHO\ WKH FUHDWLRQ RI NQRZOHGJH RQ KRZ WR GR LW /RFDO
NQRZLQJ LV WKHUHIRUH DERXW KRZ WKH VRIWZDUH RUJDQL]DWLRQ ZRUNV RU LWV WKHRULHVLQXVH DV
VHHQIURPWKHORFDOWHDPVRUZRUNJURXSVLQWKHRUJDQL]DWLRQ3DUWLFLSDWLQJLQVRIWZDUHWHDPV
LV FRQVHTXHQWO\ QRW RQO\ D PDWWHU RI GHYHORSLQJ VRIWZDUH EXW DOVR WR FKDQJH WKH
RUJDQL]DWLRQ¶V NQRZOHGJH DERXW VRIWZDUH GHYHORSPHQW DQG WR JHQHUDWH VRIWZDUH SURFHVV
LPSURYHPHQWV
7KHFRQWH[WLQZKLFKVRIWZDUHGHYHORSHUVLQWHUDFWFRQWULEXWHVWRWKHOHDUQLQJSURFHVVLQ
VHYHUDOZD\V)LUVWHDFKVRIWZDUHWHDPRUZRUNJURXSRSHUDWHVLQDSDUWLFXODUVHWWLQJZLWKD
SDUWLFXODU PL[ RI SHRSOH WRROV DQG WHFKQLTXHV WR GHILQH DQG VROYH D SDUWLFXODU VRIWZDUH
GHYHORSPHQWSUREOHP$OVRWKHZD\LQZKLFKVRIWZDUHGHYHORSHUVXVHSULRUH[SHULHQFHDQG
DYDLODEOH WRROV DQG WHFKQLTXHV YDULHV ZLWK WKH SDUWLFXODU FRQFUHWH FLUFXPVWDQFHV 7KDW LV
VRIWZDUHGHYHORSHUVZLOODSSURDFKDFHUWDLQSUREOHPGHSHQGLQJRQWKHDFWXDOVHWWLQJEHFDXVH
HDFKVHWWLQJWHQGVWRHYRNHFHUWDLQNLQGVRI³DSSURSULDWH´PRGHVRIWKRXJKWDQGDFWLRQ 7\UH

±±
&+$37(5

DQG YRQ +LSSHO   0RUHRYHU VRIWZDUH GHYHORSHUV RIWHQ WDNH DGYDQWDJH RI WKH VHWWLQJ
LWVHOIWRKHOSWKHPGHILQHDSUREOHPRUWRGLVFRYHUVROXWLRQV
$OVR VRIWZDUH GHYHORSHUV LQFRUSRUDWH FRGLILHG RUJDQL]DWLRQDO URXWLQHV LQWR ORFDO
LQIRUPDO SUDFWLFHV IUHHO\ DGDSWLQJ WKH URXWLQHV DV WKH\ ZRUN RQ VROYLQJ DFWXDO SUREOHPV LQ
WKHLU SDUWLFXODU FLUFXPVWDQFHV /RFDO NQRZLQJ GUDZV RQ ERWK WKH RUJDQL]DWLRQDO PHPEHUV¶
LQGLYLGXDO XQGHUVWDQGLQJV RI WKH VLWXDWLRQ DQG WKHLU DELOLW\ WR XVH WKH UHOHYDQW SDUWV RI
RUJDQL]DWLRQDO PHPRU\ WKDW LV DYDLODEOH LQ D JLYHQ FRQWH[W 7KHUHIRUH WKH FRQWH[W LQ ZKLFK
VRIWZDUHGHYHORSPHQWWDNHVSODFHSDUWO\GHWHUPLQHVZKDWWKHRUJDQL]DWLRQ¶VPHPEHUVFDQGR
ZKDW WKH\ NQRZ DQG ZKDW WKH\ FDQ OHDUQ 0RUHRYHU VLQFH GLIIHUHQW ORFDO VHWWLQJV SURYLGH
GLIIHUHQWRSSRUWXQLWLHVIRUOHDUQLQJDQ\63,DFWLYLW\ZLOODOVREHDVLWXDWHGSURFHVV
7KHUHIRUHDOOVRIWZDUHGHYHORSPHQWDQG63,DFWLYLWLHVKDYHDQDGKRFDGURLWQHVVDNLQWR
LPSURYLVDWLRQEHFDXVHWKH\PL[WRJHWKHUWKHFRQWLQJHQF\RIWKHSUHVHQWVLWXDWLRQZLWKOHVVRQV
OHDUQHGIURPSULRUH[SHULHQFH '\EnE 5\OH  GHVFULEHGWKLVPL[WXUHDV³SD\LQJ
KHHG´ WR EH WKLQNLQJ DW ZKDW RQH LV XS DJDLQVW KHUH DQG QRZ E\ DGMXVWLQJ RQHVHOI WR WKH
SUHVHQWVLWXDWLRQZKLOHDWWKHVDPHWLPHDSSO\LQJWKHOHVVRQVDOUHDG\OHDUQHG,QRWKHUZRUGV
ORFDONQRZLQJLVDIIHFWHGE\WKHFXUUHQWVHWWLQJDVZHOODVE\WKHRUJDQL]DWLRQ¶VPHPRU\RILWV
SDVWH[SHULHQFH
6XFKDQLPSURYLVDWLRQDOWKHRU\RIORFDONQRZLQJKDVLWVURRWVLQWKHSUDJPDWLVWV¶QRWLRQ
WKDWNQRZOHGJHLVQRWDEVROXWHEXWUDWKHUFDQRQO\EHGHILQHGLQUHODWLRQWRDVSHFLILFVLWXDWLRQ
RU FRQWH[W 'HZH\   4XHVWLRQV DERXW ZKDW LV ³WUXH´ DUH DQVZHUHG LQ UHODWLRQ WR ZKDW
ZRUNVLQDJLYHQVHWWLQJ&RQVHTXHQWO\ORFDONQRZLQJLVSUDJPDWLFDQGSURGXFHVDFWLRQVWKDW
DUH RULHQWHG WRZDUG HVWDEOLVKHG JRDOV GLUHFWHG DW GRLQJ ZKDWHYHU LV QHFHVVDU\ WR UHDFK WKH
REMHFWLYH
7KXVRUJDQL]DWLRQDOOHDUQLQJDQG63,RFFXUVWKURXJKSHRSOHLQWHUDFWLQJLQFRQWH[W±RU
PRUH SUHFLVHO\ LQ PXOWLSOH FRQWH[WV 7KLV VLWXDWHG DQG SUDJPDWLF FKDUDFWHULVWLF RI
RUJDQL]DWLRQDO OHDUQLQJ KDV LPSRUWDQW LPSOLFDWLRQV IRU KRZ SUREOHP IUDPLQJ SUREOHP
VROYLQJ DQG 63, WDNH SODFH LQ VRIWZDUH RUJDQL]DWLRQV 0RVW LPSRUWDQWO\ WKLV SHUVSHFWLYH
VXJJHVWV WKDW WUDGLWLRQDO GHFRQWH[WXDOL]HG WKHRULHV RI 63, FDQQRW FRPSOHWHO\ DFFRXQW IRU
OHDUQLQJ LQ VRIWZDUH RUJDQL]DWLRQV 5DWKHU VLQFH OHDUQLQJ LV DQ LQWHUDFWLYH VRFLDO SURFHVV
FRQWH[WXDOIDFWRUVZLOODIIHFWERWKKRZDQGZKDWRUJDQL]DWLRQDOPHPEHUVOHDUQ
7KHUHDUHVHYHUDOVRFLDOJURXSVZLWKLQDVRIWZDUHRUJDQL]DWLRQWKDWVKDUHNQRZOHGJHDQG
WKDWPD\EHLGHQWLILHGDVKDYLQJDGLVWLQFWORFDOUHDOLW\([DPSOHVRIVXFKJURXSVDUHIRUPDO
SURMHFW WHDPV DQG LQIRUPDO JURXSV RI VRIWZDUH GHYHORSHUV DQG PDQDJHUV $ JURXS¶V ORFDO
UHDOLW\FDQEHVHHQDVDZD\RIDFWLQJLQUHODWLRQVKLSWRWKHUHVWRIWKHRUJDQL]DWLRQ+RZHYHU
VKDUHGSUDFWLFHE\LWVYHU\QDWXUHFUHDWHVERXQGDULHV :HQJHU 
7KHUH DUHWZREDVLFFRQGLWLRQVIRUHVWDEOLVKLQJFRQQHFWLRQVDFURVVVXFK ERXQGDULHV DQG
PDNLQJ FRPPXQLFDWLRQV EHWZHHQ WKH JURXSV HIIHFWLYH )LUVW HDFK JURXS PXVW UHVSHFW WKH
H[SHUWLVH RI WKH RWKHU DQG PXVW DFNQRZOHGJH WKH UHOHYDQFH RI WKDW H[SHUWLVH WR WKHLU RZQ
SUREOHPV6HFRQGHDFKJURXSPXVWKDYHVXIILFLHQWNQRZOHGJHDQGXQGHUVWDQGLQJRIWKHRWKHU
JURXSV¶ SUREOHPV WR EH DEOH WR FRPPXQLFDWH HIIHFWLYHO\ DERXW WKHP +RZHYHU H[SHULHQFH
VKRZVWKDWWKHVHFRQGLWLRQVDUHXQOLNHO\WREHVDWLVILHGXQOHVVDVXIILFLHQWQXPEHURIPHPEHUV
RIHDFKJURXSKDYHKDGDFWXDOH[SHULHQFHZLWKWKHDFWLYLWLHVDQGUHVSRQVLELOLWLHVRIWKHRWKHU
JURXSV 6LPRQ 

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

7KHPRVWLPSRUWDQWJURXSVLQIOXHQFLQJ63,LQVRIWZDUHRUJDQL]DWLRQVDUH

x 6RIWZDUH GHYHORSHUV DQG ILUVW OLQH VRIWZDUH PDQDJHUV LQ JHQHUDO KDYH D FRPPRQ ZRUN
H[SHULHQFH IURP VRIWZDUH GHYHORSPHQW $OWKRXJK WKHLU UHVSRQVLELOLWLHV GLIIHU DQG WKHLU
ZRUNLVGRQH LQ GLIIHUHQW GHSDUWPHQWV WKH\ KDYH D VLPLODU EDFNJURXQG DQG ZRUN LQ WKH
VDPH FKDRWLF UHDOLW\ 7KHLU XQGHUVWDQGLQJ RI VRIWZDUH GHYHORSPHQW DQG 63, LV FORVHO\
UHODWHGWRVSHFLILFHYHQWVDQGWKHLUNQRZOHGJHLVKLJKO\FRQWH[WXDOL]HG0RUHRIWHQWKDQ
QRWWKH\H[SUHVVWKHLUNQRZLQJLQVWRULHVWKURXJKIDFHWRIDFHFRQWDFWZLWKWKHLUSHHUV
x 4XDOLW\ PDQDJHUV VHOGRP KDYH D VRIWZDUH EDFNJURXQG EXW WKH\ DUH QHYHUWKHOHVV
H[SHFWHG WR SURYLGH VRIWZDUH GHYHORSHUV DQG VRIWZDUH PDQDJHUV ZLWK VWDQGDUGV DQG
URXWLQHVWKDWFDQLPSURYHWKHTXDOLW\RIWKHLURUJDQL]DWLRQV¶SURGXFWVDQGVHUYLFHV7KHLU
XQGHUVWDQGLQJ RI VRIWZDUH GHYHORSPHQW DQG 63, LV W\SLFDOO\ LQIOXHQFHG E\ WKH PDQX
IDFWXULQJSURIHVVLRQVDQGWKH\FRQWLQXRXVO\WU\WRGHFRQWH[WXDOL]HWKHOHVVRQVWKDWVRIW
ZDUH GHYHORSHUV KDYH OHDUQHG )XUWKHUPRUH WKH\ HVSRXVH D ILUP EHOLHI WKDW 63, FDQ EH
DFKLHYHG E\ WKH LQVWLWXWLRQDOL]DWLRQ RI D TXDOLW\ PDQDJHPHQW V\VWHP EDVHG RQ FRPPRQ
VWDQGDUGVDQGH[SOLFLWURXWLQHV
x ([HFXWLYHPDQDJHUVKDYHDQRYHUDOODQGJHQHUDOXQGHUVWDQGLQJRIWKHRUJDQL]DWLRQDQGDQ
RYHUDOO DFFRXQWDELOLW\ IRU RUJDQL]DWLRQDO SHUIRUPDQFH 2IWHQ WKH\ VHHP WR KDYH OLWWOH
FRQWDFW ZLWK WKH ZD\ ZRUN LV DFWXDOO\ SHUIRUPHG LQ WKH RUJDQL]DWLRQ¶V GLYHUVH WHDPV
7KHLUNQRZOHGJHRIVRIWZDUHGHYHORSPHQWLVGHFRQWH[WXDOL]HGDQGWKH\KDYHOLWWOHDELOLW\
WRGLUHFWO\LQIOXHQFHDFWXDOZRUNSUDFWLFHV7KH\RIWHQIRFXVRQHFRQRP\DQGOLNHTXDOLW\
PDQDJHUV WKH\ DUH FRQFHUQHG DERXW RUGHU VWDELOLW\ DQG UHSHDWDELOLW\ LQ VRIWZDUH
GHYHORSPHQW,QFLGHQWDOO\WKLVLVDOVRWKHFRUHDVVXPSWLRQVRIPRVWWH[WERRNVLQVRIWZDUH
HQJLQHHULQJDQGRIPRVWUHVHDUFKRQVRIWZDUHGHYHORSPHQWPHWKRGVDQGWRROV

5DWKHUWKDQRUGHUDQGVWDELOLW\WKHUHDOLW\H[SHULHQFHGE\PRVWVRIWZDUHGHYHORSPHQWWHDPVLV
PRUHDNLQWRFKDRVGXHWRWKHFRPSOH[LW\RIZRUNFRPELQHGZLWKDG\QDPLFDQGLQFUHDVLQJO\
XQSUHGLFWDEOHHQYLURQPHQW6RZKLOHH[HFXWLYHPDQDJHUVRIWHQIDYRUGLUHFWVXSHUYLVLRQDQG
TXDOLW\PDQDJHUV ZDQW VWDQGDUGL]DWLRQ DV WKH RUJDQL]DWLRQ¶V PDLQ FRRUGLQDWLQJ PHFKDQLVPV
PXWXDO DGMXVWPHQW LV WKH RQO\ RSHUDWLRQDO PHFKDQLVP WKDW ZH KDYH REVHUYHG LQ DFWXDO XVH
ZLWKLQ DQG EHWZHHQ FUHDWLYH VRIWZDUH WHDPV 7KLV LV DOVR LQ DJUHHPHQW ZLWK 0LQW]EHUJ¶V
   SRVWXODWH WKDW PXWXDO DGMXVWPHQW LV WKH RQO\ FRRUGLQDWLRQ PHFKDQLVP WKDW FDQ
KDQGOHUHDOO\FRPSOH[ZRUNZLWKDORWRISUREOHPVROYLQJ
0XWXDO DGMXVWPHQW GHSHQGV LQ ODUJH RQ SK\VLFDO IDFHWRIDFH FRQWDFW ZKLFK LV WKH
ULFKHVWFRPPXQLFDWLRQFKDQQHOZHKDYHDQGE\IDUWKHPRVWHIIHFWLYHIRUPRIWUDQVIHUULQJDQG
H[FKDQJLQJNQRZOHGJHDQGH[SHULHQFHLQORFDOWHDPV$OVRSK\VLFDOIDFHWRIDFHH[SHULHQFH
DQGLQWHUDFWLRQDUHWKHNH\VWRFUHDWHDQGGLIIXVHWDFLWNQRZOHGJH7KHUHIRUHSHRSOHZRUNLQJ
WRJHWKHU ZLWK IUHTXHQW HDV\ FRQWDFW ZLOO PRUH HDVLO\ H[FKDQJH NQRZOHGJH DQG H[SHULHQFH
ZLWK HDFK RWKHU WKDQ SHRSOH WKDW DUH VHSDUDWHG E\ WLPH DQG VSDFH 7KLV KDV LPSRUWDQW
LPSOLFDWLRQV IRU 63, VLQFH ORFDO VRIWZDUH GHYHORSPHQW WHDPV FDQ XWLOL]H WKH IOH[LELOLW\ RI
IDFHWRIDFHFRPPXQLFDWLRQDQGVKHGEXUHDXFUDF\
+RZHYHUWKHFRPPXQLFDWLRQFDSDFLW\UDSLGO\EHFRPHVVDWXUDWHGDVWKHJURXSJURZVDQG
ZLWKRXW FRPSURPLVHV LW LV LPSRVVLEOH WR H[WHQG PXWXDO DGMXVWPHQW LQ LWV SXUH IRUP WR
RUJDQL]DWLRQVODUJHUWKDQWKHVPDOOJURXS,QODUJHRUJDQL]DWLRQVUHDOPXWXDODGMXVWPHQWFDQ
RQO\ WDNH SODFH ZLWKLQ GHYHORSPHQW WHDPV RU JURXSV VPDOO HQRXJK WR DOORZ DOOWRDOO
FRPPXQLFDWLRQ

±±
&+$37(5

1HYHUWKHOHVV ZLWK WKH VXSSRUW RI SURSHU WHFKQRORJ\ FRQVLGHUDEOH H[WHQVLRQ RI WKH
FRRUGLQDWLRQ RI ZRUN ZLWKLQ DQG EHWZHHQ WHDPV E\ PXWXDO DGMXVWPHQW LV SRVVLEOH LI WKH
DGMXVWPHQW LV PHGLDWHG E\ LQGLUHFW FRPPXQLFDWLRQ WKURXJK D UHSRVLWRU\ RI H[WHUQDOL]HG
RUJDQL]DWLRQDO PHPRU\ 6XFK LPSOLFLW FRRUGLQDWLRQ *URWK   RI VRIWZDUH GHYHORSHUV
ZRUNLQJIURPDFRPPRQH[SHULHQFHEDVHJUHDWO\UHGXFHVWKHQHHGIRU H[WUDFRPPXQLFDWLRQ
DQG GLUHFW VXSHUYLVLQJ HIIRUWV LQ WKH RUJDQL]DWLRQDO OHDUQLQJ SURFHVV &RQWUDU\ WR HIIRUWV RI
SURYLGLQJEHWWHUWRROVIRUKDQGOLQJWKHLQFUHDVHGFRPPXQLFDWLRQVXFKDVJURXSZDUHVROXWLRQV
RUHIIRUWVDWVWDQGDUGL]LQJWKHZRUNSURFHVVWKHDWWDFNSRLQWLQRXUPRGHOZKLFKLVEDVHGRQ
H[SHULHQFH EDVHV DQG FRPSXWHUL]HG RUJDQL]DWLRQDO PHPRU\ LV WR UHGXFH WKH YROXPH RI
FRPPXQLFDWLRQQHHGHGIRUFRRUGLQDWLRQ
&RQWUDU\ WR 1RQDND DQG 7DNHXFKL¶V   XQGHUVWDQGLQJ RI RUJDQL]DWLRQDO NQRZOHGJH
FUHDWLRQ DV D SURFHVV RI ³FURVVOHYHOLQJ´ DFURVV KLHUDUFKLFDO OHYHOV LQ DQ RUJDQL]DWLRQ ZH
FRQVLGHU YDULRXV IRUPV RI RUJDQL]DWLRQDO PHPRU\ WR EH WKH PRVW LPSRUWDQW PHFKDQLVP IRU
LPSOLFLWFRRUGLQDWLRQDQGOHDUQLQJEHWZHHQWHDPVLQVRIWZDUHRUJDQL]DWLRQV VHH&RQUDGLDQG
'\EnDQG6HFWLRQ 
,QWKHQH[WVHFWLRQZHGHVFULEHWKHSURFHVVRIJHQHUDWLQJQHZH[SOLFLWNQRZOHGJHEDVHG
RQORFDONQRZLQJVRWKDWOHVVRQVOHDUQHG FDQEHLQFRUSRUDWHGLQRUJDQL]DWLRQDOPHPRU\ DQG
VKDUHGRXWVLGHWKHWHDP

 *HQHUDWLQJH[SOLFLWNQRZOHGJH
*HQHUDWLQJ QHZ H[SOLFLW NQRZOHGJH LV D FROOHFWLYH SURFHVV ZKHUH D JURXS RI VRIWZDUH
GHYHORSHUV DWWHPSWV WR H[WHUQDOL]H WKHLU ORFDO NQRZLQJ 7KLV PHDQV IRU H[DPSOH WKDW D
VRIWZDUHWHDPPXVWWDNHWLPHWRH[SUHVVLWVVKDUHGSUDFWLFHVLQDIRUPWKDWFDQPHDQLQJIXOO\
EH XQGHUVWRRG DQG H[SORLWHG E\ RWKHU RUJDQL]DWLRQDO PHPEHUV 7KLV SURFHVV LQYROYHV WKH
DUWLFXODWLRQRIWDFLWNQRZOHGJHLQWRVXFKH[SOLFLWNQRZOHGJHDVFRQFHSWVPRGHOVDQGURXWLQHV
WKURXJK WKH XVH RI ZRUGV PHWDSKRUV DQDORJLHV QDUUDWLYHV RU YLVXDOV 7KH UHVXOW RI WKLV
SURFHVV LV QHZ RUJDQL]DWLRQDO NQRZOHGJH DQG DQ H[WHQGHG UDQJH RI H[SOLFLW RUJDQL]DWLRQDO
PHPRU\
$OO H[WHUQDOL]DWLRQ SURFHVVHV GHSHQG RQ ODQJXDJH DQG ZULWLQJ LV D IXQGDPHQWDO DFW RI
JHQHUDWLQJ QHZ H[SOLFLW NQRZOHGJH /DQJXDJH LV WKH PHDQV E\ ZKLFK ZH DUWLFXODWH VKDUHG
H[SHULHQFH DQG JHQHUDWH QHZ RUJDQL]DWLRQDO NQRZOHGJH ,W SURYLGHV WKH PHDQV IRU
LQFRUSRUDWLQJ QHZO\ DUWLFXODWHG NQRZOHGJH LQWR RUJDQL]DWLRQDO PHPRU\ $QRWKHU LPSRUWDQW
SDUW RI WKH H[WHUQDOL]DWLRQ SURFHVV LV WKH IDFHWRIDFH LQWHUDFWLRQ WKDW \LHOGV VWRULHV DQG
DQHFGRWHVRIH[SHULHQFHPXFKOLNHWKHSKRWRFRSLHUUHSDLUWHFKQLFLDQVLQ 2UU¶V  
VWXG\EDVHGWKHLUH[WHUQDOL]DWLRQRIH[SHULHQFHRQVWRU\WHOOLQJ
,QSUDFWLFHGLDORJXH %RKPDQG3HDW   DQG FROOHFWLYH UHIOHFWLRQ 6FK|Q   RU
UHIOHFWLYH REVHUYDWLRQ WR XVH .ROE¶V   WHUPLQRORJ\ WULJJHUV WKH DUWLFXODWLRQ RI H[SOLFLW
NQRZOHGJH 7KLV SURFHVV RI JHQHUDWLQJ QHZ H[SOLFLW NQRZOHGJH EULQJV VRPH RI ZKDW WKH
VRIWZDUHWHDPDSSUHKHQGVLQWRZKDWWKHWHDPFRPSUHKHQGV
'LDORJXHLVDQLPSRUWDQWZD\RIFROOHFWLYHO\JUDVSLQJH[SHULHQFHWKURXJKFRPSUHKHQVLRQ
VXFK WKDW WKH VRIWZDUH WHDP LV DEOH WR DUWLFXODWH DQG EXLOG PRGHOV RI WKHLU H[SHULHQFH DQG
WKHUHE\FRPPXQLFDWLQJLWWRRWKHUV7RWKHH[WHQWWKDWVXFKH[SHULHQFHPRGHOVDUHDFFXUDWHO\
FRQVWUXFWHG IURP WKH WHDP¶V ORFDO NQRZLQJ WKH\ DOORZ RWKHUV WR SUHGLFW DQG UHFUHDWH WKDW
NQRZLQJ

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

&ROOHFWLYHUHIOHFWLRQDQGGLDORJXHIDFLOLWDWHD JUHDWHUFRYHUDJHRISDVWH[SHULHQFHVLQFH
LQGLYLGXDOGHYHORSHUVFDQSURPSWHDFKRWKHUWRKHOSUHPHPEHUWKHSDVW,QWKLVVHQVHPXOWLSOH
DQGHYHQFRQIOLFWLQJLQGLYLGXDOH[SHULHQFHVHQDEOHDPRUHFRPSUHKHQVLYHUHFROOHFWLRQRISDVW
HYHQWV 6XFK GLYHUVLW\ LQ ORFDO NQRZLQJ EHWZHHQ VRIWZDUH WHDPV VKRXOG QRW EH VHHQ DV D
SUREOHPEXWUDWKHUDVDYDOXDEOHVRXUFHIRURUJDQL]DWLRQDOOHDUQLQJDQG63,7KXV³LWLVWKH
GLIIHUHQFHVQRWWKHDJUHHPHQWVWKDWDUHWKHSRVVLELOLWLHVIRUOHDUQLQJDQGFKDQJH´ *MHUVYLN
S 
2QH RI WKH PRVW HIIHFWLYH ZD\V RI H[WHUQDOL]LQJ ORFDO NQRZOHGJH LQ VRIWZDUH
RUJDQL]DWLRQV LV WKURXJK WKH XVH RI PRGHOV WRROV DQG WHFKQLTXHV $Q H[DPSOH RI VXFK D
SURFHVV LV KRZ FRQVXOWLQJ ILUPV GHYHORS PRGHOV RI WKH VRIWZDUH GHYHORSPHQW OLIHF\FOH E\
WU\LQJWRFDSWXUHDQGFRGLI\WKHWDFLWNQRZOHGJHRIWKHLUFRQVXOWDQWV7\SLFDOO\WKHFRQVXOWDQWV
SDUWLFLSDWHLQSURMHFWWHDPVZKRUHPDLQDQGZRUNDWWKHFOLHQWVLWHIRUPRQWKVRUHYHQ\HDUVWR
GHYHORS FXVWRPEXLOG DSSOLFDWLRQV 7KH FRQVXOWDQWV GRFXPHQW WKHLU SURMHFWV LQ SURMHFW ILOHV
ZKLFKFROOHFWLYHO\VHUYHDVWKHFRPSDQ\¶VH[SHULHQFHEDVH$VWKHFRPSDQ\DQGWKHQXPEHU
RI SURMHFWV JURZ DWWHPSWV DUH XVXDOO\ PDGH WR V\VWHPDWL]H WKLV YDULHG DQG KLJKO\ FRQWH[W
VSHFLILF H[SHULHQFH DQG WR H[WUDFW WKH FRPPRQ VXFFHVV DQG IDLOXUH IDFWRUV LQ RUGHU WR
JHQHUDOL]HUXOHVRIWKXPEIRUJRRGVRIWZDUHGHYHORSPHQWSUDFWLFH2YHUWLPHWKHVHLQIRUPDO
JXLGHOLQHVHYROYHLQWRVWDQGDUGOLIHF\FOHPRGHOVZKLFKGHILQHWKHVHTXHQFHRIWDVNVLQHDFK
VWDJHRIWKHPRGHOVDVZHOODVWKHFRQFHSWXDOIUDPHZRUNZLWKLQ ZKLFK LQIRUPDWLRQ V\VWHPV
VKRXOG EH GHYHORSHG IRU VSHFLILF FOLHQWV 7KH OLIHF\FOH PRGHOV WKXV JURZV RXW RI WKH GDLO\
DFWLYLWLHV RI FRQVXOWDQWV ZRUNLQJ RQ FOLHQW SURMHFWV 7KURXJK VXFK IRUPDOL]DWLRQ SURFHVVHV
WKHUHIRUHZHDUHDEOHWRH[WHUQDOL]HPXFKRIWKHWDFLWNQRZOHGJHRIH[SHULHQFHGFRQVXOWDQWV
LQWRH[SOLFLWPRGHOVRIWKHVRIWZDUHGHYHORSPHQWSURFHVV
:KHQ FRQVWUXFWLQJ PRGHOV RU V\VWHPV KRZHYHU RQO\ SDUWV RI WKH ORFDO UHDOLW\ ZLOO EH
H[WHUQDOL]HGVLQFH³7KHSURJUDPLVIRUHYHUOLPLWHGWRZRUNLQJZLWKLQWKHZRUOGGHWHUPLQHGE\
WKH SURJUDPPHU¶V H[SOLFLW DUWLFXODWLRQ RI SRVVLEOH REMHFWV SURSHUWLHV DQG UHODWLRQV DPRQJ
WKHP´ :LQRJUDGDQG)ORUHVS 6XFKPRGHOLQJFUHDWHVDEOLQGQHVVWKDWLVOLPLWHG
WRZKDWFDQEHH[SUHVVHGLQWKHWHUPVWKDWWKHRUJDQL]DWLRQKDVDGRSWHG$OWKRXJKWKLVLVDQ
XQDYRLGDEOH SURSHUW\ RI PRGHOV DQG WHFKQRORJ\ WKH VRIWZDUH RUJDQL]DWLRQ VKRXOG
QHYHUWKHOHVVEHDZDUHRIWKHOLPLWDWLRQVWKDWDUHLPSRVHG
0RVWRIWHQWKHEOLQGQHVVWKDWLVFUHDWHGE\WKHXVHRIFRPSXWHUV\VWHPVLVDEOLQGQHVVIRU
RWKHUSRVVLEOHORFDOUHDOLWLHVWKDQWKHUDWLRQDOLVWLFWUDGLWLRQ)XUWKHUPRUHLWVHHPVWKDWJURXSV
KROGLQJ ORFDO UHDOLWLHV ZKLFK DUH FORVH WR WKH UDWLRQDOLVWLF WUDGLWLRQ PRUH HDVLO\ JHW WKHLU
H[WHUQDOL]DWLRQV WKURXJK LQ WKHLU UHVSHFWLYH RUJDQL]DWLRQV ,QFLGHQWDOO\ H[HFXWLYH PDQDJHUV
DQGTXDOLW\PDQDJHUVDUHWKHRQHVLQVRIWZDUHRUJDQL]DWLRQVWKDWPRVWHDVLO\FDQEHDVVRFLDWHG
ZLWK WKLV WUDGLWLRQ 7KHLU ORFDO UHDOLWLHV DUH PRUH HDVLO\ H[WHUQDOL]HG QRW MXVW EHFDXVH LW LV
HDVLHUWRH[WHUQDOL]HDQDEVWUDFWDQGGHFRQWH[WXDOL]HGYLHZRIWKHRUJDQL]DWLRQUDWKHUWKDQWKH
WDFLW DVVXPSWLRQV RI WKH GHYHORSHUV¶ FRQWH[WEDVHG NQRZLQJ EXW DOVR EHFDXVH WKH\ FDQ WDNH
DGYDQWDJH RI WKH RUJDQL]DWLRQ¶V DV\PPHWULFDO GLVWULEXWLRQ RI SRZHU 6LQFH PDQDJHUV KDYH D
JUHDWHU LQIOXHQFH RQ GHFLVLRQPDNLQJ DQG DOORFDWLRQ RI UHVRXUFHV WKDQ RWKHU RUJDQL]DWLRQDO
PHPEHUVLWLVHDVLHUIRUWKHPWRH[WHUQDOL]HWKHPVHOYHVDQGPDNHWKHLUZRUOGYLHZGRPLQDWH
ZKDWLVFRQVLGHUHGLPSRUWDQWIRUWKHRUJDQL]DWLRQ¶VPHPRU\
:HKDYHXVHGVHYHUDONQRZOHGJHFUHDWLRQWHFKQLTXHVDVSDUWRIWKLVVWXG\WRH[WHUQDOL]H
HYDOXDWHDQGRUJDQL]HQHZNQRZOHGJH$PRQJWKHPRVWZLGHO\XVHGZDVWKH*40DSSURDFK
GHVFULEHGLQ&KDSWHU WKH.- 0HWKRG 6FXSLQ DQG0LQG 0DSV %X]DQ DQG %X]DQ
 &RPPRQWRWKHVHWHFKQLTXHVLVWKDWWKH\KHOSDJURXSRIGHYHORSHUVWRFUHDWHLGHDVDQG

±±
&+$37(5

DUWLFXODWH WKHLU NQRZOHGJH WKURXJK WZR SKDVHV 'XULQJ WKH GLYHUJHQW WKLQNLQJ SKDVH WKH
SDUWLFLSDQWV DUWLFXODWH NH\ ZRUGV SKUDVHV JRDOV TXHVWLRQV RU PHWULFV ZKLFK WKH\ WKLQN DUH
UHOHYDQW IRU WKH GLDORJXH ,Q *40 WKHVH FRQFHSWV DUH GRFXPHQWHG LQ *40 DEVWUDFWLRQ
VKHHWVZKLOHWKH.-PHWKRGXVHVOHVVVWUXFWXUHG3RVWLW1RWHVDQG0LQG0DSVXVHVDSLFWXUH
RIZRUGV
'XULQJ WKH FRQYHUJHQW WKLQNLQJ SKDVH JURXSV XVLQJ *40 FRPELQH WKHLU DEVWUDFWLRQ
VKHHWV LQWR RQH VKHHW SHU JRDO DQG MRLQWO\ WU\ WR UHVROYH DQ\ FRQIOLFWV DQG LQFRQVLVWHQFLHV
:LWKWKH.-PHWKRGWKHSDUWLFLSDQWVRUJDQL]HWKHLU3RVWLW1RWHVLQWRORJLFDO JURXSVZKLFK
DUHWKHQUHODWHGLQWRDGLDJUDPRIFRQFHSWVDQGLGHDVDVWKHFRQFOXVLRQ,QDVLPLODUZD\0LQG
0DSVDUHXVHGWRRUJDQL]HFRQFHSWVE\SODFLQJHDFKLGHDQH[WWRZKDWLWLVUHODWHGWR
7KLV GLDOHFWLF RI GLYHUJHQW DQG FRQYHUJHQW LQTXLU\ IDFLOLWDWHV WKH VXUIDFLQJ RI KLGGHQ
DVVXPSWLRQV 7KH FROODERUDWLYH QDWXUH RI WKHVH SURFHVVHV DQG WKH XWLOL]DWLRQ RI ILJXUDWLYH
ODQJXDJHIRUFRQFHSWFUHDWLRQDUHZKDWLQRXUH[SHULHQFHPDNHWKHVHWHFKQLTXHVVRSRZHUIXO
WRROVIRUFROOHFWLYHO\H[WHUQDOL]LQJWKHWDFLWNQRZOHGJHRIDJURXSRIVRIWZDUHGHYHORSHUVDQG
WKXVJHQHUDWLQJQHZRUJDQL]DWLRQDONQRZOHGJH
$UWLFXODWLQJWDFLWNQRZOHGJHDQGFUHDWLQJQHZH[SOLFLWFRQFHSWVLVQRWHQRXJK)RUQHZ
NQRZOHGJH WR EH XVHIXO IRU RWKHUV RXWVLGH WKH WHDP LW PXVW DOVR EH SDFNDJHG .QRZOHGJH
JDLQHGORFDOO\VKRXOGEHFRQVROLGDWHGDQGJOREDOL]HGLQWKHIRUPRIH[SHULHQFHSDFNDJHVDQG
VWRUHGLQDQ2UJDQL]DWLRQDO0HPRU\,QIRUPDWLRQ6\VWHP 20,6 RU([SHULHQFH%DVHVRLWLV
DYDLODEOHIRUIXWXUHSURMHFWV,QSULQFLSOHPRVWNLQGVRIH[SHULHQFHFDQEHH[WHUQDOL]HGSDFN
DJHG DQG PDGH DYDLODEOH LQ WKH RUJDQL]DWLRQ¶V H[SHULHQFH EDVH IRU H[DPSOH %DVLOL HW DO
D 

x 3URGXFWSDFNDJHV HJSURJUDPVDUFKLWHFWXUHVGHVLJQV 
x 3URFHVVSDFNDJHV HJSURFHVVPRGHOVPHWKRGV 
x 5HODWLRQVKLSSDFNDJHV HJFRVWDQGGHIHFWPRGHOVUHVRXUFHPRGHOV 
x 7RROSDFNDJHV HJVWDWLFDQDO\]HUVUHJUHVVLRQWHVWHUV 
x 0DQDJHPHQWSDFNDJHV HJPDQDJHPHQWKDQGERRNVGHFLVLRQVXSSRUWPRGHOV 
x 'DWDSDFNDJHV HJSURMHFWGDWDEDVHVTXDOLW\UHFRUGV 

6WLOOHDFKRUJDQL]DWLRQPXVWGHFLGHIRULWVHOIZKDWNQRZOHGJHQHHGVWREHSDFNDJHGEDVHGRQ
LWV EXVLQHVV YDOXHV DQG QHHGV )XUWKHUPRUH VLQFH IDFHWRIDFH LQWHUDFWLRQV QHHG WR EH KLJK
ZKHQ WUDQVIHUULQJ QHZ FRQFHSWV WR D GLIIHUHQW ORFDWLRQ HDFK H[SHULHQFH SDFNDJH VKRXOG EH
LQGH[HGZLWKORFDODUHDVRIH[SHUWLVHDQGUHIHUHQFHVWRJURXSVRULQGLYLGXDOVZKRFDQKHOSWKH
UHFHLYLQJ XQLW 0RUHRYHU WKH RUJDQL]DWLRQ VKRXOG GHFLGH RQ KRZ LWV H[SHULHQFH SDFNDJHV
VKRXOGEHVWRUHGLQRUJDQL]DWLRQDOPHPRU\
+RZHYHU XVHIXO WHFKQLTXHV D VRIWZDUH RUJDQL]DWLRQ PLJKW XVH IRU WKH DUWLFXODWLRQ RI
H[SOLFLW NQRZOHGJH DQG H[SHULHQFH SDFNDJLQJ WKH ORFDO NQRZLQJ FDQ QHYHU EH IXOO\
UHSUHVHQWHG LQ RUJDQL]DWLRQDO PHPRU\ &RQWH[WXDO LQIRUPDWLRQ LV LQHYLWDEO\ ORVW LQ WKLV
SURFHVV DQG ZKDW LV VWRUHG LQ RUJDQL]DWLRQDO PHPRU\ ZLOO EH D GHFRQWH[WXDOL]HG VXEVHW RI
ORFDO NQRZOHGJH 7KHUHIRUH SURSHU FRQVLGHUDWLRQ RI KRZ PHPRU\ REMHFWV ZLOO EH
GHFRQWH[WXDOL]HG DQG WKHQ UHFRQWH[WXDOL]HG LQ IXWXUH XVH LV QHFHVVDU\ :H PXVW LQ RWKHU
ZRUGV EH DEOH WR FRQVLGHU WKH SUHVHQW WKURXJK WKH OHQV RI IXWXUH DFWLYLW\ $FNHUPDQ DQG
+DOYHUVRQ 

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

,Q WKH QH[W VHFWLRQ ZH GHVFULEH WKH SURFHVV RI LQFRUSRUDWLQJ H[SHULHQFH SDFNDJHV LQWR
RUJDQL]DWLRQDOPHPRU\WRJHWKHUZLWKH[DPSOHVRIW\SLFDOO\REVHUYHGPHPRU\FDWHJRULHV

 2UJDQL]DWLRQDOPHPRU\
2UJDQL]DWLRQDOPHPRU\LVDJHQHULFFRQFHSWXVHGWRGHVFULEHDQRUJDQL]DWLRQ¶VFDSDELOLW\IRU
DGRSWLRQUHSUHVHQWDWLRQDQGVKDULQJRIQHZEHOLHIVNQRZOHGJHRUSDWWHUQVIRUDFWLRQ ,WLV
HVVHQWLDOIRURUJDQL]DWLRQDOOHDUQLQJDQG63,WRRFFXUE\HPEHGGLQJRUJDQL]DWLRQDOPHPEHUV¶
GLVFRYHULHV LQYHQWLRQV DQG HYDOXDWLRQV 6RPHWLPHV WKLV PD\ UHTXLUH RIILFLDO DFWLRQ DQG
LVVXLQJUHYLVHGUHJXODWLRQVRURSHUDWLQJJXLGHOLQHV+RZHYHUVLQFHHDFKORFDOJURXSZLWKLQDQ
RUJDQL]DWLRQ KDV LWV RZQ FXOWXUH LW DOVR UHTXLUHV LQIRUPDO DFFHSWDQFH E\ HQRXJK RSLQLRQ
OHDGHUVDQGUDQNDQGILOHPHPEHUVIRULWWREHGLVVHPLQDWHGDVYDOLGDQGYDOXHGNQRZOHGJH
,QRWKHUZRUGVWKDWZKLFKLVDFFHSWHGLQRQHSDUWRIDQRUJDQL]DWLRQPD\RUPD\QRWEH
SDVVHGRQWRRWKHUXQLWVRU SDUWV RI WKH RUJDQL]DWLRQ ± RQH XQLW¶V NQRZLQJ FRXOG EH DQRWKHU
XQLW¶VUXEELVKRUKHUHV\7KXVOHVVRQVOHDUQHGFDQQRWHDVLO\EHWUDQVIHUUHGIURPRQHVHWWLQJWR
DQRWKHU$OVRKLJKHUOHYHOVRIWKHSRZHUVWUXFWXUHFDQGHVWUR\WKHOHDUQLQJRIORZHUOHYHOVDV
DPDWWHURISROLF\RUHYHQDVDPDWWHURIQHJOHFWRULQGLIIHUHQFH±H[FHSWVRPHWLPHV LQ WKH
FDVHRIDVWURQJFRXQWHUFXOWXUHDULVLQJRXWRIORQJFRQIOLFWDQGVKDUHGJULHYDQFH0HPRULHV
DUHWKXVFRRSHUDWLYHO\FUHDWHGDQGXVHGWKURXJKRXWWKHRUJDQL]DWLRQDQGLQWXUQLQIOXHQFH
WKHOHDUQLQJDQGVXEVHTXHQWDFWLRQVWKDWDUHWDNHQE\WKHORFDOJURXSVLQWKHRUJDQL]DWLRQ
(DFK WLPH D VRIWZDUH RUJDQL]DWLRQ UHVWUXFWXUHV LWVHOI WKH FRQWHQWV RI LWV PHPRU\ DUH
DIIHFWHG6LQFHPXFKRIWKHRUJDQL]DWLRQ¶VPHPRU\LVVWRUHGLQKXPDQKHDGVDQGRQO\DOLWWOH
RI LW LV SXW GRZQ RQ SDSHU RU KHOG LQ FRPSXWHU PHPRULHV WXUQRYHU RI SHUVRQQHO LV D JUHDW
WKUHDWWRORQJWHUPRUJDQL]DWLRQDOPHPRU\:KHQH[SHUWVOHDYHWKHFRVWVWRWKHRUJDQL]DWLRQ
DUHHYHQJUHDWHUEHFDXVHLWWDNHV \HDUVRIHGXFDWLRQWUDLQLQJDQGH[SHULHQFHWREHFRPHRQH
6LPRQ /RVVRIVXFKNQRZOHGJHFDQXQGHUPLQHWKHFRPSHWHQFHDQGFRPSHWLWLYHQHVV
RIWKHRUJDQL]DWLRQDQGFDQDOVRKDYHDVHULRXVLPSDFWRQFXOWXUDOQRUPVDQGYDOXHV
7KXV D EHWWHU XQGHUVWDQGLQJ RI RUJDQL]DWLRQDO PHPRU\ DQG LWV UROH LQ RUJDQL]DWLRQDO
OHDUQLQJ FDQ KHOS VRIWZDUH RUJDQL]DWLRQV LQ IUDPLQJ DQG VROYLQJ SUREOHPV UHODWHG WR WKH
XWLOL]DWLRQRIRUJDQL]DWLRQDO NQRZOHGJH DQG WKH LPSURYHPHQW RI WKHLU VRIWZDUH GHYHORSPHQW
SURFHVVHV7KLVLVDOVRDWWKHKHDUWRIWKH([SHULHQFH)DFWRU\ZKLFKZDVGLVFXVVHGLQ&KDSWHU
+RZHYHUZHVKRXOGEHFDUHIXOQRWWRDVVXPHWKDWWKHDYDLODELOLW\RIRUJDQL]DWLRQDOPHPRU\
QHFHVVDULO\ OHDGV WR RUJDQL]DWLRQV WKDW DUH HIIHFWLYH LW FDQ DOVR OHDG WR ORZHU OHYHOV RI
HIIHFWLYHQHVVDQGLQIOH[LELOLW\ :HLFN 
%DVHGRQ:DOVKDQG8QJVRQ¶V  GHILQLWLRQZHIRFXVRQRUJDQL]DWLRQDOPHPRU\DV
WKHPHDQVE\ZKLFKDVRIWZDUHRUJDQL]DWLRQ¶VNQRZOHGJHIURPWKHSDVWLVEURXJKWWREHDURQ
SUHVHQW DFWLYLWLHV 7KLV GHILQLWLRQ PDNHV QR DVVXPSWLRQV UHJDUGLQJ WKH LPSDFW RI
RUJDQL]DWLRQDO PHPRU\ RQ RUJDQL]DWLRQDO HIIHFWLYHQHVV VLQFH WKLV GHSHQGV RQ WKH ZD\V LQ
ZKLFK WKH PHPRU\ LV EURXJKW WR XVH )RU H[DPSOH ZKHQ RUJDQL]DWLRQDO NQRZOHGJH LV
FRQVLVWHQWZLWKWKHJRDOVRIWKHRUJDQL]DWLRQRUJDQL]DWLRQDOPHPRU\FDQEHVDLGWRFRQWULEXWH
WRRUJDQL]DWLRQDOHIIHFWLYHQHVV$WWKHRWKHUH[WUHPHRUJDQL]DWLRQDOPHPRU\FDQEHVHHQDVD
VWUXFWXUHWKDWREMHFWLYDWHVDIL[HGUHVSRQVHWRVWDQGDUGSUREOHPVWKDWFRQVWUDLQVDQGWKUHDWHQV
WKHYLDELOLW\RIRUJDQL]DWLRQVRSHUDWLQJLQWXUEXOHQWHQYLURQPHQWV

±±
&+$37(5

7DEOH0HPRU\FDWHJRULHVDQGH[DPSOHVRIW\SLFDOHOHPHQWV

0HPRU\&DWHJRU\ 7\SLFDO(OHPHQWV

:RUOGYLHZ &XOWXUHEHOLHIVDVVXPSWLRQVYDOXHVQRUPVVWUDWHJLHVSRZHUUHODWLRQV
V\PEROVKDELWVH[SHFWDWLRQV
6WUXFWXUH 7DVNVWUXFWXUHUROHVEHKDYLRUIRUPDOL]DWLRQFRRUGLQDWLQJPHFKDQLVPV
XQLWJURXSLQJZRUNSODFHHFRORJ\
3ODQVDQGPRGHOV /LIHF\FOHPRGHOVDVVHVVPHQWPRGHOVSURMHFWSODQVPLOHVWRQHSODQV
TXDOLW\SODQVLPSURYHPHQWSODQVPHDVXUHPHQWSODQVDFWLRQSODQV
6\VWHPV ,QIRUPDWLRQV\VWHPVWRROVDQGWHFKQLTXHVTXDOLW\FRQWUROV\VWHPV
WUDLQLQJV\VWHPVVRFLDOV\VWHPV
5RXWLQHV 5XOHVVWDQGDUGRSHUDWLQJSURFHGXUHVGHYHORSPHQWSURFHVVHV
/HVVRQVOHDUQHG ([SHULHQFHUHSRUWVDUWLFOHVPHPRVQHZVOHWWHUVVWRULHVIHHGEDFN
VHVVLRQVSHHUUHYLHZVSRVWPRUWHPUHYLHZV

7KHUHIRUHWKHPHPEHUVRIWKHVRIWZDUHRUJDQL]DWLRQPXVW WKHPVHOYHV GHWHUPLQH ZKDW WR GR


ZLWKWKH NQRZOHGJH WKH\ DFTXLUH LQ RUGHU WR PHHW WKH LQFRPSDWLEOH GHPDQGV RI FKDQJH DQG
VWDELOLW\2UJDQL]DWLRQDOPHPRU\FDQEHYLHZHGDVDVWUXFWXUHWKDWERWKHQDEOHVDFWLRQZLWKLQ
WKHVRIWZDUHRUJDQL]DWLRQE\SURYLGLQJDIUDPHZRUNIRUFRPPRQRULHQWDWLRQDQGDWWKHVDPH
WLPH OLPLWV WKH UDQJH RI DFWLRQ E\ FRQVWUDLQLQJ WKH SRVVLEOH ZD\V RI GHYHORSLQJ VRIWZDUH
7KXVMXVWDVRUJDQL]DWLRQDOPHPRU\SURYLGHVVWDELOLW\LWFDQDOVRVHUYHWREORFNFKDQJH
7REHXVHIXOIRUWKHVRIWZDUHRUJDQL]DWLRQDVDZKROHQHZO\FUHDWHGFRQFHSWVKDYHWREH
FRPPXQLFDWHG DQG H[SODLQHG WR RWKHUV ZKR KDYH QRW VKDUHG WKH FRQFUHWH H[SHULHQFH 7KLV
PHDQV WKDW WKH QHZ FRQFHSWV PXVW EH WXUQHG LQWR MXVWLILHG WUXH EHOLHIV DW WKH RUJDQL]DWLRQDO
OHYHO 7KLV WKHQ PDNHV MXVWLILFDWLRQ DQ HVVHQWLDO SURFHVV VLQFH WKH RUJDQL]DWLRQ PXVW GHFLGH
ZKHWKHUQHZFRQFHSWVDQGEHOLHIVDUHZRUWK\RIIXUWKHUDWWHQWLRQDQGLQYHVWPHQW YRQ.URJK
DQG *UDQG   7KHUH LV DQ LQKHUHQW GLDOHFWLF KHUH WKDW WKH MXVWLILFDWLRQ SURFHVV WULHV WR
EDODQFH 2Q WKH RQH KDQG QHZO\ JHQHUDWHG NQRZOHGJH KDV WR EH UHODWHG WR H[LVWLQJ
RUJDQL]DWLRQDO NQRZOHGJH LQ RUGHU WR EH DFFHSWDEOH DQG XQGHUVWDQGDEOH 2Q WKH RWKHU KDQG
QHZNQRZOHGJHFKDOOHQJHVWKHRUJDQL]DWLRQ¶VH[LVWLQJXQGHUVWDQGLQJRIWKHZRUOGWKURXJKLWV
QRYHOW\ SURYRNLQJ FRPSOH[ SURFHVVHV RI DUJXPHQWDWLRQ DQG MXVWLILFDWLRQ WR EH GHFLGHG LQ
IDYRURIWKHH[LVWLQJRUWKHQHZO\HPHUJLQJYLHZV
-XVWLILFDWLRQ SURFHVVHV DUH WKHUHIRUH LPSRUWDQW IRU WKH VRIWZDUH RUJDQL]DWLRQ¶V PHPRU\
VLQFHWKH\GHFLGHZKHWKHUQHZNQRZOHGJHLVUHMHFWHGDVLUUHOHYDQWRUXQLQWHUHVWLQJUHWXUQHG
WRWKHORFDOWHDPIRUIXUWKHUHODERUDWLRQRUDSSURSULDWHGDVMXVWLILHGWUXHEHOLHIDQGWKHUHIRUH
LQWHJUDWHGLQWRRUJDQL]DWLRQDOPHPRU\
$SDUW IURP WKH NQRZOHGJH KHOG E\ LQGLYLGXDO PHPEHUV RI WKH RUJDQL]DWLRQ DQG WKHLU
FROODERUDWLRQVZHKDYHREVHUYHGVHYHUDOFDWHJRULHVRIRUJDQL]DWLRQDOPHPRU\7KHVHPHPRU\
FDWHJRULHVDQGH[DPSOHVRIW\SLFDOHOHPHQWVDUHVKRZQLQ7DEOHDQGGHVFULEHGQH[W

x :RUOGYLHZ7KHVRIWZDUHRUJDQL]DWLRQ¶VZRUOGYLHZLVWKHFXOWXUHRUVKDUHG DVVXPSWLRQV
WKDWJRYHUQZKDWNLQGRIH[SHULHQFHLVEHOLHYHGWREHXVHIXOIRUGHDOLQJZLWKWKHIXWXUH
7KHUHIRUHWKHRUJDQL]DWLRQDODQGWHFKQRORJLFDOFKRLFHVPDGHE\DQRUJDQL]DWLRQLQRUGHU
WRLPSURYHLWVVRIWZDUHGHYHORSPHQWSURFHVVHVDUHFULWLFDOH[SUHVVLRQVRILWVZRUOGYLHZ
7\SLFDOO\ WKH ZRUOGYLHZ RI D VRIWZDUH RUJDQL]DWLRQ LV IRUPDOO\ H[SUHVVHG LQ EXVLQHVV

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

VWUDWHJLHV DQG SROLF\ VWDWHPHQWV RU LPSOLFLWO\ DVVXPHG E\ WKH FRQWHQW DQG VWUXFWXUH RI
RUJDQL]DWLRQDOURXWLQHV
x 6WUXFWXUH7KHPDLQFKDUDFWHULVWLFVRIDVRIWZDUHRUJDQL]DWLRQ¶VVWUXFWXUHDUHWKHZD\VLQ
ZKLFK LWV VRIWZDUH DFWLYLW\ LV GLYLGHG LQWR YDULRXV WDVNV DQG KRZ WKHVH WDVNV DUH
FRRUGLQDWHG WR GHYHORS VRIWZDUH ([DPSOHV RI RUJDQL]DWLRQDO VWUXFWXUHV DUH WKH
GHSDUWPHQWVDQGXQLWVRIWKHRUJDQL]DWLRQLWVV\VWHPVLWVPRGHOVDQGSODQVLWVPHHWLQJV
DQG LWV FRIIHH EUHDNV $OVR UROHV SURYLGH DQ HIIHFWLYH VWUXFWXUDO PHFKDQLVP E\
IXQFWLRQLQJ DV D GLVWULEXWHG UHSRVLWRU\ RI WDVN NQRZOHGJH DQG WKXV DV D OLQN EHWZHHQ
LQGLYLGXDODQGRUJDQL]DWLRQDOPHPRULHV
:RUNSODFHHFRORJ\LVDOVRDQLPSRUWDQWSDUWRIRUJDQL]DWLRQDOPHPRU\WKDWVKRXOGEH
FRQVLGHUHGLQDQ\FKDQJHSURFHVVZKLFKKHOSVVKDSHDQGUHLQIRUFHEHKDYLRUSUHVFULSWLRQV
ZLWKLQWKHRUJDQL]DWLRQ :DOVKDQG8QJVRQ 
x 3ODQV DQG PRGHOV $FFRUGLQJ WR WKH UDWLRQDOLVWLF WUDGLWLRQ SODQV DQG PRGHOV DUH
SUHUHTXLVLWH WR DFWLRQ DQG SUHVFULEH DW HYHU\ OHYHO RI GHWDLO KRZ WKH DFWLRQ VKRXOG EH
SHUIRUPHGWRDFFRPSOLVKVRPHSUHFRQFHLYHGHQG+RZHYHUWKHUDWLRQDOLVWLFDSSURDFKLV
QRWVXLWHGWRVLWXDWLRQVZKHUHWKHPLQGDQGWKHPRWLYDWLRQRIWKHZRUNHUPDWWHUPRUHWKDQ
KLV RU KHU DELOLW\ WR GR VLPSOH URXWLQH WDVNV $V LQ VRIWZDUH GHYHORSPHQW DQG 63, LQ
ZKLFKWKHZRUNUHTXLUHVWKHNQRZOHGJHDQGH[SHULHQFHRIWKHGHYHORSHUVLWDOVRUHTXLUHV
WKHGHYHORSHUV¶PRWLYDWLRQLQYROYHPHQWDQGFRPPLWPHQWWRVXFFHHG5HPRYLQJFRQWURO
RYHU WKH GHYHORSPHQW IURP WKH GHYHORSHUV KDV WKH HYHQWXDO HIIHFW RI GHVWUR\LQJ WKLV
PRWLYDWLRQ
&RQWUDU\WRWKHUDWLRQDOLVWLFSHUFHSWLRQVRIDOLQHDUUHODWLRQVKLSEHWZHHQSODQQLQJDQG
DFWLRQ 63, DFWLRQV RIWHQ RFFXU ZLWKRXW PXFK DGYDQFH SODQQLQJ ,QGHHG WKH LQGXVWULDO
LPSURYHPHQWSODQVGHYHORSHGLQ63,4GLGQRWLQDQ\VWURQJVHQVHGHWHUPLQHWKHVRIWZDUH
RUJDQL]DWLRQV¶ FRXUVHV RI DFWLRQ &RQVHTXHQWO\ ZH VKRXOG QRW OLPLW WKH FRQFHSW RI
RUJDQL]DWLRQDO PHPRU\ WR IRUPDO NQRZOHGJH VXFK DV VRIWZDUH PDQXDOV HPSOR\HH
KDQGERRNV WUDLQLQJ PDWHULDO HWF EXW DOVR DSSUHFLDWH LQIRUPDO NQRZOHGJH VXFK DV WDFLW
NQRZKRZH[SHUWLVHH[SHULHQFHVWRULHVHWFZKLFKDUHPRVWRIWHQLJQRUHGLQVRIWZDUH
RUJDQL]DWLRQV 7KHUHIRUH WKH NH\ LV QRW JHWWLQJ WKH ULJKW SODQV RU PRGHOV EXW HQDEOLQJ
NQRZOHGJHFUHDWLRQ
x 6\VWHPV/LNHSODQVDQGPRGHOVV\VWHPVDUHDOVRSDUWRIWKHUDWLRQDOLVWLFKHULWDJH7D\ORU
  IRU H[DPSOH FODLPHG WKDW ³,Q WKH SDVW WKH PDQ KDV EHHQ ILUVW LQ WKH IXWXUH WKH
V\VWHP PXVW EH ILUVW´ LELG S   7KH PRVW QRWDEOH V\VWHPV LQ VRIWZDUH RUJDQL]DWLRQV
DUHDVZHSRLQWHGRXWLQ&KDSWHUWKHVRFLDOV\VWHPRIVRIWZDUHGHYHORSHUVFRRSHUDWLQJ
ZLWKHDFK RWKHU DQG WKH WHFKQLFDO V\VWHP RI FRPSXWHUV WRROV PHWKRGV WHFKQLTXHV DQG
FRQWURO V\VWHPV 5DGLFDOO\ LPSURYHG SHUIRUPDQFH LQ VRIWZDUH RUJDQL]DWLRQV FDQ
WKHUHIRUH RQO\ EH DFKLHYHG WKURXJK ³WKH MRLQW RSWLPL]DWLRQ RI WKH VRFLDO DQG WHFKQLFDO
V\VWHPV´ 7ULVWS FUHDWLQJDV\QHUJ\WKDW\LHOGVPRUHWKDQFRXOGEHDFKLHYHG
VLPSO\ E\ DGGLQJ WKH WZR WRJHWKHU 0RUHRYHU ³$WWHPSWV WR RSWLPL]H IRU HLWKHU WKH
WHFKQLFDORUVRFLDOV\VWHPDORQHZLOOUHVXOWLQWKHVXERSWLPL]DWLRQRIWKHVRFLRWHFKQLFDO
ZKROH´ LELG 
/LNH+XEHU  ZHDFNQRZOHGJHWKHLPSRUWDQFHRILQIRUPDWLRQV\VWHPVLQVHUYLQJ
RUJDQL]DWLRQDO PHPRU\ ,W LV LPSRUWDQW WR QRWH KRZHYHU WKDW WKH VRIWZDUH RUJDQL]DWLRQ
KDV D FKRLFH UHJDUGLQJ LWV XVH RI VXFK V\VWHPV 5DWKHU WKDQ EHLQJ GHVLJQHG IRU FRQWURO
SXUSRVHVVXFKV\VWHPVVKRXOGEHGHVLJQHGWRHQDEOHH[SHULHQWLDOOHDUQLQJDQGWKHXVHRI

±±
&+$37(5

WHFKQRORJ\ WR HQKDQFH WKH VNLOOV RI WKH GHYHORSHUV UDWKHU WKDQ WR GHVNLOO WKHP &RUEHWW
 ±WR³LQIRUPDWH´UDWKHUWKDQWR³DXWRPDWH´WDVNV =XERII 
x 5RXWLQHV2UJDQL]DWLRQDOURXWLQHVDUHDPDMRUVRXUFHRIRUJDQL]DWLRQDONQRZOHGJH7KH\
DUH LPSRUWDQW EHFDXVH D ORW RI RUJDQL]DWLRQDO DFWLRQV DUH SHUIRUPHG DQG FRRUGLQDWHG
WKURXJKURXWLQHV &\HUWDQG0DUFK0DUFKDQG6LPRQ 7KH\DUH
DOVRLPSRUWDQWEHFDXVHWKHRUJDQL]DWLRQV¶DFFXPXODWHGH[SHULHQFHRIWHQWDNHVIRUP LQ D
VHWRIURXWLQHVWKDWFDQRXWODVWWKHSDUWLFXODURUJDQL]DWLRQDOPHPEHUVZKRILUVWGHYHORSHG
WKHP /HYLWWDQG0DUFK 
7KH IRUHPRVW XVH RI URXWLQHV DULVHV LQ UHSHWLWLYH VLWXDWLRQV ± XVHG LQ LQDSSURSULDWH
VLWXDWLRQVWKH\FDQKDYHDVHULRXVSUREOHPDWLFHIIHFW7KH\DUHOLNHD³WZRHGJHGVZRUG´
&RKHQDQG%DFGD\DQ ±WKH\DOORZHIILFLHQWFRRUGLQDWHGDFWLRQEXWDOVRLQWURGXFH
WKHULVNRIKLJKO\LQDSSURSULDWHUHVSRQVHV
x /HVVRQV OHDUQHG 0RVW VRIWZDUH RUJDQL]DWLRQV GR QRW GRFXPHQW WKHLU OHVVRQV OHDUQHG
+RZHYHU ODUJH SDUWV RI WKHVH OHVVRQV DUH VWLOO PDGH H[SOLFLW WKURXJK SHHU UHYLHZV
IHHGEDFNVHVVLRQVSRVWPRUWHPDQDO\VHVDQGWKHVWRULHVWROGE\RUJDQL]DWLRQDOPHPEHUV
GXULQJIDFHWRIDFHLQWHUDFWLRQ7KLVSDUWRIRUJDQL]DWLRQDOPHPRU\LVDOVRSHUFHLYHGE\
WKH GHYHORSHUV WR EH WKH PRVW LPSRUWDQW DQG UHOHYDQW IRU GHDOLQJ ZLWK WKH FRPSOH[
VLWXDWLRQV RI DFWXDO SUDFWLFH VHH &RQUDGL DQG '\En  DQG 6HFWLRQ   $ NH\
LQJUHGLHQWRIWKH/HDUQLQJ6RIWZDUH2UJDQL]DWLRQWKHUHIRUHLVWKDWLWLVDEOHWROHDUQIURP
H[SHULHQFHUDWKHUWKDQEHLQJERXQGE\LWVSDVW

)RU D VRIWZDUH GHYHORSPHQW WHDP WR EH DEOH WR UHXVH D PHPRU\ REMHFW OLNH DQ H[SHULHQFH
SDFNDJH LW PXVW EH UHFRQWH[WXDOL]HG DQG PDGH UHOHYDQW IRU WKH QHZ VLWXDWLRQ 7KDW LV WKH
PHPRU\ REMHFW PXVW EH UHXQGHUVWRRG IRU WKH GHYHORSHUV¶ FXUUHQW SXUSRVH $ SURSHU
XQGHUVWDQGLQJRI KRZ ORFDO NQRZLQJ LV ILUVW GHFRQWH[WXDOL]HG DQG DGRSWHG DV RUJDQL]DWLRQDO
PHPRU\ DQG WKHQ UHFRQWH[WXDOL]HG LQWR QHZ ORFDO NQRZLQJ LV RI FULWLFDO LPSRUWDQFH IRU WKH
XWLOL]DWLRQ RI RUJDQL]DWLRQDO PHPRU\ 7KLV SUREOHP KDV ODUJHO\ EHHQ XQQRWLFHG LQ
FRQWHPSRUDU\GHEDWHVRQH[SHULHQFHEDVHVZLWKLQ63,ZKLFKLVRIWHQOLPLWHGWRWKHWHFKQLFDO
FKDOOHQJHV RI LPSOHPHQWLQJ D GDWDEDVH +RZHYHU LI ZH GR QRW DGGUHVV WKH SUREOHPV RI
UHFRQWH[WXDOL]DWLRQWKHZKROHFRQFHSWRIRUJDQL]DWLRQDOPHPRU\DQGH[SHULHQFHEDVHVZLOOEH
PRUHRUOHVVXVHOHVV
7KHQH[WVHFWLRQGHVFULEHVKRZWKHRUJDQL]DWLRQ¶VPHPRU\FDQEHSXWEDFNLQWRXVHDQG
EHFRPHSDUWRIORFDONQRZLQJWKURXJKDSURFHVVRIFROOHFWLYHLQWHUSUHWDWLRQ

 &ROOHFWLYHO\LQWHUSUHWLQJWKHNQRZOHGJH
7KHFROOHFWLYHLQWHUSUHWDWLRQRINQRZOHGJHLVWKHSURFHVVRIPDNLQJRUJDQL]DWLRQDOPHPRU\DQ
LQWHJUDOSDUWRIORFDONQRZLQJE\PDNLQJVHQVHRXWRIWKHDFWLRQVV\VWHPVVWUXFWXUHVSODQV
PRGHOVDQGURXWLQHVLQWKHRUJDQL]DWLRQ7KURXJKWKLVSURFHVVWKHRUJDQL]DWLRQ¶VPHPRU\LV
UHFRQWH[WXDOL]HGDQG WDNHQ XS LQWR WKH SUDFWLFH RI ORFDO VRIWZDUH GHYHORSPHQW WHDPV ,W LV D
SURFHVVRI³UHH[SHULHQFLQJ´ 1RQDNDDQG7DNHXFKL RWKHUWHDP¶VH[SHULHQFHV
$PDMRUFRQIXVLRQLQPXFKRIWKHWKLQNLQJLQFRQWHPSRUDU\NQRZOHGJHPDQDJHPHQWDQG
63, LV WR HTXDWH HDV\ DFFHVV RI LQIRUPDWLRQ ZLWK OHDUQLQJ +RZHYHU WKHUH LV DQ LPSRUWDQW
GLIIHUHQFH EHWZHHQ SDVVLYHO\ UHFHLYLQJ LQIRUPDWLRQ DQG DFWLYHO\ LQWHUSUHWLQJ DQG PDNLQJ
VHQVHRILW:KHQDQLQGLYLGXDOVRIWZDUHGHYHORSHUUHFHLYHVLQIRUPDWLRQKHRUVKHUHODWHVWKDW

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

LQIRUPDWLRQWRSDVWPRPHQWVRIH[SHULHQFHLQRUGHUWRPDNHVHQVHRILW$QGDVZHQRWHGLQ
WKH SUHYLRXV FKDSWHU LW LV WKH GLIIHUHQFHV IURP ZKDW LV H[SHFWHG DQG QRW WKH DJUHHPHQWV
ZKLFK SURYLGH WKH SRVVLELOLWLHV IRU RUJDQL]DWLRQDO OHDUQLQJ DQG 63, 7KHUHIRUH ZH DWWHQG WR
WKDWZKLFKLVGLIIHUHQWIURPRXUFXUUHQWXQGHUVWDQGLQJVDQGIURPRXUH[SHFWDWLRQVLQRUGHUWR
FRPSDUHLWZLWKDOUHDG\H[WUDFWHGFXHV/HDUQLQJFDQRQO\EHVDLGWRKDYHWDNHQSODFHZKHQ
WKH LQGLYLGXDO KDV IRUPHG QHZ QHWZRUNV RI PHDQLQJ DQG QHZ UHIHUHQFH SRLQWV IRU IXWXUH
VHQVHPDNLQJSURFHVVHVIURPWKHLQIRUPDWLRQHQFRXQWHUHG
&ROOHFWLYHLQWHUSUHWDWLRQSURFHVVHVDUHVWLOOPRUHFRPSOH[1RWRQO\PXVWHDFKVRIWZDUH
GHYHORSHU HQJDJH LQ DQ LQGLYLGXDO SURFHVV RI VHQVHPDNLQJ KH RU VKH PXVW GR VR ZKLOH
VLPXOWDQHRXVO\ LQWHUDFWLQJ ZLWK RWKHU GHYHORSHUV %\ HQJDJLQJ LQ FROOHFWLYH LQWHUSUHWDWLRQ
HDFK GHYHORSHU LV LQIOXHQFHG E\ WKH PHDQLQJV KHOG E\ RWKHUV DQG LQ WXUQ LQIOXHQFHV WKH
PHDQLQJV RI RWKHUV 7KLV ZD\ HDFK GHYHORSHU FDQ EHWWHU XQGHUVWDQG WKH H[SHULHQFHV DQG
UHDVRQLQJ WKH RWKHU GHYHORSHUV DUH XVLQJ LQ WKHLU LQWHUSUHWDWLRQV DQG E\ FRPSDULVRQ
XQGHUVWDQG HDFK RWKHU¶V PHDQLQJV PRUH IXOO\ %DVHG RQ WKHVH LQWHUDFWLRQV WKH VRIWZDUH
GHYHORSHUV DUH LQ D SRVLWLRQ WR IRUP D FROOHFWLYH LQWHUSUHWDWLRQ RI WKH RUJDQL]DWLRQDO
NQRZOHGJHWKDWLVDYDLODEOHWRWKHP
7KHUHIRUH FROOHFWLYHO\ LQWHUSUHWLQJ RUJDQL]DWLRQDO NQRZOHGJH LQYROYHV DFWLYH
FRQVWUXFWLRQRINQRZOHGJHLQWKHIRUPRIDFWLYHIRUPXODWLRQDQGVROXWLRQWRSUREOHPVZLWKWKH
KHOSRIH[SOLFLWPRGHOVJXLGLQJURXWLQHVDQGIHHGEDFN7KLVKLJKOLJKWVDQLPSRUWDQWDVSHFWRI
WKH VRFLDO FRQVWUXFWLRQ RI 63, FROOHFWLYH LQWHUSUHWDWLRQ LV HIIHFWLYH QRW QHFHVVDULO\ DV D
IXQFWLRQRIVLPSOHLQWHUQDOL]DWLRQZLWKPRGHOHGLQIRUPDWLRQEHLQJWUDQVIHUUHGDFURVVDEDUULHU
IURPWKHRUJDQL]DWLRQWRWKHLQVLGHRIDWHDPRUZLWKLQIRUPDWLRQEHLQJWUDQVPLWWHG5DWKHU
WKHVH LQWHUSUHWDWLRQV DUH HIIHFWLYH WKURXJK SHULSKHUDO DQG DFWLYH SDUWLFLSDWLRQ /DYH DQG
:HQJHU ZKHUHE\WKH PHPEHUV RI D WHDP FROOHFWLYHO\ WUDQVIRUP WKHLU XQGHUVWDQGLQJV
DQG VNLOOV LQ IUDPLQJ DQG VROYLQJ D SUREOHP $FFRUGLQJ WR WKLV YLHZ LW LV WKH DFWLYH
FRQVWUXFWLRQ WKURXJK ILUVWKDQG H[SHULHQFH WKDW LV VR FUXFLDO WR OHDUQLQJ DQG 63, QRW VRPH
GLVWDQW JXLGDQFH RU XQLYHUVDO UXOH ,W VKRXOG WKXV EH FOHDU ZK\ D FRQVWUXFWLYLVW DSSURDFK
VKRXOGEHWUHDWHGDVDFORVHDOO\WRRUJDQL]DWLRQDOOHDUQLQJDQG63,
5DWKHUWKDQEHLQJWUDQVPLWWHGRULQWHUQDOL]HGNQRZOHGJHEHFRPHVMRLQWO\FRQVWUXFWHGLQ
WKHVHQVHWKDWLWLVQHLWKHUKDQGHGGRZQUHDG\PDGHIURPWKHRUJDQL]DWLRQQRUVRPHWKLQJD
WHDP FRQVWUXFWV SXUHO\ RQ LWV RZQ .QRZOHGJH XQGHUVWDQGLQJV DQG PHDQLQJV JUDGXDOO\
HPHUJH WKURXJK LQWHUDFWLRQ DQG EHFRPH GLVWULEXWHG DPRQJ WKRVH LQWHUDFWLQJ UDWKHU WKDQ
LQGLYLGXDOO\ FRQVWUXFWHG RU SRVVHVVHG )XUWKHUPRUH VLQFH NQRZOHGJH LV GLVWULEXWHG DPRQJ
SDUWLFLSDQWVLQDVSHFLILFDFWLYLW\FRQWH[WLWLVDVZHKDYHDOUHDG\DUJXHGQHFHVVDULO\VLWXDWHG
DVZHOO7KDWLVLQWLPDWHO\ZHOGHGWRWKHFRQWH[WDQGWKHDFWLYLW\LQZKLFKDQGE\PHDQVRI
ZKLFKLWLVFRQVWUXFWHG,PSRUWDQWO\WKHUHIRUHSDUWLFLSDWLRQEHFRPHVWKHNH\FRQFHSWKHUHDV
FRQWUDVWHG ZLWK DFTXLVLWLRQ FRQFHSWXDO FKDQJH VHUYLQJ DV ERWK WKH SURFHVV DQG WKH JRDO RI
OHDUQLQJ
,Q WKH SURFHVV RI IRUPLQJ FROOHFWLYH LQWHUSUHWDWLRQV LW LV LPSRUWDQW WKDW ZH GLVWLQJXLVK
EHWZHHQUHGXFLQJDPELJXLW\DQGUHGXFLQJXQFHUWDLQW\$PELJXLW\LVWKHODFNRIFODULW\DERXW
WKHWHFKQRORJLHVDQGSURFHVVHVRIVRIWZDUHGHYHORSPHQWZKHQWKHHQYLURQPHQWLVGLIILFXOWWR
LQWHUSUHWDQGZKHQFDXVHDQGHIIHFWDUHGLVFRQQHFWHGVRWKDWWKHRUJDQL]DWLRQLVXQDEOHWROLQN
LWVDFWLRQVWRWKHLUFRQVHTXHQFHV,WKDVPRUHWRGRZLWKWKHFRQIXVLRQRIPXOWLSOHPHDQLQJV
WKDQ ZLWK WKH DEVHQFH RI VXIILFLHQW TXDQWLWLHV RI LQIRUPDWLRQ 7KH ODFN RI PHDQLQJ GULYHV
VHQVHPDNLQJZKLOHWKHODFNRIFHUWDLQW\GULYHVGDWDFROOHFWLRQDQGLQIRUPDWLRQJDWKHULQJ³,Q
WKHFDVHRIDPELJXLW\SHRSOHHQJDJHLQVHQVHPDNLQJEHFDXVHWKH\DUHFRQIXVHGE\WRRPDQ\

±±
&+$37(5

LQWHUSUHWDWLRQVZKHUHDVLQWKHFDVHRIXQFHUWDLQW\WKH\GRVREHFDXVHWKH\DUHLJQRUDQWRIDQ\
LQWHUSUHWDWLRQV´ :HLFN  S   7KXV DSSURDFKHV WR PHDVXUHPHQWGULYHQ 63, FDQ
VXSSRUW WKH UHGXFWLRQ RI XQFHUWDLQW\ EXW WKH\ GRQ¶W QHFHVVDULO\ DVVLVW WKH VRIWZDUH
RUJDQL]DWLRQLQUHGXFLQJWKHDPELJXLW\WKDWLVHVVHQWLDOIRURUJDQL]DWLRQDOOHDUQLQJDQG63,
7KHSURFHVVRI³UHH[SHULHQFLQJ´RWKHUWHDP¶V H[SHULHQFHVLQYROYHVH[SHULPHQWLQJZLWK
RUJDQL]DWLRQDO NQRZOHGJH LQ ORFDO FRQWH[WV E\ ³JLYLQJ LW D WU\´ %DVHG RQ WKH FRQFHSWV RI
DPELJXLW\DQGXQFHUWDLQW\ZHFDQGLVWLQJXLVKEHWZHHQWZRW\SHVRIVXFKH[SHULPHQWVWKDWDUH
FUXFLDO IRU RUJDQL]DWLRQDO OHDUQLQJ DQG 63, K\SRWKHVLVWHVWLQJ H[SHULPHQWV DQG H[SORUDWRU\
H[SHULPHQWV +\SRWKHVLVWHVWLQJ H[SHULPHQWV DUH ILHOG H[SHULPHQWV GHVLJQHG WR UHGXFH WKH
RUJDQL]DWLRQ¶VXQFHUWDLQW\E\GLVFULPLQDWLQJDPRQJDOWHUQDWLYHH[SODQDWLRQVRUVROXWLRQVIURP
PDQ\ SRVVLELOLWLHV 7KLV LV WKH XVXDO ZD\ RI FRQGXFWLQJ SURFHVV LPSURYHPHQW H[SHULPHQWV
DFFRUGLQJWRWKHH[SHULPHQWDODSSURDFKGHVFULEHGLQ&KDSWHU2IVSHFLDOFRQFHUQWRXVKHUH
WKHUHIRUHLVWKHFRQGXFWRIH[SORUDWRU\H[SHULPHQWVWRUHGXFHDPELJXLW\
([SORUDWRU\ H[SHULPHQWVLQYROYHOHDUQLQJWKURXJKGLVFRYHU\HQFRXUDJLQJWKHIOH[LELOLW\
DQG UHVLOLHQFH QHHGHG WR FRSH ZLWK WKH VLWXDWLRQ DW KDQG :KHQ DPELJXLW\ LV KLJK WKH
NQRZOHGJHUHSUHVHQWHGE\WKHRUJDQL]DWLRQ¶VPHPRU\SURYLGHVOLWWOHVXSSRUW6RGXULQJWKLV
SKDVH RI WKH OHDUQLQJ F\FOH WKH IRFXV VKLIWV IURP MXVWLILFDWLRQ DQG H[SORLWDWLRQ RI H[LVWLQJ
NQRZOHGJHWRVNHSWLFLVPDQGH[SORUDWLRQRIQHZRSSRUWXQLWLHV
6XFK H[SORUDWLRQ LV RI XWPRVW LPSRUWDQFH LQ XQIDPLOLDU DQG DPELJXRXV VLWXDWLRQV %XW
VXFK H[SORUDWLRQ RU ³OHDUQLQJ E\ GRLQJ´ RQO\ ZRUNV ZKHQ D WHDP UHFHLYHV UDSLG DQG
XQDPELJXRXVIHHGEDFNRQLWVDFWLRQV+RZHYHULQWKHFRPSOH[UHDOLW\H[SHULHQFHGE\PRVW
VRIWZDUHWHDPVWKHFRQVHTXHQFHVRIWKHLUDFWLRQVDUHQHLWKHULPPHGLDWHQRUXQDPELJXRXV,Q
WKHVH VLWXDWLRQV HIIHFWLYH OHDUQLQJ FDQ QHYHUWKHOHVV EH DFKLHYHG E\ WKH XVH RI VLPXODWHG
HQYLURQPHQWVZKDW1RQDNDDQG.RQQR  WHUPHG³H[HUFLVLQJED´RU³PLFURZRUOGV´WR
XVH6HQJH¶V  WHUPLQRORJ\,QVXFKPLFURZRUOGVLWEHFRPHVSRVVLEOHIRUVRIWZDUHWHDPV
WR OHDUQ DERXW IXWXUH DQG GLVWDQW FRQVHTXHQFHV RI WKHLU DFWLRQV E\ H[SHULPHQWLQJ LQ
HQYLURQPHQWVWKDW³FRPSUHVVWLPHDQGVSDFH´ 6HQJH 
3URWRW\SHVDUHLPSRUWDQWH[DPSOHVRIPLFURZRUOGVZLWKLQRUJDQL]DWLRQDOOHDUQLQJDQG63,
WKDW HQDEOH WKH FROOHFWLYH LQWHUSUHWDWLRQ RI NQRZOHGJH 'HYHORSLQJ D SURWRW\SH LV DQ
H[SHULPHQWDODFWLYLW\PDLQO\FRQFHUQHGZLWKUHGXFLQJWKHLQKHUHQWXQFHUWDLQW\DQGDPELJXLW\
RIVSHFLILFDWLRQV 0DWKLDVVHQDQG6WDJH WKXVIDFLOLWDWLQJDVKDUHGXQGHUVWDQGLQJRIWKH
V\VWHPWREHGHYHORSHG
7KHUH DUH WZR PDLQ DSSURDFKHV WR H[SORUDWLRQ LQ 63, LQ ZKLFK SURWRW\SHV VHUYH DQ
LPSRUWDQWUROHSURELQJDQGOHDUQLQJDQGSLORWSURMHFWV,QSURELQJDQGOHDUQLQJWKHVRIWZDUH
RUJDQL]DWLRQ FRQVWUXFWV ³TXLFNDQGGLUW\´ PRFNXSV 7R EH XVHIXO IRU WKH OHDUQLQJ SURFHVV
WKHVH SURWRW\SHV VWLOO KDYH WR EH FORVH HQRXJK DSSUR[LPDWLRQV RI WKH ILQDO SURGXFW RU
GHYHORSPHQW SURFHVV 2WKHUZLVH VXFK H[SHULPHQWDWLRQ ZLOO EH RI OLWWOH YDOXH VLQFH
JHQHUDOL]DWLRQV ZLOO EH YLUWXDOO\ LPSRVVLEOH )XUWKHUPRUH WKH SURELQJ DQG OHDUQLQJ SURFHVV
VKRXOGEHGHVLJQHGDVDQLWHUDWLYHSURFHVVVLQFHLWLVKDUGO\SRVVLEOHWR³JHWLWULJKWWKHILUVW
WLPH´LQDQDPELJXRXVHQYLURQPHQW
3LORWSURMHFWVDUH SURMHFWV DLPHG DW RQOLQH H[SHULPHQWDWLRQ LQ UHDO VRIWZDUH SURMHFWV RU
ODUJHVFDOHVLPXODWLRQVLQVHSDUDWHGHPRQVWUDWLRQSURMHFWV VHH'\EnG 7\SLFDOO\SLORW
SURMHFWVDUHWKHILUVWSURMHFWVWRHPERG\SULQFLSOHVDQGDSSURDFKHVWKDWWKHRUJDQL]DWLRQKRSHV
WRDGRSWODWHURQDODUJHUVFDOH7KH\LPSOLFLWO\HVWDEOLVKSROLF\JXLGHOLQHVDQGGHFLVLRQUXOHV
IRUODWHUSURMHFWV7KH\RIWHQHQFRXQWHUVHYHUHWHVWVRIFRPPLWPHQWIURPHPSOR\HHVZKRZLVK
WRVHHZKHWKHUWKHUXOHVDQGSUDFWLFHVKDYHLQIDFWFKDQJHG7KH\DUHQRUPDOO\GHYHORSHGE\

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

VWURQJPXOWLIXQFWLRQDOWHDPVUHSRUWLQJGLUHFWO\WRVHQLRUPDQDJHPHQW$QGILQDOO\WKH\WHQG
WR KDYH RQO\ OLPLWHG LPSDFW RQ WKH UHVW RI WKH RUJDQL]DWLRQ LI WKH\ DUH QRW DFFRPSDQLHG E\
H[SOLFLW VWUDWHJLHV IRU WKH GLIIXVLRQ RI H[SHULHQFH DQG NQRZOHGJH JDLQHG IURP WKH SLORW
SURMHFWV *DUYLQ 
7KH FRQWH[W GHSHQGHQW LQIHUHQFHV RI SULRU H[SHULHQFH DQG PHPRU\ REMHFWV FDQ RQO\ EH
FDUULHG RYHU IURP RQH RUJDQL]DWLRQDO VLWXDWLRQ WR DQRWKHU WKURXJK D NLQG RI ³VHHLQJDV´
6FK|Q :KHQDVRIWZDUHWHDPPDNHVVHQVHRIDVLWXDWLRQLWSHUFHLYHVWREHXQLTXHLW
VHHVLWDVVRPHWKLQJDOUHDG\SUHVHQWLQWKHUHSHUWRLUHUHSUHVHQWHGE\RUJDQL]DWLRQDOPHPRU\
7KHUHIRUH³6HHLQJWKLVVLWXDWLRQDVWKDWRQHRQHPD\DOVRGRLQWKLVVLWXDWLRQDVLQWKDWRQH´
LELGSLWDOLFVLQRULJLQDO 

,W LV RXU FDSDFLW\ WR VHH XQIDPLOLDU VLWXDWLRQV DV IDPLOLDU RQHV DQG GR LQ WKH IRUPHU DV ZH
KDYHGRQHLQWKHODWWHUWKDWHQDEOHVXVWREULQJRXUSDVWH[SHULHQFHWREHDURQ WKHXQLTXH
FDVH,WLVRXUFDSDFLW\WRVHHDVDQGGRDVWKDWDOORZVXVWRKDYHDIHHOIRUSUREOHPVWKDWGR
QRWILWH[LVWLQJUXOHV«

5HIOHFWLRQLQDFWLRQLQDXQLTXHFDVHPD\EHJHQHUDOL]HGWRRWKHUFDVHVQRWE\JLYLQJULVHWR
JHQHUDO SULQFLSOHV EXW E\ FRQWULEXWLQJ WR WKH SUDFWLWLRQHU¶V UHSHUWRLUH RI H[HPSODU\ WKHPHV
IURPZKLFKLQWKHVXEVHTXHQWFDVHVRIKLVSUDFWLFHKHPD\FRPSRVHQHZYDULDWLRQV LELG
S 

&RQVHTXHQWO\ LQ RUGHU WR OHDUQ DQG LPSURYH WKHLU VRIWZDUH SURFHVVHV VRIWZDUH WHDPV FDQ
VRPHWLPHVILJXUHRXWKRZWRVROYHXQLTXHSUREOHPVRUPDNHVHQVHRISX]]OLQJSKHQRPHQDE\
PRGHOLQJWKHXQIDPLOLDURQWKHIDPLOLDU'HSHQGLQJRQWKHLQLWLDOSUR[LPLW\RUGLVWDQFHRIWKH
WZRWKLQJVSHUFHLYHGDVVLPLODUWKHIDPLOLDUPD\VHUYHDVDQ³H[HPSODU´RUDVD³JHQHUDWLYH
PHWDSKRU´IRUWKHXQIDPLOLDU 6FK|Q ,QERWKFDVHVWKHVRIWZDUHWHDPDUULYHVDWDQHZ
LQWHUSUHWDWLRQRIWKHSKHQRPHQDEHIRUHLWE\³UHIOHFWLQJLQDFWLRQ´RQDQHDUOLHUSHUFHSWLRQRI
VLPLODULW\
7KH XWLOLW\ RI DQ H[SHULHQFH SDFNDJH OLHV LQ LWV DELOLW\ WR JHQHUDWH H[SODQDWLRQ DQG
H[SHULPHQWDWLRQLQDQHZVLWXDWLRQ:KHQWKHH[SHULHQFHSDFNDJHLVFDUULHGRYHUWRWKHQHZ
VLWXDWLRQ LWV YDOLGLW\ PXVW EH HVWDEOLVKHG WKHUH E\ D QHZ URXQG RI H[SHULPHQWDWLRQ WKURXJK
ZKLFKLWLVYHU\OLNHO\WREHPRGLILHG7KHPRGLILHGH[SHULHQFHSDFNDJHWKDWUHVXOWVIURPWKLV
QHZURXQGRIH[SHULPHQWDWLRQPD\LQWXUQVHUYHDVDEDVLVIRUWUDQVIHU DQGUHFUHDWLRQWRD
QHZVLWXDWLRQ
6RIRURUJDQL]DWLRQDO OHDUQLQJ DQG 63, WR KDSSHQ RUJDQL]DWLRQDO PHPEHUV PXVW DFW RQ
WKHFROOHFWLYHLQWHUSUHWDWLRQVWKH\KDYHPDGH±VWDUWLQJDQHZF\FOHRIRUJDQL]DWLRQDOOHDUQLQJ
7KXVSXUSRVHIXO DFWLRQ DW WKH ORFDO OHYHO LV D PHDQV IRU WKH LQWHUSUHWDWLRQ RI RUJDQL]DWLRQDO
NQRZOHGJH DV ZHOO DV IRU WKH JHQHUDWLRQ RI QHZ NQRZOHGJH DQG FRQVHTXHQWO\ HVVHQWLDO IRU
RUJDQL]DWLRQDOOHDUQLQJDQG63,

 63,6XFFHVV
'HILQLQJ WKH GHSHQGHQW YDULDEOH LQ DQ\ VWXG\ RI 63, LV RI XWPRVW LPSRUWDQFH 'H/RQH DQG
0F/HDQ   +RZHYHU GHVSLWH DQ LQFUHDVLQJ QXPEHU RI VWXGLHV WU\LQJ WR LGHQWLI\ WKRVH
IDFWRUVWKDWFRQWULEXWHWR63,VXFFHVVWKHGHSHQGHQW YDULDEOHV LQ PRVW RI WKHVH VWXGLHV KDYH
EHHQKDUGWRSLQGRZQRUWKH\DUHZLWKRXWDGHTXDWHWKHRUHWLFDODQGSV\FKRPHWULFMXVWLILFDWLRQ
)RU H[DPSOH 6WHO]HU HW DO   DQG 6WHO]HU DQG 0HOOLV¶   VWXGLHV RI VXFFHVV IDFWRUV

±±
&+$37(5

KDYHXQFOHDUGHILQLWLRQVRI63,VXFFHVVDQGQRTXDQWLWDWLYHGDWDRQWKHUHODWLRQVKLSVEHWZHHQ
VXFFHVVIDFWRUVDQGVXFFHVV
,Q WKHLU VWXGLHV RI &00 H[SHULHQFH DQG UHVXOWV *ROGHQVRQ DQG +HUEVOHE   DQG
+HUEVOHEDQG*ROGHQVRQ  GHILQHG63,VXFFHVVLQWHUPVRIRUJDQL]DWLRQDOSHUIRUPDQFH
LQDGGLWLRQWRDVLQJOHLWHPRQKRZZHOOWKHDVVHVVPHQWILQGLQJVZHUHDGGUHVVHG7KH\GHILQHG
RUJDQL]DWLRQDO SHUIRUPDQFH ZLWK UHVSHFW WR VL[ SHUIRUPDQFH FKDUDFWHULVWLFV DELOLW\ WR PHHW
VFKHGXOH DQG EXGJHW FRPPLWPHQWV SURGXFW TXDOLW\ SURGXFWLYLW\ PRUDO DQG FXVWRPHU
VDWLVIDFWLRQ %XW WKH\ GLG QRW LQFOXGH WKHVH PHDVXUHV RI RUJDQL]DWLRQDO SHUIRUPDQFH LQ WKHLU
DQDO\VLVRIWKHIDFWRUVWKDWLQIOXHQFHGVXFFHVV
/LNH*ROGHQVRQDQG+HUEVOHE  DQG+HUEVOHEDQG*ROGHQVRQ  ERWK(O(PDP
HWDO  DQG(O(PDPHWDO  XVHGWKHVDPHVLQJOHLWHPGHSHQGHQWYDULDEOHUHODWHG
WRKRZVXFFHVVIXOO\WKHILQGLQJVDQGUHFRPPHQGDWLRQVRIDQDVVHVVPHQWKDGEHHQDGGUHVVHG
WRPRGHOWKHOLNHOLKRRGRI63,VXFFHVV+RZHYHUDVZHGLVFXVVLQ&KDSWHUVXFKVLQJOHLWHP
PHDVXUHVWHQGWREHKLJKO\XQUHOLDEOHDQGFRQVHTXHQWO\RITXHVWLRQDEOHYDOXHLQGHWHUPLQLQJ
WKH IDFWRUV IRU 63, VXFFHVV DOVR VHH '\En D 1XQQDOO\ DQG %HUQVWHLQ  6SHFWRU
 
2Q WKH RWKHU KDQG LQ WKHLU DVVHVVPHQW RI WKH HIIHFWLYHQHVV RI VRIWZDUH SURFHVVHV RQ
SURMHFW SHUIRUPDQFH 'HHSKRXVH HW DO   GHILQHG SURMHFW SHUIRUPDQFH LQ WHUPV RI WZR
GLPHQVLRQV VRIWZDUH TXDOLW\ DQG PHHWLQJ WDUJHWV ZKLFK LQFOXGHG VFKHGXOHV DQG EXGJHWV
)XUWKHUPRUH6DZ\HUDQG*XLQDQ  XVHGWKUHHSHUIRUPDQFHGLPHQVLRQVLQWKHLUVWXG\RI
WKHHIIHFWVRQVRIWZDUHGHYHORSPHQWSHUIRUPDQFHGXHWRWKHSURGXFWLRQPHWKRGVRIVRIWZDUH
GHYHORSPHQW DQG WKH VRFLDO SURFHVVHV RI KRZ VRIWZDUH GHYHORSHUV ZRUN WRJHWKHU 7KH
GLPHQVLRQVZHUHVWDNHKROGHUUDWHGSURGXFWTXDOLW\VWDNHKROGHUUDWHGWHDPSHUIRUPDQFHDQG
VHOIUHSRUWHG E\ WKH GHYHORSHUV  WHDP SHUIRUPDQFH (DFK RI WKH WKUHH SHUIRUPDQFH
GLPHQVLRQVZHUHRSHUDWLRQDOL]HGXVLQJPXOWLLWHPVFDOHVWKDWZHUHVKRZQWRKDYHKLJKIDFWRU
UHOLDELOLWLHV
$OVR *ROGHQVRQ HW DO E  XVHG WZR PXOWLLWHP GLPHQVLRQV RI VXFFHVV DV WKH
GHSHQGHQW YDULDEOH LQ D VXUYH\ RQ WKH GHWHUPLQDQWV RI VXFFHVV LQ VRIWZDUH PHDVXUHPHQW
SURJUDPV%RWKGLPHQVLRQVXVHRIPHDVXUHPHQWDQGRUJDQL]DWLRQDOSHUIRUPDQFHZHUHIRXQG
WRKDYHVDWLVIDFWRU\SV\FKRPHWULFSURSHUWLHV

 2UJDQL]DWLRQDOSHUIRUPDQFH
:H DUJXH WKDW RUJDQL]DWLRQDO SHUIRUPDQFH LV WKH XOWLPDWH FULWHULRQ IRU DQ\ 63, DFWLYLW\
3HUIRUPDQFH LV D FRPSOH[ FRQVWUXFW KRZHYHU UHIOHFWLQJ WKH FULWHULD DQG VWDQGDUGV XVHG E\
GHFLVLRQPDNHUVWRDVVHVVWKHIXQFWLRQLQJRIDVRIWZDUHRUJDQL]DWLRQ7KDWLVSHUIRUPDQFHLVD
YDOXH MXGJHPHQW RQ WKH UHVXOWV GHVLUHG IURP DQ RUJDQL]DWLRQ YDQ GH 9HQ DQG )HUU\  
7KLV LV DOVR UHIOHFWHG LQ WKH JRDORULHQWHG VWUDWHJLHV WR VRIWZDUH PHDVXUHPHQW DQG 63,
GHVFULEHGLQ&KDSWHU)RURXUSXUSRVHVZHQHHGDMRLQWPHDVXUHRISHUIRUPDQFHWKDWFDQEH
XVHG DFURVV D PXOWLWXGH RI RUJDQL]DWLRQV WR FRPSDUH WKH UHODWLRQVKLSV EHWZHHQ 63, VXFFHVV
DQGWKHIDFLOLWDWLQJIDFWRUV
'HVSLWH HVSRXVHG VWUDWHJLHV DERXW FXVWRPHU UHODWLRQVKLSV FRUH FRPSHWHQFLHV DQG
RUJDQL]DWLRQDO FDSDELOLWLHV WKH DVVHVVPHQW RI RUJDQL]DWLRQDO SHUIRUPDQFH KDV WUDGLWLRQDOO\
IRFXVHGRQORQJWHUPSURILWDELOLW\DQG ILQDQFLDOPHDVXUHV )RUPDQ\VRIWZDUHRUJDQL]DWLRQV
WKLV IRFXV RQ SURILWDELOLW\ KDV WXUQHG LQWR D JHQHUDO FRQFHUQ DERXW SURGXFWLYLW\ DQG
FRQVHTXHQWO\RQPHDVXULQJVXFFHVVLQVXFKWHUPVDVWKHQXPEHURIOLQHVRIFRGHSURGXFHGSHU

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

LQGLYLGXDOSHUGD\+RZHYHUQHLWKHUSURILWDELOLW\QRUSURGXFWLYLW\LQGLFDWRUVDUHVXIILFLHQWWR
SUHGLFW IXWXUH FRPSHWLWLYHQHVV LQ WKH VRIWZDUH EXVLQHVV ,Q WRGD\¶V WHFKQRORJLFDOO\ DQG
FXVWRPHUGULYHQ JOREDO FRPSHWLWLRQ ILQDQFLDO PHDVXUHV RI SHUIRUPDQFH RIWHQ SURYLGH SRRU
JXLGHOLQHVIRUVXFFHVV7KLVUHDOL]DWLRQZDVDOVRWKHPDLQGULYHUEHKLQGWKHGHYHORSPHQW RI
WKH %DODQFHG 6FRUHFDUG .DSODQ DQG 1RUWRQ    ZKLFK KLJKOLJKWV D PRUH JHQHUDO
DQGLQWHJUDWHGVHWRIPHDVXUHPHQWVWKDWOLQNFXUUHQWFXVWRPHUVLQWHUQDOSURFHVVHVHPSOR\HHV
DQGV\VWHPSHUIRUPDQFHWRORQJWHUPILQDQFLDOVXFFHVV
$VDIXQGDPHQWDOSDUWRIRXUPRGHOWKHUHIRUHZHQHHGDG\QDPLFFRQFHSWRI63,VXFFHVV
WKDW UHSUHVHQWV D VRIWZDUH RUJDQL]DWLRQ¶V FRPSHWLWLYHQHVV 3HUIRUPDQFH ZKLFK LV VRPHWKLQJ
DQRUJDQL]DWLRQGRHV SURFHVV RUDFKLHYHV RXWFRPH LVDFRQFHSWWKDWEHWWHUFDQVHUYHDVDQ
RSHUDWLRQDO WRRO IRU LPSURYHPHQW RI FRPSHWLWLYHQHVV WKDQ SXUH SURGXFWLYLW\ RU SURILWDELOLW\
PHDVXUHV %UHGUXS 
)XUWKHUPRUH VDWLVILHG FXVWRPHUV LV DQ LPSRUWDQW DVVHW IRU D VRIWZDUH RUJDQL]DWLRQ LW LV
WKH FRUQHUVWRQH RI DQ\ 740 SURJUDP DQG LW LV WKH PRVW LPSRUWDQW SULQFLSOH LQ WKH UHFHQW
UHYLVLRQ RI ,62  7KHUHIRUH WKH FXVWRPHU SHUVSHFWLYH VKRXOG EH D FHQWUDO SDUW LQ
DQ\PRGHORIDVRIWZDUHRUJDQL]DWLRQ¶VSHUIRUPDQFH
/\QFK DQG &URVV   GHILQHG FXVWRPHU VDWLVIDFWLRQ DV WKH GLIIHUHQFH EHWZHHQ WKH
FXVWRPHUV¶SHUFHLYHGSHUIRUPDQFHDQGWKHLUQHHGVDQGH[SHFWDWLRQV

&XVWRPHUVDWLVIDFWLRQ 3HUFHLYHGSHUIRUPDQFH±([SHFWDWLRQV

$FODVVLFSUREOHPKRZHYHU LV WKDW ERWK SHUIRUPDQFH DQG H[SHFWDWLRQV DUH VXEMHFWLYH WHUPV
DQGWKDWSHUIRUPDQFHDVVHHQIURPWKHVRIWZDUHRUJDQL]DWLRQFDQEHYLHZHGGLIIHUHQWO\WKDQ
SHUIRUPDQFH DV VHHQ IURP WKH FXVWRPHU 7\SLFDOO\ WKH FXVWRPHU ZLOO IRFXV RQ H[WHUQDO
SHUIRUPDQFH PHDVXUHV VXFK DV SULFH DQG GHOLYHU\ WLPH ZKLOH WKH VRIWZDUH RUJDQL]DWLRQ
IRFXVHV RQ LQWHUQDO SHUIRUPDQFH PHDVXUHV VXFK DV FRVW DQG OHDGWLPH 7KH UHODWLRQVKLSV
EHWZHHQ VXFK H[WHUQDO DQG LQWHUQDO SHUIRUPDQFH PHDVXUHV DUH WKHUHIRUH FULWLFDO IRU WKH
LQWHJUDWLRQ RI FXVWRPHU VDWLVIDFWLRQ LQ DQ\ PRGHO WKDW SXUSRUWV WR PHDVXUH 63, VXFFHVV
+RZHYHU LPSURYHG SURILWDELOLW\ LV QRW DQ DXWRPDWLF RXWFRPH RI 63, SURJUDPV WR LPSURYH
FXVWRPHUVDWLVIDFWLRQ
$OO VRIWZDUH SURFHVVHV DUH H[SHFWHG WR GHOLYHU D TXDOLW\ SURGXFW RQ VFKHGXOH DQG RQ
EXGJHWLQRUGHUWRDFKLHYHFXVWRPHUVDWLVIDFWLRQDQGWKHUHE\WRHQVXUHORQJWHUPSURILWDELOLW\
IRUWKHVRIWZDUHRUJDQL]DWLRQ0RUHRYHUWKHVHIXQGDPHQWDOFKDUDFWHULVWLFVKDYHLPSRUWDQFHWR
ERWK FXVWRPHUV DQG WKH VRIWZDUH RUJDQL]DWLRQ DQG WKH\ DUH WKHUHIRUH LPSRUWDQW IRU WKH
XQGHUVWDQGLQJDQGGHILQLWLRQRI63,VXFFHVV,QRWKHUZRUGV63,VKRXOGOHDGWR³EHWWHUIDVWHU
>DQG@FKHDSHUVRIWZDUHGHYHORSPHQW´ 6DQGHUV 7KLVLVDOVRFOHDULQ.UDVQHU¶V 
PRGHO RI WKH FKDOOHQJHV LQ VRIWZDUH GHYHORSPHQW SURMHFWV ZKLFK IRFXVHV RQ WKH G\QDPLF
UHODWLRQVKLSVEHWZHHQVRIWZDUHSURFHVVHVDQG WKH WKUHH RXWFRPH IDFWRUV FRVW VFKHGXOH DQG
TXDOLW\

±±
&+$37(5

7LPH

6RIWZDUH
SURFHVV

&RVW 4XDOLW\

)LJXUH7KHRUJDQL]DWLRQDOSHUIRUPDQFHGLPHQVLRQRI63,VXFFHVV

)URPWKHSUHFHGLQJGLVFXVVLRQZHKDYHLGHQWLILHGRUJDQL]DWLRQDOSHUIRUPDQFHDVDQLPSRUWDQW
GLPHQVLRQLQWKHPHDVXUHPHQWRI63,VXFFHVV)XUWKHUPRUHZHKDYHLGHQWLILHGWKHIROORZLQJ
WKUHHHOHPHQWVDVFHQWUDOFRQVWLWXHQWVRIRUJDQL]DWLRQDOSHUIRUPDQFHDVVHHQIURPDFXVWRPHU
VDWLVIDFWLRQSHUVSHFWLYH VHH)LJXUH 

x 7LPH7LPHWRPDUNHWKDVEHFRPHDFULWLFDOPHDVXUHIRUVRIWZDUHRUJDQL]DWLRQVLQWRGD\¶V
WXUEXOHQW PDUNHWV %HLQJ DEOH WR UHVSRQG UDSLGO\ DQG UHOLDEO\ WR FXVWRPHU UHTXHVWV DQG
FKDQJLQJ PDUNHW FRQGLWLRQV LV RIWHQ FULWLFDO IRU D VRIWZDUH RUJDQL]DWLRQ¶V FRPSHWLWLYH
QHVV ,QFOXGLQJ WLPHEDVHG PHWULFV DV SDUW RI WKH RUJDQL]DWLRQDO SHUIRUPDQFH PHDVXUH
WKHUHIRUH VLJQDOV WKH LPSRUWDQFH RI DFKLHYLQJ DQG FRQWLQXDOO\ UHGXFLQJ OHDGWLPHV IRU
PHHWLQJWDUJHWHGFXVWRPHUV¶H[SHFWDWLRQV<HWRWKHUFXVWRPHUVPD\EHPRUH FRQFHUQHG
ZLWKWKHUHOLDELOLW\RIOHDGWLPHVWKDQZLWKMXVWREWDLQLQJWKHVKRUWHVWSRVVLEOHOHDGWLPH
,QDGGLWLRQWROHDGWLPHRUF\FOHWLPHUHGXFWLRQVWKHUHIRUHPHDVXUHVRIRQWLPHGHOLYHU\
UDWH LPSURYHPHQW DQG VFKHGXOH VOLSSDJH UDWH UHGXFWLRQV FDQ DOVR EH XVHIXO WLPHEDVHG
LQGLFDWRUVRIFXVWRPHUVDWLVIDFWLRQDQGUHWHQWLRQ
x &RVW &XVWRPHUV ZLOO DOZD\V EH FRQFHUQHG ZLWK WKH SULFH WKH\ SD\ IRU SURGXFWV DQG
VHUYLFHV /RQJWHUP SURILWDELOLW\ WKHUHIRUH UHTXLUHV WKDW WKHUH LV D KHDOWK\ UHODWLRQVKLS
EHWZHHQSULFHDQGFRVWDQGFRQVHTXHQWO\WKDWZHLQFOXGHSURFHVVFRVWPHWULFVDVSDUWRI
WKH RUJDQL]DWLRQDO SHUIRUPDQFH PHDVXUH 3URFHVV FRVW LQFOXGHV WKH FRVW RI WKH SULPDU\
DFWLYLWLHV PDUNHWLQJ DQG VDOHV LQERXQG ORJLVWLFV RSHUDWLRQV RXWERXQG ORJLVWLFV DQG
VHUYLFH  DQG WKH VXSSRUW DFWLYLWLHV LQIUDVWUXFWXUH KXPDQ UHVRXUFH PDQDJHPHQW
WHFKQRORJ\ GHYHORSPHQW DQG SURFXUHPHQW  LQ WKH VRIWZDUH GHYHORSPHQW YDOXH FKDLQ
%RHKP DQG 3DSDFFLR   $OWKRXJK WKH PDMRU VRXUFH RI VRIWZDUH FRVWV LV WKH
³RSHUDWLRQV´ FRPSRQHQW YLUWXDOO\ DOO FRPSRQHQWV DUH VWLOO KLJKO\ ODERULQWHQVLYH
7KHUHIRUH HIIRUW LV IUHTXHQWO\ WKH SUHGRPLQDQW FRVW GULYHU IRU PRVW VRIWZDUH SURFHVVHV
([DPSOHV RI SRWHQWLDOO\ XVHIXO FRVW PHWULFV DUH UDWLR RI DFWXDO YHUVXV SODQQHG FRVW RI
ZRUNHIIRUWGHYHORSPHQWKRXUVVDYHGSURGXFWLYLW\LQFUHDVHVUHZRUNFRVWUHGXFWLRQDQG
UHXVHLQFUHDVHV

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

x 4XDOLW\8VLQJ WKH .DQR PRGHO .DQR HW DO   DV WKH IUDPH RI UHIHUHQFH ZH KDYH
ZLWQHVVHVDWHQGHQF\DPRQJODUJHFXVWRPHU JURXSVWKDWTXDOLW\LVQRWDOZD\V H[SUHVVHG
DV DQ H[SOLFLW UHTXLUHPHQW ± LW LV VR REYLRXV WKDW LW LV RIWHQ QRW HYHQ PHQWLRQHG
1HYHUWKHOHVVWKHFXVWRPHUV¶H[SHFWDWLRQVFRQVLVWRIERWKWKHH[SOLFLWO\VWDWHGIXQFWLRQDO
DQGQRQIXQFWLRQDOUHTXLUHPHQWVDQGWKHREYLRXVLPSOLFLWRUWDFLWUHTXLUHPHQWV7KLVLV
DOVRWKHIRFXVRIWKHTXDOLW\GHILQLWLRQLQ,62

4XDOLW\LVWKHWRWDOLW\RIIHDWXUHVDQGFKDUDFWHULVWLFVRIDSURGXFWRUVHUYLFHWKDW EHDURQ LWV


DELOLW\WRVDWLVI\VWDWHGRULPSOLHGQHHGV

+RZHYHU LQ FHUWDLQ SDUWV RI WKH VRIWZDUH LQGXVWU\ WKH VLWXDWLRQ LV VXFK WKDW H[FHOOHQW
TXDOLW\ PD\ VWLOO RIIHU RSSRUWXQLWLHV IRU FRPSDQLHV WR GLVWLQJXLVK WKHPVHOYHV IURP WKHLU
FRPSHWLWRUV,QDQ\FDVHFXVWRPHUSHUFHLYHGTXDOLW\LVDOZD\VUHOHYDQWWRLQFOXGHDVDQ
RUJDQL]DWLRQDOSHUIRUPDQFHPHDVXUH([DPSOHVRIVXFKTXDOLW\PHWULFVDUHGHIHFWGHQVLW\
UHGXFWLRQV DQG FXVWRPHU VDWLVIDFWLRQ LQFUHDVHV $Q LPSRUWDQW SDUW RI WKLV SLFWXUH
KRZHYHU LV WKDW WKH VRIWZDUH RUJDQL]DWLRQ PD\ QRW HYHQ EH DZDUH RI WKH XQVDWLVILHG
FXVWRPHUV ± WKH\ VLPSO\ FHDVH WR XVH WKH RUJDQL]DWLRQ¶V SURGXFWV RU VHUYLFHV
,QWHUHVWLQJO\DQ$PHULFDQVWXG\UHYHDOHGWKDWSHUFHQWRIXQKDSS\FXVWRPHUVQHYHUWHOO
WKHFRPSDQ\ .RWOHU 

7RVXPPDUL]HLIRXUJRDOLVWR DVVHVV WKH LPSURYHPHQW RI VRIWZDUH GHYHORSPHQW SURFHVVHV


WKHDELOLW\WRDQVZHUVWKH IROORZLQJ WKUHH TXHVWLRQV VKRXOG EH UHJDUGHG DV D FHQWUDO FRQFHUQ
IRUWKHPHDVXUHPHQWRIRUJDQL]DWLRQDOSHUIRUPDQFH

  $UHVRIWZDUHSURMHFWVGHOLYHUHGRQWLPH"
  $UHVRIWZDUHSURMHFWVGHOLYHUHGRQEXGJHW"
  $UHFXVWRPHUVVDWLVILHGZLWKWKHGHOLYHUHGVRIWZDUH"

 3HUFHLYHGOHYHORIVXFFHVV
8VLQJRUJDQL]DWLRQDOSHUIRUPDQFHDVWKHRQO\GLPHQVLRQRIVXFFHVVFDQ HQWDLOVRPHDGYHUVH
FRPSOLFDWLRQV 7KHVH FRPSOLFDWLRQV LQFOXGH WKH LQVWDELOLWLHV RI SHUIRUPDQFH DGYDQWDJHV WKH
FDXVDO FRPSOH[LW\ VXUURXQGLQJ SHUIRUPDQFH DQG WKH OLPLWDWLRQV RI XVLQJ GDWD EDVHG RQ
UHWURVSHFWLYHUHFDOORILQIRUPDQWV 0DUFKDQG6XWWRQ )XUWKHUPRUHWKHH[WHQWWRZKLFK
RUJDQL]DWLRQDO PHPEHUV¶ SHUFHSWLRQV RI 63, VXFFHVV UHIOHFW RUJDQL]DWLRQDO SHUIRUPDQFH LV
XQFOHDU DV LV WKH H[WHQW WR ZKLFK SHUFHSWLRQV DUH LQIOXHQFHG E\ WKH VRIWZDUH RUJDQL]DWLRQV¶
VWDQGDUGV %HVLGHV UHVHDUFK RQ ERWK LQGLYLGXDO DQG RUJDQL]DWLRQDO OHDUQLQJ LQGLFDWHV WKDW
LWHPVWKDWDUHSHUFHLYHGWREHLPSRUWDQWE\WKHSHUVRQVFRQFHUQHGZLOOEHSDLGPRUHDWWHQWLRQ
WRWKDQLWHPVSHUFHLYHGDVWDQJHQWLDOWRWKHVHSHUVRQV YDQGHU%HQWHWDO 
,I RUJDQL]DWLRQDO PHPEHUV¶ SHUFHSWLRQV GR QRW UHIOHFW RUJDQL]DWLRQDO SHUIRUPDQFH WKHQ
LQFUHDVHV RU GHFUHDVHV  LQ SHUIRUPDQFH ZLOO QRW QHFHVVDULO\ EH WUDQVODWHG LQWR LQFUHDVHG RU
GHFUHDVHG OHYHOVRISHUFHLYHG63,VXFFHVV$GHFUHDVHLQWKHSHUFHLYHGOHYHORIVXFFHVVIRU
H[DPSOHPD\RFFXUHLWKHUEHFDXVHWKHVRIWZDUHRUJDQL]DWLRQ¶VSHUIRUPDQFHKDVGHFUHDVHGRU
EHFDXVHWKHRUJDQL]DWLRQKDVQRWDGHTXDWHO\PDQDJHGWKHSHUFHSWLRQVRILWVPHPEHUV,QWKH
DEVHQFHRIGDWDDERXWWKHUHODWLRQVKLSVEHWZHHQDFWXDOSHUIRUPDQFHSHUFHLYHGSHUIRUPDQFH

±±
&+$37(5

DQG FXVWRPHU VDWLVIDFWLRQ WKHUHIRUH DVVHVVPHQWV RI 63, VXFFHVV LV D TXHVWLRQ RI ERWK
RUJDQL]DWLRQDOSHUIRUPDQFHDQGWKHSHUFHSWLRQVRIWKHRUJDQL]DWLRQ¶VPHPEHUV
7KXV WR JHW D IXOOHU SLFWXUH RI 63, VXFFHVV ZH LQFOXGH WKH VRIWZDUH RUJDQL]DWLRQV¶
SHUFHLYHG OHYHO RI VXFFHVV LQ DGGLWLRQ WR PHDVXUHV RI RUJDQL]DWLRQDO SHUIRUPDQFH LQ RXU
PRGHO+HQFH63,VXFFHVVZLOOEHPHDVXUHGDORQJWZRGLPHQVLRQV

  2UJDQL]DWLRQDOSHUIRUPDQFH LHWLPHFRVWDQGTXDOLW\ 
  7KHOHYHORISHUFHLYHG63,VXFFHVV

7KLVLVVLPLODUWRWKHDSSURDFKXVHGE\7HQJ HW DO   WR PHDVXUH UHHQJLQHHULQJ SURMHFW


VXFFHVV DQG WKH UHODWLRQVKLS EHWZHHQ FKDUDFWHULVWLFV RI UHHQJLQHHULQJ SURMHFWV DQG LPSOH
PHQWDWLRQ VXFFHVV 7KH\ PHDVXUHG VXFFHVV EDVHG RQ WZR GLIIHUHQW SHUVSHFWLYHV SHUFHLYHG
OHYHORIVXFFHVVDQGJRDOIXOILOOPHQW

 )DFLOLWDWLQJ)DFWRUV
,Q WKLV VHFWLRQ ZH IRFXV RQ WKH IDFLOLWDWLQJ IDFWRUV DQG WKHLU DVVRFLDWLRQV ZLWK WKH OHDUQLQJ
F\FOHDQG63,VXFFHVVE\DUWLFXODWLQJWKHWKHRUHWLFDOMXVWLILFDWLRQDQGGHWDLOHGFRQFHSWXDOL]D
WLRQ WKDW XQGHUOLH HDFK RI WKH IDFLOLWDWLQJ IDFWRUV %DVHG RQ WKHVH FRQFHSWXDOL]DWLRQV ZH
GHYHORS D QXPEHU RI K\SRWKHVHV UHJDUGLQJ WKH NH\ IDFWRUV IRU VXFFHVV LQ 63, 7KHVH
K\SRWKHVHV DUH VWDWLVWLFDOO\ IRUPXODWHG DQG WHVWHG LQ 6HFWLRQ  ZKLOH WKH GHWDLOV RI WKH
RSHUDWLRQDOL]DWLRQV QHFHVVDU\ IRU YDOLGDWLQJ DQG WHVWLQJ WKH K\SRWKHVHV DUH GHVFULEHG LQ
&KDSWHU  )XUWKHUPRUH )LJXUH  6HFWLRQ   SUHVHQWV WKH FRQFHSWXDO UHVHDUFK PRGHO
XQGHUO\LQJWKHTXDQWLWDWLYHK\SRWKHVLVWHVWLQJSDUWRIWKLVVWXG\
7KH EDVLV IRU WKLV ZRUN ZDV DQ H[WHQVLYH OLWHUDWXUH UHYLHZ ZLWKLQ WKH ILHOGV RI
RUJDQL]DWLRQGHYHORSPHQWDQGFKDQJHRUJDQL]DWLRQDOOHDUQLQJTXDOLW\PDQDJHPHQWDQG63,
FRPELQHGZLWKHPSLULFDO VWXGLHV LQ IRXU RI WKH FDVH FRPSDQLHV DQG D VXUYH\ RI 63, H[SHUWV
IURPERWKLQGXVWU\DQGDFDGHPLD VHH)LJXUHLQ6HFWLRQ 7KHFRPELQHGUHVXOWRIWKHVH
LQYHVWLJDWLRQV ZDV WKH LGHQWLILFDWLRQ RI WKH VL[ NH\ IDFLOLWDWLQJ IDFWRUV IRU 63, VXFFHVV
GHVFULEHG LQ WKLV VHFWLRQ EXVLQHVV RULHQWDWLRQ LQYROYHG OHDGHUVKLS HPSOR\HH SDUWLFLSDWLRQ
FRQFHUQ IRU PHDVXUHPHQW H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ
NQRZOHGJH

 %XVLQHVVRULHQWDWLRQ
$WWDLQLQJEXVLQHVVREMHFWLYHVLVWKHXOWLPDWHWDUJHWIRUDQ\FKDQJHSURJUDP %HHUHWDO
&XPPLQJV DQG :RUOH\   DQG WKH UROH RI SURFHVV RULHQWDWLRQ DQG SURFHVV LPSURYHPHQW
KDVORQJEHHQUHFRJQL]HGDVHVVHQWLDOIDFWRUVWRDFKLHYHEXVLQHVVH[FHOOHQFHDQGFRPSHWLWLYH
DGYDQWDJH )UHQFK  )UHQFK DQG %HOO   &RQVHTXHQWO\ D FOHDUO\ GHILQHG 63,
SURJUDPGULYHQE\VWUDWHJLFEXVLQHVVQHHGVKDYHEHHQVXJJHVWHGDVDNH\IDFWRUIRUVXFFHVVLQ
63, HJ *UDG\  .LWFKHQKDP  0F)HHO\  3XOIRUG HW DO  =DKUDQ
 
7KHUHIRUHZHZRXOGH[SHFWWKDWDVXFFHVVIXO63,SURJUDPLVRQHLQZKLFK63,JRDOVDQG
SROLFLHVKDYHEHHQFOHDUO\DOLJQHGZLWKEXVLQHVVJRDOVLGHQWLI\LQJWKHQDWXUHDQGGLUHFWLRQRI
DQ\63,DFWLRQV$OVRVHQLRUPDQDJHUVDUHEHFRPLQJLQFUHDVLQJO\DZDUHWKDW63,FDQEHWKH

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

SULQFLSDOPHDQVIRUVXFFHVVIXOO\EULQJLQJWKHLUSURGXFWVWRWKHPDUNHWZLQQLQJFRQWUDFWVDQG
UXQQLQJ WKHLU LQWHUQDO RSHUDWLRQV LI WKH\ DUH WR EH DGDSWLYH DQG WR VXUYLYH LQ FRPSOH[ DQG
UDSLGO\FKDQJLQJPDUNHWV %LUyDQG7XOO\%URGPDQDQG-RKQVRQ 
%HIRUH 63, FDQ EH DSSOLHG DV D XVHIXO EXVLQHVV RULHQWHG VWUDWHJ\ LQ D FKDQJLQJ
HQYLURQPHQWWKHUHPXVWEH DEDODQFHEHWZHHQORQJWHUPDQGVKRUWWHUPSODQQLQJ ,Q740
WKLV EDODQFH LV FDOOHG KRVKLQ PDQDJHPHQW DQG LV WKH SULPDU\ JXLGH WR LPSOHPHQW
LPSURYHPHQWV 8FKLPDUXHWDO 1RUPDOO\DORQJWHUPSODQ±VWUDWHJLFKRVKLQ±SRLQWV
WRZDUG WKH SODFH D FRPSDQ\ ZDQWV WR EH LQ WKUHH WR ILYH \HDUV ZKLOH D VKRUWWHUP SODQ ±
DQQXDOKRVKLQ±LQFOXGHVGHWDLOHGSURSRVLWLRQVWKDWPXVWEHH[HFXWHGZLWKLQD \HDU =XOWQHU
  ,GHDOO\ WKHQ ZHOOVHOHFWHG LPSURYHPHQW DFWLRQV VKRXOG EH EDVHG RQ ORQJWHUP
FRPSDQ\QHHGVDQGDWWKHVDPHWLPHEHLQJDEOHWRVXUYLYHRUJDQL]DWLRQDOFKDQJHV
+RZHYHU PRVW VRIWZDUH RUJDQL]DWLRQV DUH IDFLQJ LQFUHDVLQJO\ WXUEXOHQW DQG FRPSOH[
HQYLURQPHQWV ZKLFK UHTXLUHV D PRUH LPSURYLVDWLRQDO DSSURDFK WR LPSURYHPHQW WKDW
UHFRJQL]HVWKHQHHGIRUDGUDPDWLFDOO\VKRUWHUWLPHIUDPHEHWZHHQSODQQLQJDQGDFWLRQ '\En
E $IXQGDPHQWDOFKDOOHQJHLQ63,LVWKXVWRGHILQHDSODQQLQJKRUL]RQWKDWLVQHLWKHU
WRRORQJQRUWRRVKRUWIRUWKHRUJDQL]DWLRQ¶VEXVLQHVVVLWXDWLRQDQGHQVXUHWKDWWKHDFWLRQSODQ
LVGULYHQE\ERWKFXUUHQWDQGIXWXUHEXVLQHVVQHHGV
$ ILQDO FRQFHUQ LV WKDW 63, LV JHQHUDOO\ YLHZHG DV GLVWLQFW IURP ³UHDO ZRUN´ 7KLV
GLVWLQFWLRQ LV PDGH SDUWLFXODUO\ FOHDU ZLWKLQ WKH ³EHVW SUDFWLFH´ SDUDGLJP WR 63, ZKHUH
LPSURYHPHQWLVVHHQDVWKHWUDQVPLVVLRQRIH[SOLFLWDEVWUDFWNQRZOHGJHIURPVRPHRQHZKR
NQRZV WR VRPHRQH ZKR GRHV QRW +RZHYHU SUDFWLFH LV FHQWUDO WR XQGHUVWDQGLQJ VRIWZDUH
GHYHORSPHQWDQGFRQVHTXHQWO\DQ\DEVWUDFWLRQVGHWDFKHGIURPSUDFWLFHFDQQRWEHWKHEDVLV
RILPSURYLQJWKDWVDPHSUDFWLFH %URZQDQG'XJXLG2UU 
)XUWKHUPRUHOHDUQLQJWKHRULVWVVXFKDV/DYHDQG:HQJHU :HQJHU DQG&RRN
DQG %URZQ   KDYH UHMHFWHG FRQWH[WIUHH WUDQVIHU PRGHOV WKDW LVRODWH NQRZOHGJH IURP
SUDFWLFH 2Q WKH FRQWUDU\ WKH\ GHYHORSHG D YLHZ RI OHDUQLQJ DV VRFLDO FRQVWUXFWLRQ SXWWLQJ
NQRZOHGJH EDFN LQWR WKH FRQWH[WV LQ ZKLFK LW KDV PHDQLQJ 6XFK D VLWXDWHG DQG
LPSURYLVDWLRQDO DSSURDFK LV DOVR FORVH WR /HYL6WUDXVV¶V   FRQFHSW RI EULFRODJH WKH
DELOLW\ WR ³PDNH GR ZLWK µZKDWHYHU LV WR KDQG¶´ S   ,Q RWKHU ZRUGV ZH H[SHFW WKDW
VXFFHVVIXOEXVLQHVVRULHQWHGDSSURDFKHVWR63,DOLJQLPSURYHPHQWDFWLYLWLHVWRWKHUHDOQHHGV
RIWKHGHYHORSHUVUDWKHUWKDQMXVWWRWKHDEVWUDFWH[SHFWDWLRQVRIFRUSRUDWHVWUDWHJ\
%DVHGRQWKHSUHFHGLQJDUJXPHQWVZHGHILQHEXVLQHVVRULHQWDWLRQDVWKHH[WHQWWRZKLFK
63,JRDOVDQGDFWLRQVDUHDOLJQHGZLWKH[SOLFLWDQGLPSOLFLWEXVLQHVVJRDOVDQGVWUDWHJLHV$
FOHDU EXVLQHVV RULHQWDWLRQ WKXV OHJLWLPL]HV WKH 63, LQLWLDWLYH WKURXJKRXW WKH VRIWZDUH
RUJDQL]DWLRQ:KLOHLWKDVDUHODWLYHO\ORZLPSDFWRQORFDONQRZLQJLWPD\QHYHUWKHOHVVKHOS
VRIWZDUH WHDPV DUWLFXODWH WKH NQRZOHGJH FUHDWHG LQ ORFDO JURXSV %XVLQHVV RULHQWDWLRQ LV
HVSHFLDOO\LPSRUWDQWLQMXVWLI\LQJFRQFHSWVIRULQFOXVLRQLQWKHRUJDQL]DWLRQ¶VPHPRU\VLQFH
FRQFHSWVPXVWEHVHOHFWHGWKDWKHOSWKHRUJDQL]DWLRQDFKLHYHLW¶VEXVLQHVVJRDOV7KHUHIRUHD
FOHDU EXVLQHVV RULHQWDWLRQ ZLOO DOVR HQFRXUDJH EHWWHU XWLOL]DWLRQ RI RUJDQL]DWLRQDO NQRZOHGJH
DQGIDFLOLWDWHWKHFROOHFWLYHLQWHUSUHWDWLRQRINQRZOHGJH
+HQFH ZH DUJXH WKDW EXVLQHVV RULHQWDWLRQ LV D NH\ IDFWRU WR IDFLOLWDWH D VXFFHVVIXO 63,
SURJUDP&HWHULVSDULEXV

+\SRWKHVLV63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKEXVLQHVVRULHQWDWLRQ

±±
&+$37(5

 ,QYROYHGOHDGHUVKLS
0DMRU FKDQJHV UHTXLUH OHDGHUVKLS 7KXV D SUHGRPLQDQW WKHPH LQ WKH TXDOLW\ PDQDJHPHQW
EXVLQHVVSURFHVVUHHQJLQHHULQJRUJDQL]DWLRQDOOHDUQLQJDQG63,OLWHUDWXUHLVDVZHKDYHVHHQ
WKH LPSRUWDQFH RI OHDGHUVKLS FRPPLWPHQW DQG LQYROYHPHQW LQ WKH LPSOHPHQWDWLRQ RI
LPSURYHPHQW DFWLRQV 6XFK LQYROYHPHQW LV RI SDUDPRXQW LPSRUWDQFH WR 63, VLQFH WRS
H[HFXWLYHV RIWHQ DUH FRPPLWWHG WR WKH VWDWXV TXR +DPEULFN HW DO   DQG DOVR EHFDXVH
WKH\XOWLPDWHO\GHWHUPLQHWKHSULRULW\RIWKHRUJDQL]DWLRQ¶V63,SURJUDP
&UHDWLQJDYLVLRQLVFRQVLGHUHGDNH\HOHPHQWLQPRVWOHDGHUVKLSIUDPHZRUNV %HQQLVDQG
1DQXV+HVVHOEHLQHWDO+XPSKUH\.RWWHU DQGWKRVHOHDGLQJWKH
RUJDQL]DWLRQPXVWWDNHDQDFWLYHUROHLQGHVFULELQJDGHVLUHGIXWXUHDQGHQHUJL]HFRPPLWPHQW
WR PRYLQJ WRZDUG LW 7KH ZRUG ³FRPPLWPHQW´ KRZHYHU LV RIWHQ PLVXVHG LQ SRSXODU
PDQDJHPHQW OLWHUDWXUH DQG IUHTXHQWO\ FRQIXVHG ZLWK ³FRPSOLDQFH´ ,Q FRQWUDVW WR WKH
FRPSOLDQWSHUVRQWKHFRPPLWWHGSHUVRQGRHVQ¶WRQO\SOD\E\WKH³UXOHVRIWKHJDPH´+HRU
VKH LV UHVSRQVLEOH IRU WKH JDPH DQG FKDQJHV WKH UXOHV LI WKDW LV QHFHVVDU\ WR DFKLHYH WKH
YLVLRQ )XUWKHUPRUH FRPPLWWHG SHUVRQV WUXO\ ZDQW WKH YLVLRQ ZKLOH VLQFHUHO\ FRPSOLDQW
SHUVRQVPHUHO\DFFHSWWKHYLVLRQ
7KH FRPPDQG DQG FRQWURO KLHUDUFK\ RI WUDGLWLRQDO RUJDQL]DWLRQV RQO\ UHTXLUHV
FRPSOLDQFH+RZHYHUWUDGLWLRQDO YLHZV RQ OHDGHUV DV ³KHURHV´ ZKR VHW WKH GLUHFWLRQ PDNH
NH\ GHFLVLRQV DQG HQHUJL]H WKH WURRSV DUH FKDQJLQJ 6HQJH   &UHDWLQJ YLVLRQ LV QRW
HQRXJKIRUDVVLPLODWHGOHDUQLQJWRRFFXUOHDGHUVKLSDWDQ\RUJDQL]DWLRQDOOHYHOPXVWHQJDJH
LQ KDQGVRQ LPSOHPHQWDWLRQ RI WKH YLVLRQ 7KXV IRU EXLOGLQJ VRIWZDUH RUJDQL]DWLRQV ZLWK
OHDUQLQJFDSDELOLWLHVZHQHHGLQYROYHGOHDGHUVKLSDWDOOOHYHOVWKDWDUHFRPPLWWHGWROHDUQLQJ
DQG 63, DQG WKDW WDNH UHVSRQVLELOLW\ IRU HQUROOLQJ RWKHUV 7KLV SRVLWLRQ LV DW RGGV ZLWK WKH
WUDGLWLRQDOYLHZRIOHDGHUVDVDV\QRQ\PIRUWRSPDQDJHUV5DWKHUZHFRQFXUZLWK6HQJHHW
DO   DQG YLHZ OHDGHUVKLS DV WKH LQWHUSOD\ EHWZHHQ ORFDO OLQH OHDGHUV LQWHUQDO
QHWZRUNHUVDQGH[HFXWLYHOHDGHUV
7KHORFDOOLQHOHDGHUVDUHSHRSOHZLWKDFFRXQWDELOLW\IRUUHVXOWVDQGVXIILFLHQWDXWKRULW\WR
XQGHUWDNH FKDQJHV LQ WKH ZD\ WKDW ZRUN LV RUJDQL]HG DQG FRQGXFWHG DW WKHLU ORFDO OHYHO
([DPSOHVDUHVRIWZDUHPDQDJHUVSURMHFWPDQDJHUVDQGWHDPOHDGHUV³/RFDOOLQHOHDGHUVDUH
YLWDO EHFDXVH RQO\ WKH\ DQG WKHLU FROOHDJXHV QRW H[HFXWLYHV FDQ XQGHUWDNH PHDQLQJIXO
RUJDQL]DWLRQDOH[SHULPHQWVWRWHVWWKHSUDFWLFDOLPSDFWRIQHZLGHDVDQGDSSURDFKHV´ 6HQJH
HWDOS 
7KLVYLHZRIORFDOOLQHOHDGHUVLVVLPLODUWR1RQDNDDQG7DNHXFKL¶V  HPSKDVLVRQ
WKH UROH RI PLGGOH PDQDJHUV LQ WKHLU ³PLGGOHXSGRZQ´ SURFHVV IRU NQRZOHGJH FUHDWLRQ
&RQWUDU\ WR WKH PRUH HVWDEOLVKHG YLHZ RI LJQRULQJ PLGGOH PDQDJHUV RIWHQ UHVXOWLQJ LQ
FRQVLGHUDEOH PDQDJHPHQW UHVLVWDQFH WR WKH FKDQJH SURJUDP  WKH\ UHFRJQL]HG WKDW PLGGOH
PDQDJHUV DUH DWWKH FHQWHU RI NQRZOHGJH PDQDJHPHQW DW WKH LQWHUVHFWLRQ RI WKH YHUWLFDO DQG
KRUL]RQWDOIORZVRILQIRUPDWLRQZLWKLQWKHFRPSDQ\7KXVWKH\DUJXHGWKDW³PLGGOHPDQDJHUV
DUHWKHNH\WRFRQWLQXRXVLQQRYDWLRQ´ LELGS ,QRWKHUZRUGVPLGGOHPDQDJHUVFDQEH
VHHQDVSOD\LQJDNH\UROHLQIDFLOLWDWLQJWKHSURFHVVRIRUJDQL]DWLRQDONQRZOHGJHFUHDWLRQDQG
KHQFH63,
7KH LQWHUQDO QHWZRUNHUV EHORQJ PRUH WR WKH LQIRUPDO VRFLDO QHWZRUNV RI WKH FRPSDQ\
WKDQWRWKHKLHUDUFK\ 0RUJDQ 7KH\FRPSOHPHQWWKHORFDOOLQHOHDGHUVDQGIXQFWLRQDV
FKDQJH DJHQWV FDUU\LQJ LGHDV VXSSRUW DQG VWRULHV WKURXJK WKH RUJDQL]DWLRQ 6XFK LQIRUPDO
JURXSOHDGHUVPD\EHFRPHDVSRZHUIXODQLQIOXHQFHRQWKHLUQHWZRUNRUJURXSDVPXFKDVDQ\
RWKHUUXOHUHJXODWLRQRUPDQDJHU'HVSLWHWKHLUSDVVLRQIRUFUHDWLQJEHWWHUUHVXOWVZLWKLQWKHLU

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

XQLWWKHOLPLWDWLRQRIWKHORFDOOLQHOHDGHUVLVWKDWWKH\RIWHQKDYHOLPLWHGFRQWDFWEH\RQGWKHLU
XQLW7KHLQWHUQDOQHWZRUNHUVRQWKHRWKHUKDQGKDYHDPDMRUVWUHQJWKLQWKHLUDELOLW\WRPRYH
DERXWWKHODUJHURUJDQL]DWLRQWRSDUWLFLSDWHLQDQGQXUWXUHEURDGQHWZRUNVRIDOOLDQFHVDQGWR
KHOSORFDOOHDGHUVE\DVVLVWLQJWKHPDQGSXWWLQJWKHPLQFRQWDFWZLWKRWKHUVZKRVKDUHWKHLU
LQWHUHVWV 6HQJHHWDO 7KXVDQ63,SURJUDPFDQKDUGO\VXFFHHGZLWKRXWWKHLQWHUQDO
QHWZRUNHUVEHLQJHQUROOHG
'XHWRFRQVWDQWFKDQJHDQGLQFUHDVLQJH[WHUQDOSUHVVXUHVH[HFXWLYHOHDGHUVKDYHDPRUH
FKDOOHQJLQJUROHWRGD\WKDQ HYHUEHIRUH7KH\KDYHRYHUDOODFFRXQWDELOLW\ IRURUJDQL]DWLRQDO
SHUIRUPDQFH EXW OHVV DELOLW\ WR GLUHFWO\ LQIOXHQFH DFWXDO ZRUN SURFHVVHV 7KH\ PD\ EH
FRUSRUDWH SUHVLGHQWV YLFH SUHVLGHQWV RU GLUHFWRUV DQG WKH\ DUH YLWDO WR SURIRXQG FKDQJH
WKURXJK WKHLU HIIRUWV WR FUHDWH DQ RUJDQL]DWLRQDO HQYLURQPHQW IRU FRQWLQXDO LQQRYDWLRQ DQG
NQRZOHGJH FUHDWLRQ 2QH FRQVHTXHQFH RI WKH H[HFXWLYH OHDGHU¶V ILQDQFLDO DFFRXQWDELOLW\
KRZHYHU LV WKDW WKH\ GLVDOORZ SURSRVHG LPSURYHPHQW DFWLYLWLHV ZKLFK UHTXLUHV WLPH DQG
UHVRXUFHV RQ WKH JURXQGV WKDW WKH ILQDQFLDO UHWXUQV FDQQRW EH GHPRQVWUDWHG RU WKDW WKH
H[LVWLQJFRQWUROV\VWHPZRXOGEHXQGHUPLQHG,QIDFW³DOORIWKHUHVHDUFKILQGLQJVDERXWWKH
LPSRUWDQFH RI WHDPZRUN FROODERUDWLRQ FRPPLWPHQW DQG LQYROYHPHQW IDOO RQ GHDI HDUV
EHFDXVHLQWKHH[HFXWLYHFXOWXUHWKRVHDUHQRWWKHLPSRUWDQWYDULDEOHVWRFRQVLGHU´ 6FKHLQ
FS 
,WLVLPSRUWDQWWRQRWHKRZHYHUWKDWHDFKW\SHRIOHDGHUVKLSFDQRQO\IXQFWLRQHIIHFWLYHO\
ZKHQ WKH RWKHUV IXQFWLRQ HIIHFWLYHO\ DQG WKDW FUHDWLQJ D FXOWXUH IRU OHDUQLQJ DQG 63, LV WKH
SURGXFW RI G\QDPLF LQWHUDFWLRQ DPRQJ DOO PHPEHUV RI WKH RUJDQL]DWLRQ 7KXV PXFK OLNH
6HQJHHWDO¶V  ³WKUHHOHDGHUV´6FKHLQ DF REVHUYHGWKDWDSUHUHTXLVLWHIRU
RUJDQL]DWLRQDOOHDUQLQJLVDUHFRQFLOLDWLRQRIWKHEXLOWLQFRQIOLFWEHWZHHQWKHFRPSOHPHQWDU\
UROHVRIH[HFXWLYHVHQJLQHHUVDQGRSHUDWRUVLQFRUSRUDWLRQV
$FFRUGLQJO\ZHGHILQHLQYROYHGOHDGHUVKLSDVWKHH[WHQWWRZKLFKOHDGHUVDWDOOOHYHOVLQ
WKH RUJDQL]DWLRQ DUH JHQXLQHO\ FRPPLWWHG WR DQG DFWLYHO\ SDUWLFLSDWH LQ 63, ,QYROYHG
OHDGHUVKLSLVWKXVLPSRUWDQWIRUDQ\63,LQLWLDWLYH%\LQYROYLQJWKHPVHOYHVLQWKHFKDOOHQJHV
RIVRIWZDUHGHYHORSPHQWDQGDOORZLQJVRIWZDUHWHDPVWRDFWDXWRQRPRXVO\WKHRUJDQL]DWLRQ¶V
OHDGHUVKLSIDFLOLWDWHVORFDONQRZLQJ7KH\KDYHDQLPSRUWDQWUROHLQIDFLOLWDWLQJWKHJHQHUDWLRQ
RI QHZ NQRZOHGJH E\ FUHDWLQJ D FRQWH[W WKDW SULRULWL]HV DQG HQFRXUDJHV GLDORJXH DQG
FROOHFWLYHUHIOHFWLRQ$OVRWKHGHJUHHRIOHDGHUVKLSLQYROYHPHQWLQIOXHQFHVZKDWLVFRQVLGHUHG
LPSRUWDQWIRULQFOXVLRQLQRUJDQL]DWLRQDOPHPRU\
+HQFH ZH DUJXH WKDW LQYROYHG OHDGHUVKLS LV D NH\ IDFWRU WR IDFLOLWDWH D VXFFHVVIXO 63,
SURJUDP&HWHULVSDULEXV

+\SRWKHVLV63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKLQYROYHGOHDGHUVKLS

 (PSOR\HHSDUWLFLSDWLRQ
(PSOR\HHSDUWLFLSDWLRQDQGWKHZD\SHRSOHDUHWUHDWHGKDVEHHQQRWHGDVDFUXFLDOIDFWRULQ
RUJDQL]DWLRQDOPDQDJHPHQW DQG GHYHORSPHQW HYHU VLQFH (OWRQ 0D\R¶V    IDPRXV
SURGXFWLYLW\ VWXGLHV DW :HVWHUQ (OHFWULF¶V +DZWKRUQH SODQW 7KH UHVXOWV RI 0D\R¶V VWXGLHV
VWDUWHGDUHYROXWLRQLQPDQDJHPHQWWKLQNLQJVKRZLQJWKDWHYHQURXWLQHMREVFDQEHLPSURYHG
LI WKH ZRUNHUV DUH WUHDWHG ZLWK UHVSHFW )XUWKHUPRUH WKH 7DYLVWRFN VWXGLHV HJ 7ULVW DQG
%DPIRUWK  7ULVW   UHIUDPHG WKH YLHZ RI RUJDQL]DWLRQDO V\VWHPV SURSRVLQJ WKH
VRFLRWHFKQLFDO V\VWHP 676  LQ ZKLFK WKH EHVW PDWFK ZRXOG EH VRXJKW EHWZHHQ WKH

±±
&+$37(5

UHTXLUHPHQWV RI WKH LQWHUGHSHQGHQW VRFLDO DQG WHFKQLFDO V\VWHP 7RJHWKHU WKHVH VWXGLHV
VKRZHG WKDW WKHUH ZHUH SRZHUIXO DOWHUQDWLYHV WR WKH SHUYDVLYH YLHZV RI 7D\ORU¶V 
FRQFHSWRIVFLHQWLILFPDQDJHPHQWDQG:HEHU¶V  GHVFULSWLRQRIEXUHDXFUDF\
6LQFHWKHQSDUWLFLSDWLRQDQGLQYROYHPHQWKDVEHHQRQHRIWKHPRVWLPSRUWDQWIRXQGDWLRQV
RI RUJDQL]DWLRQ GHYHORSPHQW DQG FKDQJH &XPPLQJV DQG :RUOH\  )UHQFK DQG %HOO
 3DUWLFLSDWLRQLVDOVRRQHRIWKHIXQGDPHQWDOLGHDVRI740ZKLFKLVD FRQVWLWXHQWRI
WKH SKLORVRSK\ RI NDL]HQ RU FRQWLQXRXV VKRSIORRUOHG LPSURYHPHQW ,PDL   6LPLODUO\
SDUWLFLSDWLRQKDVDOZD\VEHHQDFHQWUDOJRDODQGRQHRIWKHSLOODUVRIRUJDQL]DWLRQDOOHDUQLQJ
)RUH[DPSOHDXWRQRPRXVZRUNJURXSV 7ULVW TXDOLW\ FLUFOHV $XQH ,VKLNDZD
 VXUYH\IHHGEDFN %DXPJDUWHO1HII TXDOLW\RIZRUNOLIHSURJUDPV 'DYLV
  VHDUFK FRQIHUHQFHV (PHU\ DQG 3XUVHU   DQG FXOWXUDO DQDO\VLV 'HQLVRQ DQG
6SUHLW]HU6FKHLQ DUHDOOSUHGLFDWHGRQWKHEHOLHIWKDWLQFUHDVHGSDUWLFLSDWLRQZLOO
OHDGWREHWWHUVROXWLRQVDQGHQKDQFHGRUJDQL]DWLRQDOSUREOHPVROYLQJFDSDELOLW\
7KHUH DUH VHYHUDO DSSURDFKHV WR SDUWLFLSDWLRQ LQ V\VWHPV GHVLJQ DQG GHYHORSPHQW VHH
*MHUVYLN  IRU DQ RYHUYLHZ  DQG LQ SODQQHG RUJDQL]DWLRQDO FKDQJH DQG OHDUQLQJ HJ
*UHHQZRRG DQG /HYLQ  =DMDF DQG %UXKQ   WKDW DUH UHOHYDQW IRU 63, 7KH 676
DSSURDFK LV KRZHYHU WKH PRVW H[WHQVLYH ERG\ RI VFLHQWLILF DQG DSSOLHG ZRUN XQGHUO\LQJ
HPSOR\HH SDUWLFLSDWLRQ WRGD\ ZLWK WHFKQLTXHV DQG GHVLJQ SULQFLSOHV GHULYHG IURP H[WHQVLYH
DFWLRQUHVHDUFKLQERWKSXEOLFDQGSULYDWHRUJDQL]DWLRQVDFURVVDGLYHUVLW\RIQDWLRQDOFXOWXUHV
676 DOVR KDV D SDUWLFXODUO\ VWURQJ SRVLWLRQ LQ 6FDQGLQDYLD DQG WKH 8. ZKR KDV D ORQJ
WUDGLWLRQIRUZRUNSODFHGHPRFUDF\DQGSDUWLFLSDWLRQ,QIDFWPDQ\RIWKHHDUO\H[SHULPHQWV
RI676ZHUHSLRQHHUHGLQ1RUZD\ HJ7KRUVUXG7KRUVUXGHWDO 
$Q LPSRUWDQW DVSHFW RI 676 DQG SDUWLFLSDWLRQ LV ³FRGHWHUPLQDWLRQ´ LH WKH GLUHFW SDU
WLFLSDWLRQRIZRUNHUVLQGHFLVLRQVDERXWZKDWVKRXOGEHVWEHGRQHDWWKHLURZQOHYHO:LWKLQ
WKH FRQWH[W RI VRIWZDUH GHYHORSPHQW QR RQH LV PRUH H[SHUW LQ WKH UHDOLWLHV RI D VRIWZDUH
FRPSDQ\¶VEXVLQHVVZLWKUHVSHFWWRWKHGD\WRGD\GHWDLOVRISDUWLFXODUWHFKQRORJLHVSURGXFWV
DQGPDUNHWVWKDQWKHVRIWZDUHGHYHORSHUVDQGWKHLUILUVWOLQHPDQDJHUVDUH0RUHRYHUWKH\DUH
QRW RQO\ H[SHUWV RQ KRZ WR GR WKH ZRUN ± WKH\ DUH DOVR WKH H[SHUWV RQ KRZ WR LPSURYH LW
7KHUHIRUH LW FDQ EH DUJXHG WKDW WKH SHRSOH DUH D VRIWZDUH RUJDQL]DWLRQ¶V PRVW LPSRUWDQW
VRXUFHRISURGXFWLYLW\DQGSURILWV+HQFHLWLVLPSRUWDQWWRLQYROYHDOOWKRVHZKRDUHSDUWRI
WKHSUREOHPRUSDUWRIWKHVROXWLRQDQGKDYHGHFLVLRQVPDGHE\WKRVHZKRDUHFORVHVWWRWKH
SUREOHP
7KH676WKHRU\RQWKHHIILFDF\RIDXWRQRPRXVZRUNJURXSVLVEDVHGRQWKHSULQFLSOHRI
WKHF\EHUQHWLFFRQFHSWRIVHOIUHJXODWLRQ7KHPRUHWKHNH\YDULDQFHFDQEHFRQWUROOHGE\WKH
JURXS WKH EHWWHU WKH UHVXOWV DQG WKH KLJKHU WKH PHPEHU VDWLVIDFWLRQ 7ULVW   $
FRQVHTXHQFHRILQWURGXFLQJDXWRQRPRXVJURXSVLVDUDGLFDOVKLIWLQWKHUROHRIVXSHUYLVLRQ,Q
FRQWUDVWWRWKHEXUHDXFUDWLFWKHRU\RIFRQWUROWKHIXQFWLRQRIVXSHUYLVLRQLQWKH676DSSURDFK
LVWRPDQDJHWKHERXQGDU\FRQGLWLRQVLQWKHJURXS¶VHQYLURQPHQWVRWKDWWKHJURXSLWVHOIPD\
EHIUHHGWRPDQDJHLWVRZQDFWLYLWLHV
/LNHTXDOLW\FLUFOHVDQGFRPPXQLWLHVRISUDFWLFHDXWRQRPRXVZRUNJURXSVDUHV\VWHPVRI
SDUWLFLSDWRU\ OHDUQLQJ SURFHVVHV :LWKLQ VXFK JURXSV SHRSOH VKDUH WDFLW NQRZOHGJH DQG
WKURXJK GLDORJXH WKH\ EULQJ WKLV NQRZOHGJH WR WKH VXUIDFH )XUWKHUPRUH WKH\ HQJDJH LQ
GLVFXVVLRQV WKDW DIILUP RU PRGLI\ WKHRULHV LQ XVH DQG WKH\ LQQRYDWH QHZ SUREOHPVROYLQJ
URXWLQHVZKLOHVLPXOWDQHRXVO\PDQDJLQJWKHFRQWH[W,QRWKHUZRUGVWKH\HQJDJHQRWRQO\LQ
VRFLDOL]DWLRQEXWDOVRLQH[SHULHQWLDOOHDUQLQJDQGRUJDQL]DWLRQDONQRZOHGJHFUHDWLRQ

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

7R JXLGH WKHLU DFWLRQV LQ D FRPPRQ GLUHFWLRQ RI LPSURYHPHQW VRIWZDUH RUJDQL]DWLRQV
QHHG VRPH NLQG RI EDVLF VWUXFWXUH WKDW LV FRPPRQ WR LWV PHPEHUV &RQVHTXHQWO\ FUHDWLQJ
VWURQJRUJDQL]DWLRQDOFXOWXUHVKDVEHHQWKHIRFXVRIERWKPDQDJHPHQWFRQVXOWDQWV HJ+XQW
DQG %X]DQ  3HWHUV DQG :DWHUPDQ  3HWHUV    DQG RUJDQL]DWLRQDO
UHVHDUFKHUV HJ0DUWLQ6FKHLQ  D  &RPPRQ WR WKHVH ZULWLQJV LV WKH LGHD
WKDWDOOSHRSOHLQDQRUJDQL]DWLRQKDYHFRPPRQLQWHUHVWVDQGWKDWSDUWLFLSDWLRQFDQKHOSWKH
RUJDQL]DWLRQDO DFWRUV WR SXOO LQ WKH VDPH GLUHFWLRQ ± WRZDUG LPSURYHPHQW +RZHYHU UDWKHU
WKDQ GHYHORSLQJ XQQHFHVVDU\ VWUXFWXUHV RI GRPLQDWLRQ WU\LQJ WR FUHDWH D FRPPRQ ZD\ RI
YLHZLQJWKHRUJDQL]DWLRQDQGLWVHQYLURQPHQWSDUWLFLSDWLRQVKRXOGEHLQWHQGHGWRH[SORLWWKH
GLYHUVLW\H[LVWLQJEHWZHHQWKHDXWRQRPRXVJURXSVXVLQJLWWRFUHDWHD³VSDFHRISRVVLELOLW\´
*MHUVYLN WKDWFDQEHXWLOL]HGLQ63,
:LWK 63, EHFRPLQJ LQFUHDVLQJO\ LPSRUWDQW DQG SHRSOH LQFUHDVLQJO\ UHFRJQL]HG DV WKH
SULQFLSDO VRXUFH RI FRPSHWLWLYH DGYDQWDJH VRIWZDUH RUJDQL]DWLRQV QHHG WR HQFRXUDJH DQG
VXSSRUW FROODERUDWLRQ LQ ZRUN JURXSV DQG SURMHFW WHDPV DQG HQJDJH LQ RUJDQL]DWLRQDO
OHDUQLQJ 3DUWLFLSDWLRQ LV WKXV IXQGDPHQWDO IRU FUHDWLYLW\ DQG LQQRYDWLRQ DQG IRU VKRZLQJ
UHVSHFWIRUWKHRSLQLRQVRIRWKHUVDQGIRUWKHEHOLHIWKDWOHDUQLQJDQGFRPSHWLWLYHDGYDQWDJH
FDQ UHVXOW IURP DQ RUJDQL]DWLRQDO FOLPDWH WKDW FXOWLYDWHV D GLYHUVLW\ RI LGHDV DQG RSLQLRQV
7KHUHIRUH SDUWLFLSDWLRQ VKRXOG EH RIIHUHG DQG PDQDJHG LQ VXFK D ZD\ DV WR DOORZ DOO
HPSOR\HHVWRLPSURYHWKHLUZRUNDQGWRIHHODVHQVHRIFRQWULEXWLRQWRWKHRUJDQL]DWLRQDQGLWV
PLVVLRQV,QRXUYLHZWKHQ63,LVQHLWKHUWRSGRZQQRUERWWRPXS±UDWKHULWLVSDUWLFLSDWLYH
DWDOOOHYHOV
+HQFH ZH GHILQH HPSOR\HH SDUWLFLSDWLRQ DV WKH H[WHQW WR ZKLFK HPSOR\HHV XVH WKHLU
NQRZOHGJHDQGH[SHULHQFHWRGHFLGHDFWDQGWDNHUHVSRQVLELOLW\IRU63,7KHUHIRUHHPSOR\HH
SDUWLFLSDWLRQ LV WKH FRUQHUVWRQH RI RXU PRGHO ,W LV LPSRUWDQW IRU DOO WKH NQRZOHGJH FUHDWLQJ
DFWLYLWLHV LQ WKH OHDUQLQJ F\FOH ,W LV WKH EDVLV IRU ORFDO NQRZLQJ VLQFH LW LV RQO\ WKURXJK
SDUWLFLSDWLRQWKDWFROOHFWLYHDFWLRQFDQEHWDNHQDQGWDFLWNQRZOHGJHFDQEHVKDUHG'LDORJXH
DQGFROOHFWLYHUHIOHFWLRQDUHPHDQLQJOHVVFRQFHSWVZLWKRXWSDUWLFLSDWLRQDQGLWLVDQLPSRUWDQW
IDFLOLWDWRU IRU WKH JHQHUDWLRQ RI YDOLG RUJDQL]DWLRQDO NQRZOHGJH /LNHZLVH LW LV WKURXJK
FROOHFWLYHSURFHVVHVRIVHQVHPDNLQJDQGDFWLYHSDUWLFLSDWLRQWKDWRUJDQL]DWLRQDONQRZOHGJHLV
GLIIXVHGDQGEURXJKWWRXVHLQQHZVLWXDWLRQV
&RQVHTXHQWO\ ZH DUJXH WKDW HPSOR\HH SDUWLFLSDWLRQ LV D NH\ IDFWRU WR IDFLOLWDWH D
VXFFHVVIXO63,SURJUDP&HWHULVSDULEXV

+\SRWKHVLV63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKHPSOR\HHSDUWLFLSDWLRQ

 &RQFHUQIRUPHDVXUHPHQW
6RIWZDUHPHDVXUHPHQWLVZLGHO\UHFRJQL]HGDVDQHVVHQWLDOSDUWRIXQGHUVWDQGLQJFRQWUROOLQJ
PRQLWRULQJ SUHGLFWLQJ DQG HYDOXDWLQJ VRIWZDUH GHYHORSPHQW DQG PDLQWHQDQFH SURMHFWV
'H0DUFR  *DIIQH\ HW DO  *LOE  *UDG\ DQG &DVZHOO  )HQWRQ DQG
3IOHHJHU)HQWRQDQG1HLO 0|OOHUDQG3DXOLVK2PDQDQG3IOHHJHU
DQG DV D QHFHVVDU\ SDUW RI DQ\ 63, RU FKDQJH SURJUDP %DVLOL DQG 5RPEDFK  '\En
H*UDG\  +XPSKUH\  .LWFKHQKDP  3XOIRUG HW DO   7KLV
SRVLWLRQLVE\QRPHDQVXQLTXHWRWKHVRIWZDUHFRPPXQLW\0HDVXUHPHQWDQGLQ SDUWLFXODU
PHDVXUHPHQW RI FXVWRPHU VDWLVIDFWLRQ LV DW WKH KHDUW RI TXDOLW\ PDQDJHPHQW DQG LV DOVR D
PDMRU FRQFHUQ IRU UHODWHG GLVFLSOLQHV VXFK DV RUJDQL]DWLRQ GHYHORSPHQW &XPPLQJV DQG

±±
&+$37(5

:RUOH\ RUJDQL]DWLRQDOOHDUQLQJ $UJ\ULVDQG6FK|Q VWUDWHJLFSODQQLQJ .DSODQ


DQG1RUWRQ DQGEXVLQHVVSURFHVVUHHQJLQHHULQJ 'DYHQSRUW+DPPHUDQG
&KDPS\+DPPHU 
7KH XVH RI JRDORULHQWHG PHDVXUHPHQW HJ *40  DGPLQLVWHUHG E\ WKH GHYHORSHUV
WKHPVHOYHV WR GRFXPHQW DQG LPSURYH WKHLU RZQ SHUIRUPDQFH KDV EHHQ LGHQWLILHG DV DQ
LPSRUWDQWVRXUFHRILPSURYHPHQW,QDGGLWLRQLWKDVEHHQUHSRUWHGWKDWH[WHUQDOHYDOXDWLRQV
DQGDVVHVVPHQWVDOVRLPSURYHSHUIRUPDQFH VHH&KDSWHU 7KLVFUXFLDOUROHRIPHDVXUHPHQW
LVDOVRUHFRJQL]HGLQWKHUHFHQWUHYLVLRQRI,62DQGLQWKHJXLGHOLQHVIRUSURFHVV
LPSURYHPHQWLQWKH,62,(&VWDQGDUGRQVRIWZDUHSURFHVVDVVHVVPHQW ,62,(&:'
 )XUWKHUPRUHLWVHHPVWKDWWKHVHPHDVXUHPHQWDVSHFWVFDQFRPSOHPHQWHDFKRWKHU
DQG WKDW JRDORULHQWHG PHDVXUHPHQW FDQ EH LQWHJUDWHG ZLWK DVVHVVPHQW WR IRUP D
FRPSUHKHQVLYH PHDVXUHPHQWEDVHG LPSURYHPHQW VWUDWHJ\ -DQVHQ DQG 6DQGHUV 
0F)HHOH\3XOIRUGHWDO 
0HDVXUHPHQWDQGDQDO\VLVLVQRWRQO\DQHIILFLHQWPHDQVIRULGHQWLI\LQJUHFRPPHQGLQJ
DQGHYDOXDWLQJSURFHVVFKDQJHLWFDQDOVREHRIFUXFLDOLPSRUWDQFHIRUDVVLVWLQJDQGJXLGLQJ
RQJRLQJ FKDQJH ,Q RWKHU ZRUGV IHHGEDFN WR PDQDJHUV DQG HPSOR\HHV DERXW TXDOLW\
SHUIRUPDQFHSURYLGHVDPHDQVRIOHDUQLQJDQGPDLQWDLQLQJLPSURYHPHQWRULHQWHGEHKDYLRUV
1DGOHU   $ PDMRU FRQFHUQ IRU D PHDVXUHPHQW SURJUDP WKHUHIRUH LV WR SURYLGH
RSSRUWXQLWLHV IRU GHYHORSHUV WR SDUWLFLSDWH LQ DQDO\]LQJ LQWHUSUHWLQJ DQG OHDUQLQJ IURP WKH
UHVXOWVRIPHDVXUHPHQWVDQGWRLGHQWLI\FRQFUHWHDUHDVIRULPSURYHPHQW
%DVLFDOO\WKHTXHVWIRUPHDVXUHPHQWVWHPVIURPDQHHGIRUDQDQDO\WLFDODQGIDFWXDOEDVLV
WR GHFLVLRQPDNLQJ DQG SURFHVV LPSURYHPHQW 1HYHUWKHOHVV ZH VKRXOG UHPHPEHU WKDW
VRIWZDUHGHYHORSPHQWLVODUJHO\DQLQWHOOHFWXDODQGVRFLDODFWLYLW\ )XJJHWWD+RKPDQQ
2XOG DQGWRLQWHUSUHWDQ\PHDVXUHPHQWUHVXOWV DFFRUGLQJO\ +RZHYHU WKHUH LV
UHDVRQWREHOLHYHWKDWSURYLGLQJDFRQVWDQWIORZRITXDOLW\GDWDIURPDYDULHW\RIVRXUFHVPD\
OHDGWRLPSURYHGSHUIRUPDQFH7KLVSRLQWZDVDOVRHPSKDVL]HGE\*UDG\  ZKRPDGH
WKHIROORZLQJDQDORJ\

>$@ VRIWZDUH SURMHFW LV OLNH D WUDLQ LQ D WXQQHO UXVKLQJ WRZDUG D OLJKW :LWK NQRZOHGJH RI LWV
VSHHGDQGVFKHGXOHNQRZLQJWKDWLWLVRQWKHULJKWWUDFNZHFDQEHUHDVRQDEO\DVVXUHGWKDW
LW¶VGD\OLJKWZHVHHDWWKHHQGRIWKHWXQQHO:LWKRXWVXFKTXDQWLILDEOHIDFWVLWLVMXVWDVOLNHO\
WKDWWKHOLJKWZHVHHLVDQRWKHUWUDLQ RUGLVDVWHU UXVKLQJWRZDUGXVRQWKHVDPHWUDFN LELG
S 

+HQFHZHGHILQHFRQFHUQIRUPHDVXUHPHQWDVWKHH[WHQWWRZKLFKWKHVRIWZDUHRUJDQL]DWLRQ
FROOHFWVDQGXWLOL]HVTXDOLW\GDWDWRJXLGHDQGDVVHVVWKHHIIHFWVRI63,DFWLYLWLHV,QDGGLWLRQWR
SHUVRQDODQGFROOHFWLYHH[SHULHQFHD FRQFHUQ IRU PHDVXUHPHQW LV WKXV LPSRUWDQW LQ RUGHU WR
YDOLGDWH QHZO\ FUHDWHG NQRZOHGJH DQG WR HQVXUH WKDW JDLQV KDYH LQ IDFW EHHQ PDGH 0RVW
LPSRUWDQWO\DFRQFHUQIRUPHDVXUHPHQWIDFLOLWDWHVORFDONQRZLQJE\DFWLQJDVDIRXQGDWLRQIRU
WKHFROOHFWLRQDQDO\VLVDQGIHHGEDFNRIGDWD$OVRRQJRLQJIHHGEDFN DV D JURXS SURFHVV LV
VSHFLILFDOO\LPSRUWDQWVLQFHLWFDQEHDQHIIHFWLYHWRROIRUEULQJLQJDERXWFKDQJHVLQWKHZD\
ZRUNLVGRQHDVZHOODVLQHVWDEOLVKLQJFDXVDOUHODWLRQVKLSVDQGJHQHUDWLQJQHZNQRZOHGJH
&RQVHTXHQWO\ ZH DUJXH WKDW FRQFHUQ IRU PHDVXUHPHQW LV D NH\ IDFWRU WR IDFLOLWDWH D
VXFFHVVIXO63,SURJUDP&HWHULVSDULEXV

+\SRWKHVLV63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKFRQFHUQIRUPHDVXUHPHQW

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

 /HDUQLQJVWUDWHJ\
$ FULWLFDO FKDOOHQJH IDFLQJ VRIWZDUH RUJDQL]DWLRQV LV WKH GLOHPPD RI PDLQWDLQLQJ WKH
FDSDELOLWLHVRIERWKHIILFLHQF\DQGIOH[LELOLW\7KLVVLWXDWLRQZKLFKUHTXLUHVWKHPDQDJHPHQW
RI ERWK VWDELOLW\ DQG FKDQJH KDV EHHQ GHVFULEHG ZLWK D SXQFWXDWHG HTXLOLEULXP PRGHO
7XVKPDQDQG5RPDQHOOL/DQWDQG0H]LDV )URPWKLVSHUVSHFWLYHRUJDQL]DWLRQV
H[SHULHQFH SHULRGV RI FRQYHUJHQFH SXQFWXDWHG E\ IXQGDPHQWDO UHRULHQWDWLRQV 7RR PXFK
VWDELOLW\ ZLWKLQ WKH RUJDQL]DWLRQ FDQ EH G\VIXQFWLRQDO DQG WRR PXFK FKDQJH DQG WXUEXOHQFH
OHDGVWRGLIILFXOWLHVIRUPDQDJHUVDQGGHYHORSHUVWRPDNHVHQVHRIWKHLUHQYLURQPHQWV,QRWKHU
ZRUGVWKHSURFHVVRIOHDUQLQJ³LQYROYHVWKHFUHDWLRQDQGPDQLSXODWLRQRIWKLVWHQVLRQEHWZHHQ
FRQVWDQF\DQGFKDQJH´ )LRODQG/\OHVS 
7KXVUHVHDUFKHUVDQGSUDFWLWLRQHUVLQFUHDVLQJO\GLVWLQJXLVKEHWZHHQWKHPRUHPRGHVWRU
HYROXWLRQDU\ HIIRUWV WRZDUG FKDQJH DQG WKRVH WKDW DUH PRUH IXQGDPHQWDO DQG LQ D VHQVH
UHYROXWLRQDU\ VHH&KDSWHU )RUH[DPSOH$UJ\ULVDQG6FK|Q¶V  GLVWLQFWLRQEHWZHHQ
WKHFRQFHSWVRI VLQJOHORRS DQGGRXEOHORRS OHDUQLQJ FRUUHVSRQGV WR )LRO DQG /\OHV¶ 
ORZHUOHYHO DQG KLJKHUOHYHO OHDUQLQJ RU ZKDW 6HQJH   FDOOHG WKH GLIIHUHQFH EHWZHHQ
DGDSWLYHDQGJHQHUDWLYHOHDUQLQJ6LPLODUO\0DUFK  PDGHDGLVWLQFWLRQEHWZHHQ
WKHH[SORLWDWLRQRIROGFHUWDLQWLHVDQGWKHH[SORUDWLRQRIQHZSRVVLELOLWLHV&RPPRQWRDOORI
WKHVH FRQVWUXFWV LV WKDW WKH ORZHU OHYHO LQYROYHV LPSURYLQJ H[LVWLQJ EHKDYLRUV DQG PDNLQJ
SURJUHVVWRZDUGVWDWHGJRDOVZKLOHWKHKLJKHUOHYHOUHTXLUHVTXHVWLRQLQJWKHDSSURSULDWHQHVV
RIWKHJRDOVDQGUHFRJQL]LQJWKHVXEMHFWLYLW\RIPHDQLQJ
(YROXWLRQDU\OHDUQLQJVWUDWHJLHVUHSUHVHQWUHODWLYHO\VPDOORULQFUHPHQWDOFKDQJHVLQWKH
RUJDQL]DWLRQ¶VSURGXFWVSURFHGXUHVRUVHUYLFHV7KH\DUHQHZWRWKHRUJDQL]DWLRQEXWUHIOHFW
DQ DGDSWDWLRQ RU VLPSOH DGMXVWPHQW RI H[LVWLQJ SUDFWLFHV DQG WKHLU LPSOHPHQWDWLRQ UDUHO\
UHTXLUHV FKDQJHV LQ RUJDQL]DWLRQDO VWUXFWXUHV RU SURFHVVHV ,Q FRQWUDVW UDGLFDO OHDUQLQJ
VWUDWHJLHV UHSUHVHQW ODUJHU FKDQJHV LQ RUJDQL]DWLRQDO SURGXFWV SURFHGXUHV RU VHUYLFHV 7KH\
UHIOHFWEURDGHUVKLIWV LQ SHUVSHFWLYH DQG UHRULHQWDWLRQ RI H[LVWLQJ SUDFWLFHV DQG RIWHQ UHTXLUH
PDMRUFKDQJHVLQRUJDQL]DWLRQDOVWUXFWXUHVRUSURFHVVHVWRLPSOHPHQW
,Q RWKHU ZRUGV VRIWZDUH RUJDQL]DWLRQV FDQ HQJDJH LQ WZR EURDG NLQGV RI OHDUQLQJ
VWUDWHJLHV7KH\FDQHQJDJHLQH[SORLWDWLRQ±WKHDGRSWLRQDQGXVHRIH[LVWLQJNQRZOHGJHDQG
H[SHULHQFH DQG WKH\ FDQ HQJDJH LQ H[SORUDWLRQ ± WKH VHDUFK IRU QHZ NQRZOHGJH HLWKHU
WKURXJK LPLWDWLRQ RU LQQRYDWLRQ VHH 7DEOH   ([SORLWDWLRQ LV DVVRFLDWHG ZLWK V\VWHPDWLF
UHDVRQLQJULVNDYHUVLRQGHILQLQJDQGPHDVXULQJSHUIRUPDQFHDQGH[SOLFLWO\OLQNLQJDFWLYLWLHV
WR WKHVH PHDVXUHV ([SORLWDWLRQ LQYROYHV LPSURYLQJ H[LVWLQJ FDSDELOLWLHV SURFHVVHV DQG
WHFKQRORJLHV DV ZHOO DV UDWLRQDOL]LQJ DQG UHGXFLQJ FRVWV ([SORLWDWLRQ WKXV OHJLWLPDWHV UH
ILQLQJVWDQGDUGL]LQJURXWLQL]LQJDQGHODERUDWLQJHVWDEOLVKHGLGHDVSDUDGLJPVWHFKQRORJLHV
KHXULVWLFVDQGNQRZOHGJH
,Q FRQWUDVW H[SORUDWLRQ LV DVVRFLDWHG ZLWK FRPSOH[ VHDUFK LQQRYDWLRQ YDULDWLRQ ULVN
WDNLQJUHOD[HGFRQWUROORRVHGLVFLSOLQHDQGIOH[LELOLW\([SORUDWLRQLQYROYHVOHDUQLQJWKURXJK
GLVFRYHU\DQGH[SHULPHQWLQJZLWKLGHDVSDUDGLJPVWHFKQRORJLHVVWUDWHJLHVDQGNQRZOHGJH
LQKRSHRIILQGLQJQHZDOWHUQDWLYHVDQGXQWDSSHGRSSRUWXQLWLHVWKDWDUHVXSHULRUWRWKHFXUUHQW
SUDFWLFH )XUWKHUPRUH LW HQFRXUDJHV WKH IOH[LELOLW\ DQG UHVLOLHQFH QHHGHG WR FRSH ZLWK
WXUEXOHQWHQYLURQPHQWVWKDWDUHODFNLQJLQH[SORLWDWLRQ

±±
&+$37(5

7DEOH([SORLWDWLRQYHUVXVH[SORUDWLRQ '\EnES 

([SORLWDWLRQ ([SORUDWLRQ

i 5HILQHPHQWURXWLQL]LQJDQGHODERUDWLRQ
 i ([SHULPHQWDWLRQZLWKQHZLGHDVSDUDGLJPV


RIH[LVWLQJLGHDVSDUDGLJPVWHFKQRORJLHV WHFKQRORJLHVSURFHVVHVVWUDWHJLHVDQG
SURFHVVHVVWUDWHJLHVDQGNQRZOHGJH NQRZOHGJHLQRUGHUWRILQGDOWHUQDWLYHVWKDW
LPSURYHRQROGRQHV
i 3URYLGHVLQFUHPHQWDOUHWXUQVRQNQRZOHGJH
 i 3URYLGHVXQFHUWDLQEXWSRWHQWLDOO\KLJKUHWXUQV


DQGORZULVNRIIDLOXUH RQNQRZOHGJHDQGFDUULHVVLJQLILFDQWULVNRI
IDLOXUH
i 5HTXLUHVSHUVRQQHOZKRDUHVNLOOHGLQ
 i 5HTXLUHVSHUVRQQHOZKRDUHVNLOOHGLQ


H[LVWLQJWHFKQRORJLHV HPHUJLQJRULQQRYDWLYHWHFKQRORJLHV
i &DQJHQHUDWHVKRUWWHUPLPSURYHPHQW
 i 2IWHQUHTXLUHVDORQJWLPHKRUL]RQWRJHQHUDWH


UHVXOWV LPSURYHGUHVXOWV

)LQGLQJ D JRRG EDODQFH EHWZHHQ H[SORUDWLRQ DQG H[SORLWDWLRQ LV D UHFXUUHQW SUREOHP RI
WKHRULHVRIDGDSWDWLRQ $UJ\ULV DQG 6FK|Q  /HYLQWKDO DQG 0DUFK  0DUFK 
  ZKLFK WDON DERXW EDODQFLQJ VHDUFK DQG DFWLRQ YDULDWLRQ DQG VHOHFWLRQ FKDQJH DQG
VWDELOLW\ DQG GLYHUVLW\ DQG XQLW\ ,W LV LPSRUWDQW WR QRWH KRZHYHU WKDW H[SORLWDWLRQ DQG
H[SORUDWLRQ DUH FRPSOHPHQWDU\ PRGHV RI RUJDQL]DWLRQDO OHDUQLQJ DQG WKDW ERWK IRUPV DUH
QHFHVVDU\ IRU VRIWZDUH RUJDQL]DWLRQV $ EDVLF SUREOHP WKHUHIRUH LV WR HQJDJH LQ HQRXJK
H[SORLWDWLRQWRHQVXUHVKRUWWHUPUHVXOWVDQGFRQFXUUHQWO\WRHQJDJHLQH[SORUDWLRQWRHQVXUH
ORQJWHUPVXUYLYDO
7KXVWREHYLDEOHLQWKHVKRUWWHUPDVRIWZDUHRUJDQL]DWLRQQHHGVWREHHIILFLHQW±WREH
JRRGDWZKDWLWGRHVWREHDEOHWROHYHURQLWVSUHVHQWVNLOOVDQGFDSDELOLWLHV7KLVLVDFKLHYHG
E\ DFFXPXODWLQJ H[SHULHQFH LQWR RUJDQL]DWLRQDO PHPRU\ LQ D OLPLWHG QXPEHU RI DFWLYLW\
GRPDLQV DQG E\ LQFUHDVLQJ SURILFLHQF\ WKURXJK UHSHDWHG SUDFWLFH DQG WKH IRUPDOL]DWLRQ RI
WDVNUHODWHGNQRZOHGJH+RZHYHUWREHYLDEOHLQWKHORQJHUUXQDVRIWZDUHRUJDQL]DWLRQDOVR
QHHGV WR EH DEOH WR GHYHORS QHZ FDSDELOLWLHV WR DEVRUE RU FUHDWH QHZ NQRZOHGJH DQG QHZ
WHFKQRORJLHV 7KLV LV D PRUH ³PHVV\´ SURFHVV DQG PDQ\ DWWHPSWV DW GLVFRYHU\ RU
H[SHULPHQWDWLRQ RXWVLGH WKH ERXQGV RI FXUUHQW FRPSHWHQFLHV RU WKH QRUPV VHW E\ H[LVWLQJ
URXWLQHV PLJKW ZHOO SURYH WR EH XQUHZDUGLQJ 6WLOO VRPH RI WKH GHYLDWLRQV IURP VWDQGDUG
SUDFWLFHZLOOEHSURPLVLQJHQRXJKWRSRLQWWRQHZLGHDVDQGGLUHFWLRQVZKLFKWKHRUJDQL]DWLRQ
FDQWXUQLQWRXVDEOHNQRZOHGJH
,Q VKRUW H[SORUDWLRQ FDQQRW UHDOL]H LWV RFFDVLRQDO JDLQV ZLWKRXW H[SORLWDWLRQ RI
GLVFRYHULHV DQG H[SORLWDWLRQ EHFRPHV REVROHVFHQW ZLWKRXW H[SORUDWLRQ RI QHZ GLUHFWLRQV
7KXV D VRIWZDUH RUJDQL]DWLRQ WKDW VSHFLDOL]HV LQ H[SORLWDWLRQ ZLOO HYHQWXDOO\ EHFRPH EHWWHU
DQGEHWWHUWRXVHDQLQFUHDVLQJO\REVROHWHWHFKQRORJ\ZKLOHDQRUJDQL]DWLRQWKDWVSHFLDOL]HVLQ
H[SORUDWLRQQHYHUZLOOUHDOL]HWKHDGYDQWDJHVRILWVGLVFRYHULHV
%DVHG RQ WKH SUHFHGLQJ GLVFXVVLRQ ZH FRQWHQG WKDW H[SORLWDWLRQ DQG H[SORUDWLRQ DUH
OLQNHGLQDQHQGXULQJV\PELRVLVDQGWKDWHDFKIRUPUHTXLUHVWKHRWKHULQRUGHUWRFRQWULEXWH
HIIHFWLYHO\ WR D VRIWZDUH RUJDQL]DWLRQ¶V VXUYLYDO DQG SURVSHULW\ &RQVHTXHQWO\ ZH GHILQH
OHDUQLQJVWUDWHJ\DVWKHH[WHQWWRZKLFKDVRIWZDUHRUJDQL]DWLRQLVHQJDJHGLQWKHH[SORLWDWLRQ
RIH[LVWLQJNQRZOHGJHDQGLQWKHH[SORUDWLRQRIQHZNQRZOHGJH

±±
$'<1$0,&02'(/2)62)7:$5(352&(66,03529(0(17

([SORLWDWLRQRIH[LVWLQJNQRZOHGJHLVFORVHO\WLHGWRDOOWKHNQRZOHGJHFUHDWLQJDFWLYLWLHV
LQ WKH OHDUQLQJ F\FOH ,W IDFLOLWDWHV ORFDO NQRZLQJ E\ SUHVHQWLQJ D VHW RI SUHYLRXVO\ OHDUQHG
OHVVRQVWKDWFDQEHXVHGLQH[SORULQJWKHFRQWLQJHQFLHVRIWKHFXUUHQWVHWWLQJ,WLVSDUWLFXODUO\
LPSRUWDQWLQIDFLOLWDWLQJWKH JHQHUDWLRQRIQHZRUJDQL]DWLRQDONQRZOHGJH VLQFH WKLV LQYROYHV
WKHDUWLFXODWLRQDQGSDFNDJLQJRIORFDONQRZOHGJHDQGH[SHULHQFH)XUWKHUPRUHEHIRUHORFDOO\
FUHDWHGNQRZOHGJHLVDSSURSULDWHGDVSDUWRIWKHRUJDQL]DWLRQ¶VPHPRU\LWPXVWEHUHODWHGWR
WKH H[LVWLQJ NQRZOHGJH $OVR DV ZH KDYH VHHQ WKH LQWHUSUHWDWLRQ RI NQRZOHGJH QHFHVVDULO\
LQYROYHVDUHODWLRQEHWZHHQQHZDQGH[LVWLQJNQRZOHGJH
&RQVHTXHQWO\ ZH DUJXH WKDW H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH LV D NH\ IDFWRU WR
IDFLOLWDWHDVXFFHVVIXO63,SURJUDP&HWHULVSDULEXV

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKH[SORLWDWLRQRIH[LVWLQJ
NQRZOHGJH

)XUWKHUPRUH H[SORUDWLRQ RI QHZ NQRZOHGJH LV SDUWLFXODUO\ LPSRUWDQW LQ IDFLOLWDWLQJ WKH
FROOHFWLYHLQWHUSUHWDWLRQRINQRZOHGJHWKURXJKH[SORUDWRU\H[SHULPHQWVDQGSURWRW\SLQJ,WLV
DOVRWKHEDVLVIRUORFDONQRZLQJE\PL[LQJWRJHWKHUWKHFRQWLQJHQF\RIWKHSUHVHQWVLWXDWLRQ
ZLWKWKHOHVVRQVOHDUQHGIURPSULRUH[SHULHQFH&HWHULVSDULEXV

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKH[SORUDWLRQRIQHZNQRZOHGJH

 -RLQWFRQWULEXWLRQRIIDFLOLWDWLQJIDFWRUV
6R IDU ZH KDYH GLVFXVVHG WKH SRVVLEOH LQGHSHQGHQW FRQWULEXWLRQV RI EXVLQHVV RULHQWDWLRQ
LQYROYHG OHDGHUVKLS HPSOR\HH SDUWLFLSDWLRQ FRQFHUQ IRU PHDVXUHPHQW H[SORLWDWLRQ RI
H[LVWLQJNQRZOHGJHDQGH[SORUDWLRQRIQHZNQRZOHGJHWR63,VXFFHVV +RZHYHUGHSHQGHQW
YDULDEOHVVXFKDVRUJDQL]DWLRQDOSHUIRUPDQFHRURWKHUVXFFHVVPHDVXUHVOLNHWKHRQHXVHGLQ
WKLVVWXG\DUHUDUHO\GHWHUPLQHGE\RQHVLQJOHLQGHSHQGHQWYDULDEOH,QDGGLWLRQWRH[DPLQLQJ
WKHLQGHSHQGHQWFRQWULEXWLRQVWKHUHIRUHZHDOVRZDQWWRH[DPLQHWKHMRLQWFRQWULEXWLRQRIWKH
LQGHSHQGHQWYDULDEOHVWR63,VXFFHVV&HWHULVSDULEXV

+\SRWKHVLV 7KHVL[LQGHSHQGHQWYDULDEOHVRIEXVLQHVVRULHQWDWLRQLQYROYHGOHDGHUVKLS
HPSOR\HHSDUWLFLSDWLRQFRQFHUQIRUPHDVXUHPHQWH[SORLWDWLRQRIH[LVWLQJ
NQRZOHGJHDQGH[SORUDWLRQRIQHZNQRZOHGJHZLOOH[SODLQDODUJHDPRXQW
RIWKHYDULDQFHLQ63,VXFFHVV

 &KDSWHU6XPPDU\
,QWKLVFKDSWHUZHKDYHGHYHORSHGDG\QDPLFPRGHORI63,ZKLFKHPEUDFHVWKHIRXQGDWLRQV
RI WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ GHVFULEHG LQ WKH SUHYLRXV FKDSWHU 7KH PRGHO ZDV
JURXQGHG LQ RXU SHUVRQDO H[SHULHQFH DQG REVHUYDWLRQV LQ WKH FDVH VWXGLHV UHODWHG WR WKH
H[WHQVLYH OLWHUDWXUH UHYLHZ DQG IRFXVHG RQ WKH WKUHH UHVHDUFK TXHVWLRQV SRVHG LQ WKH
LQWURGXFWRU\ FKDSWHU RI WKH WKHVLV $ FULWLFDO HOHPHQW IRU GHYHORSLQJ WKH PRGHO ZDV WKH
LQWHJUDWLRQ RI 63, DFWLYLWLHV ZLWK WKH UHDO VLWXDWHG QDWXUH RI VRIWZDUH GHYHORSPHQW DQG WR

±±
&+$37(5

IRFXVRQWKHUROHRIFHUWDLQIDFLOLWDWLQJIDFWRUVLQWKHGLIIXVLRQRINQRZOHGJHDQGH[SHULHQFH
ZLWKLQDQGEHWZHHQJURXSVRIVRIWZDUHGHYHORSHUV
)LUVW RUJDQL]DWLRQDO FRQWH[W ZDV GHVFULEHG DV DQ LPSRUWDQW HOHPHQW WKDW LPSRVHV
FRQVWUDLQWV DQG RSSRUWXQLWLHV DERXW ZKDW DQG KRZ WKH RUJDQL]DWLRQ FDQ OHDUQ 7KXV WZR
FRQWH[WXDO YDULDEOHV ZHUH LQFOXGHG LQ WKH PRGHO WR FDSWXUH WKH PRVW LQIOXHQWLDO VRXUFHV RI
YDULDWLRQ HQYLURQPHQWDO WXUEXOHQFH DQG RUJDQL]DWLRQDO VL]H 7KHQ ZH HPSKDVL]HG WKH
LPSRUWDQFH RI DFNQRZOHGJLQJ WKDW WKH OHDUQLQJ SURFHVV LV D G\QDPLF LQWHUSOD\ EHWZHHQ WZR
SULPDU\ GLDOHFWLFV RQH EHWZHHQ WKH ORFDO DQG RUJDQL]DWLRQDO OHYHO WKH RWKHU EHWZHHQ
JHQHUDWLQJDQGLQWHUSUHWLQJNQRZOHGJH1H[W63,VXFFHVVZDVGHVFULEHGLQWHUPVRIRUJDQL]D
WLRQDO SHUIRUPDQFH DQG WKH VRIWZDUH RUJDQL]DWLRQ¶V SHUFHLYHG OHYHO RI VXFFHVV )LQDOO\ ZH
GHVFULEHGWKHWKHRUHWLFDOMXVWLILFDWLRQVGHWDLOHGFRQFHSWXDOL]DWLRQVDQGK\SRWKHVHVIRUWKHNH\
IDFWRUVRIVXFFHVVLQ63,7KHVHK\SRWKHVHVDUHVXPPDUL]HGLQ7DEOH
,Q WKH QH[W FKDSWHU ZH GHVFULEH WKH MXVWLILFDWLRQV IRU DQG WKH DVVXPSWLRQV EHKLQG WKH
UHVHDUFKDSSURDFKXVHGLQWKLVVWXG\DVZHOODVWKHGHWDLOVRIWKHPHWKRGVXVHGWRGHYHORSWKH
WKHRU\ RSHUDWLRQDOL]H WKH PHDVXUHV FROOHFW WKH GDWD WHVW WKH K\SRWKHVHV DQG DQVZHU WKH
UHVHDUFKTXHVWLRQV7KHK\SRWKHVHVDUHVWDWLVWLFDOO\IRUPXODWHGDQGWHVWHGLQ&KDSWHUZKLOH
WKH GHWDLOV RI WKH HPSLULFDO MXVWLILFDWLRQV DQG RSHUDWLRQDOL]DWLRQV QHFHVVDU\ IRU WHVWLQJ WKH
K\SRWKHVHVDUHGHVFULEHGLQ&KDSWHU

7DEOH5HVHDUFKK\SRWKHVHV

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKEXVLQHVVRULHQWDWLRQ

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKLQYROYHGOHDGHUVKLS

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKHPSOR\HHSDUWLFLSDWLRQ

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKWKHFRQFHUQIRUPHDVXUHPHQW

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKH[SORLWDWLRQRIH[LVWLQJNQRZOHGJH

+\SRWKHVLV 63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKH[SORUDWLRQRIQHZNQRZOHGJH

+\SRWKHVLV 7KHVL[LQGHSHQGHQWYDULDEOHVRIEXVLQHVVRULHQWDWLRQLQYROYHGOHDGHUVKLS
HPSOR\HHSDUWLFLSDWLRQFRQFHUQIRUPHDVXUHPHQWH[SORLWDWLRQRIH[LVWLQJ
NQRZOHGJHDQGH[SORUDWLRQRIQHZNQRZOHGJHZLOOH[SODLQDODUJHDPRXQWRI
WKHYDULDQFHLQ63,VXFFHVV

±±
&+$37(5 
5HVHDUFK0HWKRGRORJ\

³7KHUHLVQRWKLQJVRSUDFWLFDODVDJRRGWKHRU\´
±.XUW/HZLQ

'RLQJUHVHDUFKZKHWKHULQ63,RUDQ\RWKHUILHOGLQYROYHVWZRIXQGDPHQWDOSUREOHPVLQWKH
SXUVXLWRINQRZOHGJHZKLFKDUHRIWHQUHIHUUHGWRDVWKH³HVVHQWLDOSUREOHPVRIVFLHQFH´7KDW
LV ³+RZ GR ZH NQRZ ZKDW ZH NQRZ"´ DQG ³+RZ GR ZH DFTXLUH NQRZOHGJH"´ 7KHVH
SUREOHPVFDQEHWUDFHGEDFNWRWKHDQFLHQW*UHHNVZKRFRQVLGHUHGWKHSULPDU\UROHRIVFLHQFH
ZDVWRWXUQGR[D WKDWZKLFKZDVEHOLHYHGWREHWUXH LQWRHSLVWHPH WKDWZKLFKZDVNQRZQWR
EH WUXH  2Q WKH RWKHU KDQG WKH 6RSKLVWV TXHVWLRQHG KRZ DQG HYHQ LI WKLV FRXOG EH GRQH
7KH\DVNHGZKHWKHULWZDVSRVVLEOHWRDFWXDOO\NQRZWKDWVRPHWKLQJZDVWUXH7KHDUJXPHQW
VLQFHWKHQKDVFHQWHUHGRQZKHWKHUNQRZOHGJHFDQHYHUEH³SURYHQ´
7KLV FKDSWHU GHVFULEHV WKH MXVWLILFDWLRQ IRU DQG WKH DVVXPSWLRQV EHKLQG WKH UHVHDUFK
DSSURDFKXVHGLQWKLVVWXG\DVZHOODVWKHGHWDLOVRIWKHPHWKRGVXVHGWRGHYHORSWKHWKHRU\
RSHUDWLRQDOL]H WKH PHDVXUHV FROOHFW WKH GDWD WHVW WKH K\SRWKHVHV DQG DQVZHU WKH UHVHDUFK
TXHVWLRQV,QRUGHUWR SURYLGH PRUH SHUVSHFWLYHV RQ WKH SKHQRPHQD EHLQJ VWXGLHG D PL[HG
PHWKRGVGHVLJQZDVXVHG7KHPDLQPHWKRGZDVTXDQWLWDWLYH+RZHYHUTXDOLWDWLYHPHWKRGV
ZHUH XVHG LQ D VHFRQGDU\ UROH WR KHOS LQ FRQFHSWXDOL]DWLRQ LQ GHYHORSLQJ WKH WKHRU\ WR
RSHUDWLRQDOL]H GHILQLWLRQV RI FRQFHSWV WR H[WHQG DQG JHQHUDOL]H WKH ILQGLQJV RI WKH PDLQ
PHWKRGDQGWRH[SODLQFDXVHHIIHFWUHODWLRQVKLSV

 -XVWLILFDWLRQIRUWKH0HWKRGRORJ\
$VDUHODWLYHO\\RXQJDFDGHPLFGLVFLSOLQHOLNHVRIWZDUHHQJLQHHULQJPDWXUHVLWLVLPSRUWDQWWR
IROORZ VFLHQWLILF FRQFHSWV DQG PHWKRGV LQ GHYHORSLQJ DQG WHVWLQJ WKHRULHV DERXW VRIWZDUH
SURFHVVHV DQG WKH DSSURDFKHV XVHG WR LPSURYH WKHP 6RIWZDUH HQJLQHHULQJ KDV GRQH DQ
RXWVWDQGLQJ MRE RI GHYHORSLQJ VSHFLILF VROXWLRQV WR VSHFLILF SUREOHPV +RZHYHU VLQFH
VRIWZDUHHQJLQHHULQJ UHVHDUFKLVRIWHQPRUH VROXWLRQGULYHQ WKDQ SUREOHPIRFXVHG D FDUHIXO
DQDO\VLVRIWKHSUREOHPVWKDWSUDFWLWLRQHUVIDFHRIWHQUHYHDOVWKDWZKDWWKHUHVHDUFKHUWKLQNVLV

±±
&+$37(5

DPDMRUSUDFWLFDOSUREOHPKDVOLWWOHVLJQLILFDQFHZKHUHDVWKHQHJOHFWHGSUREOHPRIWHQWXUQV
RXW WR EH LPSRUWDQW 3RWWV   0RUHRYHU PXFK RI WKH UHVHDUFK LV PHUH DGYRFDF\ UDWKHU
WKDQYDOLGUHVHDUFKIROORZLQJDPRGHOFKDUDFWHUL]HGE\³FRQFHLYHDQLGHDDQDO\]HWKHLGHD
DGYRFDWHWKHLGHD´ *ODVVS  7KXV WKHUH LV D QHHG IRU VROLG DQG UHOHYDQW WKHRU\
EDVHG RQ VRXQG DQG ULJRURXV HPSLULFDO PHWKRGV RI ERWK WHFKQRORJLFDO DQG RUJDQL]DWLRQDO
SKHQRPHQDLQRUGHUWRLPSURYHVRIWZDUHHQJLQHHULQJSURFHVVHV
,Q&KDSWHUZHDUJXHGWKDWVRIWZDUHGHYHORSPHQWLVDVRFLDOSURFHVVDQGFRQVHTXHQWO\
WKDWVRIWZDUHSURFHVVLPSURYHPHQWLVDVRFLDOO\FRQVWUXFWHGOHDUQLQJSURFHVV8QOLNHQDWXUDO
SURFHVVHVZKLFKRFFXUVVHSDUDWHIURPRXUSHUFHSWLRQVRILWVRFLDOSURFHVVHVDUHFRQVWUXFWVRI
KXPDQ LQWHQWLRQ DQG FRQVFLRXVQHVV 6LPLODUO\ DOO UHVHDUFK LV EDVHG RQ VRPH XQGHUO\LQJ
DVVXPSWLRQV DERXW ZKDW FRQVWLWXWHV ³YDOLG´ UHVHDUFK DQG ZKLFK UHVHDUFK PHWKRGV DUH
DSSURSULDWH 7KHUHIRUH SULRU WR GHFLGLQJ ZKLFK UHVHDUFK PHWKRG WR XVH LW LV LPSRUWDQW WR
NQRZZKDWWKHVH VRPHWLPHVKLGGHQ DVVXPSWLRQVDUH
)XUWKHUPRUHZHZRXOGOLNHWRHPSKDVL]HWKDWDOOUHVHDUFKLVDVRFLDOFRQVWUXFWLRQVLQFH
DOOUHVHDUFKSURFHGXUHVQHFHVVDULO\LQYROYHLQGLYLGXDOVWKHLUDFWLYLWLHVDQGWKHLU LQVWLWXWLRQV
LQ LWV LQVWDQWLDWLRQ 5HVHDUFK WKHUHIRUH LV D FRQYHQWLRQ ± UHODWHG WR VRFLHWDO QRUPV
H[SHFWDWLRQV DQG YDOXHV ± ZKLFK LV XVHG WR HQJDJH LQ D VHDUFK IRU NQRZOHGJH DQG
XQGHUVWDQGLQJ,QWKHZRUGVRI/HH D 

5HVHDUFKLQP\YLHZFRQVLVWVRILQGLYLGXDODQG JURXSDFWLYLW\ DLPHGDWWKHFRQVWUXFWLRQRI


WKHRULHV ZKHWKHU WKH\ DUH WKHRULHV DERXW QDWXUH RU WKHRULHV DERXW LQGLYLGXDOV JURXSV
RUJDQL]DWLRQV DQG VRFLHW\ $V VXFK WKHRULHV DUH RQO\ WKHRULHV WKH\ DUH ILFWLRQV WKH\ DUH
VRFLDOFRQVWUXFWLRQV7KH\DUHQRWDOUHDG\µWKHUH¶ZDLWLQJWREHGLVFRYHUHGUDWKHUZHLQYHQW
WKHP LELGS 

7KXVZHGHILQH63,UHVHDUFKDV HLWKHU HQKDQFLQJ H[LVWLQJ WKHRU\ RU EXLOGLQJ QHZ WKHRU\ LQ


RUGHUWRLPSURYHWKHSUDFWLFHRIVRIWZDUHGHYHORSPHQWLQRUJDQL]DWLRQV$VLJQLILFDQWHOHPHQW
LQWKLVGHILQLWLRQLVWKDWXQOLNHFRPSXWHUVFLHQFH63,LQYROYHVERWKWKHVRIWZDUHV\VWHPDQG
WKHRUJDQL]DWLRQ+HQFHWKHVRIWZDUHV\VWHPDQGWKHRUJDQL]DWLRQDOFRQWH[WPXVWEHVWXGLHG
XQGHUVWRRGDQGPDQDJHGWRJHWKHUQRWVHSDUDWHO\
.XKQ  GLVFXVVHGWKHLPSRUWDQFHRI³SDUDGLJP´LQH[SODLQLQJUHVHDUFKDVVXPSWLRQV
DUJXLQJ WKDW SDUDGLJPV DUH ³XQLYHUVDOO\ UHFRJQL]HG VFLHQWLILF DFKLHYHPHQWV WKDW IRU D WLPH
SURYLGHPRGHOSUREOHPVDQGVROXWLRQVWRDFRPPXQLW\RISUDFWLWLRQHUV´ LELGS[ 5DWKHU
WKDQ.XKQ¶V  VSHFLDOL]HGQRWLRQZHXVHSDUDGLJPLQWKHEURDGHUVHQVHRI%XUUHOODQG
0RUJDQ  ZKRFKDUDFWHUL]HGWKHWHUPDVD³FRPPRQDOLW\RISHUVSHFWLYHZKLFKELQGVWKH
ZRUN RI D JURXS RI WKHRULVWV WRJHWKHU´ LELG S   :H DUJXH WKDW WKH SHUFHSWLRQ RI
³SDUDGLJP´ LV DQ LPSRUWDQW LVVXH IRU WKH XQGHUVWDQGLQJ RI 63, UHVHDUFK ,QGHHG *XED DQG
/LQFROQ  PDLQWDLQHGWKDW³4XHVWLRQVRIPHWKRGDUHVHFRQGDU\WRTXHVWLRQVRISDUDGLJP
ZKLFKZHGHILQHDVWKHEDVLFEHOLHIV\VWHPRUZRUOGYLHZWKDWJXLGHVWKHLQYHVWLJDWRUQRWRQO\
LQFKRLFHVRIPHWKRGEXWLQRQWRORJLFDOO\DQGHSLVWHPRORJLFDOO\IXQGDPHQWDOZD\V´ LELGS
 
7KXVWKHEDVLFEHOLHIVWKDWGHILQHDUHVHDUFKSDUDGLJPFDQEHVXPPDUL]HGE\WKHDQVZHUV
JLYHQ WR WKH WKUHH IXQGDPHQWDO TXHVWLRQV RI RQWRORJ\ HSLVWHPRORJ\ DQG PHWKRGRORJ\
)XUWKHUPRUH WKHVH TXHVWLRQV DUH LQWHUUHODWHG VR WKH DQVZHU WR RQH TXHVWLRQ ZLOO FRQVWUDLQ
KRZ WKH RWKHUV FDQ EH DQVZHUHG 7KH RQWRORJLFDO TXHVWLRQ LV DERXW WKH IRUP DQG QDWXUH RI
UHDOLW\DQGWKHUHIRUHDERXWZKDWWKHUHLVWKDWFDQEHNQRZQDERXWLW)RUH[DPSOHLID³UHDO´
ZRUOGLVDVVXPHGWKHQZKDWFDQEHNQRZQDERXWLWLV³KRZWKLQJVUHDOO\DUH´DQG³KRZWKLQJV
UHDOO\ ZRUN´ LELG S  ,Q WKLV FDVH RQO\ TXHVWLRQV WKDW UHODWH WR PDWWHUV RI ³UHDO´

±±
5(6($5&+0(7+2'2/2*<

H[LVWHQFHDQG³UHDO´DFWLRQVDUHDGPLVVLEOH2WKHUTXHVWLRQVVXFKDVWKRVHFRQFHUQLQJYDOXH
RUPRUDOZRXOGIDOORXWVLGHWKHUHDOPRIOHJLWLPDWHVFLHQWLILFLQTXLU\
7KH HSLVWHPRORJLFDO TXHVWLRQ GHDOV ZLWK WKH QDWXUH RI WKH UHODWLRQVKLS EHWZHHQ WKH
UHVHDUFKHUDQGZKDWFDQEHNQRZQ7KHDQVZHUWRWKLVTXHVWLRQLVFRQVWUDLQHGE\WKHDQVZHU
JLYHQ WR WKH RQWRORJLFDO TXHVWLRQ 7KXV LI D ³UHDO´ ZRUOG LV DVVXPHG WR H[LVW WKHQ WKH
UHVHDUFKHUPXVWEHREMHFWLYHO\GHWDFKHGIURPWKHSKHQRPHQRQXQGHUVWXG\DQGYDOXHIUHHLQ
RUGHUWRGLVFRYHU³KRZWKLQJVUHDOO\DUH´DQG³KRZWKLQJVUHDOO\ZRUN´
7KH PHWKRGRORJLFDO TXHVWLRQ GHDOV ZLWK KRZ WKH UHVHDUFKHU JDLQV NQRZOHGJH DERXW WKH
SKHQRPHQRQXQGHUVWXG\$JDLQWKHDQVZHUWKDWFDQEHJLYHQWRWKLVTXHVWLRQLVFRQVWUDLQHG
E\WKHDQVZHUVDOUHDG\JLYHQE\WKHILUVWWZRTXHVWLRQV7KDWLVLID³UHDO´ZRUOGLVDVVXPHG
WRH[LVWDQGWKHUHVHDUFKHUVWULYHVWREHDQ³REMHFWLYH´REVHUYHULQWKHSXUVXLWRINQRZOHGJH
WKHQQRWMXVWDQ\PHWKRGRORJ\LVDSSURSULDWH7KXV³WKHPHWKRGRORJLFDOTXHVWLRQFDQQRWEH
UHGXFHGWRDTXHVWLRQRIPHWKRGVPHWKRGVPXVWEHILWWHGWRDSUHGHWHUPLQHGPHWKRGRORJ\´
LELGS 
$OWKRXJKSDUDGLJPVGHDOZLWKILUVWSULQFLSOHVRU³XOWLPDWHV´ 'HQ]LQDQG/LQFROQ 
WKHVHWVRIDQVZHUVJLYHQWRWKHRQWRORJLFDOHSLVWHPRORJLFDODQGPHWKRGRORJLFDOTXHVWLRQVDUH
DOZD\VKXPDQFRQVWUXFWLRQVVXEMHFWWRKXPDQHUURU DQG VRFLDO DFFHSWDQFH 7KH\ GHILQH WKH
ZRUOGYLHZ RI WKH UHVHDUFKHU EXW ³7KHVH EHOLHIV FDQ QHYHU EH HVWDEOLVKHG LQ WHUPV RI WKHLU
XOWLPDWHWUXWKIXOQHVV LELGS 
0XFK RI WKH GHEDWH FRQFHUQLQJ WKH DSSOLFDELOLW\ RI UHVHDUFK PHWKRGV RULJLQDWHV LQ D
SRODUL]DWLRQ RU ³SDUDGLJP ZDU´ EHWZHHQ WKH SRVLWLYLVW SDUDGLJP DQG WKH LQWHUSUHWDWLYH
SDUDGLJP :H DUJXH WKDW LW LV RI JUHDW LPSRUWDQFH IRU 63, UHVHDUFK WR XQGHUVWDQG WKH
DVVXPSWLRQV EHKLQG WKHVH SDUDGLJPV %URDGO\ XQGHUVWRRG SRVLWLYLVP LV D SKLORVRSK\ WKDW
DUJXHV IRU WKH DSSOLFDWLRQ RI WKH PHWKRGV RI WKH QDWXUDO VFLHQFHV WR WKH VRFLDO VFLHQFHV DQG
WKHUHE\SUHVXSSRVHVWKHXQLW\ RI VFLHQFH 'HODQW\   7KH LQWHUSUHWLYH DSSURDFK RQ WKH
RWKHUKDQGPDLQWDLQVWKDWWKHPHWKRGVRIWKHQDWXUDOVFLHQFHVDUHLQDGHTXDWHWRWKHVWXG\RI
VRFLDO UHDOLW\ /HH   )XUWKHUPRUH WKH SRVLWLYLVW SDUDGLJP XQGHUOLHV ZKDW LV FDOOHG
TXDQWLWDWLYH PHWKRGV ZKLOH WKH LQWHUSUHWDWLYH SDUDGLJP XQGHUOLHV TXDOLWDWLYH PHWKRGV
7DVKDNNRUL DQG 7HGGOLH   7KHUHIRUH WKH GHEDWH EHWZHHQ WKHVH WZR SDUDGLJPV KDV
VRPHWLPHVEHHQFDOOHGWKHTXDOLWDWLYHTXDQWLWDWLYHGHEDWH 5HLFKDUGWDQG5DOOLV 
7KHRQWRORJLFDOSRVLWLRQDGRSWHGE\WKHSRVLWLYLVWVLVRQHRI³QDwYHUHDOLVP´,WSRVWXODWHV
WKDWWKHZRUOGLVDQREMHFWLYHO\JLYHQUHDOLW\DQGWKDWWKHREMHFWVDQGVWUXFWXUHVRIWKHZRUOG
H[LVWDVHPSLULFDOHQWLWLHVRQWKHLURZQLQGHSHQGHQWRIWKHREVHUYHU¶VDSSUHFLDWLRQRIWKHP
7KLV QDwYH UHDOLVP LV KRZHYHU RIWHQ UHSODFHG ZLWK D PRUH PRGHUDWH IRUP RI ³VFLHQWLILF
UHDOLVP´ ZKLFK KROGV WKDW WKH REMHFWLYH ZRUOG FDQ RQO\ EH NQRZQ WKURXJK PRGHOV RI WKH
ZRUOG7KHVHPRGHOVDUHQRWDEVROXWH±WKH\FDQQHYHUEHNQRZQZLWKFHUWDLQW\±WKHUHIRUH
WKH MRE RI VFLHQFH LV WR GHYHORS EHWWHU PRGHOV RI WKH ZRUOG $V VXFK WKH ORJLFDO SRVLWLYLVW
EHOLHILQ³FRQILUPDWLRQ´LVRIWHQUHSODFHGE\3RSSHU¶V  FRQFHSWRI³IDOVLILFDWLRQ´ &RRN
DQG&DPSEHOO 
7KH SRVLWLYLVW HSLVWHPRORJ\ LV HVVHQWLDOO\ EDVHG RQ WKH WUDGLWLRQDO DSSURDFKHV LQ WKH
QDWXUDOVFLHQFHV7KHLQYHVWLJDWRUDQGWKHLQYHVWLJDWHG³REMHFW´DUHDVVXPHGWREHLQGHSHQGHQW
HQWLWLHV DQG WKH LQYHVWLJDWRU WR EH FDSDEOH RI VWXG\LQJ WKH REMHFW ZLWKRXW LQIOXHQFLQJ LW
)XUWKHUPRUH YDOXHV DQG ELDVHV DUH SUHYHQWHG IURP LQIOXHQFLQJ RXWFRPHV VR ORQJ DV WKH
SUHVFULEHG UHVHDUFK SURFHGXUHV DUH ULJRURXVO\ IROORZHG *XED DQG /LQFROQ   ,Q WKLV
SHUVSHFWLYHWKHJURZWKRINQRZOHGJHLVDFXPXODWLYHSURFHVVLQZKLFKQHZLQVLJKWVDUHDGGHG

±±
&+$37(5

WR H[LVWLQJ RQHV DQG IDOVH K\SRWKHVHV DUH HOLPLQDWHG LQ D VHDUFK IRU UHJXODULWLHV DQG FDXVDO
UHODWLRQVKLSV
7\SLFDOO\ SRVLWLYLVW UHVHDUFK LV EDVHG RQ TXDQWLWDWLYH PHWKRGV VXFK DV VXUYH\V DQG
H[SHULPHQWVDLPHGDWGHGXFWLYHO\WHVWLQJWKHRULHVZKLFKDUHRIWHQH[SUHVVHGDVK\SRWKHVHVLQ
WHUPV RI LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV ,Q SUDFWLFH WKHUHIRUH SRVLWLYLVW UHVHDUFK
PHWKRGV LQYROYH WKUHH LQWHUUHODWHG VHWV RI ORJLF WKH UXOHV RI IRUPDO ORJLF WKH UXOHV RI
H[SHULPHQWDO DQG TXDVLH[SHULPHQWDO GHVLJQ DQG WKH UXOHV RI K\SRWKHWLFRGHGXFWLYH ORJLF
/HH D  ,Q VXPPDU\ SRVLWLYLVP LV D VRFLDOO\ FRQVWUXFWHG ZRUOG SRSXODWHG ZLWK
UHVHDUFKHUVZKRVHVKDUHGEHOLHIVLQFOXGHWKHLQWHUUHODWHGORJLFSURYLGHGE\WKHDQVZHUVJLYHQ
WRWKHRQWRORJLFDOHSLVWHPRORJLFDODQGPHWKRGRORJLFDOTXHVWLRQVGHVFULEHGDERYH
$SSDUHQWO\WKHYDVWPDMRULW\RI63,UHVHDUFKLVGRQHIURPDSRVLWLYLVWSHUVSHFWLYH7KLVLV
UHIOHFWHG E\ WKH ODUJH QXPEHU RI 63, SDSHUV GHDOLQJ ZLWK WHFKQLFDO LVVXHV &RQVROLQL DQG
)RQDGH  )XJJHWWD  *ODVV   7KLV LV QRW VXUSULVLQJ VLQFH PRVW VRIWZDUH
HQJLQHHULQJUHVHDUFKHUVKDYHWKHLUEDFNJURXQGLQWKHFRPSXWHUVFLHQFHDQGHQJLQHHULQJILHOGV
WZRRIWKHVRFDOOHG³KDUG´GLVFLSOLQHV,QGHHGLWVHHPVDVDFRQILUPDWLRQRI.DSODQ¶V 
/DZ RI WKH ,QVWUXPHQW ³*LYH D VPDOO ER\ D KDPPHU DQG KH ZLOO ILQG WKDW HYHU\WKLQJ KH
HQFRXQWHUV QHHGV SRXQGLQJ ,W FRPHV DV QR SDUWLFXODU VXUSULVH WR GLVFRYHU WKDW D VFLHQWLVW
IRUPXODWHVSUREOHPVLQDZD\ZKLFKUHTXLUHVIRUWKHLUVROXWLRQMXVWWKRVHWHFKQLTXHVLQZKLFK
KHKLPVHOILVHVSHFLDOO\VNLOOHG´ LELGS 
&RQWUDU\WRWKHSRVLWLYLVWSDUDGLJPWKHRQWRORJLFDOSRVLWLRQDGRSWHGE\WKHLQWHUSUHWLYH
SDUDGLJPLVHVVHQWLDOO\UHODWLYLVWLFZKLFKLPSOLHVWKDWRQHPXVWXQGHUVWDQGWKHZRUOGIURPWKH
LQVLGHUDWKHUWKDQWKHRXWVLGH7KHLQWHUSUHWLYLVWKROGVWKDWUHDOLW\LVDVXEMHFWLYHFRQVWUXFWLRQ
RIWKHPLQGDQGWKDWLWVIRUPDQGFRQWHQWGHSHQGVRQWKHLQGLYLGXDOKROGLQJWKHFRQVWUXFWLRQ
7KXV ZKDW LV VXEMHFWLYHO\ H[SHULHQFHG DV DQ REMHFWLYH UHDOLW\ H[LVWV RQO\ LQ WKH REVHUYHU¶V
PLQG6XFKFRQVWUXFWLRQVDUHQRWPRUHRUOHVV³WUXH´LQDQ\DEVROXWHVHQVHEXWVLPSO\PRUH
RU OHVV LQIRUPHG DQGRU VRSKLVWLFDWHG *XED DQG /LQFROQ   %HVLGHV WKH SURFHVV RI
LQWHUSUHWDWLRQLVLWHUDWLYHZKLFKPHDQVWKDWWKHVXEMHFWLYHFRQVWUXFWLRQVDQGWKHLUDVVRFLDWHG
³UHDOLWLHV´DUHDOWHUDEOH$VDUHVXOWLWLVKDUGIRUDUHVHDUFKHUZLWKLQWKHLQWHUSUHWLYHSDUDGLJP
WRJHQHUDWHREMHFWLYHNQRZOHGJH
$V VHHQ IURP WKH LQWHUSUHWLYH SDUDGLJP WKH FRQYHQWLRQDO GLVWLQFWLRQ EHWZHHQ RQWRORJ\
DQGHSLVWHPRORJ\GLVDSSHDUVVLQFH³7KHLQYHVWLJDWRUDQGWKHREMHFWRI LQYHVWLJDWLRQ DUH DV
VXPHGWREHLQWHUDFWLYHO\OLQNHGVRWKDWWKHµILQGLQJV¶DUHOLWHUDOO\FUHDWHGDVWKHLQYHVWLJDWLRQ
SURFHHGV´ *XEDDQG/LQFROQSHPSKDVLVLQRULJLQDO $VVXFKWKHLQWHUSUHWLYH
UHVHDUFKHUXVHVKLPVHOIRUKHUVHOIDVWKHLQVWUXPHQWRIREVHUYDWLRQ /HHD 
)URP D PHWKRGRORJLFDO SRLQW RI YLHZ LQWHUSUHWLYLVW UHVHDUFK FDQ EH VHHQ DV WDNLQJ D
KHUPHQHXWLFDO DSSURDFK WR WKH LQWHUSUHWDWLRQ RI KXPDQ DQG RUJDQL]DWLRQDO EHKDYLRU ,W LV
IRFXVHGRQXQGHUVWDQGLQJDSKHQRPHQRQLQLWVFRQWH[W7KLVYLHZGUDZVXSRQWKHQRWLRQRI
WKHKHUPHQHXWLFFLUFOH,QRUGHUWRXQGHUVWDQGWKHSDUWWKHLQTXLUHUPXVWJUDVSWKHZKROHDQG
YLFHYHUVD 6FKZDQGW &RQVHTXHQWO\WKHLQWHUSUHWLYHUHVHDUFKHUW\SLFDOO\PDNHVDQLQ
GHSWKLQTXLU\RIDSDUWLFXODUFDVHDVLQJOHHQWLW\RUDVSHFLILFHYHQWXVLQJTXDOLWDWLYHPHWKRGV
VXFK DV FDVH VWXG\ RU DFWLRQ UHVHDUFK ,Q VXPPDU\ WKHQ LQWHUSUHWLYLVP QR OHVV WKDQ
SRVLWLYLVP LV LWVHOI D VRFLDOO\ FRQVWUXFWHG ZRUOG SRSXODWHG ZLWK UHVHDUFKHUV ZKRVH VKDUHG
EHOLHIV LQFOXGH WKH FRQFHSWV RI KXPDQO\ FUHDWHG PHDQLQJV ZLWK WKH UHVHDUFKHU KLPVHOI RU
KHUVHOIDVWKHLQVWUXPHQWRIREVHUYDWLRQLQDQLQWULQVLFDOO\LWHUDWLYHSURFHVVRILQWHUSUHWDWLRQ
%DVHGRQWKHSUHFHGLQJGLVFXVVLRQWKHSRVLWLYLVWDSSURDFKDQGWKHLQWHUSUHWLYHDSSURDFK
ZRXOG DSSHDU WR EH LQ RSSRVLWLRQ +RZHYHU LW LV LPSRUWDQW WR QRWH WKDW UHJDUGOHVV RI WKH

±±
5(6($5&+0(7+2'2/2*<

UHVHDUFKSDUDGLJPERWKWKHUHVHDUFKSURGXFWDQGWKHUHVHDUFKSURFHVVLVVRFLDOO\FRQVWUXFWHG
5HVHDUFKWKHUHIRUH³LVQRWDQHQWLW\WKDWKDVDQH[LVWHQFHLQGHSHQGHQWRINQRZLQJVXEMHFWV
UHVHDUFK HYHQUHVHDUFKLQWKHQDWXUDOVFLHQFHV LVDKXPDQFUHDWLRQDQGVRFLDODFWLYLW\´ /HH
DS 
%XUUHOO DQG 0RUJDQ   FRQWHQGHG WKDW WKH RQWRORJLFDO HSLVWHPRORJLFDO DQG
PHWKRGRORJLFDO DVVXPSWLRQV XSRQ ZKLFK HDFK SDUDGLJP LV EDVHG DUH VR FRQWUDGLFWRU\ WKDW
WKH\ DUH PXWXDOO\ H[FOXVLYH 6HYHUDO RWKHU DXWKRUV KDYH IXHOHG WKH SDUDGLJP ZDU ZLWK
VWDWHPHQWV DERXW WKHLU LQFRPSDWLELOLW\ )RU H[DPSOH *XED   VWDWHG WKDW RQH SDUDGLJP
SUHFOXGHV WKH RWKHU ³MXVW DV VXUHO\ DV WKH EHOLHI LQ D URXQG ZRUOG SUHFOXGHV EHOLHI LQ D IODW
RQH´ LELGS ZKLOH6PLWK  VWDWHGWKHLQFRPSDWLELOLW\WKHVLVDVIROORZV

2QHDSSURDFKWDNHVDVXEMHFWREMHFWSRVLWLRQRQWKHUHODWLRQVKLSWRVXEMHFWPDWWHUWKHRWKHU
WDNHVDVXEMHFWVXEMHFWSRVLWLRQ2QHVHSDUDWHVIDFWVDQGYDOXHVZKLOHWKHRWKHUVHHVWKHP
DV LQH[WULFDEO\ PL[HG 2QH VHDUFKHV IRU ODZV DQG WKH RWKHU VHHNV XQGHUVWDQGLQJ 7KHVH
SRVLWLRQVGRQRWVHHPFRPSDWLEOH LELGS 

2SSRQHQWVRI³SDUDGLJPLQFRPPHQVXUDELOLW\´FRXQWHUZLWKDUJXPHQWVWKDWZKLOHWKHFHQWUDO
DVVXPSWLRQV RI HDFK SDUDGLJP DUH LQGHHG LQFRPSDWLEOH WKH SDUDGLJP ERXQGDULHV DUH
SHUPHDEOH +DVVDUG  /HH  D  )XUWKHUPRUH *LRLD DQG 3LWUH   DUJXHG
WKDWSHUVSHFWLYHVLQYROYLQJPXOWLSOHSDUDGLJPVRSHQPRUHZLQGRZVWKURXJKZKLFKWRYLHZD
SDUWLFXODUSKHQRPHQRQSHUPLWWLQJDPRUHFRPSUHKHQVLYHRXWORRN

7KLV VWDQFH LPSOLHV WKDW WKH SURYLQFLDOLVP WKDW FRPHV ZLWK SDUDGLJP FRQILQHPHQW PLJKW
LQVWHDG EH WXUQHG WRZDUG WKH SURGXFWLRQ RI PRUH FRPSOHWH YLHZV RI RUJDQL]DWLRQDO
SKHQRPHQDYLDPXOWLSDUDGLJPFRQVLGHUDWLRQ LELGS 

6FKXOW] DQG +DWFK   LQWURGXFHG WKH FRQFHSW RI LQWHUSOD\ EHWZHHQ SDUDGLJPV 7KH\
DUJXHG WKDW DSDUW IURP SDUDGLJP LQFRPPHQVXUDELOLW\ WKHUH DUH WZR SDUDGLJPDWLF SRVLWLRQV
WKDW FDQ EH XVHG IRU PXOWLSDUDGLJP UHVHDUFK   SDUDGLJP LQWHJUDWLRQ V\QWKHVL]HV
FRQWULEXWLRQV IURP GLIIHUHQW SDUDGLJPV LQ DQ DWWHPSW WR DFKLHYH D PRUH JHQHUDO PRGHO RU
WKHRU\ ZKLOH   SDUDGLJP FURVVLQJ SRVWXODWHV LQWHUGHSHQGHQW UHODWLRQVKLSV EHWZHHQ
SDUDGLJPVHPSKDVL]LQJLQWHUSDUDGLJPDWLFFRQWUDVWVDQGFRQQHFWLRQV
)XUWKHUPRUH 6FKXOW] DQG +DWFK   LGHQWLILHG IRXU EDVLF DSSURDFKHV WR SDUDGLJP
FURVVLQJ VHTXHQWLDO SDUDOOHO EULGJLQJ DQG LQWHUSOD\ ,Q VHTXHQWLDO SDUDGLJP FURVVLQJ WKH
UHVXOWVRIUHVHDUFKLQRQHSDUDGLJPDUHXVHGWRLQIRUPRUDGYDQFHUHVHDUFKLQDQRWKHUZKLOH
SDUDOOHO SDUDGLJP FURVVLQJ DSSOLHV GLIIHUHQW SDUDGLJPV DW WKH VDPH WLPH WR D SDUWLFXODU
SUREOHP%ULGJLQJHPSKDVL]HVVLPLODULWLHVEHWZHHQSDUDGLJPVDW WKH H[SHQVH RI GLIIHUHQFHV
ZKLOH SDUDGLJP LQWHUSOD\ VLPXOWDQHRXVO\ DFNQRZOHGJHV ERWK GLIIHUHQFHV DQG VLPLODULWLHV
EHWZHHQSDUDGLJPV
$FNQRZOHGJLQJ WKH JDS EHWZHHQ WKH WZR PDMRU SDUDGLJPV RI RUJDQL]DWLRQDO DQG
LQIRUPDWLRQV\VWHPVUHVHDUFK/HH  UHIUDPHGWKLVJDSDVD³GLYHUVLW\´LQPHWKRGVZKRVH
HIIHFWLVDPXWXDOO\ VXSSRUWHG FROODERUDWLRQ UDWKHU WKDQ D ZLGHQLQJ VHSDUDWLRQ EHWZHHQ WKH
SRVLWLYLVW DQG LQWHUSUHWLYH DSSURDFKHV 8VLQJ D VHTXHQWLDO SDUDGLJP FURVVLQJ DSSURDFK KH
SURSRVHG DQ LQWHJUDWHG PRGHO RI WKH SRVLWLYLVW DQG LQWHUSUHWLYH DSSURDFKHV LQ ZKLFK KH
LGHQWLILHGWKUHHOHYHOVRIXQGHUVWDQGLQJVXEMHFWLYHXQGHUVWDQGLQJLQWHUSUHWLYHXQGHUVWDQGLQJ
DQG SRVLWLYLVW XQGHUVWDQGLQJ )LJXUH  GHSLFWV WKH F\FOLFDO QDWXUH RI WKHVH WKUHH OHYHOV RI
XQGHUVWDQGLQJ 7KH VXEMHFWLYH XQGHUVWDQGLQJ FRQVLVWV RI WKH HYHU\GD\ FRPPRQ VHQVH DQG
HYHU\GD\ PHDQLQJV ZLWK ZKLFK WKH KXPDQ VXEMHFWV VHH WKHPVHOYHV DQG WKH RUJDQL]DWLRQDO

±±
&+$37(5

ZRUOG DURXQG WKHP DQG ZKLFK JLYH ULVH WR WKH EHKDYLRU WKDW WKH\ PDQLIHVW LQ VRFLDOO\
FRQVWUXFWHGVHWWLQJV,WSURYLGHVWKHEDVLVRQZKLFKWRGHYHORSWKHLQWHUSUHWLYHXQGHUVWDQGLQJ
7KHLQWHUSUHWLYHXQGHUVWDQGLQJEHORQJVWRWKHREVHUYLQJUHVHDUFKHUDQGLVWKHUHVHDUFKHU¶V
UHDGLQJ RU LQWHUSUHWDWLRQ RI WKH VXEMHFWLYH XQGHUVWDQGLQJ /HH   PDGH LW FOHDU WKDW ³D
GLIIHUHQWUHDGLQJRULQWHUSUHWDWLRQRIZKDWWKHRUJDQL]DWLRQPHDQVWRWKHKXPDQVXEMHFWVZLOO
OHDGWRDGLIIHUHQWWKHRUHWLFDOH[SODQDWLRQIRUKRZWKHKXPDQVXEMHFWVEHKDYH´ LELGS 
,Q RWKHU ZRUGV WKH LQWHUSUHWLYH XQGHUVWDQGLQJ ZLOO LQIOXHQFH RXU FKRLFH RI WKHRU\ DQG WKH
PRGLILFDWLRQVRIWKLVWKHRU\LQWKHSURFHVVRIUHILQLQJWKHUHVHDUFKPRGHO2QFHLWLVMXGJHG
YDOLG WKH LQWHUSUHWLYH XQGHUVWDQGLQJ SURYLGHV WKH EDVLV RQ ZKLFK WR GHYHORS WKH SRVLWLYLVW
XQGHUVWDQGLQJ
/LNH WKH LQWHUSUHWLYH XQGHUVWDQGLQJ WKH SRVLWLYLVW XQGHUVWDQGLQJ DOVR EHORQJV WR WKH
RUJDQL]DWLRQDO UHVHDUFKHU LW LV WKH RQH WKDW WKH UHVHDUFKHU FRQVWUXFWV DQG WHVWV LQ RUGHU WR
H[SODLQ WKH HPSLULFDO UHDOLW\ EHLQJ LQYHVWLJDWHG 7KLV H[SODQDWLRQ WDNHV WKH IRUP RI IRUPDO
SURSRVLWLRQVDQG REH\V WKH VDPH UXOHV RI IRUPDO ORJLF DQG FRQWUROOHG HPSLULFDO WHVWLQJ WKDW
DSSO\WRVFLHQWLILFH[SODQDWLRQVLQJHQHUDO/HH  HPSKDVL]HGWKDWWKHFRQVWUXFWLRQRID
SRVLWLYLVWXQGHUVWDQGLQJZLWKRXWWKHDLGRIDFDUHIXOLQWHUSUHWDWLRQRIWKHVXEMHFWLYHPHDQLQJV
ZRXOG LQYLWH ³HWKQRFHQWULVP´ 7KDW LV WKH DSSOLFDWLRQ RI WKH UHVHDUFKHU¶V RZQ VXEMHFWLYH
PHDQLQJV WKDW H[LVW LQ KLV RU KHU RZQ FXOWXUH RU RUJDQL]DWLRQ WR WKH SKHQRPHQRQ XQGHU
REVHUYDWLRQLQVWHDGRIWKHVXEMHFWLYHPHDQLQJV WKDW H[LVW LQ WKH REVHUYHG FXOWXUH RU RUJDQL
]DWLRQ
,Q VXPPDU\ WKH VXEMHFWLYH XQGHUVWDQGLQJ SURYLGHV WKH EDVLV WR WKH LQWHUSUHWLYH
XQGHUVWDQGLQJ ZKLFK SURYLGHV WKH EDVLV WR WKH SRVLWLYLVW XQGHUVWDQGLQJ IURP ZKLFK IROORZ
SUHGLFWLRQV DERXW WKH VXEMHFW¶V DFWLRQV 7KURXJK WKH F\FOLFDO UHODWLRQVKLSV EHWZHHQ WKHVH
XQGHUVWDQGLQJV WKHUH DUH WKUHH WHVWV WKDW WKH SRVLWLYLVW XQGHUVWDQGLQJ PD\ XQGHUJR /HH
 )LUVWWKHRUJDQL]DWLRQDOUHVHDUFKHUVKRXOGHQVXUHWKDWWKHVXEMHFWLYHPHDQLQJVHDUOLHU
UHFRUGHGLQWKHLQWHUSUHWLYHXQGHUVWDQGLQJKDYHEHHQEXLOWLQWRWKHSRVLWLYLVWXQGHUVWDQGLQJ
6HFRQG WKH RUJDQL]DWLRQDO UHVHDUFKHU VKRXOG HQVXUH WKDW WKH DFWLRQV WKHRUL]HG E\ WKH
SRVLWLYLVW XQGHUVWDQGLQJ ZRXOG EH XQGHUVWDQGDEOH WR WKH REVHUYHG VXEMHFWV WKHPVHOYHV LQ
WHUPV RI WKHLU RZQ VXEMHFWLYH XQGHUVWDQGLQJ )LQDOO\ WKH RUJDQL]DWLRQDO UHVHDUFKHU VKRXOG
FRPSDUHWKHEHKDYLRUWKDWWKHSRVLWLYLVWXQGHUVWDQGLQJSUHGLFWVDJDLQVWWKHEHKDYLRUWKDWWKH
UHVHDUFKHU DFWXDOO\ REVHUYHV ,Q RWKHU ZRUGV WKH SXUSRVH RI WKH ILQDO WHVW LV WR FRQILUP RU
GLVFRQILUPWKHSRVLWLYLVWXQGHUVWDQGLQJWKURXJKFRQWUROOHGHPSLULFDOWHVWLQJDFFRUGLQJWRWKH
UXOHVRIIRUPDOORJLFDQGWKHUXOHVRIK\SRWKHWLFRGHGXFWLYHORJLF

WKH
LQWHUSUHWLYH
XQGHUVWDQGLQJ

WKH WKH
VXEMHFWLYH SRVLWLYLVW
XQGHUVWDQGLQJ XQGHUVWDQGLQJ

)LJXUH/HH¶V  PRGHOIRULQWHJUDWLQJSRVLWLYLVWDQGLQWHUSUHWLYHDSSURDFKHV

±±
5(6($5&+0(7+2'2/2*<

7DEOH&RPSDULVRQDPRQJWKHPDMRUUHVHDUFKSDUDGLJPV DGDSWHGIURP7DVKDNNRULDQG
7HGGOLHS 

3DUDGLJP 3RVLWLYLVP ,QWHUSUHWLYLVP 3UDJPDWLVP

2QWRORJ\ 1DwYHUHDOLVP 5HODWLYLVP $FFHSWH[WHUQDOUHDOLW\


&KRRVHH[SODQDWLRQVWKDW
EHVWSURGXFHGHVLUHG
RXWFRPHV
(SLVWHPRORJ\ 2EMHFWLYHSRLQWRIYLHZ 6XEMHFWLYHSRLQWRIYLHZ %RWKREMHFWLYHDQG
.QRZHUDQGNQRZQDUH .QRZHUDQGNQRZQDUH VXEMHFWLYHSRLQWVRIYLHZ
GXDOLVP LQVHSDUDEOH
0HWKRGRORJ\ 4XDQWLWDWLYH 4XDOLWDWLYH 4XDQWLWDWLYHDQG
TXDOLWDWLYH
/RJLF 'HGXFWLYH ,QGXFWLYH 'HGXFWLYHDQGLQGXFWLYH
$[LRORJ\ ,QTXLU\LVYDOXHIUHH ,QTXLU\LVYDOXHERXQG 9DOXHVSOD\DODUJHUROH
LQLQWHUSUHWLQJUHVXOWV
&DXVDOOLQNDJHV 5HDOFDXVHVWHPSRUDOO\ $OOHQWLWLHVVLPXOWDQH 7KHUHPD\EHFDXVDO
SUHFHGHQWWRRU RXVO\VKDSLQJHDFK UHODWLRQVKLSVEXWZHZLOO
VLPXOWDQHRXVZLWKHIIHFW RWKHU,W¶VLPSRVVLEOHWR QHYHUEHDEOHWRSLQWKHP
GLVWLQJXLVKFDXVHVIURP GRZQ
HIIHFWV

,QDVLPLODUYHLQDV/HH  *ROHVDQG+LUVFKKHLP  /HH D 1HXPDQ  


7DVKDNNRULDQG7HGGOLH  DQG:LFNVDQG)UHHPDQ  KDYHDUJXHGIRUDSUDJPDWLVW
YLHZ DQG WKH XVH RI PL[HG PHWKRG UHVHDUFK GHVLJQV ,Q HVVHQFH SUDJPDWLVWV FRQVLGHU WKH
UHVHDUFKTXHVWLRQWREHPRUHLPSRUWDQWWKDQHLWKHUWKHPHWKRGWKH\XVHRUWKHZRUOGYLHZWKDW
LVVXSSRVHGWRXQGHUOLHWKHPHWKRGXVLQJWKHSUDJPDWLVWFUHGRRI³ZKDWZRUNV´ 7DVKDNNRUL
DQG7HGGOLH  7KDW LVSUDJPDWLVP LV EDVHG RQ WKH SURSRVLWLRQ WKDW UHVHDUFKHUV VKRXOG
XVH ³ZKDWHYHU SKLORVRSKLFDO DQGRU PHWKRGRORJLFDO DSSURDFK >WKDW@ ZRUNV IRU WKH SDUWLFXODU
UHVHDUFKSUREOHPXQGHUVWXG\´ 7DVKDNNRULDQG7HGGOLHS 7KHRYHUULGLQJLVVXHIRU
WKH SUDJPDWLVW LV WKXV ZKHWKHU RU QRW VRPHWKLQJ EH LW SKLORVRSKLFDO DVVXPSWLRQV
PHWKRGRORJ\ RU ZKDWHYHU LV XVHIXO ZLWK WKH WHUP ³XVHIXO´ XVHG LQ WKH VHQVH WKDW WKH
VRPHWKLQJLQTXHVWLRQLVLQVWUXPHQWDOLQSURGXFLQJWKHGHVLUHGRUDQWLFLSDWHGUHVXOWV,QRUGHU
WRSURYLGHDPRUHFRPSUHKHQVLYHXQGHUVWDQGLQJRIWKHSUDJPDWLVWSDUDGLJPZHILQGLWXVHIXO
WR FRPSDUH WKH IXQGDPHQWDO DVVXPSWLRQV RI SUDJPDWLVP WR WKRVH RI SRVLWLYLVP DQG
LQWHUSUHWLYLVP VHH7DEOH 
:KLOHSRVLWLYLVWVDUJXHWKDWWKHUHLVDQH[WHUQDOREMHFWLYHUHDOLW\WKDWH[LVWLQGHSHQGHQWRI
WKH LQGLYLGXDO LQWHUSUHWLYLVWV FRXQWHU WKDW UHDOLW\ LV HTXLYRFDO DQG WKDW HDFK LQGLYLGXDO
XQLTXHO\LQWHUSUHWVLW3UDJPDWLVWVWDNHWKHSRVLWLRQWKDWWKHUHLVDQREMHFWLYHUHDOLW\H[LVWLQJ
H[WHUQDOO\ WR WKH REVHUYHU +RZHYHU WKLV UHDOLW\ LV JURXQGHG LQ WKH HQYLURQPHQW DQG
H[SHULHQFH RI HDFK LQGLYLGXDO DQG FDQ WKXV RQO\ EH LPSHUIHFWO\ XQGHUVWRRG ,Q D OLNH YHLQ
SRVLWLYLVWV EHOLHYH WKDW NQRZOHGJH LV REMHFWLYH DQG LV DFTXLUHG E\ H[DPLQLQJ HPSLULFDO
HYLGHQFH DQG WHVWLQJ K\SRWKHVHV WR XQFRYHU IXQGDPHQWDO ODZV DQG FDXVDO UHODWLRQVKLSV %\
FRQWUDVWLQWHUSUHWLYLVWVEHOLHYHNQRZOHGJHLVUHODWLYHDQGUHDOLW\WRRFRPSOH[WREH³NQRZQ´
E\ D VLQJOH SHUVSHFWLYH DQG IXUWKHUPRUH WKDW DOO HQWLWLHV DUH VLPXOWDQHRXVO\ VKDSLQJ HDFK
RWKHULQVXFKDZD\ WKDW LW LV LPSRVVLEOH WR GLVWLQJXLVK FDXVHV IURP HIIHFWV 3UDJPDWLVWV IDOO

±±
&+$37(5

VRPHZKHUH LQ EHWZHHQ SRVLWLYLVWV DQG LQWHUSUHWLYLVWV 7KH\ YLHZ WKH SURFHVV RI DFTXLULQJ
NQRZOHGJH DV D FRQWLQXXP UDWKHU WKDQ DV WZR RSSRVLQJ DQG PXWXDOO\ H[FOXVLYH SROHV RI
REMHFWLYLW\DQGVXEMHFWLYLW\ *ROHVDQG+LUVFKKHLP 
7KXV WKH SUDJPDWLVW YLHZ RQ WKH RQWRORJLFDO DQG HSLVWHPRORJLFDO TXHVWLRQV JLYHV WKH
SUDJPDWLVWDFKRLFHRILQGXFWLYHDQGGHGXFWLYHORJLFLQWKHFRXUVHRIFRQGXFWLQJUHVHDUFKRQD
TXHVWLRQWKDWQHHGVWREHDQVZHUHG 7DVKDNNRULDQG7HGGOLH )XUWKHUPRUHLWDOORZVWKH
SUDJPDWLVW WR VHOHFW WKH PHWKRGRORJ\ EHVW VXLWHG WR D SDUWLFXODU UHVHDUFK TXHVWLRQ WKXV
SURYLGLQJWKHFRQFHSWXDOIRXQGDWLRQIRUWKHXVHRIERWKTXDQWLWDWLYHDQGTXDOLWDWLYHPHWKRGV
*ROHVDQG+LUVFKKHLP 
)LQDOO\ SRVLWLYLVWV EHOLHYH WKDW UHVHDUFK LV YDOXHIUHH ZKLOH LQWHUSUHWLYLVWV RQ WKH RWKHU
KDQG EHOLHYH WKDW UHVHDUFK LV YDOXHERXQG 2QFH DJDLQ SUDJPDWLVWV WDNH D PLGGOH SRVLWLRQ
7KH\ EHOLHYH WKDW YDOXHV SOD\ D VLJQLILFDQW UROH LQ FRQGXFWLQJ UHVHDUFK DQG LQ GUDZLQJ
FRQFOXVLRQV IURP WKHLU VWXGLHV EXW WKH\ EHOLHYH WKDW WKH SRVLWLYLVW ]HDO IRU REMHFWLYLW\ LV
XQDWWDLQDEOH6LPLODUO\WKH\VHHWKHLQWHUSUHWLYLVWSRVLWLRQDVSUREOHPDWLFGXHWRLWVQRWLRQWKDW
DOO LQVLJKWV SHUVSHFWLYHV DQG YDOXHV DUH HTXDOO\ YDOLG :LFNV DQG )UHHPDQ   7R WKH
SUDJPDWLVWYDOXHVDUHUHOHYDQWDQGLPSRUWDQWRQO\LQVRIDUDVWKH\LQIOXHQFHZKDWWRVWXG\DQG
KRZWRVWXG\LW$V7DVKDNNRULDQG7HGGOLH  VWDWHG

7KXV SUDJPDWLVWV GHFLGH ZKDW WKH\ ZDQW WR UHVHDUFK JXLGHG E\ WKHLU SHUVRQDO YDOXH
V\VWHPVWKDWLVWKH\VWXG\ZKDWWKH\WKLQNLVLPSRUWDQWWRVWXG\7KHQWKH\VWXG\WKHWRSLFLQ
DZD\WKDWLVFRQJUXHQWZLWKWKHLUYDOXHV\VWHPLQFOXGLQJYDULDEOHVDQGXQLWVRIDQDO\VLVWKDW
WKH\IHHODUHWKHPRVWDSSURSULDWHIRUILQGLQJDQDQVZHUWRWKHLUUHVHDUFKTXHVWLRQ7KH\DOVR
FRQGXFW WKHLU VWXGLHV LQ DQWLFLSDWLRQ RI UHVXOWV WKDW DUH FRQJUXHQW ZLWK WKHLU YDOXH V\VWHP
LELGSS 

,Q DFFRUGDQFH ZLWK WKH DERYH GLVFXVVLRQ RI WKH DVVXPSWLRQV EHKLQG WKH PDMRU UHVHDUFK
SDUDGLJPVZHDUJXHWKDWWKHSUDFWLFHRISRVLWLYLVWUHVHDUFKFDQEHLQWHJUDWHGZLWKWKHSUDFWLFH
RILQWHUSUHWLYHUHVHDUFK)XUWKHUPRUHVXFKLQWHJUDWLRQLVMXGJHGWREHLQGLVSHQVDEOHIRUYDOLG
DQG UHOHYDQW 63, UHVHDUFK ,Q RXU YLHZ LI 63, UHVHDUFKHUV DUH WR JHW SDVW WKH HIIHFWV RI WKH
³SDUDGLJP ZDU´ DQG ILQG PHDQLQJIXO ZD\V WR LQFRUSRUDWH WHFKQRORJLFDO DQG RUJDQL]DWLRQDO
FRQFHUQVLQWRPDLQVWUHDP63,UHVHDUFKZHDUJXHWKDWDSUDJPDWLF DSSURDFKDSSO\LQJPL[HG
PHWKRGUHVHDUFKGHVLJQVLVUHTXLUHG7KXVSUDJPDWLVPRIIHUVDSUDFWLFDOEDVLVIRUUHVHDUFKLQ
DQ DSSOLHG ILHOG VXFK DV 63, ³6WXG\ ZKDW LQWHUHVWV DQG LV RI YDOXH WR \RX VWXG\ LW LQ WKH
GLIIHUHQW ZD\V WKDW \RX GHHP DSSURSULDWH DQG XVH WKH UHVXOWV LQ ZD\V WKDW FDQ EULQJ DERXW
SRVLWLYHFRQVHTXHQFHVZLWKLQ\RXUYDOXHV\VWHP´ 7DVKDNNRULDQG7HGGOLHS 7KLV
GRHVQRWPHDQKRZHYHUWKDWZHVDFULILFH ULJRUIRUUHOHYDQFH 2QWKHFRQWUDU\ ZH DUJXH IRU
ERWK±ERWKUHOHYDQWWKHRU\DQGULJRURXVHPSLULFDOPHWKRGV
7KHUDLVRQG¶rWUHIRUDSUDJPDWLFDSSURDFKWR63,UHVHDUFKLVWROLQNWKHRU\DQGSUDFWLFH
WKURXJKPL[HGPHWKRGGHVLJQVDQGWULDQJXODWLRQ7ULDQJXODWLRQLVDPHWDSKRUIURPQDYLJDWLRQ
DQG PLOLWDU\ VWUDWHJ\ WKDW XVHV PXOWLSOH UHIHUHQFH SRLQWV WR ORFDWH DQ REMHFW¶V H[DFW SRVLWLRQ
-LFN   *LYHQ EDVLF SULQFLSOHV RI JHRPHWU\ PXOWLSOH YLHZSRLQWV DOORZ IRU JUHDWHU
DFFXUDF\ /LNHZLVH 63, UHVHDUFKHUV FDQ LPSURYH WKH DFFXUDF\ RI WKHLU MXGJHPHQWV E\
FROOHFWLQJGLIIHUHQWNLQGVRIGDWDEHDULQJRQWKHVDPHSKHQRPHQRQ
,QWKHVRFLDO VFLHQFHV WKH FRQFHSW RI WULDQJXODWLRQ FDQ EH WUDFHG EDFN WR &DPSEHOO DQG
)LVNH   7KH\ DUJXHG WKDW PRUH WKDQ RQH PHWKRG VKRXOG EH XVHG WR HQVXUH WKDW WKH
YDULDQFHLQWKHLUUHVHDUFKZDVDFFRXQWHGIRUE\WKHWUDLWXQGHUVWXG\DQGQRWE\WKHPHWKRG
WKDW ZDV HPSOR\HG 'HQ]LQ   GLVFXVVHG IRXU W\SHV RI WULDQJXODWLRQ GDWD WULDQJXODWLRQ
LQYHVWLJDWRUWULDQJXODWLRQWKHRU\WULDQJXODWLRQDQGPHWKRGRORJLFDOWULDQJXODWLRQ VHH3DWWRQ

±±
5(6($5&+0(7+2'2/2*<

 IRU H[WHQVLYH H[DPSOHV  )XUWKHUPRUH -LFN   GLVFXVVHG ³ZLWKLQPHWKRG´


WULDQJXODWLRQZKLFKHVVHQWLDOO\LQYROYHVFURVVFKHFNLQJIRULQWHUQDOFRQVLVWHQF\RUUHOLDELOLW\
DQG³EHWZHHQPHWKRG´WULDQJXODWLRQZKLFKWHVWVWKHGHJUHHRIH[WHUQDOYDOLGLW\
%DVHGRQWKHFRQFHSWRIWULDQJXODWLRQ&UHVZHOO  GHILQHGWKHIROORZLQJIRXUW\SHV
RIPL[HGPHWKRGGHVLJQVZKLFKKDYHFOHDUUHVHPEODQFHWR6FKXOW]DQG+DWFK¶V  EDVLF
DSSURDFKHVIRUSDUDGLJPFURVVLQJ

x 6HTXHQWLDORUWZRSKDVHGHVLJQVZKHUHWKHUHVHDUFKHUILUVWFRQGXFWVDTXDOLWDWLYHSKDVH
RIDVWXG\DQGWKHQDVHSDUDWHTXDQWLWDWLYHSKDVHRUYLFHYHUVD
x 3DUDOOHOVLPXOWDQHRXV GHVLJQV ZKHUH WKH UHVHDUFKHU FRQGXFWV WKH TXDOLWDWLYH DQG
TXDQWLWDWLYHSKDVHDWWKHVDPHWLPHDQGDQDO\]HWKHGDWDLQDFRPSOHPHQWDU\PDQQHU
x (TXLYDOHQW VWDWXV GHVLJQV ZKHUH WKH UHVHDUFKHU FRQGXFWV WKH VWXG\ XVLQJ ERWK
TXDQWLWDWLYHDQGWKHTXDOLWDWLYHDSSURDFKHVDERXWHTXDOO\WRXQGHUVWDQGWKHSKHQRPHQRQ
XQGHUVWXG\
x 'RPLQDQW±OHVVGRPLQDQWGHVLJQVZKHUHWKHUHVHDUFKHUFRQGXFWVDVWXG\LQZKLFKRQH
SDUDGLJPDQGLWVPHWKRGVDUHGRPLQDQWZKLOHDVPDOOFRPSRQHQWRIWKHRYHUDOOVWXG\LV
GUDZQIURPDQDOWHUQDWLYHGHVLJQ

,QDGGLWLRQ7DVKDNNRULDQG7HGGOLH  GHILQHGDILIWKW\SHRIPL[HGPHWKRGGHVLJQ

x 'HVLJQVZLWKPXOWLOHYHOXVHRIDSSURDFKHVZKHUHWKHUHVHDUFKHUXVHVGLIIHUHQWW\SHVRI
PHWKRGVDWGLIIHUHQWOHYHOVRIGDWDDJJUHJDWLRQ

7KXV PL[HG PRGHO VWXGLHV FDQ EH GHILQHG DV ³VWXGLHV WKDW DUH SURGXFWV RI WKH SUDJPDWLVW
SDUDGLJP DQG WKDW FRPELQH WKH TXDOLWDWLYH DQG TXDQWLWDWLYH DSSURDFKHV ZLWKLQ GLIIHUHQW
SKDVHVRIWKHUHVHDUFKSURFHVV´ LELGSHPSKDVLVLQRULJLQDO 
7KHQHHGIRUPRUHSUDJPDWLVPDQGPL[HGPRGHOVWXGLHVKDVDOVREHHQGLVFXVVHGZLWKLQ
WKH VRIWZDUH HQJLQHHULQJ GRPDLQ 3RWWV   IRU H[DPSOH DUJXHG WKDW ³ZH PXVW GHYHORS
PL[HGTXDOLWDWLYHDQGTXDQWLWDWLYHWHFKQLTXHVEHFRPHPRUHDZDUHRISURIHVVLRQDOJXLGHOLQHV
DERXW WKH LQWHUSUHWDWLRQ RI FDVHVWXG\ DQG VXUYH\ GDWD DQG UHDFK D FRQVHQVXV DERXW ZKDW
FRQVWLWXWHVDFFHSWDEOHHYLGHQFH´ LELGS )XUWKHUPRUHZLWKUHVSHFWWRUHVHDUFKPHWKRG
-LFN  QRWHGWKDW³WKHPRVWSUHYDOHQWDWWHPSWVWRXVHWULDQJXODWLRQKDYHEHHQUHIOHFWHGLQ
HIIRUWVWRLQWHJUDWHILHOGZRUNDQGVXUYH\PHWKRGV´ LELGS 
)ROORZLQJ-LFN  DQG/HH¶V  PRGHOIRULQWHJUDWLQJSRVLWLYLVWDQGLQWHUSUHWLYH
DSSURDFKHV*DEOH  GHPRQVWUDWHGKRZTXDOLWDWLYHFDVHVWXGLHVZKHQLQWHJUDWHGZLWKD
TXDQWLWDWLYHVXUYH\FDQEHXVHIXOZLWKLQLQIRUPDWLRQV\VWHPVUHVHDUFK  DVDVRXUFHRIULFK
GHWDLO WR DLG LQ WKH LQWHUSUHWDWLRQ RI TXDQWLWDWLYH ILQGLQJV IURP WKH VXUYH\   DV D IXUWKHU
PHDQVRIWULDQJXODWLRQ E\ WHVWLQJ WKH SURSRVLWLRQV ZLWK WKH FDVH VDPSOH DV ZHOO DV ZLWK WKH
TXDQWLWDWLYHVXUYH\GDWD  WRGHYHORSDFORVHUHODWLRQVKLSZLWKDIHZILUPVZKRPD\VHUYH
DVWKHVDPSOHIRUSLORWWHVWLQJWKHVXUYH\LQVWUXPHQWV  DVDWHVWRIWKHFRQWH[WXDOUHOHYDQFH
RIYDULDEOHVRILQWHUHVWDQG  DVDQDLGLQLGHQWLI\LQJDOWHUQDWLYHH[SRVWHPRGHOV
,QWKHQH[WVHFWLRQZHGHVFULEHWKHVHTXHQWLDOPL[HGPHWKRGUHVHDUFKGHVLJQXVHGLQWKLV
VWXG\ZKLFKDSSOLHGWKHSULQFLSOHVRISUDJPDWLVPGLVFXVVHGDERYHZLWK /HH¶V  PRGHO
IRULQWHJUDWLQJSRVLWLYLVWDQGLQWHUSUHWDWLYHDSSURDFKHVDQG*DEOH¶V  DGYLFHFRQFHUQLQJ
WKHLQWHJUDWLRQRIFDVHVWXG\DQGVXUYH\UHVHDUFKPHWKRGV

±±
&+$37(5

 5HVHDUFK'HVLJQ
*HQHUDOO\WKHVHOHFWLRQRIDUHVHDUFKPHWKRGIRUDQHPSLULFDOVWXG\GHSHQGVRQWKHYDULDEOHV
VWXGLHG WKH FXUUHQW VWDWH RI NQRZOHGJH DQG WKH REMHFWLYHV RI WKH VWXG\ *DOOLHUV DQG /DQG
  $OVR SUDFWLFDO OLPLWDWLRQV VXFK DV WLPH FRVW DQG DYDLODELOLW\ RI GDWD LQIOXHQFH WKH
FKRLFH)XUWKHUPRUHWKHFKRLFHRIUHVHDUFKGHVLJQDIIHFWVZKDWFRQFHSWVZLOOEHVWXGLHGKRZ
WKH\ZLOOEHPHDVXUHGZKR RUZKDW ZLOOEHVWXGLHGKRZWKHGDWDZLOOEHREWDLQHGDQGKRZ
LWZLOOEHDQDO\]HG7KXVWKHUHVHDUFKGHVLJQFDQEHGHILQHGDVD³EOXHSULQW´RIUHVHDUFK <LQ
 
:KLOH LW KDV EHHQ DUJXHG WKDW ³6RIWZDUH HQJLQHHULQJ LV D ODERUDWRU\ VFLHQFH´ %DVLOL
 S  HPSKDVLV LQ RULJLQDO  LW LV LPSRUWDQW WR QRWH WKDW XQOLNH WKH QDWXUDO VFLHQFHV
VRIWZDUHHQJLQHHULQJLVDKXPDQEDVHGVRFLDODFWLYLW\7KHVRIWZDUHHQJLQHHULQJ³ODERUDWRU\´
LVWKHUHIRUHQRWDFRQWUROOHGHQYLURQPHQWOLNHWKHODERUDWRULHVRIWKHQDWXUDOVFLHQFHV5DWKHU
RXU ODERUDWRU\ LV WKH VRIWZDUH LQGXVWU\ ± ZKHUH SUDFWLWLRQHUV EXLOG VRIWZDUH V\VWHPV 3RWWV
  7KHUHIRUH LQ RUGHU WR LGHQWLI\ WKH IDFWRUV IRU VXFFHVV LQ 63, DQG JLYHQ WKH
DIRUHPHQWLRQHG SRWHQWLDO EHQHILWV RI FRPELQLQJ UHVHDUFK PHWKRGV ZLWKLQ D VLQJOH UHVHDUFK
GHVLJQ ZH FRQVLGHUHG D FRPELQDWLRQ RI FDVH VWXG\ ZLWK VXUYH\ UHVHDUFK WR EH WKH PRVW
DSSURSULDWHUHVHDUFKGHVLJQIRUWKLVVWXG\
7KHRYHUDOOUHVHDUFKGHVLJQIRUWKHVWXG\LVVKRZQLQ)LJXUH,WLVDVHTXHQWLDOPL[HG
PHWKRGGHVLJQ &UHVZHOO  7DVKDNNRUL DQG 7HGGOLH   ZKLFK EXLOGV RQ 6FXOW] DQG
+DWFK¶V  VHTXHQWLDOSDUDGLJPFURVVLQJDSSURDFK,WFRQVLVWVRIIRXUPDMRUVWDJHV  D
VLQJOH SLORW FDVH VWXG\   D PXOWLSOH FDVH VWXG\ RI WZHOYH VRIWZDUH RUJDQL]DWLRQV 
IRUPXODWLRQRIWKHPRGHODQGILQDOO\  WHVWLQJWKHK\SRWKHVHVRIWKHPRGHOE\DVXUYH\
7KHFDVHVWXG\LVDUHVHDUFKPHWKRGZKLFKFDQLQYROYHDPXOWLWXGHRIUHVHDUFKVWUDWHJLHV
7KXV VHYHUDO DSSURDFKHV RI EXLOGLQJ WKHRU\ IURP FDVH VWXG\ UHVHDUFK KDYH DSSHDUHG LQ WKH
OLWHUDWXUH DQG PXFK DGYLFH UHJDUGLQJ WKH WKHRU\ EXLOGLQJ SURFHVV KDYH EHHQ RIIHUHG
+RZHYHULQRXUSURFHVVRILQGXFWLQJWKHRU\IURPWKHFDVHVWXGLHVZHEDVHGRXUGHVLJQRQWKH
DSSURDFKHVRIIHUHGE\(LVHQKDUGW  6WUDXVVDQG&RUELQ  DQG<LQ  
7KHFDVHVWXG\GHVLJQLQFOXGHGDVLQJOHH[SORUDWRU\LQGHSWKSLORWFDVHVWXG\ &DVH$
6HFWLRQ   IROORZHG E\ D PRUH H[SODQDWRU\ FURVVFDVH DQDO\VLV RI WZHOYH VRIWZDUH
RUJDQL]DWLRQV &DVH % DQG & 6HFWLRQ  &DVH ' DQG H[SHUW UHYLHZ 6HFWLRQ  
&ROOHFWLYHO\ WKHVH FDVH VWXGLHV KDG D FRQVLGHUDEOH LQIOXHQFH RQ WKH PRGHO XOWLPDWHO\
PHDVXUHGDQGWHVWHGE\WKHVXUYH\,GHDVDQGFRQFHSWVUHJDUGLQJ63,VXFFHVVLGHQWLILHGLQWKH
H[SORUDWRU\ SLORW FDVH VWXG\ SRLQWHG WRZDUG LPSRUWDQW LVVXHV IRU IXUWKHU LQTXLU\ 7KH
VXEVHTXHQWPXOWLSOHFDVHVWXG\KDGWKHREMHFWLYHRIIXUWKHUH[SORULQJWKHVHLVVXHVDVZHOODV
LGHQWLI\LQJWKHNH\OHDUQLQJSURFHVVHVDQGIDFWRUIRUVXFFHVVLQ63,

  3. 
A priori model
3LORW 0XOWLSOH 0DLQ6XUYH\
FDVHVWXG\ FDVHVWXG\
&DVH$ &DVH%&'

)LJXUH2YHUDOOUHVHDUFKGHVLJQ

±±
5(6($5&+0(7+2'2/2*<

7DEOH&KDUDFWHULVWLFVRIWKHSLORWDQGPXOWLSOHFDVHVWXGLHV

&KDUDFWHULVWLF 3LORW&DVH6WXG\ 0XOWLSOH&DVH6WXG\

0DMRUREMHFWLYHV ([SORUDWLRQ ([SORUDWLRQH[SODQDWLRQ


5ROHRIUHVHDUFKHU 3DUWLFLSDQWREVHUYHU 3DUWLFLSDQWREVHUYHU
'HVFULSWLRQRIFDVHV 2QHVRIWZDUHRUJDQL]DWLRQ 7ZHOYHVRIWZDUHRUJDQL]DWLRQ
8QLWRIDQDO\VLV 6RIWZDUHRUJDQL]DWLRQ 6RIWZDUHRUJDQL]DWLRQ
'DWDVRXUFHV ,QWHUYLHZVREVHUYDWLRQV ,QWHUYLHZVREVHUYDWLRQV
GRFXPHQWVIRUPV GRFXPHQWVTXHVWLRQQDLUHV
'HSHQGHQWYDULDEOH 1RWDSSOLFDEOH 63,VXFFHVV
$QDO\VLVPHWKRGV 'HVFULSWLRQ 'HVFULSWLRQSDWWHUQDQDO\VLV

5HIHUULQJWRWKHGLVFXVVLRQRQSDUDGLJPLQWKHSUHYLRXVVHFWLRQZHDUJXHWKDWWKHUHPXVWEHD
FRUUHVSRQGHQFHEHWZHHQWKHSDUDGLJPDWLFDVVXPSWLRQVDQGWKHWKHRU\EXLOGLQJHIIRUW,QWKLV
SHUVSHFWLYH*LRLDDQG3LWUH  GHILQHGWKHRU\DV³DQ\FRKHUHQWGHVFULSWLRQRUH[SODQDWLRQ
RI REVHUYHG RU H[SHULHQFHG SKHQRPHQD´ DQG WKHRU\ EXLOGLQJ DV ³WKH SURFHVV RU F\FOH E\
ZKLFK VXFK UHSUHVHQWDWLRQV DUH JHQHUDWHG WHVWHG DQG UHILQHG´ LELG S   )XUWKHUPRUH
WKH\VWUHVVHGWKDWWKHRU\EXLOGLQJVKRXOGQRWQHFHVVDULO\EHYLHZHGDVWKHVHDUFKIRUWKHWUXWK
EXWUDWKHUDVFRPSUHKHQVLYHQHVVVWHPPLQJIURPGLIIHUHQWZRUOGYLHZV
:KLOH WKH JRDO RI WKH SRVLWLYLVW SDUDGLJP DQG KHQFH IRU WKH TXDQWLWDWLYH SDUW RI WKLV
VWXG\ZDVWRVHDUFKIRUUHJXODULWLHVDQGWRHVWDEOLVKFDXVHHIIHFWUHODWLRQVKLSVWKLVZDVFOHDUO\
QRWWKHJRDORIWKHTXDOLWDWLYHSDUWRIWKHVWXG\5DWKHUWKHJRDOIRUWKHTXDOLWDWLYHSDUWZDVWR
GHVFULEH DQG H[SODLQ LQ RUGHU WR GLDJQRVH DQG XQGHUVWDQG ,Q RWKHU ZRUGV WKH JRDO RI WKH
WKHRU\EXLOGLQJSDUWRIWKHVWXG\ZDV³WRJHQHUDWHGHVFULSWLRQVLQVLJKWVDQGH[SODQDWLRQVRI
HYHQWVVRWKDWWKHV\VWHPRILQWHUSUHWDWLRQVDQGPHDQLQJDQGWKHVWUXFWXULQJDQGRUJDQL]LQJ
SURFHVVHVDUHUHYHDOHG´ LELGS 
7KHWKHRU\EXLOGLQJSDUWRIWKLVVWXG\ZDVWKXVEDVHGRQGDWDFROOHFWLRQLQFDVHVWXGLHV
DQG GLVFRYHU\ WKURXJK SDWWHUQ DQDO\VLV ZKLFK SURYLGHG WKH SRVVLELOLW\ WR LGHQWLI\ UHODWLRQ
VKLSV EHWZHHQ FRQFHSWV )XUWKHUPRUH WKH GHVFULSWLRQV RI WKH LGHQWLILHG FRQFHSWV DQG WKHLU
UHODWLRQVKLSVFRPELQHGZLWKDQH[WHQVLYHOLWHUDWXUHUHYLHZDQGSULRUH[SHULHQFHSURYLGHGWKH
IRXQGDWLRQIRUWKHGHYHORSLQJWKHG\QDPLFPRGHORI63,ZKLFKZDVGHVFULEHGLQ&KDSWHU
8VLQJ *DEOH¶V   FODVVLILFDWLRQ WKH WKHRU\ EXLOGLQJ SDUW RI WKLV VWXG\ LQYROYHG DQ
H[SORUDWRU\ORQJLWXGLQDOSDUWLFLSDQWREVHUYDWLRQVLQJOHSLORWFDVHVWXG\ &DVH$ IROORZHGE\
DQ H[SORUDWRU\H[SODQDWRU\ ORQJLWXGLQDO SDUWLFLSDQWREVHUYDWLRQ PXOWLSOH FDVH VWXG\ RI
WZHOYHVRIWZDUHRUJDQL]DWLRQV &DVH%&DQG' 7DEOHLQGLFDWHVWKHPDLQFKDUDFWHULVWLFV
RIWKHLQLWLDOSLORWFDVHVWXG\DQGWKHVXEVHTXHQWPXOWLSOHFDVHVWXGLHVZLWKUHVSHFWWRPDMRU
REMHFWLYHV UHVHDUFKHU UROH QXPEHU RI FDVHV XQLW RI DQDO\VLV GDWD FROOHFWLRQ GHSHQGHQW
YDULDEOHDQGWKHSULPDU\PHWKRGRIDQDO\VLV
:HZRXOGOLNHWRHPSKDVL]HKRZHYHUWKDWZHGLGQRWDFWDVDQLQGHSHQGHQWREVHUYHULQ
WKHVH FDVH VWXGLHV 5DWKHU DV SDUW RI D ODUJHU UHVHDUFK WHDP ZH SDUWLFLSDWHG GLUHFWO\ LQ WKH
SURFHVVRIFKDQJH ZLWKLQKDOIRI WKH RUJDQL]DWLRQV HJ &RQUDGL DQG '\En  '\En DQG
0RH   DQG PRUH LQGLUHFWO\ LQ WKH RWKHU KDOI RI WKH RUJDQL]DWLRQV HJ '\En H
6WnOKDQH HW DO   7KLV LV DOVR LQ OLQH ZLWK RXU JHQHUDO YLHZ RQ WKH UROH RI WKH 63,

±±
&+$37(5

UHVHDUFKHU+HRUVKHVKRXOGQRWEHDQREMHFWLYHGLVLQWHUHVWHGVFLHQWLVW2QWKHFRQWUDU\ WKH
63,UHVHDUFKHU VKRXOG VHHN WR DFWLYHO\ FRQWULEXWH ZLWK KLV RU KHU NQRZOHGJH WR WKH SUREOHP
VROYLQJSURFHVVLQVRIWZDUHRUJDQL]DWLRQV2XUREMHFWLYHZDVWKHUHIRUHWZRIROG  WRWDNH
DFWLRQWRVROYHDSUREOHPDQG  WRFRQWULEXWHWRDVHWRI63,FRQFHSWV7KXVWKHFDVHVWXGLHV
FRXOGEHWWHUEHFKDUDFWHUL]HGDVDFWLRQUHVHDUFKSURMHFWV
*HQHUDOO\WKHUHVHDUFKHUKDVOHVVDSULRULNQRZOHGJHRIZKDWWKHYDULDEOHVRILQWHUHVWZLOO
EHDQGKRZWKH\ZLOOEHPHDVXUHGLQ DFDVHVWXG\FRPSDUHGZLWKH[SHULPHQWVDQGVXUYH\V
%HQEDVDWHWDO*DEOH 7\SLFDOO\WKHUHVHDUFKHUGRHVQRWEHJLQWKHVWXG\ZLWKD
SUHFRQFHLYHGWKHRU\LQPLQG5DWKHUKHRUVKHEHJLQVZLWKDQDUHDRIVWXG\DQGDOORZVWKH
WKHRU\ WR HPHUJH IURP WKH GDWD 6WUDXVV DQG &RUELQ   )RU WKDW UHDVRQ DQG GXH WR WKH
H[SORUDWRU\ DQG GHVFULSWLYH QDWXUH RI WKH SLORW FDVH VWXG\ ZH GLG QRW VSHFLI\ DQ D SULRUL
GHSHQGHQWYDULDEOHIRUWKHLQLWLDOSLORWFDVHVWXG\7KHIROORZLQJPXOWLSOHFDVHVWXG\RQWKH
RWKHU KDQG KDG WKH REMHFWLYH RI LGHQWLI\LQJ DQG GHVFULELQJ WKH NH\ OHDUQLQJ SURFHVVHV DQG
H[SODLQLQJ DV IDU DV SRVVLEOH WKH UHODWLRQVKLSV DPRQJ WKH PDMRU YDULDEOHV VWXGLHG DV VHHQ
IURPWKHYDQWDJHSRLQWRIWKHVRIWZDUHRUJDQL]DWLRQ7KXVWKHFDVHVWXGLHVKDGDVLQJOHXQLWRI
DQDO\VLV±WKHVRIWZDUHRUJDQL]DWLRQ±DQGFDQWKHUHIRUHEH FKDUDFWHUL]HGDV³KROLVWLF´ <LQ
 
7KHGHSHQGHQWYDULDEOHLQWKHPXOWLSOHFDVHVWXG\ZDV63,VXFFHVVDQGWKHLQGHSHQGHQW
YDULDEOHVRILQWHUHVWZHUHWKRVHIDFWRUVZKLFKZHUHSRVLWHGWRKDYHDPDMRULQIOXHQFHRQWKH
OHYHORI63,VXFFHVV7KHVHIDFWRUVZHUHLGHQWLILHGIURPWKHSLORWFDVHVWXG\GXULQJWKHFRXUVH
RI WKH PXOWLSOH FDVH VWXG\ IURP WKH OLWHUDWXUH DQG IURP RXU RZQ SULRU H[SHULHQFH DV D
FRQVXOWDQW )XUWKHUPRUH WKH REMHFWLYH RI WKH PXOWLSOH FDVH VWXG\ ZDV WR LGHQWLI\ WKH PDMRU
FRQWH[WXDO IDFWRUV WKDW FRXOG LQIOXHQFH WKH UHODWLRQVKLSV EHWZHHQ WKH LQGHSHQGHQW DQG
GHSHQGHQWYDULDEOHVDQGH[SODLQDVIDUDVSRVVLEOHWKHPRGHUDWLQJHIIHFWVRIWKHVHIDFWRUV
0XOWLSOH GDWD FROOHFWLRQ PHWKRGV ZHUH XVHG ERWK LQ WKH SLORW FDVH VWXG\ DQG LQ WKH
PXOWLSOH FDVH VWXGLHV 'DWD ZHUH FROOHFWHG E\ PHDQV RI TXDOLWDWLYH WHFKQLTXHV VXFK DV
LQWHUYLHZV JURXS GLVFXVVLRQV IHHGEDFN VHVVLRQV REVHUYDWLRQV DQG DUFKLYDO VRXUFHV DQG
TXDQWLWDWLYH WHFKQLTXHV VXFK DV TXHVWLRQQDLUH VXUYH\V DQG YDULRXV GDWD FROOHFWLRQ IRUPV
DFFRUGLQJWRSUHGHILQHG*40PHDVXUHPHQWSODQV0LQW]EHUJ  GHVFULEHGWKHV\QHUJ\
RIFRPELQLQJTXDOLWDWLYHDQGTXDQWLWDWLYHGDWDLQWKHRU\EXLOGLQJDVIROORZV

)RUZKLOHV\VWHPDWLFGDWDFUHDWHWKHIRXQGDWLRQIRURXUWKHRULHVLWLVWKHDQHFGRWDOGDWDWKDW
HQDEOHXVWRGRWKHEXLOGLQJ7KHRU\EXLOGLQJVHHPVWRUHTXLUHULFKGHVFULSWLRQWKHULFKQHVV
WKDW FRPHV IURP DQHFGRWH :H XQFRYHU DOO NLQGV RI UHODWLRQVKLSV LQ RXU KDUG GDWD EXW LW LV
RQO\WKURXJKWKHXVHRIWKLVVRIWGDWDWKDWZHDUHDEOHWRH[SODLQWKHP LELGS 

7KHPDLQPHWKRGRIDQDO\VLVIRUWKHPXOWLSOHFDVHVWXG\LQ&DVH'ZDVSDWWHUQDQDO\VLVXVLQJ
WKHWKUHHEDVLFW\SHVRIFRGLQJSURFHGXUHVLQJURXQGHGWKHRU\RSHQFRGLQJD[LDOFRGLQJDQG
VHOHFWLYH FRGLQJ 6WUDXVV DQG &RUELQ   7KLV DQDO\VLV LQYROYHG WKH LGHQWLILFDWLRQ RI D
SDWWHUQRIYDULDEOHVIURPWKHOLWHUDWXUHDQGWKHSLORWFDVHVWXG\DQGVXEVHTXHQWO\FRPSDULQJ
WKLVSDWWHUQZLWKWKHSDWWHUQVREVHUYHGLQWKHPXOWLSOHFDVHVWXG\%DVHGRQWKLVFRPSDULVRQ
ZHGHYHORSHGDQLQLWLDOVHWRIIDFWRUVIRU63,VXFFHVVZLWKDFRUUHVSRQGLQJVHWRIK\SRWKHVHV
&RPSOHPHQWLQJ WKHVH VWXGLHV ZH SHUIRUPHG D UHYLHZ SURFHVV ZLWK H[SHUWV IURP DFDGHPLD
DQG LQGXVWU\ LQ RUGHU WR GHULYH D ILQDO VHW RI IDFWRUV DQG K\SRWKHVHV VHH )LJXUH   7KH
GHWDLOV RI WKH OLWHUDWXUH UHYLHZ ZKLFK SURYLGHV WKH WKHRUHWLFDO MXVWLILFDWLRQV IRU WKH
K\SRWKHVHVZDVSUHVHQWHGLQ&KDSWHUVZKLOHWKHGHWDLOVRIWKHHPSLULFDOMXVWLILFDWLRQVLV
SUHVHQWHGLQWKHQH[WFKDSWHU

±±
5(6($5&+0(7+2'2/2*<

/LWHUDWXUHUHYLHZ
&K

,QLWLDOVHW ([SHUWUHYLHZ )LQDOVHW


$SS' &K $SS(

&DVHVWXG\'
&K

)LJXUH3URFHVVIRUGHYHORSLQJDQGMXVWLI\LQJWKHK\SRWKHVHV

7KHWKHRUHWLFDOPRGHODQGK\SRWKHVHVGHYHORSHGLQWKHWKHRU\EXLOGLQJSDUWRIWKHVWXG\ZHUH
WHVWHG XVLQJ DQ H[SODQDWRU\ FURVVVHFWLRQDO H[ SRVW IDFWR ILHOG VXUYH\ GHVLJQ ,W LQYROYHG
VHYHUDOVRIWZDUHRUJDQL]DWLRQVDWRQHSDUWLFXODUSRLQWLQWLPHLQYHVWLJDWLQJWRZKDWH[WHQWWKH
LGHQWLILHGSUDFWLFHVZHUHLPSOHPHQWHGDQGZKDWLPSDFWWKH\KDGRQ63,VXFFHVV7KHXQLWRI
DQDO\VLVIURPZKLFKRULJLQDOGDWDREVHUYDWLRQVZHUHREWDLQHGZDVWKHVRIWZDUHRUJDQL]DWLRQ
:LWKLQWKLVVWXG\DVRIWZDUHRUJDQL]DWLRQLVGHILQHGDVDZKROHFRPSDQ\RUDQLQGHSHQGHQW
EXVLQHVVXQLWLQVLGHDODUJHUFRPSDQ\WKDWKDVVRIWZDUHGHYHORSPHQWDVLWVSULPDU\EXVLQHVV
,Q WKLV PDLQ SDUW RI WKH VWXG\ ZH XVHG D PDLOHG TXHVWLRQQDLUH DV WKH GDWD FROOHFWLRQ
LQVWUXPHQW 7KH UHVXOWV RI UHOLDELOLW\ DQG YDOLGLW\ DQDO\VHV VKRZHG WKDW WKH LQVWUXPHQW KDV
GHVLUDEOHSV\FKRPHWULFSURSHUWLHVDVGLVFXVVHGLQWKHQH[WFKDSWHU
7KHSULPDU\LQWHQWRIWKHVXUYH\ZDVWKXVWRWHVWWKHH[LVWHQFHRIVWDWLVWLFDODVVRFLDWLRQV
DPRQJWKHLGHQWLILHGIDFWRUVDQG63,VXFFHVVWKXVSURYLGLQJTXDQWLWDWLYHHYLGHQFHIRUWKHNH\
IDFWRUV RI VXFFHVV LQ 63, DQG WKH JHQHUDOL]DELOLW\ RI UHVXOWV ,Q DGGLWLRQ WR WKH LQGHSHQGHQW
DQGGHSHQGHQWYDULDEOHVWKHFRQWH[WXDOIDFWRUVWKDWPLJKWLQIOXHQFHWKHUHVXOWVZHUHLQFOXGHG
LQWKHVWDWLVWLFDODQDO\VHVIRUJUHDWHUTXDVLH[SHULPHQWDOFRQWURO7KXVWKHTXDQWLWDWLYHWKHRU\
WHVWLQJSDUWRIWKLVVWXG\FDQEHFRQVLGHUHGTXDVLH[SHULPHQWDO &RRNDQG&DPSEHOO 

 3RSXODWLRQDQG6DPSOH
6LQFHWKLVUHVHDUFKLVIRFXVHGRQDQLQYHVWLJDWLRQRIWKHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ
HQDEOLQJ 63, VRIWZDUH LQWHQVLYH RUJDQL]DWLRQV ZHUH FRQVLGHUHG DV WKH WDUJHW SRSXODWLRQ
)XUWKHUPRUHWKLVSRSXODWLRQLQFOXGHVFRPSDQLHVRIGLIIHUHQWVL]HVGHYHORSLQJHLWKHUVRIWZDUH
RUFRPELQHGVRIWZDUHDQGKDUGZDUHSURGXFWVIRUDZLGHYDULHW\RIPDUNHWV
:LWKUHVSHFWWRVDPSOLQJZHDSSURDFKHGWKHTXDOLWDWLYHDQGWKHTXDQWLWDWLYHSDUWVRIWKH
VWXG\GLIIHUHQWO\7KHSULPDU\JRDORIVDPSOLQJLQWKHTXDQWLWDWLYHSDUWRIWKHVWXG\ZDVWRJHW
D UHSUHVHQWDWLYH VDPSOH IURP WKH SRSXODWLRQ LQ RUGHU WR PDNH LQIHUHQFHV IURP WKH VPDOOHU
JURXS DERXW WKH ODUJHU JURXS )RU WKH TXDOLWDWLYH SDUW RI WKH VWXG\ ZH ZHUH OHVV FRQFHUQHG
DERXW WKH UHSUHVHQWDWLYHQHVV RU RQ GHWDLOHG WHFKQLTXHV IRU GUDZLQJ D SUREDELOLW\ VDPSOH
,QVWHDGZHIRFXVHGRQVWXG\LQJVSHFLILFFDVHVDQGDFWLRQVWKDWFRXOGFODULI\DQGGHHSHQRXU
XQGHUVWDQGLQJ )XUWKHUPRUH RXU PDMRU FRQFHUQ UHJDUGLQJ WKH FKRLFH RI WKH SLORW FDVH VWXG\
ZDV WR VHHN D FDVH WKDW ZDV UHFRJQL]HG DV D PDMRU VXFFHVV WKXV GHYLDWLQJ IURP WKH
SUHGRPLQDQWFKDUDFWHULVWLFVRIRWKHUFDVHV
*LYHQWKHVHFRQVLGHUDWLRQVZHHVWDEOLVKHGDPXWXDOUHODWLRQVKLSZLWK1HUD$6±RQHRI
1RUZD\¶VOHDGLQJ FRPSDQLHVLQWKHILHOGRI HOHFWURQLFV ± LQ WKH IRUP RI DQ (66, 3,( (66,
SURMHFW7(/0(7±7HOHFRPPXQLFDWLRQV0HWULFV$SSURDFK LQRUGHUWRFDUU\RXWWKH

±±
&+$37(5

SLORW FDVH VWXG\ 1HUD SURYLGHV DQ H[WHQVLYH UDQJH RI PRQLWRULQJ DQG FRQWURO V\VWHPV IRU
WHOHFRPPXQLFDWLRQVQHWZRUNV±WKH7HOH6FDGD701:HVWXGLHGDQGZRUNHGZLWKDVHSDUDWH
EXVLQHVVXQLWZLWKLQ1HUDWKDWZDVUHVSRQVLEOHIRUWKHVRIWZDUHSURGXFW7HOH6FDGD701 QRZ
SDUWRI3URWHN7HOVRIW$6 0DLQFXVWRPHUVDUHWHOHFRPPXQLFDWLRQVHUYLFHSURYLGHUVVXFKDV
SXEOLF SULYDWH DQG PLOLWDU\ WHOHFRPPXQLFDWLRQ RUJDQL]DWLRQV 2SHUDWLRQV SURFHVVHV DQG
SURFHGXUHVDUHUHJXODUO\DVVHVVHGE\WKH%ULWLVK6WDQGDUG,QVWLWXWHDQGWKH1RUZHJLDQ'HIHQVH
DXWKRULWLHV DQG DUH IXOO\ DSSURYHG DFFRUGLQJ WR WKH PLOLWDU\ $4$3 VWDQGDUGV WKH
,62DQG7LFN,7VWDQGDUGV
7KH RYHUDOO JRDO RI WKH 3,( ZDV WR LPSURYH WKH TXDOLW\ DQG SURGXFWLYLW\ RI
WHOHFRPPXQLFDWLRQ VRIWZDUH V\VWHPV GHYHORSPHQW E\ LQWURGXFLQJ PHWULFV LQ WKH WHVWLQJ DQG
LQVSHFWLRQSURFHVVHV,QDGGLWLRQWKHSURMHFWDFWHGDVWKHILUVWVWHSLQ1HUD¶VDPELWLRXVHIIRUW
WRDGYDQFHLQPDWXULW\IURPTXDOLWDWLYHWRTXDQWLWDWLYHJRDOVHWWLQJ7KHH[SHULPHQWZDVWKXV
XVHG WR WHVW RXU LGHDV LQ D OLPLWHG DQG FRQWUROOHG ZD\ EHIRUH SURFHHGLQJ ZLWK WKH
LPSOHPHQWDWLRQ RI DQ RUJDQLVDWLRQ ZLGH PHDVXUHPHQW SURJUDPPH )RU WKH SXUSRVH RI WKH
H[SHULPHQWWKHDPLPHWKRG 3XOIRUGHWDO DQGWKH*40DSSURDFK %DVLOLDQG:HLVV
 YDQ6ROLQJHQDQG%HUJKRXW ZHUHXVHGWR DVVLVWLQSODQQLQJ LGHQWLILFDWLRQ DQG
LQWURGXFWLRQRIWKHPHWULFVSURJUDPPH
7KH3,(ZDVRUJDQL]HGE\HVWDEOLVKLQJDGHGLFDWHGWHDPZLWKLQ1HUDUHVSRQVLEOHIRUWKH
7(/0(7 SURMHFW 7KH 6RIWZDUH+DUGZDUH 'HYHORSPHQW GHSDUWPHQW ZDV UHSUHVHQWHG ZLWK
WKHLU PDQDJHU LQ WKH PHWULFV LQLWLDWRU DQG SURPRWHU UROHV 7KH 9HULILFDWLRQ DQG 7HVW JURXS
UHSUHVHQWHG WKH 6\VWHP7HFKQRORJ\ GHSDUWPHQW DQG WKH &XVWRPHU 6HUYLFHV GHSDUWPHQW ZDV
UHSUHVHQWHGZLWKWKHSURGXFWRZQHUZKRZDVUHVSRQVLEOHIRUUHILQHPHQWLPSURYHPHQWDQG
PDLQWHQDQFH RI SURGXFWV :KHQ H[SHULPHQWDWLRQ VWDUWHG D SHUVRQ IURP WKH 4$ IXQFWLRQ
MRLQHGWKHWHDPDQGODWHUEHFDPHSURMHFWPDQDJHUIRUWKH7(/0(73,(DVUHTXHVWHGE\WKH
PDQDJHU RI WKH 6RIWZDUH+DUGZDUH 'HYHORSPHQW GHSDUWPHQW )LQDOO\ ZH ZHUH SDUW RI WKH
WHDP ZLWK UHVSRQVLELOLWLHV IRU WUDLQLQJ DQG PHWKRGRORJ\ VXSSRUW GXULQJ DOO SKDVHV RI WKH
PHDVXUHPHQWSURJUDP)RUPRUHGHWDLOVUHJDUGLQJWKHVSHFLILFDFWLRQVWDNHQLQWKHSLORWFDVH
VWXG\ &DVH$ VHH6HFWLRQDQG '\EnHWDO6WRNNHDQG3DOPVWU¡P6WnOKDQH
HWDO 
)RUWKHPXOWLSOHFDVHVWXGLHVZHVRXJKWFDVHVWKDWZHUHDFWLYHO\SXUVXLQJ63,DFWLRQVDQG
FRQVHTXHQWO\ZHUHFRQFHUQHGDERXWVXFFHHGLQJZLWK63,7KXVZKLOHWKHVDPSOLQJSURFHGXUH
LQWKHSLORWFDVHVWXG\FDQEHFKDUDFWHUL]HGDV³GHYLDQWFDVHVDPSOLQJ´ 1HXPDQ<LQ
  ZH DSSOLHG ³WKHRUHWLFDO VDPSOLQJ´ 6WUDXVV DQG &RUELQ   WR WKH PXOWLSOH FDVH
VWXG\7KDWLVRXU JURZLQJWKHRUHWLFDOLQWHUHVWLQWKHNH\OHDUQLQJSURFHVVHVDQGIDFLOLWDWLQJ
IDFWRUV IRU 63, VXFFHVV JXLGHG RXU VHOHFWLRQ RI FDVHV 7KXV ZH VHOHFWHG FDVHV EDVHG RQ WKH
QHZLQVLJKWVWKH\FRXOGSURYLGH
7KH PXOWLSOH FDVH VWXGLHV ZHUH GRQH ZLWKLQ WKH FRQWH[W RI WKH ODUJHVW VRIWZDUH SURFHVV
LPSURYHPHQWHIIRUWWRGDWHLQ1RUZD\FDOOHG63,4 6RIWZDUH3URFHVV,PSURYHPHQWIRUEHWWHU
4XDOLW\ 7KHREMHFWLYHRI63,4ZDVWRLQFUHDVHWKHFRPSHWLWLYHQHVVDQGSURILWDELOLW\RI1RU
ZHJLDQ,7LQGXVWU\WKURXJKDV\VWHPDWLFDQGFRQWLQXRVDSSURDFKWRSURFHVVLPSURYHPHQW7KH
JRDO RI 63,4 ZDV WZRIROG   WR HVWDEOLVK DQ HQYLURQPHQW IRU SURFHVV LPSURYHPHQW LQ WKH
VRIWZDUH RUJDQL]DWLRQV DVVRFLDWHG ZLWK 63,4 DQG   WR WUDQVIHU DQG GLIIXVH WKH NQRZOHGJH
JDLQHGWRWKHUHPDLQLQJ,7LQGXVWU\LQ1RUZD\WKURXJKWUDLQLQJVHPLQDUVDQGFRQIHUHQFHV
63,4ZDVSDUWO\IXQGHGE\WKH1RUZHJLDQ5HVHDUFK&RXQFLODQGZDVPDQDJHGE\WKH,7
LQGXVWU\ LWVHOI ZLWK D FRQVRUWLXP RI WZHOYH VRIWZDUH FRPSDQLHV DFWLYHO\ SDUWLFLSDWLQJ ZLWK
LPSURYHPHQW SURMHFWV DQG DQ DGGLWLRQDO VHW RI WKUHH WR ILYH FRPSDQLHV SDUWLFLSDWLQJ LQ WKH

±±
5(6($5&+0(7+2'2/2*<

LQWHUQDOH[SHULHQFHIRUXP¶V7KH63,4PHPEHURUJDQL]DWLRQVFRYHUHGFRPSDQLHVRIGLIIHUHQW
VL]HV ZLWK D ZLGH UDQJH RI SURGXFWV DQG PDUNHWV GHYHORSLQJ HLWKHU VRIWZDUH RU FRPELQHG
VRIWZDUH DQG KDUGZDUH SURGXFWV 6RPH FRPSDQLHV EHORQJHG WR WKH WUDGLWLRQDO HOHFWURQLFV
EDVHG,7LQGXVWU\ZKLOHRWKHUVEHORQJHGWRWKHQHZGRWFRPLQGXVWU\%HVLGHV6,17()WKH
1RUZHJLDQ 8QLYHUVLW\ RI 6FLHQFH DQG 7HFKQRORJ\ DQG WKH 8QLYHUVLW\ RI 2VOR PDGH XS WKH
UHVHDUFKSDUWQHUVLQWKHSURJUDP5HVXOWVRI&DVH%DQG&FDQEHIRXQGLQ6HFWLRQV
ZKLOHUHVXOWVRI&DVH'FDQEHIRXQGLQ6HFWLRQ)XUWKHUGHWDLOVUHJDUGLQJWKHVSHFLILFUH
VXOWV RI 63,4 FDQ EH IRXQG LQ $ULVKROP HW DO  '\En H '\En DQG 0RH 
-¡UJHQVHQHWDO/LHGDQG6WnOKDQH6WnOKDQHHWDO:HVWJDDUGDQG*XVWDG
 
,Q WKH TXDQWLWDWLYH SDUW RI WKH VWXG\ VRIWZDUH PDQDJHUV DQG TXDOLW\ PDQDJHUV LQ WKH
1RUZHJLDQ,7LQGXVWU\ZLWKFRUSRUDWHPHPEHUVKLSHLWKHULQWKH$VVRFLDWLRQRIWKH1RUZHJLDQ
6RIWZDUH,QGXVWU\ 352)) RUWKH1RUZHJLDQ,77HFKQRORJ\)RUXP ,78) ZHUHFKRVHQDV
WKH VDPSOLQJ IUDPH IRU WKH VXUYH\ %RWK RUJDQL]DWLRQV DUH DFWLYH LQ WKH DUHD RI VRIWZDUH
GHYHORSPHQW DQG WDNHQ WRJHWKHU WKH\ ZHUH FRQVLGHUHG WR EH UHSUHVHQWDWLYH IRU VRIWZDUH
GHYHORSPHQWZLWKLQWKH1RUZHJLDQ,7LQGXVWU\6LQFHWKHXQLWRIDQDO\VLVLQWKLVVWXG\ZDVWKH
VRIWZDUH RUJDQL]DWLRQ WKH PDQDJHUV ZHUH DVNHG WR DQVZHU RQ EHKDOI RI WKHLU UHVSHFWLYH
RUJDQL]DWLRQV
6DPSOHVL]HPLJKWKDYHDVXEVWDQWLDOLPSDFWRQDOOUHVXOWVLQTXDQWLWDWLYHUHVHDUFK7KXV
DQLPSRUWDQWFRQVLGHUDWLRQZDVWKHVDPSOHVL]HQHHGHGIRUWKHVXUYH\7KHHIIHFWVRIVDPSOH
VL]H DUH VHHQ PRVW GLUHFWO\ LQ WKH VWDWLVWLFDO SRZHU RI WKH VLJQLILFDQFH WHVWLQJ DQG WKH
JHQHUDOL]DELOLW\RIWKHUHVXOWV +DLUHWDO %RWKLVVXHVZHUHDGGUHVVHGLQWKLVVWXG\$W
DQ\ JLYHQDOSKDOHYHOWKHVDPSOHVL]HZLOOLPSDFWWKH SRZHU RI WKH VWDWLVWLFDO WHVW E\ HLWKHU
PDNLQJLWLQVHQVLWLYH DWVPDOOVDPSOHVL]HV RURYHUO\VHQVLWLYH DWYHU\ODUJHVDPSOHVL]HV 
&RKHQ  H[DPLQHGSRZHUIRUPRVWVWDWLVWLFDOLQIHUHQFHWHVWVDQGSURYLGHGJXLGHOLQHV
IRUDFFHSWDEOHOHYHOVRISRZHUVXJJHVWLQJWKDWVWXGLHVEHGHVLJQHGWRDFKLHYHDOSKDOHYHOVRI
DWOHDVWZLWKSRZHUOHYHOVRISHUFHQW8VLQJWKHVHJXLGHOLQHVDVDPSOHVL]HRIDERXW
WRUHVSRQGHQWVZLOOVXIILFHLQWHVWLQJWKHK\SRWKHVHVDQGH[SORULQJWKHUHODWLRQVKLSV
LQWKLVVWXG\ VHH6HFWLRQLQWKLVFKDSWHUIRUPRUHGHWDLOVUHJDUGLQJWKHVHFRQVLGHUDWLRQV 
7KHVDPSOHVL]HDIIHFWVWKHJHQHUDOL]DELOLW\RIWKHUHVXOWVE\WKHUDWLRRIREVHUYDWLRQVWR
LQGHSHQGHQWYDULDEOHV$JHQHUDOUXOHLVWKDWWKHUDWLRVKRXOGQHYHUIDOOEHORZWR+RZHYHU
WKHGHVLUHGOHYHOLVEHWZHHQWRREVHUYDWLRQVIRUHDFKLQGHSHQGHQWYDULDEOH +DLUHWDO
 :KHQWKLVOHYHOLVUHDFKHGWKHUHVXOWVVKRXOGEHJHQHUDOL]DEOHSURYLGHGWKDWWKHVDPSOH
LVUHSUHVHQWDWLYH7KLVVWXG\HPSOR\VVL[LQGHSHQGHQWYDULDEOHV7KXVDVDPSOHVL]HRIWR
LVQHHGHGWRYDOLGDWHWKHJHQHUDOL]DELOLW\RIWKHUHVXOWV
6DPSOH VL]H LV DOVR DQ LPSRUWDQW FRQVLGHUDWLRQ LQ WKH GLVFXVVLRQ RI WKH LQWHUQDO
FRQVLVWHQF\RIWKHPHDVXUHPHQWVFDOHV DGHWDLOHGH[DPLQDWLRQRIWKHLQWHUQDOFRQVLVWHQF\RI
WKHVXPPDWHGUDWLQJVFDOHVXVHGLQWKLVVWXG\LVPDGHLQWKHQH[WFKDSWHU 7KHLWHPDQDO\VLV
WR FKRRVH D VHW RI LWHPV WKDW IRUP DQ LQWHUQDOO\ FRQVLVWHQW VFDOH UHTXLUHV D VDPSOH VL]H RI
DERXWWRUHVSRQGHQWV 6SHFWRU  %DVHGRQWKHVH JXLGHOLQHVRXUWDUJHW VDPSOH
VL]HIRUHQVXULQJDGHTXDWHVWDWLVWLFDOSRZHUJHQHUDOL]DELOLW\DQGLWHPDQDO\VLVZDVDPLQLPXP
RIUHVSRQGHQWV
$UDQGRPVDPSOHRIVRIWZDUHDQGTXDOLW\PDQDJHUVIURPWKHPHPEHUVKLSOLVWVRIWKH
WZR DVVRFLDWLRQV ZHUH FRQWDFWHG E\ WHOHSKRQH WR UHTXHVW SDUWLFLSDWLRQ LQ WKH VWXG\ SULRU WR
PDLOLQJWKHTXHVWLRQQDLUHV$OOPDQDJHUVDJUHHGWRSDUWLFLSDWHLQWKHVWXG\:HSURYLGHGWKH
UHVSRQGHQWVZLWKVHOIDGGUHVVHGVWDPSHGUHWXUQHQYHORSHV

±±
&+$37(5

7DEOH&KDUDFWHULVWLFVRIWKHVXUYH\VDPSOH

&KDUDFWHULVWLF )UHTXHQF\ 3HUFHQW

, &KDUDFWHULVWLFVRIWKH5HVSRQGHQW

$YHUDJHQXPEHURI\HDUVZRUNHGLQWKHFRPSDQ\ 
$YHUDJHQXPEHURI\HDUVZRUNHGZLWKVRIWZDUHGHYHORSPHQW 
+LJKHVWFRPSOHWHGHGXFDWLRQ
%DFKHORU¶VGHJUHH  
0DVWHU¶VGHJUHH  
'RFWRUDOGHJUHH  
2WKHU  
-REIXQFWLRQ
6RIWZDUHPDQDJHU  
4XDOLW\PDQDJHU  
,, &KDUDFWHULVWLFVRIWKH5HVSRQGHQW¶V&RPSDQ\

1XPEHURIVRIWZDUHGHYHORSHUV
/HVVWKDQRUHTXDOWR  
%HWZHHQDQG  
0RUHWKDQRUHTXDOWR  
3ULPDU\LQGXVWU\JURXS
3XEOLFVHFWRU  
%DQNLQJILQDQFHLQVXUDQFH  
0DQXIDFWXULQJ  
,7VHFWRU  
2WKHU  
7\SHRISURGXFWEXVLQHVV
6WDQGDUGDSSOLFDWLRQV VKHOIZDUH  
7DLORUPDGHVROXWLRQVIRUH[WHUQDOFXVWRPHUV  
7DLORUPDGHVROXWLRQVIRULQWHUQDOFRPSDQ\FXVWRPHUV  
4XDOLW\V\VWHPLQXVH
<HV  
1R  

$OVR E\ NHHSLQJ WKH TXHVWLRQQDLUH DV VKRUW DV SRVVLEOH D SLORW VWXG\ RI WKH VXUYH\
TXHVWLRQQDLUHVKRZHGWKDWUHVSRQGHQWVQHHGHGDERXWPLQXWHVWRFRPSOHWHLW ZHFRPELQHG
VHYHUDOZHOOSURYHQWHFKQLTXHVIRULPSURYLQJWKHUHVSRQVHUDWHRIPDLOHGTXHVWLRQQDLUHV HJ
)LQNDQG.RVHFRII,OVWDG.DQXNDQG%HUHQVRQ1HXPDQ 
$ WRWDO RI  VRIWZDUH DQG TXDOLW\ PDQDJHUV UHSUHVHQWLQJ ZKROH RUJDQL]DWLRQV RU
LQGHSHQGHQW EXVLQHVV XQLWV ZLWKLQ  VRIWZDUH FRPSDQLHV FRPSOHWHG DQG UHWXUQHG WKH
TXHVWLRQQDLUH 7KLV LV ZLWKLQ WKH OLPLWV GLVFXVVHG DERYH IRU ERWK DGHTXDWH VWDWLVWLFDO SRZHU
DQG JHQHUDOL]DELOLW\ RI WKH UHVXOWV LQ WKLV VWXG\ )XUWKHUPRUH WKLV UHSUHVHQWV DQ HIIHFWLYH
UHVSRQVH UDWH RI  SHUFHQW ZKLFK LV ZHOO ZLWKLQ WKH QRUP RI    SHUFHQW IRU
UHSUHVHQWDWLYHV RI RUJDQL]DWLRQV DQG PLGOHYHO PDQDJHUV VXJJHVWHG IRU DFDGHPLF VWXGLHV E\

±±
5(6($5&+0(7+2'2/2*<

%DUXFK  DQGFRQVLGHUDEO\KLJKHUWKDQSULRUPDLOVXUYH\VFRQGXFWHGLQWKH1RUZHJLDQ


VRIWZDUHDQG,7LQGXVWU\$VDFRPSDULVRQDUHFHQWVWXG\E\/DUVHQDQG.DXW]  RQWKH
VWDWXVRITXDOLW\DVVXUDQFHDQGVRIWZDUHSURFHVVLPSURYHPHQWLQ1RUZD\REWDLQHGDUHVSRQVH
UDWHRISHUFHQW6WnOKDQHHWDO¶V D VWXG\RIWKHFXVWRPHU¶VYLHZRIVRIWZDUHSURG
XFWTXDOLW\DFKLHYHGDUHVSRQVHUDWHRISHUFHQWZKLOH.URJVWLH¶V  VWXG\RIWKHXVHRI
PHWKRGVDQG&$6(WRROVLQ1RUZD\DFKLHYHGDUHVSRQVHUDWHRISHUFHQW*LYHQWKHKLJK
UHVSRQVH UDWH LQ WKLV VWXG\ QR IXUWKHU DQDO\VLV ZDV GRQH RQ WKH GLIIHUHQFHV EHWZHHQ
UHVSRQGHQWVDQGQRQUHVSRQGHQWV
$VVKRZQLQ7DEOHWKHUHVSRQGHQW¶VFRPSDQLHVUHSUHVHQWDZLGHYDULHW\RILQGXVWU\
VHFWRUV+RZHYHUWKHVDPSOHLVDVH[SHFWHGELDVHGLQIDYRURI,7FRPSDQLHV RIWKH
VDPSOH  7R D ODUJH H[WHQW WKH RUJDQL]DWLRQV GHYHORS VRIWZDUH IRU H[WHUQDO FXVWRPHUV
DSSUR[LPDWHO\RIWKHVDPSOH )XUWKHUPRUHWKHVDPSOHVKRZVDPL[RIERWKVPDOODQG
ODUJHRUJDQL]DWLRQVZLWKDSSUR[LPDWHO\RQHWKLUG  RIWKHRUJDQL]DWLRQVKDYLQJRU
OHVVGHYHORSHUVDQGDSSUR[LPDWHO\RQHWKLUG  KDYLQJRUPRUH$ODUJHPDMRULW\RI
WKHUHVSRQGHQW¶VRUJDQL]DWLRQV KDYH D TXDOLW\ V\VWHP LQ XVH   7KH DYHUDJH OHQJWK RI
WKHUHVSRQGHQWV¶MREWHQXUHDWWKHLUFXUUHQWRUJDQL]DWLRQLV\HDUVZKLOHSURIHVVLRQDOWHQXUH
\HDUVLQVRIWZDUHGHYHORSPHQW LV\HDUV7ZRWKLUGVRIWKHUHVSRQGHQWV  KROGVD
PDVWHU¶VRUGRFWRUDOGHJUHH

 9DULDEOHVDQG0HDVXUHV
7ZR SURFHVVHV RI PHDVXUHPHQW ZHUH XVHG LQ WKLV VWXG\ FRQFHSWXDOL]DWLRQ DQG RSHUDWLRQD
OL]DWLRQ &RQFHSWXDOL]DWLRQ LV WKH SURFHVV RI WDNLQJ DQ DEVWUDFW FRQVWUXFW DQG UHILQLQJ LW E\
JLYLQJ LW D FRQFHSWXDO RU WKHRUHWLFDO GHILQLWLRQ ZKLOH RSHUDWLRQDOL]DWLRQ LV WKH SURFHVV RI
OLQNLQJ D FRQFHSWXDO GHILQLWLRQ WR D VSHFLILF VHW RI PHDVXUHPHQW WHFKQLTXHV RU SURFHGXUHV
1HXPDQ   7KLV SURFHVV IURP DEVWUDFW FRQVWUXFW WR FRQFUHWH PHDVXUH IRU WKH
LQGHSHQGHQWDQGGHSHQGHQWYDULDEOHVLQWKLVVWXG\LVLOOXVWUDWHGLQ)LJXUH7KHSURFHVVFDQ
WKXV EH VHHQ DV OLQNLQJ WKH DEVWUDFW RU WKHRUHWLFDO  OHYHO WRJHWKHU ZLWK WKH RSHUDWLRQDO DQG
HPSLULFDOOHYHOV

,QGHSHQGHQW9DULDEOH 'HSHQGHQW9DULDEOH

+\SRWKHWLFDO&DXVDO
$EVWUDFW&RQVWUXFW $EVWUDFW&RQVWUXFW
5HODWLRQVKLS

&RQFHSWXDOL]DWLRQ &RQFHSWXDOL]DWLRQ

&RQFHSWXDO'HILQLWLRQ &RQFHSWXDO'HILQLWLRQ

2SHUDWLRQDOL]DWLRQ 2SHUDWLRQDOL]DWLRQ
7HVWHG(PSLULFDO
,QGLFDWRURU0HDVXUH ,QGLFDWRURU0HDVXUH
+\SRWKHVLV

)LJXUH&RQFHSWXDOL]DWLRQDQGRSHUDWLRQDOL]DWLRQ DGDSWHGIURP1HXPDQS 

±±
&+$37(5

7KHTXDQWLWDWLYHPHDVXUHPHQWSURFHVVFRQVLVWHGRIDUHODWLYHO\VWUDLJKWIRUZDUGVHTXHQFH
RI FRQFHSWXDOL]DWLRQ IROORZHG E\ RSHUDWLRQDOL]DWLRQ DQG GDWD FROOHFWLRQ 7KXV FRQVWUXFWV
LGHQWLILHG GXULQJ WKH FDVH VWXGLHV ZHUH JLYHQ FOHDU FRQFHSWXDO GHILQLWLRQV VHH &KDSWHU  
1H[WWKHVHGHILQLWLRQVZHUHRSHUDWLRQDOL]HGE\GHYHORSLQJDVHWRILQGLFDWRUVIRUHDFKFRQFHSW
VHH&KDSWHU )LQDOO\WKHVHLQGLFDWRUVZHUHDSSOLHGWRWKHPHDVXUHPHQWLQVWUXPHQWXVHGWR
FROOHFWWKHGDWD%\FRQWUDVWWKHPHDVXUHPHQWSURFHVVRIWKHTXDOLWDWLYHSDUWRIWKHVWXG\ZDV
QRWWKDWFOHDUFXW,WZDVDPRUHLWHUDWLYHSURFHVVRIIRUPLQJDQGUHILQLQJFRQFHSWVJURXQGHG
LQWKHGDWDDQGWKXVPRUHLQWHJUDWHGLQWRWKHGDWDFROOHFWLRQSURFHVV7KHUHIRUHPRVWRIWKH
FRQFHSWXDOL]DWLRQLQWKHTXDOLWDWLYHSDUWRIWKHVWXG\RFFXUUHGDIWHUGDWDFROOHFWLRQUDWKHUWKDQ
SULRUWRLW
,QRUGHUWRPDNHVXUHWKDWWKHFRQFHSWVZHGHYHORSHGZHUHZHOOJURXQGHGLQWKHGDWDDV
ZHOODVLQWKHVXEVWDQWLYHWKHRULHVUHODWHGWRWKHSKHQRPHQRQXQGHUVWXG\ZHFRPELQHGWKH
FDVHVWXGLHV ZLWK DQ H[WHQVLYH OLWHUDWXUH UHYLHZ DQG WKH XVH RI DGGLWLRQDO H[SHUWV IURP ERWK
DFDGHPLD DQG LQGXVWU\ VHH )LJXUH   7KH GDWD FROOHFWHG WKURXJK WKHVH DFWLYLWLHV ZDV
VXEVHTXHQWO\XVHGDVLQSXWWRWKHFRGLQJSURFHGXUHLQRUGHUWRUHILQHWKHDEVWUDFWFRQVWUXFWV
DQGGHILQHWKHFRQFHSWV,QWKLVSURFHVVZHDSSOLHGWKHWKUHHFRGLQJSURFHGXUHVLQJURXQGHG
WKHRU\ RSHQ FRGLQJ D[LDO FRGLQJ DQG VHOHFWLYH FRGLQJ 6WUDXVV DQG &RUELQ   WR WKH
FROOHFWHGGDWD
'XULQJ RSHQ FRGLQJ GDWD ZHUH EURNHQ GRZQ LQWR GLVFUHWH SDUWV FORVHO\ H[DPLQHG DQG
FRPSDUHGIRUVLPLODULWLHVDQGGLIIHUHQFHV'DWDWKDWZDVIRXQGWREHFRQFHSWXDOO\VLPLODURU
UHODWHG ZDV JURXSHG XQGHU PRUH DEVWUDFW FRQFHSWV RU FDWHJRULHV EDVHG RQ WKHLU DELOLW\ WR
H[SODLQ63,VXFFHVV7KLVDEVWUDFWLQJWKURXJKFRPSDUDWLYHDQDO\VLVZDVDQLPSRUWDQWSDUWRI
WKHFRQFHSWXDOL]DWLRQSURFHVVVLQFHLWHQDEOHGXVWRUHGXFHWKHQXPEHURIFRQFHSWV
'XULQJWKHD[LDOFRGLQJSURFHVVWKHLGHQWLILHG FDWHJRULHVZHUHUHODWHGWRVXEFDWHJRULHV
RULQGLFDWRUVLQRUGHUWRIRUPSUHFLVHDQGFRPSOHWHH[SODQDWLRQVDERXW63,VXFFHVV7KLVVWHS
ZDV LPSRUWDQW LQ EXLOGLQJ WKH WKHRU\ DQG RXU JRDO ZDV WR V\VWHPDWLFDOO\ GHYHORS DQG UHODWH
FDWHJRULHVWRJLYHWKHPJUHDWHUH[SODQDWRU\SRZHU
6HOHFWLYHFRGLQJFDQEHVHHQDVWKHSURFHVVRILQWHJUDWLQJDQGUHILQLQJWKHWKHRU\ 6WUDXVV
DQG&RUELQ 'XULQJWKLVSURFHVVZHLQWHJUDWHGWKHGDWDFROOHFWHGIURPWKHFDVHVWXGLHV
LQ&DVH' VHH$SSHQGL[ &IRUDQ H[DPSOH DQGUHODWHGLWGRWKHSUHVFULSWLRQVIRXQG LQ WKH
OLWHUDWXUH VHH&KDSWHUV IRUPLQJDILQDOVHWRIFHQWUDOFDWHJRULHV VHH$SSHQGL[' 7KLV
SURFHVV UHVXOWHG LQ WKH FRQFHSWXDO GHILQLWLRQV RI WKH LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV
GHVFULEHGLQWKHSUHYLRXVFKDSWHU7KHVHGHILQLWLRQVZHUHWKHQRSHUDWLRQDOL]HGDQGQHZGDWD
ZDVFROOHFWHGWRWHVWWKHK\SRWKHVHVLQWKHTXDQWLWDWLYHSDUWRIWKHVWXG\7KXVWKHJURXQGHG
WKHRU\FRGLQJSURFHVVPD\EHUHJDUGHGDVTXDOLWDWLYHIDFWRUDQDO\VLV /HHE 
7KH RSHUDWLRQDOL]DWLRQ SURFHVV LQ TXDOLWDWLYH UHVHDUFK VLJQLILFDQWO\ GLIIHUV IURP
TXDQWLWDWLYH UHVHDUFK 5DWKHU WKDQ WXUQLQJ D FRQFHSWXDO GHILQLWLRQ LQWR D VHW RI PHDVXUDEOH
LQGLFDWRUVRSHUDWLRQDOL]DWLRQLQTXDOLWDWLYHUHVHDUFKLVPRUHRIDGHWDLOHGGHVFULSWLRQRIKRZ
WKHGDWDZDVFROOHFWHG$VVXFKLWLVDQ³DIWHUWKHIDFW´GHVFULSWLRQPRUHWKDQD³EHIRUHWKH
IDFW´WHFKQLTXH 1HXPDQ &RQVHTXHQWO\ZHKDYHGHVFULEHGWKHVHGHWDLOVDVSDUWRIWKH
QH[W VHFWLRQ RQ GDWD FROOHFWLRQ 7KXV WKH IRFXV LQ WKH TXDOLWDWLYH UHVHDUFK ZDV RQ
FRQFHSWXDOL]DWLRQ ZKLOH WKH TXDQWLWDWLYH UHVHDUFK IRFXVHG RQ RSHUDWLRQDOL]DWLRQ 'HWDLOV
UHJDUGLQJWKHFRQFHSWXDOGHILQLWLRQVZHUHGHVFULEHGLQWKHSUHYLRXVFKDSWHU &KDSWHU DQG
GHWDLOHGGHVFULSWLRQVRIWKHRSHUDWLRQDOL]DWLRQSURFHVVLVJLYHQLQWKHQH[WFKDSWHU &KDSWHU
RQLQVWUXPHQWGHYHORSPHQW

±±
5(6($5&+0(7+2'2/2*<

%DVHGRQWKHFRQFHSWXDOGHILQLWLRQVRIWKHFHQWUDOFDWHJRULHVDQGWKHLQGLFDWRUVLGHQWLILHG
LQ WKH TXDOLWDWLYH SDUW RI WKH VWXG\ RQH GHSHQGHQW VL[ LQGHSHQGHQW DQG WZR PRGHUDWLQJ
YDULDEOHV ZHUH RSHUDWLRQDOL]HG DQG XVHG LQ WKH TXDQWLWDWLYH SDUW RI WKLV VWXG\ WR FROOHFW WKH
GDWD

,QGHSHQGHQWYDULDEOHV7RPHDVXUHWKHH[WHQWWRZKLFKHDFKRIWKHVL[LQGHSHQGHQWYDULDEOHV
ZHUH SUDFWLFHG ZH XVHG PXOWLLWHP ILYHSRLQW ELSRODU /LNHUW VFDOHV WKDW UDQJHG IURP
³VWURQJO\ GLVDJUHH´   WR ³VWURQJO\ DJUHH´   IRU DOO LQGLFDWRUV )RU HDFK LQGHSHQGHQW
YDULDEOHWKHLWHPUDWLQJVZHUHVXPPDUL]HGWRIRUPDVXPPDWHGUDWLQJVFDOHIRUWKDWYDULDEOH
7KXVWKHRSHUDWLRQDOL]HGOHYHOVRIWKHLQGHSHQGHQWYDULDEOHVZHUHUHSUHVHQWHGE\WKHVXPVRI
WKHUDWLQJVRIWKHPXOWLLWHPVFDOHV)XUWKHUPRUHVLQFHWKLVLVWKHILUVWVWXG\RILWVNLQGZLWKLQ
63,DOOLWHPVZHUHZULWWHQVSHFLILFDOO\IRUWKLVVWXG\EDVHGRQWKHGDWDFROOHFWHGLQWKHFDVH
VWXGLHVDQGWKURXJKWKHOLWHUDWXUHUHYLHZ
7KHUHOLDELOLW\FRHIILFLHQWVUDQJHGIURPWR VHH7DEOHLQWKHQH[WFKDSWHU 
6LQFH UHOLDELOLW\ FRHIILFLHQWV RI  RU KLJKHU DUH FRQVLGHUHG EHLQJ VDWLVIDFWRU\ &URQEDFK
1XQQDOO\DQG%HUQVWHLQ DOOVFDOHVGHYHORSHGIRUWKHLQGHSHQGHQWYDULDEOHVXVHG
LQ WKLV VWXG\ ZHUH MXGJHG WR EH UHOLDEOH $ PRUH GHWDLOHG DQDO\VLV DQG GLVFXVVLRQ RI WKH
YDOLGLW\ DQG UHOLDELOLW\ RI WKH RSHUDWLRQDOL]HG PHDVXUHV IRU WKH LQGHSHQGHQW YDULDEOHV LV
SUHVHQWHGLQWKHQH[WFKDSWHU

'HSHQGHQWYDULDEOH:HRSHUDWLRQDOL]HGDQGPHDVXUHG63,VXFFHVVEDVHGRQWZRPXOWLLWHP
PHDVXUHV(DFKPDQDJHUZDVDVNHGWRUDWHRQSRLQWELSRODU/LNHUWVFDOHV  WKHOHYHORI
SHUFHLYHG63,VXFFHVVDQG  WKHSHUIRUPDQFHRIWKHLURUJDQL]DWLRQIRUWKHSDVWWKUHH \HDUV
ZLWK UHVSHFW WR FRVW UHGXFWLRQ F\FOH WLPH UHGXFWLRQ DQG FXVWRPHU VDWLVIDFWLRQ 7ZR LWHPV
ZHUH XVHG WR PHDVXUH WKH OHYHO RI SHUFHLYHG 63, VXFFHVV ZKLOH WKUHH LWHPV ZHUH XVHG WR
PHDVXUHRUJDQL]DWLRQDOSHUIRUPDQFH$VIRUWKHLQGHSHQGHQWYDULDEOHVDOOLWHPVZHUHZULWWHQ
VSHFLILFDOO\IRUWKLVVWXG\7KHUDWLQJVIRUWKHWZRSHUIRUPDQFHGLPHQVLRQVZHUHDYHUDJHGWR
IRUPDVLQJOHPHDVXUHRIRYHUDOO63,VXFFHVV7KHUHOLDELOLW\FRHIILFLHQWIRUWKHILYHLWHPVRI
WKHGHSHQGHQWYDULDEOH63,VXFFHVVZDV

0RGHUDWLQJ YDULDEOHV 7ZR PRGHUDWLQJ YDULDEOHV ± HQYLURQPHQWDO FRQGLWLRQV DQG


RUJDQL]DWLRQDOVL]H±ZHUHRSHUDWLRQDOL]HGDQGLQFOXGHGLQWKHK\SRWKHVLVWHVWLQJSDUWRIWKLV
VWXG\(QYLURQPHQWDOFRQGLWLRQVZHUHPHDVXUHGXVLQJWZRVHPDQWLFGLIIHUHQWLDOLWHPVZULWWHQ
VSHFLILFDOO\IRUWKLVVWXG\%RWKLWHPVZHUHUDWHGRQDVHYHQSRLQWELSRODUDGMHFWLYDOJUDSKLF
VFDOH7KHWZRLWHPVZHUHVWDEOHYVXQVWDEOHHQYLURQPHQWDQGSUHGLFWDEOHYVXQSUHGLFWDEOH
HQYLURQPHQW7KHUHOLDELOLW\FRHIILFLHQWRIWKHVXPPDWHGUDWLQJVFDOHZDV
2UJDQL]DWLRQDO VL]H ZDV GHILQHG DV WKH QXPEHU RI VRIWZDUH GHYHORSHUV LQ WKH VRIWZDUH
RUJDQL]DWLRQ

 'DWD&ROOHFWLRQ3URFHGXUH
'XULQJ WKH WZR\HDU SHULRG RI WKH SLORW FDVH VWXG\ 7(/0(7  ± IURP $SULO  WR $SULO
±DQGWKHWKUHH\HDU SHULRG RI WKH PXOWLSOH FDVH VWXG\ 63,4  ± IURP -DQXDU\  WR
'HFHPEHU±ZHFROOHFWHGDQH[WHQVLYHDPRXQWRIERWKTXDOLWDWLYHDQGTXDQWLWDWLYHGDWD
$GGLWLRQDO TXDOLWDWLYH GDWD ZDV DOVR FROOHFWHG GXULQJ WKH SHULRG -DQXDU\  WR -XQH 

±±
&+$37(5

352),7 WRDLGLQWKHLQWHUSUHWDWLRQRIWKHTXDQWLWDWLYHUHVXOWVRIWKHPDLQVXUYH\'DWDZDV
FROOHFWHG E\ WKH PHDQV RI FRQYHUVDWLRQDO LQWHUYLHZV GRFXPHQW VWXGLHV JURXS GLVFXVVLRQV
PHDVXUHPHQWIRUPVDQGVXUYH\V
$OVR ZH GHYHORSHG D GHHSHU XQGHUVWDQGLQJ RI WKH QDWXUH RI 63, E\ EHLQJ DQ DFWLYH
SDUWLFLSDQWLQVHYHUDORIWKHUHVHDUFKSURMHFWVFRYHUHGE\WKHFDVHVWXGLHV7KXVWKHLQIRUPDO
GLVFXVVLRQVREVHUYDWLRQVDQGVRFLDOUHODWLRQVKLSVZLWKGHYHORSHUVDQGPDQDJHUVIURPWKHVH
VRIWZDUHRUJDQL]DWLRQVDVZHOODVZLWKIHOORZUHVHDUFKHUVGXULQJWKHVH\HDUVKDYHWDXJKWXVD
ORW7RJHWKHUZLWKRXUSULRUFRQVXOWLQJH[SHULHQFHWKLVEDFNJURXQGKDVQRGRXEWLQIOXHQFHG
WKH LQWHUSUHWDWLRQ RI LPSRUWDQW DVSHFWV RI WKLV UHVHDUFK ,Q WKH VDPH ZD\ ZH KDYH DOVR
FRQWULEXWHGWRWKHNQRZOHGJHFUHDWLQJSURFHVVHVLQWKHSDUWLFLSDWLQJRUJDQL]DWLRQV7KXVWKLV
UHVHDUFKLVSDUWRIDVRFLDOO\FRQVWUXFWHGVHWWLQJ
7KHPDLQGDWDVRXUFHLQWKHSLORWFDVHVWXG\ZDVVHYHUDOFRQYHUVDWLRQDOLQWHUYLHZVZLWK
WKH 9LFH 3UHVLGHQW RI 1HUD WKH PDQDJHU RI 7HOH6FDGD WKH 6RIWZDUH+DUGZDUH GHSDUWPHQW
PDQDJHU WKH 4$ PDQDJHU WKH 6\VWHP7HFKQRORJ\ GHSDUWPHQW PDQDJHU WKH &XVWRPHU
6HUYLFHVGHSDUWPHQWPDQDJHUDQGWKHVRIWZDUHGHYHORSHUV$GGLWLRQDOO\ZHZHUHDOORZHGWR
VWXG\DOOWKHGRFXPHQWVDW1HUDWKDWZHWKRXJKWUHOHYDQWIRUWKLVVWXG\7KLVLQFOXGHGEXVLQHVV
VWUDWHJLHV SURMHFW SODQV TXDOLW\ PDQXDOV LQWHUQDO DQG H[WHUQDO DVVHVVPHQW UHSRUWV SURGXFW
VSHFLILFDWLRQV PLQXWHV RI PHHWLQJV LQIRUPDWLRQ OHDIOHWV DQG MRE GHVFULSWLRQV )XUWKHUPRUH
DV SDUW RI WKH 7(/0(7 WHDP ZH SDUWLFLSDWHG LQ LQWHUQDO IHHGEDFN VHVVLRQV DQG JURXS
GLVFXVVLRQVDQGKDGDFFHVVWRDOOPHDVXUHPHQWUHVXOWVRIWKHSDUWLFLSDWLQJ1HUDSURMHFWV
:HJURXQGHGRXURZQOHDUQLQJSURFHVVDERXWVXFFHVVIXO63,DFWLRQVLQWKHVHGDWDVRXUFHV
DQGWRJHWKHUWKH\JDYHYDOXDEOHLQSXWIRUUHIOHFWLRQDQGWRWKHSURFHVVRIIRUPLQJWKHDEVWUDFW
FRQVWUXFWV RI WKLV VWXG\ 0RVW RI WKH LQVLJKWV KRZHYHU FDPH IURP WKH LQIRUPDO LQWHUYLHZV
JURXSGLVFXVVLRQVDQGREVHUYDWLRQV2QHUHDVRQIRUWKLVZDVWKDWWKH\ ZHUHXVHIXO LQ VKHG
GLQJOLJKWRQWKHLPSRUWDQFHRIVHQVHPDNLQJDQGWKHUHODWLRQVKLSEHWZHHQHVSRXVHGWKHRULHV
DQGWKHRULHVLQXVH$QRWKHUUHDVRQZDVWKDWWKHVHDFWLYLWLHVDOORZHGXVWRJHWWRNQRZPRUH
RI 1HUD¶V RUJDQL]DWLRQDO FXOWXUH FRQWULEXWLQJ WR D EHWWHU XQGHUVWDQGLQJ RI WKH WDFLW
DVVXPSWLRQVXQGHUO\LQJPXFKRIWKHLUDFWLRQV
7KHGDWDFROOHFWLRQPHWKRGVXVHGLQWKHPXOWLSOHFDVHVWXGLHVZDVPXFKWKHVDPH DVLQ
WKH SLORW FDVH VWXG\ +RZHYHU LQ WKH PXOWLSOH FDVH VWXGLHV ZH IRFXVHG WKH GDWD FROOHFWLRQ
DFWLYLWLHVPRUHGLUHFWO\WRZDUGOHDUQLQJSURFHVVHVDQG63,VXFFHVVIDFWRUV:LWKUHVSHFWWR63,
VXFFHVV IDFWRUV ZH SHUIRUPHG IRXU VXUYH\V DPRQJ VRIWZDUH PDQDJHUV TXDOLW\ PDQDJHUV
VRIWZDUH GHYHORSHUV DQG FXVWRPHU UHSUHVHQWDWLYHV LQ IRXU RI WKH FDVH FRPSDQLHV DERXW WKH
IDFWRUV HQDEOLQJ 63, VXFFHVV &DVH '  7KH GDWD FROOHFWLRQ PHWKRG XVHG WR GHULYH WKHVH
IDFWRUVZDVWKUHHTXHVWLRQQDLUHLWHPVDQGIROORZXSJURXSLQWHUYLHZV IHHGEDFNVHVVLRQV )RU
WKHSXUSRVHRIWKHUHVXOWVSUHVHQWHGLQWKLVFKDSWHUGDWDFROOHFWLRQIRFXVHGRQDQVZHULQJRQH
TXHVWLRQ

,Q \RXU RSLQLRQ ZKDW DUH WKH WKUHH PRVW LPSRUWDQW IDFWRUV HQDEOLQJ 63, VXFFHVV LQ \RXU
RUJDQL]DWLRQ"

,QRUGHUWRJDLQPRUHEDFNJURXQGLQIRUPDWLRQDERXWWKHHQDEOLQJIDFWRUVRI63,VXFFHVVRXU
TXHVWLRQLQJ VWUDWHJ\ LQFOXGHG WZR DGGLWLRQDO TXHVWLRQV )LUVW ZH DVNHG WKH VXEMHFWV DERXW
WKHLU PRVW LPSRUWDQW DUJXPHQW LQ IDYRU RI 63, LQ WKHLU RUJDQL]DWLRQ 6HFRQG ZH DVNHG WKH
VXEMHFWVDERXWWKHLUPRVWLPSRUWDQWDUJXPHQWDJDLQVW63,LQWKHLURUJDQL]DWLRQ7KHDQVZHUV
WR WKHVH TXHVWLRQV JDYH XV YDOXDEOH LQIRUPDWLRQ IRU LQWHUSUHWLQJ WKH HQDEOLQJ IDFWRUV VHH
$SSHQGL[&IRUDQH[DPSOH 

±±
5(6($5&+0(7+2'2/2*<

,QWRWDOPDQDJHUVGHYHORSHUVDQGFXVWRPHUUHSUHVHQWDWLYHVDQVZHUHGWKHWKUHHTXHV
WLRQVDQGSDUWLFLSDWHGLQWKHVXEVHTXHQWIHHGEDFNVHVVLRQV)XUWKHUPRUHDVDFRPSOHPHQWWR
WKHVHIRXUVXUYH\VDQGWKHDFFRPSDQ\LQJOLWHUDWXUHUHYLHZZHFRQGXFWHGDQDGGLWLRQDOUHYLHZ
SURFHVVZKHUHZHFROOHFWHGGDWDIURPHOHYHQ63,H[SHUWVLQERWKDFDGHPLDDQGLQGXVWU\7KH
UHYLHZ SURFHVV FRQVLVWHG RI WKUHH FRQVHFXWLYH DFWLYLWLHV   UHILQHPHQW RI WKH GHULYHG
FDWHJRULHV  SULRULWL]DWLRQRIWKHK\SRWKHVL]HGFDWHJRULHVDQG  SULRULWL]DWLRQRILQGLFDWRUV
ZLWKLQHDFKFDWHJRU\
$VIRUWKHVXFFHVVIDFWRUVZHFROOHFWHGDGGLWLRQDOGDWDUHJDUGLQJRUJDQL]DWLRQDOOHDUQLQJ
SURFHVVHVDQGWKHWUDQVIHURIH[SHULHQFHDPRQJDIXUWKHUVHWRIVRIWZDUHPDQDJHUVTXDOLW\
PDQDJHUVDQGVRIWZDUHGHYHORSHUVLQILYHVRIWZDUHRUJDQL]DWLRQV &DVH& 7KHGDWDFROOHF
WLRQPHWKRGXVHGZDVSHUVRQDOLQWHUYLHZVIRFXVHGRQDQVZHULQJTXHVWLRQVUHJDUGLQJ  WKH
IDPLOLDULW\ZLWKRUJDQL]DWLRQDOURXWLQHV  WKHH[WHQWWRZKLFKWKHVHURXWLQHVZHUH DFWXDOO\
XVHG   WKH SURFHGXUHV IRU UHYLVLQJ WKH URXWLQHV DQG   WKH RUJDQL]DWLRQDO SURFHVVHV RI
WUDQVIHUULQJ NQRZOHGJH DQG H[SHULHQFH )XUWKHUPRUH JURXS UHIOHFWLRQ DQG GLVFXVVLRQ DQG
GRFXPHQWVWXGLHVZHUHMXVWDVLPSRUWDQWIRUGDWDFROOHFWLRQLQWKHPXOWLSOHFDVHVWXG\DVLWZDV
LQWKHSLORWFDVHVWXG\
7KUHHWUDGLWLRQDOPHWKRGVRIGDWDFROOHFWLRQZHUHFRQVLGHUHGIRUWKHTXDQWLWDWLYHSDUWRI
WKHVWXG\PDLOTXHVWLRQQDLUHWHOHSKRQHLQWHUYLHZDQGSHUVRQDOLQWHUYLHZ0DLOHGVXUYH\VDUH
XVXDOO\VHOIDGPLQLVWHUHGWKDWLVWKHUHVSRQGHQWVILOOLQWKHTXHVWLRQQDLUHVWKHPVHOYHVZKLOH
WHOHSKRQHDQGSHUVRQDOLQWHUYLHZVDUHDGPLQLVWHUHGE\WKH UHVHDUFKHURU DQRWKHUSHUVRQ:H
HYDOXDWHGWKHVWUHQJWKVDQGZHDNQHVVHVRIHDFKRIWKHVHGDWD FROOHFWLRQPHWKRGVLQRUGHUWR
DUULYH DW WKH EHVW VROXWLRQ IRU WKLV VWXG\ *HQHUDOO\ WKH FKRLFH RI PHWKRGV GHSHQGV XSRQ
VHYHUDO IDFWRUV VXFK DV WKH DYDLODELOLW\ RI WLPH DQG IXQGV WKH VDPSOH SRSXODWLRQ DQG WKH
DPRXQWDQGNLQGRIGDWDWRFROOHFW
:H FKRVH D PDLO VXUYH\ IRU WKLV SDUW RI WKH VWXG\ LQ RUGHU WR FRYHU D ODUJH QXPEHU RI
VRIWZDUH RUJDQL]DWLRQV LQ D ZLGH JHRJUDSKLFDO DUHD ZLWK D IDLUO\ ODUJH QXPEHU RI TXHVWLRQV
ZLWKLQ D UHDVRQDEOH SHULRG RI WLPH DQG FRVW EXGJHW $GGLWLRQDO DGYDQWDJHV RI PDLO VXUYH\V
LQFOXGH DQRQ\PLW\ DQG WKH ODFN RI LQWHUYLHZHU ELDV 2Q WKH RWKHU KDQG WKH ELJJHVW
GLVDGYDQWDJHZLWKPDLOHGVXUYH\VLVDSRWHQWLDOO\ORZUHVSRQVHUDWH
$VH[SODLQHGLQ6HFWLRQZHFRPELQHGWKHPDLOVXUYH\ZLWKDWHOHSKRQHLQWHUYLHZWR
UHTXHVWFRRSHUDWLRQDQGSDUWLFLSDWLRQLQWKHVXUYH\SULRUWRPDLOLQJWKH TXHVWLRQQDLUHV ZLWK
VHYHUDORWKHUZHOOSURYHQWHFKQLTXHVIRULPSURYLQJWKHUHVSRQVHUDWH)XUWKHUPRUHVLQFHPDLO
VXUYH\VKDYHEHHQVKRZQWREHYHU\HIIHFWLYHZLWKKLJKUHVSRQVHUDWHVIRUWDUJHWSRSXODWLRQV
WKDWDUHZHOOHGXFDWHGRUKDYHDVWURQJLQWHUHVWLQWKHWRSLF 1HXPDQ ZHDVVXPHGWKDW
DIDLUO\KLJKUHVSRQVHUDWHZRXOGEHUHDOLVWLFIRUWKLVVWXG\
:H VFKHGXOHG WKH VXUYH\ WR WKH VSULQJ RI  DQG DQWLFLSDWHG WKDW WKH GDWD FROOHFWLRQ
SHULRGZRXOGODVWIRUDERXWWZRPRQWKV2XUPDMRUFRQFHUQZDVWKHUHIRUHWRKDYHWKHVXUYH\
FRPSOHWHGEHIRUHWKHEHJLQQLQJRIWKHVXPPHUKROLGD\VHDVRQ7KHILUVWTXHVWLRQQDLUHVZHUH
PDLOHGRQ0D\DQGZHFRQWLQXHGPDLOLQJTXHVWLRQQDLUHVIRUVL[ZHHNVXQWLO-XQH
7KHODVWUHVSRQVHZDVUHFHLYHGE\-XO\WKXVWKHGDWDFROOHFWLRQSHULRGIRUWKHPDLQ
VXUYH\ODVWHGIRUZHHNV
7KH TXHVWLRQQDLUH FRQVLVWHG RI WZR SDUWV WKH ILUVW SDUW DVNHG IRU PDQDJHU¶V UDWLQJV RI
WKHLUVRIWZDUHGHSDUWPHQWZLWKUHVSHFWWRIDFLOLWDWLQJIDFWRUVDQG63,VXFFHVVWKHVHFRQGSDUW
DVNHG IRU JHQHUDO EDFNJURXQG LQIRUPDWLRQ DQG DQ DVVHVVPHQW RI WKH HQYLURQPHQW VHH
$SSHQGL[) 

±±
&+$37(5

,QWKHILUVWSDUWVHSDUDWHLWHPVZHUHXVHGWRPHDVXUHWKHVL[IDFLOLWDWLQJIDFWRUVRI63,
VXFFHVV+RZHYHUWZRLWHPVZHUHHYHQWXDOO\GHOHWHGLQRUGHUWRLPSURYHWKHUHOLDELOLW\RIWKH
ILQDO LQVWUXPHQW $Q DGGLWLRQDO VHW RI ILYH LWHPV ZDV XVHG WR PHDVXUH WKH 63, VXFFHVV
FRQVWUXFW$FRPSOHWHOLVWRIWKHVHLWHPVDSSHDUVLQWKHQH[WFKDSWHU)RUHDFKRIWKHIDFWRUVD
VXPPDWHGUDWLQJVFDOHUHSUHVHQWHGWKHOHYHORISUDFWLFHDVSHUFHLYHGE\WKHPDQDJHUV7KXV
HDFKPDQDJHUJHQHUDWHGVHYHQVFRUHVRQHIRUHDFKRIWKHIDFLOLWDWLQJIDFWRUVDQGRQHIRUWKH
63,VXFFHVVPHDVXUH$OVRIROORZLQJ%DJR]]L  ³IRUVFDOHVFRPSULVHGRIWKHVXPVRI
LWHPVDERXWWRLWHPVDUHXVXDOO\DGHTXDWH´ S DOOVFDOHVLQWKLVUHVHDUFKKDGWR
LWHPV
,QWKHVHFRQGSDUWRIWKHLQVWUXPHQWHDFKPDQDJHUDVVHVVHGWKH HQYLURQPHQWXVLQJWZR
VHPDQWLF GLIIHUHQWLDO LWHPV LQ DGGLWLRQ WR WKH JHQHUDO EDFNJURXQG DQG GHPRJUDSKLF
LQIRUPDWLRQVKRZQLQ7DEOH
,QWKHQH[WFKDSWHUZHGHWDLOWKHUHVHDUFKPHWKRGIXUWKHUDQGGHVFULEHWKHGHVLJQRIWKH
LQVWUXPHQWXVHGWRFROOHFWWKHVXUYH\GDWDDQGPHDVXUHWKHNH\IDFWRUVRIVXFFHVVLQ63,

 'DWD$QDO\VLV7HFKQLTXHV
,Q 6HFWLRQRQ YDULDEOHV DQG PHDVXUHV XVHG ZH DOVR GHVFULEHG WKH PDLQ TXDOLWDWLYH GDWD
DQDO\VLVWHFKQLTXHVXVHGLQWKLVVWXG\RSHQFRGLQJD[LDOFRGLQJDQGVHOHFWLYHFRGLQJ,QWKLV
VHFWLRQZHIRFXVRQWKHTXDQWLWDWLYHDQDO\VLVWHFKQLTXHV)XQGDPHQWDOO\WKHTXDQWLWDWLYHGDWD
DQDO\VLV LQYROYHG WZR PDMRU VWHSV   GHVFULELQJ WKH GDWD ± GHVFULSWLYH VWDWLVWLFV ± DQG 
WHVWLQJK\SRWKHVHVDQGPRGHOV±LQIHUHQWLDOVWDWLVWLFV
7KH SULPDU\ SXUSRVH RI WKH GHVFULSWLYH VWDWLVWLFV ZDV WR GHVFULEH DQG FKDUDFWHUL]H WKH
EDVLF IHDWXUHV RI WKH VDPSOH XQGHU VWXG\ LQ D PDQDJHDEOH IRUP :H SURYLGHG VLPSOH
VXPPDULHV RI WKH VDPSOH DQG WKH PHDVXUHV ZKLFK IRUPHG WKH EDVLV RI WKH TXDQWLWDWLYH
DQDO\VLVRIWKHGDWD7DEOHVKRZVWKHPDMRUGHVFULSWLYHVWDWLVWLFVIRUWKLVVWXG\LQWHUPVRI
IUHTXHQF\GLVWULEXWLRQVSHUFHQWDJHVDQGFHQWUDOWHQGHQFLHV,QIHUHQWLDOVWDWLVWLFVZDVXVHGWR
WHVWWKHPRGHODQGK\SRWKHVHVLQRUGHUWRUHDFKFRQFOXVLRQVDERXWWKHSRSXODWLRQSDUDPHWHUV
7KXV ZKLOH WKH GHVFULSWLYH VWDWLVWLFV VLPSO\ GHVFULEHG WKH VDPSOH GDWD WKH LQIHUHQWLDO
VWDWLVWLFVDOORZHGXVWRPDNHLQIHUHQFHVIURPWKHVDPSOHWRWKHPRUHJHQHUDOFRQGLWLRQVRIWKH
SRSXODWLRQ
0RVWFODVVLFDOVWDWLVWLFVPDNHDQXPEHURIDVVXPSWLRQVDERXWWKHSURSHUWLHV SDUDPHWHUV
RIWKHSRSXODWLRQVVXFKDVWKHPHDQDQGVWDQGDUGGHYLDWLRQIURPZKLFKVDPSOHVDUHGUDZQ
*HQHUDOO\ WKHVH SDUDPHWULF WHVWV DVVXPH WKDW WKH GDWD EHLQJ DQDO\]HG FRPH IURP D QRUPDO
GLVWULEXWLRQ +D\V   1RQSDUDPHWULF WHVWV RQ WKH RWKHU KDQG PDNH QR DVVXPSWLRQV
DERXWWKHXQGHUO\LQJGLVWULEXWLRQRIWKHSRSXODWLRQV)RUWKLVUHDVRQWKH\DUHRIWHQUHIHUUHGWR
DVGLVWULEXWLRQIUHHVWDWLVWLFV 'DYLV ,WLVLPSRUWDQWWRQRWHKRZHYHUWKDWDOWKRXJKWKH
QRQSDUDPHWULFWHVWVDUHGLVWULEXWLRQIUHHWKH\VWLOOUHTXLUHWKDWFHUWDLQDVVXPSWLRQVEHPHW
7KHIDFWWKDWVRPHWHVWVH[LVWLQERWK SDUDPHWULF DQG QRQSDUDPHWULF YHUVLRQV UDLVHV WKH
TXHVWLRQRIZKHQWRXVH ZKLFK YHUVLRQ ,Q JHQHUDO ZKHQ WKH VDPSOH LV QRUPDOO\ GLVWULEXWHG
WKH SDUDPHWULF WHVWV DUH PRUH SRZHUIXO WKDQ WKHLU QRQSDUDPHWULF FRXQWHUSDUWV $V D
FRQVHTXHQFHZH DUH OHVV OLNHO\ WR FRPPLW DQ HUURU RI 7\SH ,, ZKHQ XVLQJ D SDUDPHWULF WHVW
VHHWKHQH[WVHFWLRQIRUPRUHGHWDLOVUHJDUGLQJHUURUSUREDELOLWLHV 7KHUHDUHKRZHYHUWKUHH
VLWXDWLRQV ZKHQ WKH XVH RI QRQSDUDPHWULF WHVWV VKRXOG EH FRQVLGHUHG   :KHQ WKH VDPSOH

±±
5(6($5&+0(7+2'2/2*<

VL]HLVWRRVPDOO XVXDOO\ IRUSDUDPHWULFWHVWV  ZKHQWKHGDWDDUHQRWPHDVXUHGRQDQ


LQWHUYDOVFDOHDQG  ZKHQWKHGDWDDUHQRWQRUPDOO\GLVWULEXWHG
:LWKUHVSHFWWR  DERYH DQGDVZHKDYH DOUHDG\GHVFULEHGLQ 6HFWLRQ  WKH VDPSOH
VL]H LQ WKLV VWXG\ ZDV PXFK JUHDWHU WKDQ  5HJDUGLQJ   ZH ZLOO VKRUWO\ MXVWLI\ DQG GH
VFULEHWKHWHFKQLTXHVXVHGLQWKLVVWXG\ZLWKUHIHUHQFHWRWKHGHEDWHUHJDUGLQJWKHPHDQLQJ
IXOQHVVRIDSSO\LQJGLIIHUHQWFODVVHVRIVWDWLVWLFDOPHWKRGVWRGDWDDULVLQJIURPGLIIHUHQWNLQGV
RIPHDVXUHPHQWVFDOHV)LQDOO\UHIHUULQJWR6HFWLRQRQHPSLULFDOUHVXOWVZHGHVFULEHWKH
WHVWVSHUIRUPHGWRH[DPLQHZKHWKHUWKHDVVXPSWLRQVRIWKHFKRVHQWHVWVDUHPHW
6WHYHQV¶V  VHPLQDOZRUNRQPHDVXUHPHQWWKHRU\HYRNHGFRQVLG
HUDEOH GLVFXVVLRQ DQG D JUHDW GHDO RI FRQWURYHUV\ DERXW WKH SRVVLEOH W\SHV RI PHDVXUHPHQW
VFDOHV DQG WKH SHUPLVVLEOH VWDWLVWLFV IRU HDFK VFDOH 6WHYHQV   SURSRVHG WKDW PHDVXUH
PHQWVIDOOLQWRIRXUPDMRUFODVVHVQRPLQDORUGLQDOLQWHUYDODQGUDWLRVFDOHFKDUDFWHUL]HGE\
WKHW\SHRIWUDQVIRUPDWLRQVZKLFKPDSIURPRQHOHJLWLPDWHUHSUHVHQWDWLRQWRDQRWKHU1RZD
GD\V WKHVH WUDQVIRUPDWLRQV DUH FDOOHG DGPLVVLEOH RU SHUPLVVLEOH WUDQVIRUPDWLRQV +DQG
 )XUWKHUPRUH6WHYHQV   FODVVLILHG³SHUPLVVLEOH´ VWDWLVWLFDO SURFHGXUHV DFFRUGLQJ
WRWKHVHVFDOHV
7KXVIRUQRPLQDOVFDOHVRQHWRRQHWUDQVIRUPDWLRQVDQGVXPPDU\VWDWLVWLFVOLNHQXPEHU
RIFDVHVWKHPRGHDQGFRQWLQJHQF\FRUUHODWLRQZRXOGEHSHUPLVVLEOH)RURUGLQDOVFDOHVWKH
SHUPLVVLEOHVWDWLVWLFVLQFOXGHGWKHVHSOXVWKHPHGLDQSHUFHQWLOHVDQGRUGLQDOFRUUHODWLRQVLH
WKRVH WKDW DUH SUHVHUYHG XQGHU PRQRWRQLF LQFUHDVLQJ WUDQVIRUPDWLRQV ,Q DGGLWLRQ LQWHUYDO
VFDOHV DOORZHG PHDQV VWDQGDUG GHYLDWLRQV DQG SURGXFW PRPHQW FRUUHODWLRQV VLQFH WKHVH
VWDWLVWLFVUHPDLQXQFKDQJHGXQGHU OLQHDU WUDQVIRUPDWLRQV )LQDOO\ UDWLR VFDOHV DOORZHG DOO RI
WKHVHSOXVJHRPHWULFPHDQVDQGFRHIILFLHQWVRIYDULDWLRQZKLFKDUHXQFKDQJHGE\UHVFDOLQJ
WKHGDWD7DEOHSURYLGHVDQRYHUYLHZRI6WHYHQV¶FODVVLILFDWLRQRIPHDVXUHPHQWVFDOHVDQG
WKHFRUUHVSRQGLQJ³SHUPLVVLEOH´VWDWLVWLFV
:KHUHDV WKHUH LV OLWWOH GLVSXWH RYHU ZKHWKHU QRPLQDO RU RUGLQDO SURSHUWLHV KDYH EHHQ
HVWDEOLVKHG WKHUH LV RIWHQ JUHDW GLVSXWH RYHU ZKHWKHU RU QRW D VFDOH SRVVHVVHV D PHDQLQJIXO
XQLW RI PHDVXUHPHQW 1XQQDOO\ DQG %HUQVWHLQ   )XUWKHUPRUH WKHUH LV GLVSXWH RYHU
ZKHWKHU WKH VFDOH W\SHV VKRXOG EH XVHG WR SURVFULEH WKH XVH RI ³LQDSSURSULDWH´ VWDWLVWLFDO
WHFKQLTXHV HJ%ULDQGHWDOE)HQWRQ)HQWRQDQG3IOHHJHU+DQG
7XNH\9HOOHPDQDQG:LONLQVRQ 3DUWRIWKLVGLVSXWHKDVWRGRZLWK
WKHGHILQLWLRQRIZKDWLVFRQVLGHUHGPHDQLQJIXO
$FFRUGLQJWRWKHUHSUHVHQWDWLRQDOSRLQWRIYLHZWKHLQYDULDQFHGHILQLWLRQLVXVHG DV WKH
VLQJOH GHILQLQJ FKDUDFWHULVWLF RI PHDQLQJIXOQHVV ,W VKRXOG WKXV FRPH DV QR VXUSULVH WKDW
SUDFWLWLRQHUVFRPHDWRGGVZLWKVXFKDGHILQLWLRQ7DNLQJDUHSUHVHQWDWLRQDOLVWSRVLWLRQ)HQWRQ
DQG 3IOHHJHU   IXUWKHU DGYDQFH WKLV JDS EHWZHHQ WKHRU\ DQG SUDFWLFH E\ VWDWLQJ WKDW
³0DQ\ VRIWZDUH SUDFWLWLRQHUV DQG UHVHDUFKHUV PLVWDNHQO\ WKLQN WKDW WR EH PHDQLQJIXO D
PHDVXUHPXVWEHXVHIXOSUDFWLFDOZRUWKZKLOHRUHDV\WRFROOHFW7KHVHFKDUDFWHULVWLFVDUHQRW
SDUWRIPHDQLQJIXOQHVV´ LELGS 
&RQWUDU\WRWKLVYLHZDQGDVZHKDYHDOUHDG\DUJXHGLQ6HFWLRQZHWDNHDSUDJPDWLVW
DSSURDFK WR 63, UHVHDUFK ZLWK WKH DLP RI OLQNLQJ WKHRU\ DQG SUDFWLFH 7KXV ZH RSSRVH WKH
UHSUHVHQWDWLRQDOLVW SRVLWLRQ DQG DUJXH WKDW WKH NH\ WR HVWDEOLVKLQJ PHDVXUHPHQW FRQYHQWLRQV
DERXWPHDQLQJIXOQHVVVKRXOGUDWKHUEHEDVHGRQDFWXDOGDWDDQGKRZZHOOWKHVFDOHVZRUNLQ
SUDFWLFH7KLVLVDOVRWKHHVVHQFHRI9HOOHPDQDQG:LONLQVRQ¶V  DUJXPHQW

$OWKRXJK ZH RIIHU PDQ\ DUJXPHQWV WKH VLQJOH XQLI\LQJ DUJXPHQW DJDLQVW SURVFULELQJ
VWDWLVWLFVEDVHGRQVFDOHW\SHLVWKDWLWGRHVQRWZRUN LELGSHPSKDVLVDGGHG 

±±
&+$37(5

7DEOH6WHYHQV¶OHYHOVRIPHDVXUHPHQW DGDSWHGIURP1XQQDOO\DQG%HUQVWHLQS
 

3HUPLVVLEOH 3HUPLVVLEOH
6FDOH %DVLFRSHUDWLRQ WUDQVIRUPDWLRQV VWDWLVWLFV ([DPSOHV

1RPLQDO (TXDOLW\YV $Q\RQHWRRQH 1XPEHUVRIFDVHV )DXOWFDWHJRULHV


LQHTXDOLW\ PRGH LQGXVWU\VHFWRU
2UGLQDO *UHDWHUWKDQYV 0RQRWRQLF 0HGLDQSHUFHQWLOHV 0DWXULW\OHYHOV
OHVVWKDQ LQFUHDVLQJ RUGHUVWDWLVWLFV
,QWHUYDO (TXDOLW\RILQWHUYDOV *HQHUDOOLQHDU $ULWKPHWLFPHDQ 7HPSHUDWXUH q& 
RUGLIIHUHQFHV [¶ D[E YDULDQFH VWXGHQWJUDGHV "
5DWLR (TXDOLW\RIUDWLRV 0XOWLSOLFDWLYH *HRPHWULFPHDQ 7HPSHUDWXUH . 
[¶ D[ OHQJWK

)XUWKHUPRUH WKH XVH RI VFDOH W\SHV WR SURVFULEH WKH XVH RI ³LQDSSURSULDWH´ VWDWLVWLFDO
WHFKQLTXHVLVFRQWURYHUVLDOIRUDWOHDVWWZRDGGLWLRQDOUHDVRQV %ULDQGHWDOE )LUVWLWLV
QRWDOZD\VREYLRXVWKDWDOOVWDWLVWLFVFODVVLILHGDVQRQSDUDPHWULFRQO\PDNHXVHRIUDQNRUGHU
LQIRUPDWLRQ6HFRQGLWLVTXLWHGLIILFXOWWRGHWHUPLQHSUHFLVHO\WKHVFDOHW\SHRIDPHDVXUH,Q
IDFW³.QRZLQJWKHVFDOHW\SHRIDPHDVXUHZLWKDEVROXWHFHUWDLQW\LVRXWRIWKHTXHVWLRQLQWKH
YDVW PDMRULW\ RI FDVHV´ %ULDQG HW DO E S   +RZHYHU DOWKRXJK LW FDQQRW EH
GHPRQVWUDWHGZLWKDEVROXWHFHUWDLQW\WKDWDSDUWLFXODUVFDOHLVLQWHUYDOWKHUHVHDUFKHUPD\EH
FRQILGHQW WKDW LW LV PRUH WKDQ MXVW RUGLQDO 7KH TXHVWLRQ LV WKHUHIRUH ³,I D VFDOH LV QRW DQ
LQWHUYDOVFDOHPXVWLWEHPHUHO\RUGLQDO"´ 7XNH\S 
$FFRUGLQJWRWKHUHSUHVHQWDWLRQDOSRVLWLRQWKHDQVZHULVWKDW6WHYHQV¶V  VFDOH
W\SHV DUH DEVROXWH DQG FRQVHTXHQWO\ WKDW GDWD WKDW DUH QRW IXOO\ LQWHUYDO VFDOH PXVW EH
GHPRWHGWRRUGLQDOVFDOH7KHSUDJPDWLFDQVZHUWRWKLVTXHVWLRQRQWKHRWKHUKDQGLVWKDWLWLV
WKHFRQWH[WLQZKLFKDVWDWLVWLFLVXVHGWKDWVKRXOGGHWHUPLQHZKHWKHULWLVOHJLWLPDWHRUQRWWR
SURPRWHDPHDVXUHWRDKLJKHUOHYHO7XNH\  DOVRQRWHGWKHLPSRUWDQFHRIPHDQLQJRI
WKH GDWD LQ GHWHUPLQLQJ ERWK VFDOH W\SH DQG DSSURSULDWH DQDO\VLV WHFKQLTXHV )XUWKHUPRUH
:LONLQVRQ  FODLPHGWKDWWKHSRSXODUDGYLFHRIGRZQJUDGLQJWKHPHDVXUHPHQWOHYHORI
³VORSS\ GDWD´ WR RUGLQDO RU QRPLQDO FRXOG RQO\ EH FRQVLGHUHG D ³SDURG\ RI PHDVXUHPHQW
WKHRU\´ LELGS ,QDVLPLODUYHLQ9HOOHPDQDQG:LONLQVRQ  VWDWHGWKDW

$SSURDFKHVWRVWDWLVWLFVWKDWVWDUWVIURPDQDSULRULVFDOHW\SHDQGWKHQSURVFULEHWKHNLQGVRI
K\SRWKHVHV WKDW PD\ EH FRQVLGHUHG RU WKH VWDWLVWLFDO PHWKRGV DQG WHVWV WKDW PD\ EH
FRPSXWHGEDVHGRQWKDWVFDOHW\SHDUHVLPSO\EDGVFLHQFHDQGEDGGDWD DQDO\VLV LELGS
HPSKDVLVDGGHG 

(YHQ6WHYHQV  KLPVHOIDGPLWWHGWKDW

,Q WKH VWULFWHVW SURSULHW\ WKH RUGLQDU\ VWDWLVWLFV LQYROYLQJ PHDQV DQG VWDQGDUG GHYLDWLRQV
RXJKWQRWWREHXVHGZLWK>RUGLQDO@VFDOHV«2QWKHRWKHUKDQG«WKHUHFDQEHLQYRNHGD
NLQGRISUDJPDWLFVDQFWLRQLQQXPHURXVLQVWDQFHVLWOHDGVWRIUXLWIXOUHVXOWV LELGS 

$WWKHKHDUWRIWKLVFRQWURYHUV\ZKLFKKDVODVWHGIRUPRUHWKDQ\HDUVLV³7KHGLVWLQFWLRQ
DQGFRQIXVLRQEHWZHHQZKDWLVUHTXLUHGWREHDEOHWRFDOFXODWHDVWDWLVWLFDQGZKDWLVUHTXLUHG
WRLQWHUSUHWLW´ +DQGSHPSKDVLVLQRULJLQDO :KLOHLWLVQRWRXUDPELWLRQWRWU\

±±
5(6($5&+0(7+2'2/2*<

WRSXWDQHQGWRWKLVGHEDWHZHPDLQWDLQWKDWDQD[LRPV\VWHPFDQEHPDSSHGWRWKHZRUOGLQ
PRUH WKDQ RQH ZD\ DQG KHQFH WKDW GDWD DQDO\VLV FDQQRW EH UHGXFHG WR D[LRPDWLF
PDWKHPDWLFV7KHUHIRUH³$QRYHUVLPSOLILHGDQGRYHUSXULILHGYLHZRIZKDWPHDVXUHPHQWVDUH
OLNHFDQQRWEHDOORZHGWRGLFWDWHKRZGDWDLVWREHDQDO\]HG´ 7XNH\S 
:H PXVW DOZD\V UHPHPEHU WKDW D PRGHO LV QRWKLQJ PRUH WKDQ D OLPLWHG DEVWUDFWLRQ RI
UHDOLW\DQGQRWHQWLUHO\DFFXUDWH$EULOOLDQWH[DPSOHRIWKLVSRLQWLVPDGHLQ5HQp0DJULWWH¶V
IDPRXVSDLQWLQJRIDSLSH±³/D7UDKLVRQ'HV,PDJHV´±ZKLFKDOVRFRQWDLQVWKHZRUGV³&HFL
Q¶HVWSDVXQHSLSH³ 7KLVLVQRWDSLSH 0DJULWWH¶VSRLQWZDVWKDWKRZHYHUUHDOLVWLFDSDLQWLQJ
PD\EHLWIDOOVLQGHILQLWHO\VKRUWRIEHLQJDQ DFWXDOSLSH3HUKDSVLQ WKH VSLULW RI 0DJULWWH
DQ\PRGHOXVHGLQ63,VKRXOGKDYHLQLWWKHIXQGDPHQWDOVWDWHPHQW³7KLVLVQRWDSURFHVV´
7KXVLQDFFRUGDQFHZLWKRXUSUDJPDWLFYLHZRQWKHXVHRIUHVHDUFKPHWKRGVZHDJUHH
ZLWK%ULDQGHWDO E DQG9HOOHPDQDQG:LONLQVRQ  WKDWWKHTXHVWLRQXQGHU
VWXG\UDWKHUWKDQWKHGDWDVKRXOGGHWHUPLQHWKHDSSURSULDWHVWDWLVWLFDOWHFKQLTXH

6FDOHW\SHDVGHILQHGE\6WHYHQVLVQRWDQDWWULEXWH RIWKHGDWD EXWUDWKHU GHSHQGVXSRQ


WKHTXHVWLRQVZHLQWHQGWRDVNRIWKHGDWDDQGXSRQDQ\DGGLWLRQDOLQIRUPDWLRQZHPD\KDYH
9HOOHPDQDQG:LONLQVRQS 

,Q PRVW FDVHV WKH TXHVWLRQV WR DQVZHU LH RXU PHDVXUHPHQW JRDOV  GHWHUPLQH WKH VFDOH
XQGHUZKLFKGDWDPXVWEHXVHGDQGQRWYLFHYHUVD %ULDQGHWDOES 

:LWK WKH QRWDEOH H[FHSWLRQ RI %ULDQG HW DO  E  WKLV SUDJPDWLF YLHZ RQ
PHDVXUHPHQW LV XQGHUUHSUHVHQWHG LQ VRIWZDUH HQJLQHHULQJ GXH WR WKH IDFW WKDW WKH VWDQGDUG
UHIHUHQFHV RQ PHDVXUHPHQW WKHRU\ LQ VRIWZDUH HQJLQHHULQJ HJ )HQWRQ  )HQWRQ DQG
3IOHHJHU DUHRQO\SUHVHQWLQJWKHUHSUHVHQWDWLRQDOVLGHRIWKHGHEDWH,QFLGHQWDOO\LQWKH
VHFRQG HGLWLRQ RI KLV FODVVLF ERRN RQ 3V\FKRPHWULF 7KHRU\ 1XQQDOO\   FKDUDFWHUL]HG
WKLVYLHZDVWKH³IXQGDPHQWDOLVW´SRVLWLRQ
$VGHVFULEHGLQ6HFWLRQWKHVFDOHVIRUWKHIDFLOLWDWLQJIDFWRUVRI63,DQGRI63,VXFFHVV
DUH VXPV RI LQGLYLGXDO /LNHUW VFDOH LWHPV )XUWKHUPRUH LQ WKH QH[W FKDSWHU RQ LQVWUXPHQW
GHYHORSPHQWZHGLVFXVVDQXPEHURIFRQVLGHUDWLRQVUHJDUGLQJWKHVHOHFWLRQRIWKHQXPEHURI
SRLQWV RQ WKH UDWLQJ VFDOHV *XLGHG E\ WKHVH FRQVLGHUDWLRQV ZH FRQVWUXFWHG SRLQW ELSRODU
/LNHUWVFDOHVIRUDOOTXHVWLRQVLQRXUILQDOTXHVWLRQQDLUH$OWKRXJKGDWDIURPLQGLYLGXDOLWHPV
DUHFOHDUO\RUGLQDOLWLVQRWHTXDOO\FOHDUZKDWSURSHUWLHVWKHVXPPDWHGVFDOHVKDYH+RZHYHU
ZH FRQFXU ZLWK WKH YLHZV RI HJ 1XQQDOO\   6SHFWRU    0F,YHU DQG
&DUPLQHV   +D\V   'DYLV   DQG $QDVWDVL DQG 8UELQD   DQG EHOLHYH
WKDWLWLVSHUPLVVLEOHWRWUHDWDVXPPDWHGVFDOHRILQGLYLGXDO/LNHUWVFDOHLWHPVDVOHDGLQJWR
LQWHUYDOVFDOHPHDVXUHPHQWVWKDWFDQEHDQDO\]HGZLWKSDUDPHWULFVWDWLVWLFV
$ QXPEHU RI UHDVRQV DFFRXQW IRU WKLV XVH RI VXPPDWHG UDWLQJ VFDOHV )LUVW HPSLULFDO
VWXGLHVKDYHIRXQGWKDW/LNHUWVFDOHVFRPPXQLFDWHLQWHUYDOSURSHUWLHVWRWKHUHVSRQGHQWVDQG
WKDWWKH\FDQEHWUHDWHGOLNHDSSUR[LPDWHLQWHUYDOVFDOHVLQHPSLULFDOUHVHDUFKZRUN &UDVNDQG
)R[  6FKHUW]HU DQG .HUQDQ  6SHFWRU    $OVR 6SHFWRU   VKRZHG
WKDWSHRSOHWHQGWR WUHDW FDWHJRULHV LQ /LNHUW VFDOHV DV HTXLGLVWDQW UHJDUGOHVV RI WKH VSHFLILF
FDWHJRULHVHPSOR\HG6HFRQGWKHXVHRIVXPPDWHGUDWLQJVFDOHVDVOHDGLQJWRLQWHUYDOVFDOH
PHDVXUHPHQWVWKDWFDQEHDQDO\]HGZLWKSDUDPHWULFVWDWLVWLFVLVWKHHVWDEOLVKHGFRQYHQWLRQLQ
WKH VRFLDO VFLHQFHV DQG LQ SV\FKRPHWULF WKHRU\ 1XQQDOO\ DQG %HUQVWHLQ   0RUHRYHU
XVLQJSDUDPHWULFWHVWVIRUVFDOHVWKDWDUHQRWVWULFWO\LQWHUYDOGRHVQRWOHDGH[FHSWLQH[WUHPH
FDVHV WR ZURQJ VWDWLVWLFDO GHFLVLRQV %DURXGL DQG 2UOLNRZVNL  %ULDQG HW DO 

±±
&+$37(5

E +D\V  1XQQDOO\  1XQQDOO\ DQG %HUQVWHLQ  7XNH\  
9HOOHPDQDQG:LONLQVRQ 
0RVWUHVXOWVLQWKLVVWXG\DUHUHSRUWHGDVHLWKHUFRUUHODWLRQVRUPHDQGLIIHUHQFHVEHWZHHQ
JURXSV 7KH PRVW UHOHYDQW SDUDPHWULF VWDWLVWLFV IRU VXFK DQDO\VHV DUH SURGXFW PRPHQW
FRUUHODWLRQV WKH WWHVW DQG ) ZKLFK DUH UHODWLYHO\ UREXVW ZLWK UHVSHFW WR PHDVXUHV WKDW DUH
³VRPHZKHUH EHWZHHQ´ RUGLQDO DQG LQWHUYDO OHYHOV RI PHDVXUHPHQW VLQFH WKH\ DUH OLWWOH
DIIHFWHGE\PRQRWRQLFWUDQVIRUPDWLRQVRQYDULDEOHV 1XQQDOO\DQG%HUQVWHLQ )XUWKHU
PRUHWKH\DUHDOVRUDWKHUUREXVWWRWKHYLRODWLRQVRIWKHQRUPDOGLVWULEXWLRQ

*LYHQ WKH UREXVWQHVV DQG HQKDQFHG SRZHU SURYLGHG E\ SDUDPHWULF WHVWV UHVHDUFKHUV DUH
HQFRXUDJHG WR XVH WKH SDUDPHWULF WHVW PRVW DSSURSULDWH IRU WKHLU VWXG\ DQG UHVRUW WR QRQ
SDUDPHWULFSURFHGXUHVRQO\LQWKHUDUHFDVHRIH[WUHPHDVVXPSWLRQYLRODWLRQV %DURXGLDQG
2UOLNRZVNLSHPSKDVLVDGGHG 

$QLQWHUHVWLQJREVHUYDWLRQLVDOVRWKDW+D\V  LQWKHODWHVWHGLWLRQ RI KLV FODVVLF ERRN


6WDWLVWLFVUHPRYHGWKHFKDSWHURQQRQSDUDPHWULFPHWKRGV+HPDGHWKHIROORZLQJVWDWHPHQW
LQWKHSUHIDFHWRWKHILIWKHGLWLRQWRMXVWLI\WKLV

7KHUHPDLQLQJPDMRUFKDQJHLQWKHWH[WLWVHOILVWKHHOLPLQDWLRQRIWKHIRUPHU&KDSWHURQ
RWKHUPHWKRGV7KHVHQRQSDUDPHWULFWHFKQLTXHVDUHVWLOORILQWHUHVWDQGRIYDOXHEXWWRPH
WKH\GRQRWVHHPDVFULWLFDOO\LPSRUWDQWDVWKH\RQFHGLG7KHUDWKHUORZSRZHURIPDQ\RI
WKH RUGHU PHWKRGV DQG WKH JURZLQJ HYLGHQFH RI WKH UREXVWQHVV RI PDQ\ RI WKH WUDGLWLRQDO
PHWKRGVPDNHVLWVHHPOHVVLPSRUWDQWWRJLYHWKHQRQSDUDPHWULFPHWKRGVDVPXFKVSDFH
DVKHUHWRIRUH LELGSYL 

6LQFHZHKDYHDUJXHGIRUWKHXVHRISDUDPHWULFVWDWLVWLFVVXFKDVWKH3HDUVRQSURGXFWPRPHQW
FRUUHODWLRQ FRHIILFLHQW WKH WWHVW WKH ) VWDWLVWLF DQG PXOWLSOH UHJUHVVLRQ DQDO\VLV WR WHVW WKH
K\SRWKHVHV LQ WKLV VWXG\ LW LV HVVHQWLDO WKDW WKH DVVXPSWLRQV RI WKHVH DQDO\VHV EH PHW
7KHUHIRUH DV VKRZQ LQ &KDSWHU  RQ UHVHDUFK UHVXOWV ZH H[DPLQHG WKH DVVXPSWLRQV RI
QRUPDOLW\ KRPRVFHGDVWLFLW\ OLQHDULW\ DQG LQGHSHQGHQFH RI WKH HUURU WHUPV DV ZHOO DV DQ\
SRWHQWLDOO\ LQIOXHQWLDO REVHUYDWLRQV RXWOLHUV  DQG WKH GHJUHH RI FROOLQHDULW\ DQG PXOWL
FROOLQHDULW\WRYDOLGDWHWKHDSSOLFDELOLW\RISDUDPHWULFVWDWLVWLFV
7KHUHVXOWVRIWKHVHWHVWVVKRZHGWKDWDOOYDULDEOHVZHUHZLWKLQWKHDFFHSWDEOHUDQJHIRU
WKH QRUPDO GLVWULEXWLRQ DVVXPSWLRQ DQG WKDW WKH DVVXPSWLRQV RI KRPRVFHGDVWLFLW\ OLQHDULW\
DQGLQGHSHQGHQFHRIWKHHUURUWHUPVZHUHVXSSRUWHG)XUWKHUPRUHQRLQIOXHQWLDOREVHUYDWLRQV
ZHUH LGHQWLILHG DQG WKH LQYHVWLJDWLRQV RI FROOLQHDULW\ DQG PXOWLFROOLQHDULW\ LQGLFDWHG QR
SUREOHPV ,Q RWKHU ZRUGV WKHUH ZHUH QR H[WUHPH YLRODWLRQV WR WKH EDVLF DVVXPSWLRQV
XQGHUO\LQJWKHFKRVHQGDWDDQDO\VLVWHFKQLTXHVWKDWFRXOGMXVWLI\WKHXVHRIOHVVSRZHUIXOQRQ
SDUDPHWULFVWDWLVWLFV/DVWO\WKHDQDO\VLVRIWKHTXDQWLWDWLYHVXUYH\GDWDZDVFRQGXFWHGXVLQJ
WKH6WDWLVWLFDO3DFNDJHIRUWKH6RFLDO6FLHQFHV 6366DE 
$ILQDOFRQFHUQIRUWKHTXDQWLWDWLYHGDWDDQDO\VLVZDVWRGLIIHUHQWLDWHWKHVXFFHVVIXOIURP
WKHOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQVLQRUGHUWRH[SORUHIXUWKHUUHODWLRQVKLSV7KXVZH
GHILQHG FRQWUDVWHG FULWHULRQ JURXSV EDVHG RQ WKH XSSHU DQG ORZHU WKLUG RI WKH SHUIRUPDQFH
GLVWULEXWLRQ VHH )LJXUH   7KLV LV VLPLODU WR WKH DSSURDFK XVHG E\ +RFK HW DO   WR
OHDUQZKLFKIDFWRUVPDNHWKHGLIIHUHQFHEHWZHHQVXFFHVVDQGIDLOXUHLQWKHVRIWZDUHLQGXVWU\
DW ODUJH 7KH DGYDQWDJH RI WKLV DSSURDFK LV D PXFK VKDUSHU GLIIHUHQWLDWLRQ EHWZHHQ WKH
FRQWUDVWHGFULWHULRQJURXSVWKDWRWKHUZLVHZRXOGEHPDGHPRUHGLIIXVHGE\ERUGHUOLQHFDVHV
7KHPDMRUGLVDGYDQWDJH KRZHYHU LV WKH H[FOXVLRQ RI RQH WKLUG RI WKH GDWD SRLQWV DQG WKXV
ORZHUVWDWLVWLFDOSRZHU

±±
5(6($5&+0(7+2'2/2*<

68&&(66,1',&$7256 5$1.%<29(5$//68&&(66,1',&$725

6 8&&(66)8/
2 5*$1,=$7,216
2UJDQL]DWLRQDO

SHUIRUPDQFH

2YHUDOO63,

VXFFHVV
&RPSDULVRQ $ 9(5$*(
EHWZHHQXSSHUDQG 2 5*$1,=$7,216
3HUFHLYHGOHYHO ORZHUWKLUG

RIVXFFHVV

/(66
68&&(66)8/
2 5*$1,=$7,216

)LJXUH2YHUDOO63,VXFFHVVRIWRSWKLUGYHUVXVERWWRPWKLUGVRIWZDUHRUJDQL]DWLRQV

 3URFHGXUHIRU+\SRWKHVLV7HVWLQJ
$SDUWIURP IRUPXODWLQJ WKH K\SRWKHVHV WKH PRVW FULWLFDO FRQFHUQ RI WKH TXDQWLWDWLYH SDUW RI
WKLV VWXG\ LV WKH UHVHDUFK PRGHO DQG SURFHGXUH IRU HYDOXDWLRQ RI WKH K\SRWKHVHV %DVLFDOO\
VXFKDSURFHGXUHIRUK\SRWKHVLVWHVWLQJLVDTXHVWLRQRI³+RZWR'HFLGH+RZWR'HFLGH´RU
³+RZ0XFK(YLGHQFH,V(QRXJK"´ +D\VS &RQVLVWHQWZLWKWKHG\QDPLFPRGHO
RI 63, GHILQHG LQ WKH SUHYLRXV FKDSWHU )LJXUH  SUHVHQWV WKH FRQFHSWXDO UHVHDUFK PRGHO
XQGHUO\LQJWKHTXDQWLWDWLYHK\SRWKHVLVWHVWLQJSDUWRIWKLVVWXG\7KHPRGHOLVFRPSULVHGRI
WKHVL[LQGHSHQGHQWYDULDEOHVLGHQWLILHGLQWKHSUHYLRXVFKDSWHUWKHWZRPRGHUDWLQJYDULDEOHV
DQGWKHGHSHQGHQWYDULDEOH63,VXFFHVV
+HQFHDVWKHEDVLVIRUWHVWLQJWKHK\SRWKHVHVZHKDYHDQHPSLULFDOO\GHULYHGPRGHORI
63, VXFFHVV DV ZHOO DV D YDOLGDWHG DQG UHOLDEOH LQVWUXPHQW WR PHDVXUH WKH NH\ IDFWRUV RI
VXFFHVVLQ63,7KHPRGHOWREHTXDQWLWDWLYHO\WHVWHGE\DSSO\LQJWKHPHDVXUHPHQWLQVWUXPHQW
FDQWKHUHIRUHEHGHVFULEHGDVIROORZV

6 I [  [    [ Q 

ZKHUH6GHQRWHVWKHGHJUHHRI63,VXFFHVVDQG[ GHQRWHVWKHLWKNH\ IDFWRU IRUVXFFHVV$V


L

DOUHDG\GHVFULEHGLQWKHSUHYLRXVFKDSWHUZHK\SRWKHVL]HWKDWHDFKLGHQWLILHG[ LVSRVLWLYHO\
L

DVVRFLDWHGZLWK63,VXFFHVV:HDUHWKXVQRWRQO\DEOHWRLGHQWLI\WKHNH\IDFWRUVIRUVXFFHVV
LQ63,EXWDOVRWRPHDVXUHWKHVWUHQJWKRIWKHLUUHODWLRQVKLSVZLWK63,VXFFHVVDVZHOODVWKHLU
MRLQWFRQWULEXWLRQDQGUHODWLYHLPSRUWDQFHWRWKHH[SODQDWLRQRI63,VXFFHVV

±±
&+$37(5

,QGHSHQGHQWYDULDEOHV
x %XVLQHVVRULHQWDWLRQ
'HSHQGHQWYDULDEOH
x ,QYROYHGOHDGHUVKLS
x 63,VXFFHVV
x (PSOR\HHSDUWLFLSDWLRQ
i 3HUFHLYHGOHYHORIVXFFHVV


x &RQFHUQIRUPHDVXUHPHQW i 2UJDQL]DWLRQDOSHUIRUPDQFH


x ([SORLWDWLRQRIH[LVWLQJNQRZOHGJH

x ([SORUDWLRQRIQHZNQRZOHGJH

0RGHUDWLQJYDULDEOHV
x 2UJDQL]DWLRQDOVL]H

x (QYLURQPHQWDOFRQGLWLRQV

)LJXUH&RQFHSWXDOUHVHDUFKPRGHOIRUWKHTXDQWLWDWLYHSDUWRIWKHVWXG\

:HWHVWHGWKHK\SRWKHVHVXVLQJWKHFRQYHQWLRQDOORJLFRIGLVFRQILUPLQJK\SRWKHVHVZKLFKLV
FORVHO\DVVRFLDWHGZLWK3RSSHU¶V  LGHDRIIDOVLILFDWLRQLHWKDWFODLPVWRNQRZOHGJHFDQ
QHYHU EH SURYHQ RU IXOO\ MXVWLILHG EXW RQO\ EH UHIXVHG 7KHUHIRUH WKH VWDUWLQJ SRLQW IRU
VLJQLILFDQFH WHVWLQJ RI HDFK RI WKH K\SRWKHVHV ZDV D QXOO K\SRWKHVLV RI QR UHODWLRQVKLS
EHWZHHQ WKH YDULDEOHV EHLQJ WHVWHG 7KXV LI WKH QXOO K\SRWKHVLV LV VXSSRUWHG WKHQ DQ\
SURSRVLWLRQVWKDWWKHUHLVDUHODWLRQVKLSPXVWEHUHMHFWHG,QRWKHUZRUGVZHDSSOLHGWKHPRVW
FRPPRQ DSSURDFK RI WUHDWLQJ QHJDWLYH RU GLVFRQILUPLQJ HYLGHQFH IRU D K\SRWKHVLV DV PRUH
FULWLFDOWKDQSRVLWLYHRUFRQILUPLQJHYLGHQFH
$FFRUGLQJWRWKH1H\PDQ3HDUVRQPHWKRGRIVWDWLVWLFDOLQIHUHQFHWHVWLQJWKHK\SRWKHVHV
UHTXLUHVWKDWZH VSHFLI\ DQ DFFHSWDEOH OHYHO RI VWDWLVWLFDO HUURU RU WKH ULVN ZH DUH ZLOOLQJ WR
WDNHUHJDUGLQJWKHFRUUHFWQHVVRIRXUGHFLVLRQV5HJDUGOHVVRIZKLFKGHFLVLRQUXOHZHVHOHFW
WKHUHDUHJHQHUDOO\WZRZD\VRIEHLQJFRUUHFWDQGWZRZD\VRIPDNLQJDQHUURULQWKHFKRLFH
EHWZHHQWKHQXOO + DQGWKHDOWHUQDWH +$ K\SRWKHVHV VHH7DEOH 
5HO\LQJ RQ D ZHDN WHVW RI D GHFLVLRQ SURSRVLWLRQ FDQ OHDG WR D VXEVWDQWLDO PRQH\ RU
RSSRUWXQLW\ ORVV IRU D VRIWZDUH RUJDQL]DWLRQ LI WKH GHFLVLRQ WXUQV RXW WR EH ZURQJ ,Q RXU
H[SHULHQFHPRVWVRIWZDUHPDQDJHUVDUHPRUHDZDUHRIWKHPRQH\ORVVHVWKDQWKHRSSRUWXQLW\
ORVVHVDQGDVZHDUJXHGLQWKHSUHYLRXVFKDSWHUWKXVFRPPLWWHGWRWKHVWDWXVTXR7KHUHDVRQ
IRU WKLV LV VLPSO\ WKDW WKH FRVWV RI FKDQJH DUH PRUH YLVLEOH WKDQ WKH SRWHQWLDO UHWXUQ RQ WKH
LQYHVWPHQW 7KHUHIRUH LQ WKLV VWXG\ ZH DUH PRVW FRQFHUQHG DERXW DYRLGLQJ D 7\SH , HUURU
ZKLFKLVWKHHUURUPDGHZKHQ+ WKHWHVWHGK\SRWKHVLV LVZURQJO\UHMHFWHG,QRWKHUZRUGVD
7\SH , HUURU LV FRPPLWWHG ZKHQHYHU WKH VDPSOH UHVXOWV IDOO LQWR WKH UHMHFWLRQ UHJLRQ HYHQ
WKRXJK+LVWUXH&RQYHQWLRQDOO\WKHSUREDELOLW\RIFRPPLWWLQJD7\SH,HUURULVUHSUHVHQWHG
E\ WKH OHYHO RI VWDWLVWLFDO VLJQLILFDQFH GHQRWHG E\ WKH ORZHUFDVH *UHHN OHWWHU DOSKD D 
&RQYHUVHO\WKHSUREDELOLW\RIEHLQJFRUUHFWJLYHQWKDW+LVWUXHLVHTXDOWRD
:H WHVWHG WKH K\SRWKHVHV XVLQJ WKH FRQYHQWLRQDO OHYHO RI VWDWLVWLFDO VLJQLILFDQFH
HVWDEOLVKHG ZLWKLQ WKH VFLHQWLILF FRPPXQLW\ RI D   DV WKH GHFLVLRQ UXOH %DURXGL DQG
2UOLNRZVNL  &RKHQ  0LOOHU HW DO  1HXPDQ  6HNDUDQ   WKXV
UXQQLQJDULVNRIRILQFRUUHFWO\UHMHFWLQJWKHQXOOK\SRWKHVLV7KLVPHDQVWKDWFRUUHODWLRQV
ZLWKS!GHWHUPLQH WKDW WKHUH LV QR VLJQLILFDQW DVVRFLDWLRQ EHWZHHQ WKH YDULDEOHV EHLQJ
WHVWHG

±±
5(6($5&+0(7+2'2/2*<

7DEOH:D\VRIEHLQJFRUUHFWRUPDNLQJDQHUURUZKHQFKRRVLQJEHWZHHQWZRFRPSHWLQJ
K\SRWKHVHV +DLUHWDOS 

5HDOLW\

+1R'LIIHUHQFH +$'LIIHUHQFH

E
+1R'LIIHUHQFH D
6WDWLVWLFDO 7\SH,,HUURU
'HFLVLRQ
D E
+$'LIIHUHQFH
7\SH,HUURU 3RZHU

%\VSHFLI\LQJWKHOHYHORI7\SH,HUURUZHDOVRGHWHUPLQHWKHSUREDELOLW\RIPDNLQJDQHUURU
RI 7\SH ,, DOVR NQRZQ DV EHWD E  ZKLFK LV WKH SUREDELOLW\ RI IDLOLQJ WR UHMHFW WKH QXOO
K\SRWKHVLVZKHQLWLVDFWXDOO\IDOVH7KXVZKHQDVDPSOHUHVXOWGRHVQRWIDOOLQWRWKHUHMHFWLRQ
UHJLRQHYHQWKRXJKVRPH+$ LVWUXHZH DUHOHGWR PDNH D 7\SH ,, HUURU &RQVHTXHQWO\ WKH
SUREDELOLW\RIFRUUHFWO\UHMHFWLQJWKHQXOOK\SRWKHVLVLHWKHSUREDELOLW\RIPDNLQJ DFRUUHFW
GHFLVLRQJLYHQWKDW+$LVWUXHPXVWEHE:HVKRXOGQRWHKRZHYHUWKDWDQ\FKDQJHLQD
GHFLVLRQUXOHWKDWPDNHVWKHSUREDELOLW\RIRQHW\SHRIHUURUVPDOOHUXVXDOO\PDNHWKHRWKHU
HUURUSUREDELOLW\ODUJHU
7KHSUREDELOLW\ELVRIWHQFDOOHGWKHSRZHURIWKHVWDWLVWLFDOWHVW &RKHQ ,WLV
OLWHUDOO\WKHSUREDELOLW\RI ILQGLQJRXWWKDW+LVZURQJ JLYHQ WKH GHFLVLRQ UXOH DQG WKH WUXH
+$ 7KHUHIRUH LW LV LPSRUWDQW WKDW WKH UHVHDUFK GHVLJQ KDV DGHTXDWH SRZHU WR GHWHFW DQ
DQWLFLSDWHG HIIHFW VL]H )DLOXUH WR SURYLGH DQ DGHTXDWH OHYHO RI VWDWLVWLFDO SRZHU KDV
LPSOLFDWLRQVIRUERWKWKHH[HFXWLRQDQGWKHRXWFRPHVRIUHVHDUFK,QWKHZRUGVRI%DURXGLDQG
2UOLNRZVNL   ³,I UHVRXUFHV DUH OLPLWHG DQG SUHFOXGH DWWDLQLQJ D VDWLVIDFWRU\ OHYHO RI
VWDWLVWLFDO SRZHU WKH UHVHDUFK LV SUREDEO\ QRW ZRUWK WKH WLPH HIIRUW DQG FRVW RI LQIHUHQWLDO
VWDWLVWLFV´ LELGS 
6LQFH ZH KDYH FKRVHQ WR SURWHFW RXUVHOYHV PRUH DJDLQVW IDOVH SRVLWLYHV WKDQ IDOVH
QHJDWLYHVZHVHWWKHSRZHUOHYHOWRWKHXVXDOO\UHFRPPHQGHGYDOXHRI±E  %DURXGL
DQG 2UOLNRZVNL  &RKHQ  0LOOHU HW DO  5DGHPDFKHU   ,H WKH
SUREDELOLW\ RI QRW GHWHFWLQJ DQ HIIHFW LQ WHVWLQJ WKH K\SRWKHVHV LQ WKLV VWXG\ LV  7DNHQ
WRJHWKHUZLWKWKHFRQYHQWLRQDOD ZHWKXVKDYHDEDUDWLRRIRIWKHWZRNLQGVRI
ULVNVRIEHLQJZURQJLQWKLVVWXG\
)XUWKHUPRUH D K\SRWKHVLV FRXOG EH WHVWHG ZLWK D RQH RU WZRWDLOHG UHMHFWLRQ UHJLRQ
7KXVDQRWKHUHOHPHQWWRFRQVLGHU LV WKH GLUHFWLRQDOLW\ RU QRQGLUHFWLRQDOLW\ RI WKH VWDWLVWLFDO
WHVW 'LUHFWLRQDO RU RQHWDLOHG K\SRWKHVHV DUH LPSOLHG ZKHQ WKH EDVLF TXHVWLRQ LQYROYHV
FRPSDUDWLYH WHUPV OLNH PRUH WKDQ LQFUHDVHG LPSURYHG GHFOLQHG DQG VR RQ 7KH HVVHQWLDO
TXHVWLRQ WR EH DQVZHUHG E\ WKH GDWD KDV FOHDU LPSOLFDWLRQV RI D GLIIHUHQFH RU FKDQJH LQ D
VSHFLILF GLUHFWLRQ LI WKH UHVXOW LV WR EH FDOOHG ³VLJQLILFDQW´ 1RQGLUHFWLRQDO RU WZRWDLOHG
K\SRWKHVLVWHVWLQJRQWKHRWKHUKDQGLVFDOOHGIRUZKHQWKHTXHVWLRQODFNVDFOHDUO\GHILQHG
QRWLRQ RI WKH GLUHFWLRQ RI GLIIHUHQFH WR H[SHFW LI + LV IDOVH 5HVHDUFK TXHVWLRQV ZRXOG EH
ZLWKRXW DQ\ VSHFLILFDWLRQ RI H[SHFWHG GLUHFWLRQ HJ ³'LG VRPHWKLQJ KDSSHQ"´ ³,V WKHUH D
GLIIHUHQFH"´RU³:DVWKHUHDFKDQJH"´ +D\V 

±±
&+$37(5

$FFHSW+ 5HMHFW+

E
P

E D

)LJXUH6WDWLVWLFDOSRZHUDQGWKHSUREDELOLW\RI7\SH,DQG7\SH,,HUURULQWHVWLQJD
GLUHFWLRQDOK\SRWKHVLV

7KH SRZHU RI RQHDQG WZRWDLOHG WHVWV RI WKH VDPH K\SRWKHVLV + ZLOO WHQG WR EH GLIIHUHQW
JLYHQWKHVDPHDOHYHODQGWKHVDPHWUXHDOWHUQDWLYH+$)RUH[DPSOHLIDRQHWDLOHGWHVWLV
XVHGWRWHVWDPHDQDQGWKHWUXHDOWHUQDWLYHP$DFWXDOO\LVWKHGLUHFWLRQRIWKHUHMHFWLRQUHJLRQ
WKHRQHWDLOHGWHVWLVPRUHSRZHUIXOWKDQWKHWZRWDLOHGRYHUDOOVXFKSRVVLEO\WUXHYDOXHVRI
P$&RQYHUVHO\LIWKHWUXHDOWHUQDWLYHKDSSHQVWREHRQWKHWDLORSSRVLWHWKHUHMHFWLRQUHJLRQLQ
DRQHWDLOHGWHVWWKHSRZHULVYHU\ORZLQIDFWKHUHWKHSRZHUZLOOEHQRPRUHWKDQDLQWKH
WHVWRIDPHDQ VHH)LJXUH   6LQFH DOO K\SRWKHVHV LQ WKLV VWXG\ DUH GLUHFWLRQDO LQYROYLQJ
FRPSDUDWLYHWHUPVOLNH³SRVLWLYHO\DVVRFLDWHGZLWK´ZHXVHGRQHWDLOHGVLJQLILFDQFHWHVWV
,Q DGGLWLRQ WR WKH GLUHFWLRQDOLW\ DQG WKH W\SH RI WKH VWDWLVWLFDO WHVW WKH UHTXLUHG SRZHU
OHYHO E LVFORVHO\ UHODWHG WR WKH VLJQLILFDQFH FULWHULRQ D  WKH VDPSOH VL]H 1  DQG WKH
HIIHFWVL]H J  %ULDQG HW DO E &RKHQ  0LOOHU HW DO   $V ZH KDYH DOUHDG\
PHQWLRQHGSRZHUGHFUHDVHVZLWKPRUHUHVWULFWLYHDOSKDOHYHOV:LWKUHVSHFWWRHIIHFWVL]HD
ODUJHUHIIHFWLVPRUHOLNHO\WREHIRXQGWKDQDVPDOOHUHIIHFWDQGWKXVWRLPSDFWWKHSRZHURI
WKHVWDWLVWLFDOWHVW)LQDOO\DWDQ\JLYHQOHYHORIDOSKDLQFUHDVHGVDPSOHVL]HDOZD\VSURGXFH
JUHDWHUSRZHU+RZHYHU LQFUHDVLQJ WKH VDPSOH FDQ DOVR SURGXFH ³WRR PXFK´ SRZHU XQWLO DW
YHU\ODUJHVDPSOHVL]HVDOPRVWDQ\HIIHFWLVVLJQLILFDQW +DLUHWDO 
+DYLQJVHWWKHVLJQLILFDQFHFULWHULRQWRWKHSRZHUOHYHOWRDQGGHFLGHGWRWHVWWKH
K\SRWKHVHVZLWKRQHWDLOHGUHMHFWLRQUHJLRQVZKDWUHPDLQVLVWRVHOHFWWKHSURSHUW\SHRIWHVWV
DQGDVXLWDEOHVDPSOHVL]HWRHQVXUHDPHDQLQJIXOVWXG\,QRUGHUWRGHWHUPLQHWKH1QHFHVVDU\
IRUWKHVSHFLILHGSRZHUOHYHODQGWKHVLJQLILFDQFHFULWHULRQZHWKHUHIRUHKDYHWRHVWLPDWHWKH
HIIHFW VL]H ZKLFK LV WKH GHJUHH WR ZKLFK WKH SKHQRPHQRQ XQGHU VWXG\ LV SUHVHQW LQ WKH
SRSXODWLRQ 7KLV LV DQ HVVHQWLDO FRQFHUQ VLQFH ³$ UHFRJQLWLRQ RI WKH FULWLFDO UROH SOD\HG E\
HIIHFW VL]H LQ WKH GHWHUPLQDWLRQ RI WKH SRZHU RI D VWDWLVWLFDO WHVW LV IXQGDPHQWDO WR DGHTXDWH
LQWHUSUHWDWLRQDQGDSSOLFDWLRQRIUHVHDUFKUHVXOWV´ %DURXGLDQG2UOLNRZVNLS 
)XUWKHUPRUH DFFRUGLQJ WR %DURXGL DQG 2UOLNRZVNL   ³HIIHFW VL]H LV SUREDEO\ WKH
PRVWLPSRUWDQWGHWHUPLQDQWRIVWDWLVWLFDOSRZHU´ LELGS +RZHYHUHVWLPDWLQJWKHHIIHFW
VL]H LV D QRQWULYLDO WDVN 'XH WR WKH OLPLWHG QXPEHU RI HPSLULFDO VWXGLHV ZLWKLQ VRIWZDUH
HQJLQHHULQJ DQG 63, QRUPDWLYH DSSURDFKHV WR GHWHUPLQH HIIHFW VL]H DUH GLIILFXOW WR DSSO\

±±
5(6($5&+0(7+2'2/2*<

0LOOHUHWDO 7KHUHIRUHZHDSSOLHGDMXGJPHQWDODSSURDFKEDVHGRQ&RKHQ¶V 


HIIHFWVL]HFRQYHQWLRQVRIVPDOOPHGLXPRUODUJH,QLQIRUPDWLRQV\VWHPVUHVHDUFKDQGLQWKH
EHKDYLRUDO VFLHQFHV WKH RSHUDWLRQDOL]HG GHILQLWLRQV RI WKH HIIHFW VL]H IRU HDFK RI WKHVH
FDWHJRULHV KDYH EHFRPH VRPHWKLQJ RI D UHVHDUFK VWDQGDUG IRU WKH PRVW FRPPRQO\ XVHG
VWDWLVWLFDOWHVWV %DURXGLDQG2UOLNRZVNL5DGHPDFKHU 
&RKHQ HVWDEOLVKHG WKHVH FRQYHQWLRQV LQ  &RKHQ   DQG WKH\ KDYH EHHQ IL[HG
VLQFH+LVLQWHQWZDVWKDW³PHGLXP>HIIHFWVL]H@UHSUHVHQWDQHIIHFWOLNHO\WREHYLVLEOHWRWKH
QDNHGH\HRIDFDUHIXOREVHUYHUVPDOO>HIIHFWVL]H@WREHQRWLFHDEO\VPDOOHUWKDQPHGLXPEXW
QRWVRVPDOODVWREHWULYLDODQGODUJH>HIIHFWVL]H@WREHWKHVDPHGLVWDQFHDERYHPHGLXPDV
VPDOOZDVEHORZLW´ &RKHQS  7DEOH JLYHVWKHGHILQLWLRQRIWKHHIIHFWVL]H
LQGH[ DQG WKH FRUUHVSRQGLQJ RSHUDWLRQDOL]HG HIIHFW VL]H YDOXHV IRU WKH IRXU VWDWLVWLFDO WHVWV
XVHGLQWKLVVWXG\
,Q 7DEOH  WKH HIIHFWVL]H LQGH[ G IRU WKH WWHVW RI WKH GLIIHUHQFH EHWZHHQ WZR
LQGHSHQGHQW PHDQV LV WKH GLIIHUHQFH H[SUHVVHG LQ XQLWV RI WKH ZLWKLQSRSXODWLRQ VWDQGDUG
GHYLDWLRQ7KXVDQRSHUDWLRQDOO\GHILQHGPHGLXPGLIIHUHQFHEHWZHHQPHDQVLVKDOIDVWDQGDUG
GHYLDWLRQ)RUWHVWLQJWKHSURGXFWPRPHQWFRUUHODWLRQRIDVDPSOHIRUVLJQLILFDQFHWKHHIIHFW
VL]HLVVLPSO\WKHSRSXODWLRQU,QWKHIRUPXODIRUWKHHIIHFWVL]HLQGH[ZIRUWKHFKLVTXDUH
WHVWIRUDVVRFLDWLRQLQWZRZD\FRQWLQJHQF\WDEOHVNLVWKHQXPEHURIFHOOVDQG3 DQG3$ DUH L L

WKH QXOO DQG DOWHUQDWH SRSXODWLRQ SURSRUWLRQV LQ FHOO L )LQDOO\ WKH HIIHFWVL]H LQGH[ I LV
GHILQHG IRU HLWKHU VTXDUHG PXOWLSOH RU VTXDUHG PXOWLSOH SDUWLDO FRUUHODWLRQV 5  &RKHQ
 
+DYLQJVSHFLILHGDVLJQLILFDQFHFULWHULRQRID DQGDSRZHUOHYHORIZHGHWHU
PLQHGWKHQHFHVVDU\VDPSOHVL]H1EDVHGRQ&RKHQ¶V  WDEOHV XVLQJ DPHGLXP HIIHFW
VL]H DV WKH GLPHQVLRQLQJ SDUDPHWHU )XUWKHUPRUH ³WKH WDEOHG VDPSOH VL]HV SURYLGH FORVH
DSSUR[LPDWLRQVIRURQHVLGHGWHVWVDWòD HJWKHVDPSOHVL]HVWDEOHGXQGHUD PD\EH
XVHG IRU RQHVLGHG WHVWV DW D   ´ LELG S   7DEOH  VKRZV WKH QHFHVVDU\ 1 IRU
SRZHURIDQGVLJQLILFDQFHFULWHULDRIDQGIRUWKHIRXUWHVWVXVHGLQWKLVVWXG\

7DEOH(IIHFWVL]HLQGH[HVDQGWKHLUYDOXHVIRUVPDOOPHGLXPDQGODUJHHIIHFWVIRUWHVWV
XVHGLQWKLVVWXG\ DGDSWHGIURP&RKHQS 

(IIHFW6L]H

6WDWLVWLFDO7HVW (IIHFW6L]H,QGH[ 6PDOO 0HGLXP /DUJH

 7KHWWHVWIRUWKHGLIIHUHQFH P $  P%
EHWZHHQWZRLQGHSHQGHQWPHDQV
G   
V
 7KHWWHVWIRUWKHVLJQLILFDQFHRI
DSURGXFWPRPHQWFRUUHODWLRQ r   
FRHIILFLHQWU

 7KHFKLVTXDUHWHVWIRU N 3$L  3L 


DVVRFLDWLRQLQWZRZD\
FRQWLQJHQF\WDEOHV
Z ¦
L  3L
  

 0XOWLSOHDQGPXOWLSOHSDUWLDO  5
FRUUHODWLRQ I   
 5

±±
&+$37(5

7DEOH1IRUVPDOOPHGLXPDQGODUJHHIIHFWVL]HVDWSRZHU IRUD DQG


DGDSWHGIURP&RKHQS 

D  D 

6WDWLVWLFDO7HVW 6PDOO 0HGLXP /DUJH 6PDOO 0HGLXP /DUJH

 0HDQGLIIHUHQFH      


 6LJQLILFDQFHRIU      
 &KLVTXDUH
GI      
GI      
GI      
 0XOWLSOH5
D
N   
D
N   
D
N   
D
N   

D
1XPEHURILQGHSHQGHQWYDULDEOHV

7HVWLQJ WKH K\SRWKHVHV LQ WKLV VWXG\ LQYROYHG VLJQLILFDQFH WHVWLQJ RI VDPSOH FRUUHODWLRQV LQ
K\SRWKHVHVWRDQGVLJQLILFDQFHWHVWLQJRIWKHPXOWLSOHFRUUHODWLRQFRHIILFLHQWLQK\SRWKHVLV
$VVHHQIURP7DEOHDVLJQLILFDQFHWHVWRIDVDPSOHU LHK\SRWKHVHVWR DWD 
RQHVLGHG ZLWKDSRZHUOHYHORIZKHQWKHSRSXODWLRQULVPHGLXP U  UHTXLUHV
D VDPSOH VL]H 1   )RU D FRUUHVSRQGLQJ QRQGLUHFWLRQDO WHVW WKH UHTXLUHG VDPSOH VL]H
ZRXOGEH1 
,Q PXOWLSOH UHJUHVVLRQ SRZHU UHIHUV WR ³WKH SUREDELOLW\ RI GHWHFWLQJ DV VWDWLVWLFDOO\
VLJQLILFDQW D OHYHO RI 5 RU D UHJUHVVLRQ FRHIILFLHQW DW D VSHFLILHG VLJQLILFDQFH OHYHO IRU D
VSHFLILF VDPSOH VL]H´ +DLU HW DO  S   :LWK VL[ LQGHSHQGHQW YDULDEOHV DV LQ
K\SRWKHVLV DQDOSKDOHYHORIDQGSHUFHQWSRZHU7DEOHVKRZVWKDWDVDPSOHRI
 UHVSRQGHQWV ZLOO GHWHFW D PHGLXP HIIHFW VL]H IRU WKH ) WHVW RI 5 I    *LYHQ WKH
UHODWLRQVKLSEHWZHHQIDQG5WKLVFRUUHVSRQGVWRDQDELOLW\RIGHWHFWLQJ5YDOXHVRIRU
JUHDWHUDQG5YDOXHVRIRUJUHDWHU
,Q DGGLWLRQ WR WHVWLQJ WKH K\SRWKHVHV ZH DOVR H[DPLQHG WKH HIIHFWV RI FHUWDLQ
FKDUDFWHULVWLFVRIWKHUHVSRQGHQWVDQGWKHUHVSRQGHQWV¶RUJDQL]DWLRQVRQ63,VXFFHVVXVLQJWKH
WWHVWIRUWKHGLIIHUHQFHEHWZHHQWZRLQGHSHQGHQW PHDQV DQG WKH 3HDUVRQ FKLVTXDUH WHVWV RI
DVVRFLDWLRQ7RGHWHFWDPHGLXPGLIIHUHQFHEHWZHHQWZRLQGHSHQGHQWVDPSOHPHDQV G 
ZLWKDGLUHFWLRQDOWHVWDWD  QRQGLUHFWLRQDOD  DQGSRZHURIUHTXLUHV1
LQHDFKJURXS7RGHWHFWDPHGLXPGHJUHHRIDVVRFLDWLRQLQDFRQWLQJHQF\WDEOHZLWKRQH
GHJUHHRIIUHHGRPLQWKHSRSXODWLRQ Z  DWD DQGSRZHURIUHTXLUHV1 
:LWKWKUHHGHJUHHVRIIUHHGRPWKHFRUUHVSRQGLQJVDPSOHVL]HUHTXLUHPHQWEHFRPHV1 
,QVXPPDU\WKHUHVXOWVRIWKHSUHFHGLQJSRZHUDQDO\VLVKDYHVKRZQWKDWDVDPSOHVL]HRI
DERXW  WR  UHVSRQGHQWV LV QHFHVVDU\ IRU WKH FRQYHQWLRQDO DOSKD OHYHO RI  DQG 
SHUFHQWSRZHUWRGHWHFWPHGLXPHIIHFWVL]HVLQWHVWLQJWKHK\SRWKHVHVDQGLQH[SORULQJRWKHU
SRWHQWLDOUHODWLRQVKLSV

±±
5(6($5&+0(7+2'2/2*<

,QDJUHHPHQWZLWKWKHSULQFLSOHRIIDOVLILFDWLRQZHVKRXOGVSHDNRI³WKHFUHGLELOLW\RID
K\SRWKHVLVUHODWLYHWRDJLYHQVHWRINQRZOHGJH´ +HPSHOSHPSKDVLVLQRULJLQDO 
UDWKHUWKDQWU\LQJWRSURYHDK\SRWKHVLVLQWKHDEVROXWHVHQVH7KHGLYHUVLW\RIHYLGHQFHLVDQ
LPSRUWDQWIDFWRULQHVWDEOLVKLQJVXFKFUHGLELOLW\DQGWKXVLQWKHFRQILUPDWLRQRIDK\SRWKHVLV
7KDW LV WKH JUHDWHU WKH YDULHW\ RI WHVWV ZLWK IDYRUDEOH RXWFRPHV WKH VWURQJHU WKH UHVXOWLQJ
VXSSRUW IRU WKH K\SRWKHVLV &RQVHTXHQWO\ ZH WHVWHG K\SRWKHVHV  WKURXJK  XVLQJ ERWK
ELYDULDWH FRUUHODWLRQDO DQG SDUWLDO FRUUHODWLRQDO DQDO\VLV DV ZHOO DV PXOWLSOH UHJUHVVLRQ
DQDO\VLVWRVLPXOWDQHRXVO\DVVHVVWKHGHJUHHDQGFKDUDFWHURIWKHUHODWLRQVKLSVEHWZHHQHDFK
LQGHSHQGHQW YDULDEOH DQG WKH GHSHQGHQW PHDVXUH +\SRWKHVLV  ZDV WHVWHG E\ PXOWLSOH
UHJUHVVLRQDQDO\VLVERWKE\VLPXOWDQHRXVO\HQWHULQJDOOLQGHSHQGHQWYDULDEOHVWRWKHHTXDWLRQ
DQGE\DSSO\LQJVWHSZLVHUHJUHVVLRQ7KLVZD\ZHZHUHDEOHWRGHWHUPLQHQRWRQO\LQGLYLGXDO
UHODWLRQVKLSVEXWDOVRWKHUHODWLYHLPSRUWDQFHRIHDFKLQGHSHQGHQWYDULDEOH

 &KDSWHU6XPPDU\
,QWKLVFKDSWHUZHKDYHSURYLGHGDFRPSUHKHQVLYHGHVFULSWLRQRIWKHMXVWLILFDWLRQIRUDQGWKH
DVVXPSWLRQVEHKLQGWKHUHVHDUFKDSSURDFKXVHGLQWKLVVWXG\2XUPDLQDUJXPHQWZDVWKDWDQ
DSSOLHG GLVFLSOLQH VXFK DV 63, UHTXLUHV D SUDJPDWLF UHVHDUFK DSSURDFK ZLWK PL[HG PHWKRG
UHVHDUFK GHVLJQV LQ RUGHU WR OLQN WKHRU\ DQG SUDFWLFH DQG WKXV HQVXULQJ ERWK ULJRU DQG
UHOHYDQFH7KHQEDVHGRQ D FRQVLGHUDWLRQ RI IRUPDO H[SHULPHQW FDVH VWXG\ DQG VXUYH\ ZH
DUJXHG IRU DQ ³LQGXVWU\DVODERUDWRU\´ DSSURDFK DQG GHVFULEHG WKH VSHFLILF UHVHDUFK GHVLJQ
HPSOR\HG LQ WKLV VWXG\ 7KH UHVHDUFK GHVLJQ ZDV D VHTXHQWLDO PL[HG PHWKRG GHVLJQ
FRQVLVWLQJ RI IRXU PDMRU VWDJHV   D VLQJOH SLORW FDVH VWXG\ &DVH $    D PXOWLSOH FDVH
VWXG\RIWZHOYHVRIWZDUHRUJDQL]DWLRQV &DVH%&DQG'   IRUPXODWLRQRIWKHPRGHODQG
ILQDOO\  WHVWLQJRIWKHPRGHOE\DVXUYH\1H[WWKHSRSXODWLRQDQGVDPSOHZHUHGHVFULEHG
IROORZHG E\ D SUHVHQWDWLRQ RI KRZ WKH YDULDEOHV DQG PHDVXUHV XVHG HPHUJHG IURP WKH
SURFHVVHV RI FRQFHSWXDOL]DWLRQ DQG RSHUDWLRQDOL]DWLRQ 'DWD FROOHFWLRQ SURFHGXUHV DQG WKH
WHFKQLTXHV XVHG IRU GDWD DQDO\VLV ZHUH SUHVHQWHG QH[W 5HJDUGLQJ WKH FKRLFH RI DSSURSULDWH
WHVWVWDWLVWLFVZHHPSKDVL]HGWKHSUHHPLQHQFHRIWKHUHVHDUFKTXHVWLRQRYHUFRQVLGHUDWLRQVRI
HLWKHUPHWKRGRUSDUDGLJP)XUWKHUPRUHPHDQLQJIXOQHVVVKRXOGEHEDVHGRQDFWXDOGDWDDQG
KRZZHOOWKHVFDOHVZRUNLQSUDFWLFH)LQDOO\ZHGHVFULEHGWKHSURFHGXUHVXVHGIRUWHVWLQJWKH
K\SRWKHVHVHPSKDVL]LQJWKHUHODWLRQVKLSVEHWZHHQWKHVLJQLILFDQFHFULWHULRQVWDWLVWLFDOSRZHU
OHYHOHIIHFWVL]HDQGVDPSOHVL]H
7KHQH[WFKDSWHUGHWDLOVWKHUHVHDUFKPHWKRGIXUWKHUDQGGHVFULEHVWKHGHVLJQRIWKHGDWD
FROOHFWLRQLQVWUXPHQWXVHGWRPHDVXUHWKHNH\IDFWRUVRIVXFFHVVLQWKHG\QDPLFPRGHORI63,
VWDJH  RIWKHUHVHDUFKGHVLJQ 6SHFLILFDOO\WKHIRFXVLVRQUHOLDELOLW\DQGYDOLGLW\LVVXHVRI
WKHPHDVXUHPHQWVFDOHV7KHQLQ6HFWLRQWKHLQVWUXPHQWLVXVHGWRWHVWWKHK\SRWKHVHVDQG
H[SORUHWKHUHODWLRQVKLSVWKDWZHUHSURSRVHGLQWKHPRGHO VWDJH  RIWKHUHVHDUFKSUREOHP 

±±
&+$37(5 
$Q,QVWUXPHQWIRU0HDVXULQJ
WKH.H\)DFWRUVRI6XFFHVVLQ
6RIWZDUH3URFHVV,PSURYHPHQW

³,WLVWKHWKHRU\WKDWGHFLGHVZKDWFDQEHREVHUYHG´
±$OEHUW(LQVWHLQ

,Q WKH SUHFHGLQJ FKDSWHU ZH GHVFULEHG WKH JHQHUDO UHVHDUFK PHWKRG XVHG LQ WKLV VWXG\ 7KLV
FKDSWHUGHWDLOVWKHUHVHDUFKPHWKRGIXUWKHUDQGGHVFULEHVWKHRSHUDWLRQDOL]DWLRQDQGGHVLJQRI
WKH LQVWUXPHQW XVHG WR PHDVXUH WKH NH\ IDFWRUV RI VXFFHVV LQ 63, 7KH FKDSWHU SURYLGHV D
V\QWKHVLVRIWKHSUHVFULSWLRQVIRUVXFFHVVIRXQGIURPWKHUHYLHZRIWKHTXDOLW\PDQDJHPHQW
RUJDQL]DWLRQDOOHDUQLQJDQGVRIWZDUHSURFHVVLPSURYHPHQWOLWHUDWXUHGLVFXVVHGLQ&KDSWHUV
RIWKHWKHVLV
,QDGGLWLRQWRWKHWKHRUHWLFDOMXVWLILFDWLRQVIRUWKHK\SRWKHVHVSUHVHQWHGLQ&KDSWHUWKLV
FKDSWHUSURYLGHVDGHWDLOHGHPSLULFDOMXVWLILFDWLRQRIWKHVHK\SRWKHVHVLQWHUPVRIH[SORUDWRU\
VWXGLHV LQ IRXU RI WKH FDVH FRPSDQLHV &DVH '  DQG D VXUYH\ DPRQJ 63, H[SHUWV IURP ERWK
DFDGHPLDDQGLQGXVWU\ VHH)LJXUHLQWKHSUHYLRXVFKDSWHU 
7KH PDLQ UHVXOW IURP WKLV FKDSWHU LV DQ LQVWUXPHQW ZLWK VDWLVIDFWRU\ SV\FKRPHWULF
SURSHUWLHVIRUPHDVXULQJWKHNH\IDFWRUVRIVXFFHVVLQ63,EDVHGRQGDWDFROOHFWHGIURP
VRIWZDUH RUJDQL]DWLRQV ,Q WKH QH[W FKDSWHU WKLV LQVWUXPHQW LV XVHG WR WHVW WKH K\SRWKHVHV
UHJDUGLQJ WKHVH IDFWRUV DQG 63, VXFFHVV DQG WR H[SORUH UHODWLRQVKLSV EHWZHHQ WKH VXFFHVV
IDFWRUVDQGWKHFRQWH[WXDOYDULDEOHV



7KHUHVXOWVUHSRUWHGLQWKLVFKDSWHUDUHEDVHGRQ '\EnD 

±±
&+$37(5

 ,QWURGXFWLRQ
'XULQJWKHODVWGHFDGHWKHVRIWZDUHLQGXVWU\KDVEHHQPRUHDQGPRUHFRQFHUQHGDERXW63,
&RQVHTXHQWO\ ZH KDYH ZLWQHVVHG D SUROLIHUDWLRQ RI PRGHOV DQG LQLWLDWLYHV DOO FODLPLQJ WR
LQFUHDVH WKH OLNHOLKRRG RI VXFFHHGLQJ ZLWK 63, LQLWLDWLYHV 7KH 63, OLWHUDWXUH LV IXOO RI FDVH
VWXGLHV DQG DQHFGRWDO HYLGHQFH RI VXFFHVVIXO FRPSDQLHV DQG GHVFULSWLRQV RI WKHLU 63,
SURJUDPV6HYHUDODXWKRUVUHSHDWHGO\GLVFXVVWKHLPSRUWDQFHRIFHUWDLQFULWLFDOVXFFHVVIDFWRUV
VHH HJ &KDSWHU   +RZHYHU WKHUH KDV EHHQ QR V\VWHPDWLF DWWHPSW WR V\QWKHVL]H DQG
RUJDQL]H WKH SUHVFULSWLRQV RIIHUHG 7KH UHVHDUFK HIIRUWV WR GDWH DUH OLPLWHG DQG LQFRQFOXVLYH
DQG ZLWKRXW DGHTXDWH WKHRUHWLFDO DQG SV\FKRPHWULF MXVWLILFDWLRQ (YHQ IRU FRPPRQO\
UHFRJQL]HG IDFWRUV VXFK DV PDQDJHPHQW FRPPLWPHQW DQG HPSOR\HH SDUWLFLSDWLRQ QR
RSHUDWLRQDOPHDVXUHVDUHDYDLODEOH
'HVSLWH DQ LQFUHDVLQJ IRFXV RQ WKH QDWXUH DQG YDOXH RI HPSLULFDO VRIWZDUH HQJLQHHULQJ
HJ %DVLOL HW DO  %DVLOL DQG 6HOE\  %DVLOL  +DUULVRQ HW DO  -HIIHU\
DQG9RWWD SRRUWKHRU\GHYHORSPHQWDQGLQDGHTXDWHPHDVXUHPHQWRIFRQVWUXFWVVHHPV
WREHWKHQRUPIRUPRVWVWXGLHVUHJDUGLQJWKHNH\IDFWRUVRIVXFFHVVLQ63,7KHGDWDFROOHF
WLRQGHYLFH LQWKLVVWXG\DTXHVWLRQQDLUH XVHGIRUPHDVXUHPHQWLVFRPPRQO\ UHIHUUHGWRDV
DQLQVWUXPHQW 'DYLV +RZHYHULQVWUXPHQWYDOLGDWLRQDQGUHOLDELOLW\LVVXHVKDYHEHHQ
LQDGHTXDWHO\DGGUHVVHG LQ VRIWZDUH HQJLQHHULQJ UHVHDUFK ZLWK RQO\ D KDQGIXO RI UHVHDUFKHUV
HJ (O (PDP DQG 0DGKDYML   *ROGHQVRQ HW DO D )XVDUR HW DO  (O
(PDP(O(PDPDQG%LUN GHYRWLQJVHULRXVDWWHQWLRQWRWKHVHLVVXHV
0HDVXUHPHQWLQVWUXPHQWVLQERWKUHVHDUFKDQGSUDFWLFHDUHH[SHFWHGWREHYDOLGDQGUHOL
DEOH 6WUDXE  $QDVWDVL DQG 8UELQD   7KH EDVLF SRLQW LV WKDW XVHUV RI D JLYHQ
LQVWUXPHQWVKRXOGREWDLQVLPLODUUHVXOWV7KXVSV\FKRORJLVWVDQGSV\FKRPHWULFWKHRULVWVKDYH
GHYHORSHG ULJRURXV PHWKRGV IRU FRQVWUXFWLQJ UHOLDEOH DQG YDOLG LQVWUXPHQWV WR PHDVXUH
YDULDEOHVLQWKHVRFLDOVFLHQFHV HJ&URQEDFK/LNHUW1XQQDOO\1XQQDOO\
DQG%HUQVWHLQ$QDVWDVLDQG8UELQD 

+HQFHIRUWKHSUHVHQWUHVHDUFKZHGHILQHLQVWUXPHQWFRQVWUXFWLRQDV

WKH SURFHVV RI GHYHORSLQJ WKH GDWD FROOHFWLRQ GHYLFH LQ RUGHU WR GHILQH DQG REWDLQ UHOHYDQW
GDWDIRUDJLYHQUHVHDUFKTXHVWLRQ

7KHUHDUHPDQ\UHDVRQVZK\UHVHDUFKHUVLQ63,VKRXOGSD\FORVHUDWWHQWLRQWRLQVWUXPHQWDWLRQ
)LUVW FRQFHUQV DERXW LQVWUXPHQWDWLRQ DUH FORVHO\ FRQQHFWHG ZLWK FRQFHUQV DERXW ULJRU LQ
HPSLULFDO UHVHDUFK PHWKRGV IRU 63, 6HFRQG JUHDWHU DWWHQWLRQ WR LQVWUXPHQWDWLRQ SHUPLWV
FRQILUPDWRU\ IROORZXS UHVHDUFK WR XVH D WHVWHG LQVWUXPHQW KHQFH SURPRWLQJ FRRSHUDWLYH
UHVHDUFKHIIRUWV +XQWHUDQG6FKPLGW 7KLUGFORVHUDWWHQWLRQWRLQVWUXPHQWDWLRQEULQJV
JUHDWHU FODULW\ WR WKH IRUPXODWLRQ DQG LQWHUSUHWDWLRQ RI UHVHDUFK TXHVWLRQV 6WUDXE  
)LQDOO\ODFNRIYDOLGDWHGPHDVXUHVLQFRQILUPDWRU\UHVHDUFKUDLVHVVHULRXVTXHVWLRQVDERXWWKH
WUXVWZRUWKLQHVVRIWKHILQGLQJVRIWKHVWXG\
,Q 63, UHVHDUFK DV LQ VRFLDO UHVHDUFK DQG EXVLQHVV UHVHDUFK ZH DWWHPSW WR XQGHUVWDQG
UHDOZRUOGSKHQRPHQDWKURXJKH[SUHVVHGUHODWLRQVKLSVEHWZHHQUHVHDUFKFRQVWUXFWV %ODORFN
  +RZHYHU WKHVH FRQVWUXFWV DUH QHLWKHU GLUHFWO\ PHDVXUDEOH QRU REVHUYDEOH EXW DUH
EHOLHYHG WR EH ODWHQW LQ WKH SKHQRPHQRQ XQGHU LQYHVWLJDWLRQ ,Q 63, IRU H[DPSOH FDVXDO
FRQVWUXFWV OLNH ³RUJDQL]DWLRQDO PDWXULW\´ LV WKRXJKW WR LQIOXHQFH RXWFRPH FRQVWUXFWV OLNH

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

³RUJDQL]DWLRQDOSHUIRUPDQFH´1HLWKHURIWKHVHFRQVWUXFWVLVGLUHFWO\REVHUYDEOHEXWUHOHYDQW
PHDVXUHVFDQEHRSHUDWLRQDOL]HGWRVHUYHDVVXUURJDWHVIRUWKHVHFRQVWUXFWV
0HDVXUHPHQW RI UHVHDUFK FRQVWUXFWV LV QHLWKHUVLPSOHQRUVWUDLJKWIRUZDUG +RZHYHU LQ
VWUXPHQWDWLRQ WHFKQLTXHV DUH DYDLODEOH WKDW DOORZ XV WR FRQVWUXFW UHVHDUFK LQVWUXPHQWV WKDW
FRQVWLWXWHVDFFHSWDEOHOHYHOVRIUHOLDELOLW\DQGYDOLGLW\7KHSURFHVVRIGHYHORSLQJWKHUHVHDUFK
LQVWUXPHQW IRU WKLV VWXG\ ZDV EDVHG RQ JHQHUDOO\ DFFHSWHG SV\FKRPHWULF SULQFLSOHV RI
LQVWUXPHQWGHVLJQDQGZDVFDUULHGRXWDFFRUGLQJWRWKHQLQHVWHSVVKRZQLQ)LJXUH
7KHVHFWLRQVLQWKLVFKDSWHUDUHDUUDQJHGDFFRUGLQJWRWKHVHVWHSV6HFWLRQSUHVHQWVWKH
SURFHVV RI LGHQWLI\LQJ WKH NH\ IDFWRUV RI 63, VXFFHVV 7KH LGHQWLILFDWLRQ RI LWHPV IRU HDFK
IDFWRULVGHVFULEHGLQ6HFWLRQDQGWKHFRQVWUXFWLRQRIPHDVXUHPHQWVFDOHVLVSUHVHQWHGLQ
6HFWLRQ,Q6HFWLRQZHSUHVHQWDSLORWWHVWRIWKHPHDVXUHPHQWVFDOHVDQGWKHRYHUDOO
LQVWUXPHQW EHIRUH GDWD ZDV FROOHFWHG 6HFWLRQ   )LQDOO\ 6HFWLRQV   DQG  DUH
FRQFHUQHGZLWKWKHUHOLDELOLW\RIWKHPHDVXUHPHQWVFDOHVGHWDLOHGLWHPDQDO\VLVDQGYDOLGLW\
RIWKHPHDVXUHPHQWVFDOHVUHVSHFWLYHO\

 .H\)DFWRUVRI63,6XFFHVV
7KHVWDUWLQJSRLQWIRUGHYHORSLQJWKHLQVWUXPHQWZDVWKHH[WHQVLYHOLWHUDWXUHUHYLHZRIFULWLFDO
IDFWRUV RI TXDOLW\ PDQDJHPHQW RUJDQL]DWLRQDO OHDUQLQJ DQG VRIWZDUH SURFHVV LPSURYHPHQW
GLVFXVVHGLQ &KDSWHUV  DQG LQ6HFWLRQ  DOVR VHH '\En D  7KH UHYLHZHG DXWKRUV
KDYHHPSKDVL]HGVOLJKWO\GLIIHUHQWVHWV RI RUJDQL]DWLRQDO UHTXLUHPHQWV IRU VXFFHVVIXO TXDOLW\
PDQDJHPHQW DQG RUJDQL]DWLRQDO FKDQJH EDVHG RQ WKHLU SHUVRQDO MXGJPHQW DQG H[SHULHQFH
:LWKDIHZH[FHSWLRQV HJ6DUDSKHWDO3RZHOO$KLUHHWDO%ODFNDQG
3RUWHU(O(PDPHWDOE WKHLUUHTXLUHPHQWVZHUHQRWIRUPXODWHGRQWKHEDVLVRI
V\VWHPDWLFHPSLULFDOUHVHDUFK
$VDFRPSOHPHQWWRWKHOLWHUDWXUHVWXG\ZHFRQGXFWHGDQH[WHQVLYHH[SORUDWRU\VWXG\RI
IDFWRUVHQDEOLQJ63,VXFFHVVLQIRXURIWKHFDVHFRPSDQLHV &DVH '  $V ZH VDZ LQ 6HFWLRQ
WKHGDWDFROOHFWLRQPHWKRGXVHGWRGHULYHNH\IDFWRUVIRUVXFFHVVZDVWKUHHTXHVWLRQQDLUH
LWHPVDQGIROORZXSJURXSLQWHUYLHZV IHHGEDFNVHVVLRQV LQHDFKFRPSDQ\)RUWKHSXUSRVH
RIWKHUHVXOWVSUHVHQWHGLQWKLVFKDSWHUGDWDFROOHFWLRQIRFXVHGRQDQVZHULQJRQHTXHVWLRQ

,Q \RXU RSLQLRQ ZKDW DUH WKH WKUHH PRVW LPSRUWDQW IDFWRUV HQDEOLQJ 63, VXFFHVV LQ \RXU
RUJDQL]DWLRQ"

,QRUGHUWRJDLQPRUHEDFNJURXQGLQIRUPDWLRQDERXWWKHHQDEOLQJIDFWRUVRI63,VXFFHVVRXU
TXHVWLRQLQJ VWUDWHJ\ LQFOXGHG WZR DGGLWLRQDO TXHVWLRQV )LUVW ZH DVNHG WKH VXEMHFWV DERXW
WKHLU PRVW LPSRUWDQW DUJXPHQW LQ IDYRU RI 63, LQ WKHLU RUJDQL]DWLRQ 6HFRQG ZH DVNHG WKH
VXEMHFWVDERXWWKHLUPRVWLPSRUWDQWDUJXPHQWDJDLQVW63,LQWKHLURUJDQL]DWLRQ7KHDQVZHUV
WR WKHVH TXHVWLRQV JDYH XV YDOXDEOH LQIRUPDWLRQ IRU LQWHUSUHWLQJ WKH HQDEOLQJ IDFWRUV VHH
$SSHQGL[&IRUDQH[DPSOHRIWKHUHVXOWVIURPRQHRIWKHFRPSDQLHV 
,Q WRWDO  VRIWZDUH PDQDJHUV TXDOLW\ PDQDJHUV VRIWZDUH GHYHORSHUV DQG FXVWRPHU
UHSUHVHQWDWLYHVDQVZHUHGWKHWKUHHTXHVWLRQVDQGSDUWLFLSDWHGLQWKHVXEVHTXHQWIHHGEDFNVHV
VLRQV 7KH RXWFRPH RI WKLV VWXG\ ZDV D VHW RI ILYH HQDEOLQJ IDFWRUV IRU 63, VXFFHVV
PDQDJHPHQWFRPPLWPHQWSDUWLFLSDWLRQOHDUQLQJIURPH[SHULHQFHJRDOEXVLQHVVRULHQWDWLRQ
DQGPHDVXUHPHQW(DFKRIWKHVHILYHIDFWRUVZDVPHQWLRQHGE\DWOHDVWWKUHHVXEMHFWVLQHDFK
RUJDQL]DWLRQ

±±
&+$37(5

/,7(5$785(5(9,(:
6WHS
&KDSWHUV

6WHS ,'(17,),&$7,212).(<
6HFWLRQ )$&72562)63,68&&(66

,1,7,$/6(/(&7,212)
6WHS
,7(06)25($&+)$&725
6HFWLRQ

&216758&7,212)
6WHS
0($685(0(176&$/(6
6HFWLRQ

3,/277(672)7+(
6WHS
0($685(0(176&$/(6
6HFWLRQ

'$7$&2//(&7,21
6WHS
6HFWLRQ

1R 'HOHWHLWHPVWKDW
6WHS $5(0($685(0(176&$/(6 ZLOOLPSURYHLQWHUQDO
6HFWLRQ ,17(51$//<&216,67(17"
FRQVLVWHQF\

<HV

1R &RQVLGHULWHPVWKDW
$5(,7(06$66,*1(' FRUUHODWHKLJKO\ZLWK
6WHS
727+(3523(56&$/(" PRUHWKDQRQHVFDOH
6HFWLRQ

<HV

1R
6WHS $5(0($685(0(17
6HFWLRQ 6&$/(69$/,'"

<HV

0($685(0(17,167580(17

)LJXUH,QVWUXPHQWGHYHORSPHQWSURFHVV DGDSWHGIURP6DUDSKHWDO 

&RPSOHPHQWLQJ WKH OLWHUDWXUH UHYLHZ DQG WKH H[SORUDWRU\ VWXG\ LQ WKH IRXU VRIWZDUH FRP
SDQLHVLQ&DVH'ZHFRQGXFWHGDUHYLHZSURFHVVZLWKHOHYHQ63,H[SHUWVLQERWKDFDGHPLD
DQGLQGXVWU\ VHH)LJXUHLQWKHSUHYLRXVFKDSWHU 7KHVLQJOHPRVWLPSRUWDQWFULWHULRQIRU
FKRRVLQJ H[SHUWV WR WKLV SDQHO ZDV ³KDQGVRQ H[SHULHQFH ZLWK 63, SURMHFWV LQ WKH VRIWZDUH
LQGXVWU\´7KXV ZH LQFOXGHG VRIWZDUH PDQDJHUV VHQLRU VRIWZDUH HQJLQHHUV DQG UHVHDUFKHUV
WKDWDFWLYHO\SDUWLFLSDWHGHLWKHULQWKHODUJHVWVRIWZDUHSURFHVVLPSURYHPHQWHIIRUWWRGDWHLQ
1RUZD\FDOOHG63,4 6RIWZDUH3URFHVV,PSURYHPHQWIRUEHWWHU4XDOLW\  VHH'\EnH 

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

RU LQ D 3URFHVV ,PSURYHPHQW ([SHULPHQW 3,(  ZLWKLQ WKH (XURSHDQ 6\VWHPV DQG 6RIWZDUH
,QLWLDWLYH (66, 
7KH H[SHUWV ZHUH WKXV FKRVHQ IURP FRPSDQLHV RI GLIIHUHQW VL]HV ZLWK D ZLGH UDQJH RI
SURGXFWV DQG PDUNHWV GHYHORSLQJ HLWKHU VRIWZDUH RU FRPELQHG VRIWZDUH DQG KDUGZDUH
SURGXFWV 6RPH RI WKH LQGXVWU\ H[SHUW¶V FRPSDQLHV EHORQJHG WR WKH WUDGLWLRQDO HOHFWURQLFV
EDVHG ,7LQGXVWU\ ZKLOH RWKHUV EHORQJHG WR WKH QHZ GRWFRP LQGXVWU\ %HVLGHV 6,17()
H[SHUWV IURP DFDGHPLD ZHUH FKRVHQ IURP WKH 1RUZHJLDQ 8QLYHUVLW\ RI 6FLHQFH DQG 7HFK
QRORJ\DQGWKH8QLYHUVLW\RI2VORZKLFKPDGHXSWKHUHVHDUFKSDUWQHUVLQWKH63,4SURMHFW
2IWKHSDQHORIHOHYHQH[SHUWVVHYHQKDG D3K'LQFRPSXWHUVFLHQFHVL[KDGSURMHFWPDQ
DJHPHQWRU63,UHVSRQVLELOLW\LQLQGXVWU\DQGILYHZHUH UHVHDUFKHUVLQVRIWZDUH HQJLQHHULQJ
DQG63,LQXQLYHUVLWLHVRUUHVHDUFKLQVWLWXWHV
7KHXVHRIVXFKDQH[SHUWUHYLHZSURFHVVLVFRPPRQLQLQVWUXPHQWGHYHORSPHQWDQGWKH
SDUWLFXODUSURFHVVXVHGLQWKLVVWXG\ZDVVLPLODUWRWKDWRI(O(PDPDQG0DGKDYML  7KH
UHYLHZ SURFHVV FRQVLVWHG RI WKUHH FRQVHFXWLYH DFWLYLWLHV   UHILQHPHQW RI WKH OLWHUDWXUH
GHULYHG SUHVFULSWLRQV   SULRULWL]DWLRQ RI WKH K\SRWKHVL]HG FDWHJRULHV DQG   SULRULWL]DWLRQ
RILQGLFDWRUVZLWKLQHDFKFDWHJRU\
(DFK H[SHUW UHFHLYHG D PHPRUDQGXP ZLWK D EULHI VXPPDU\ RI WKH SUHVFULSWLRQV IRU
VXFFHVVIRXQGIURPWKHOLWHUDWXUHUHYLHZ)XUWKHUPRUHDVDUHVXOWRIWKLVOLWHUDWXUHUHYLHZWKH
H[SHUWV ZHUH SUHVHQWHG ZLWK DQ LQLWLDO OLVW RI VHYHQ NH\ IDFWRUV IRU 63, VXFFHVV DQG D VHW RI
SRWHQWLDOLQGLFDWRUVIRUHDFKIDFWRUEDVHGRQWKHDXWKRU¶VMXGJHPHQW VHH$SSHQGL[' 1HDUO\
DOORIWKHDXWKRUVVXSSRUWHGHDFKRIWKHVHIDFWRUVKHQFHWRJHWKHUWKH\ZHUHMXGJHGWRGHILQH
HVVHQWLDODVSHFWVRI63,
(DFKH[SHUWZDVDVNHGWR  UHYLHZWKHILQGLQJVIURPWKHOLWHUDWXUHDQGWKHLQLWLDOOLVWRI
NH\IDFWRUV  GHOHWHWKHIDFWRUVFRQVLGHUHGWRKDYHVHFRQGDU\RUQRLPSRUWDQFH  DGGQHZ
IDFWRUV FRQVLGHUHG WR KDYH KLJK LPSRUWDQFH DQG   JLYH HDFK RI WKH UHPDLQLQJ IDFWRUV D
SULRULW\FRGH7KHH[SHUWVZHUHDOVRDVNHGWRDGGDQ\OLWHUDWXUHUHIHUHQFHVWKDWDFFRUGLQJWR
WKHLUMXGJHPHQWZDVQRWUHSUHVHQWHGE\WKHUHYLHZLHWKDWZRXOGDGGQHZSUHVFULSWLRQVQRW
FRYHUHG E\ WKH SUHVHQWHG OLWHUDWXUH UHYLHZ 6XEVHTXHQWO\ WKH OLVW RI IDFWRUV ZDV PRGLILHG
UHILQHGDQGUHZRUGHGGXULQJWKHFRXUVHRIWKHGDWDFROOHFWLRQ
$ UDQN RUGHULQJ ZDV REWDLQHG XVLQJ WKH WRWDO SURSRUWLRQ RI UHVSRQGHQWV ZKR UDQNHG D
IDFWRU DVFULWLFDOIRU 63, VXFFHVV DV RSSRVHG WR EHLQJ RI VRPHZKDW LPSRUWDQFH 'XULQJ WKLV
VWHS RI WKH H[SHUW UHYLHZ SURFHVV LW EHFDPH FOHDU WKDW WKH H[SHUWV SODFHG VLPLODU OHYHOV RI
HPSKDVLVRQWKH63,VXFFHVVIDFWRUV7KHUHVXOWVRIWKLVVXUYH\DQGWKHVXEVHTXHQWUDQNRUGHU
LQJLQGLFDWHGZKLFKIDFWRUVRI63,VXFFHVVZKLFKZHUHFRQVLGHUHGPRVWLPSRUWDQWDQGZKLFK
ZHUHFRQVLGHUHGOHVVLPSRUWDQW
'XULQJ WKLV SURFHVV LW ZDV FOHDU WKDW WKH ILYH IDFWRUV WKDW ZHUH UDQNHG KLJKHVW E\ WKH
HOHYHQ63,H[SHUWVZHUHWKHVDPHIDFWRUVWKDWUHVXOWHGIURPWKHH[SORUDWRU\VWXG\DPRQJWKH
PDQDJHUVDQGGHYHORSHUVLQWKHIRXUVRIWZDUHFRPSDQLHV7KHWZRORZHVWUDQNLQJIDFWRUV
IURPWKHH[SHUWUHYLHZSURFHVV H[SHULPHQWDWLRQDQGRSHUDWLRQDOYDULHW\ ZHUHFRPELQHGLQWR
RQH IDFWRU H[SORUDWLRQ RI QHZ NQRZOHGJH  +HQFH WKH UHVXOW RI WKLV LQYHVWLJDWLRQ ZDV WKH
LGHQWLILFDWLRQ RI VL[ NH\ IDFLOLWDWLQJ IDFWRUV IRU 63, VXFFHVV GHVFULEHG DQG WKHRUHWLFDOO\
MXVWLILHGLQ&KDSWHU7KHVHVL[IDFWRUVDUHOLVWHGLQ7DEOH
,QWKHQH[WVHFWLRQZHGHVFULEHWKHLGHQWLILFDWLRQRILQGLFDWRUVIRUHDFKRIWKHIDFLOLWDWLQJ
IDFWRUVRI63,VXFFHVV

±±
&+$37(5

7DEOH.H\IDFWRUVRI63,VXFFHVV

.H\)DFWRUVRI63,6XFFHVV ,QGLFDWRUVIRUWKH.H\)DFWRUVRI63,6XFFHVV

%XVLQHVV2ULHQWDWLRQ i ([WHQWRIJRDORULHQWDWLRQLQ63,DFWLYLWLHV


i ([WHQWWRZKLFK63,JRDOVDQGSROLF\DUHXQGHUVWRRG


i 'HJUHHRILQWHJUDWLQJ63,DFWLRQVZLWK³UHDO´ZRUN


i ([WHQWWRZKLFK63,JRDOVDUHDOLJQHGZLWKEXVLQHVVJRDOV


i 'HJUHHRIEDODQFHEHWZHHQVKRUWWHUPDQGORQJWHUPJRDOV


/HDGHUVKLS,QYROYHPHQW i 'HJUHHRIPDQDJHPHQWVXSSRUWWR63,DFWLYLWLHV


i $FFHSWDQFHRIUHVSRQVLELOLW\IRU63,E\PDQDJHPHQW


i 'HJUHHWRZKLFKPDQDJHPHQWFRQVLGHUV63,DVDZD\WR


LQFUHDVHFRPSHWLWLYHDGYDQWDJH
i 'HJUHHRISDUWLFLSDWLRQE\PDQDJHPHQWLQWKH63,SURFHVV


i $PRXQWRIUHYLHZRI63,LVVXHVLQWRSPDQDJHPHQWPHHWLQJV


(PSOR\HH3DUWLFLSDWLRQ i ([WHQWRIHPSOR\HHLQYROYHPHQWLQGHFLVLRQVDERXWZKDW


VKRXOGEHVWEHGRQHDWWKHLURZQOHYHO FRGHWHUPLQDWLRQ 
i ([WHQWWRZKLFKHPSOR\HHVFRQWULEXWHZLWKLPSURYHPHQW


SURSRVDOV
i ([WHQWRIGHYHORSHUSDUWLFLSDWLRQLQWKHIRUPDOL]DWLRQRIURX


WLQHV
i ([WHQWRIRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXWVRIWZDUH


GHYHORSPHQW
i ([WHQWWRZKLFKHPSOR\HHVKDYHUHVSRQVLELOLW\IRU63,


i ([WHQWRIGHYHORSHUSDUWLFLSDWLRQLQ63,JRDOVHWWLQJ


i ([WHQWRIRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXW63,


i ([WHQWRIHPSOR\HHSDUWLFLSDWLRQLQGHYHORSPHQWSODQQLQJ 


&RQFHUQIRU0HDVXUHPHQW i ,PSRUWDQFHRIPHDVXULQJSHUIRUPDQFH


i $YDLODELOLW\RITXDOLW\GDWD GHIHFWVWLPHOLQHVVHWF 


i ([WHQWWRZKLFKTXDOLW\GDWDLVDYDLODEOHWRGHYHORSHUV


i ([WHQWWRZKLFKTXDOLW\GDWDLVDYDLODEOHWRPDQDJHUV


i ([WHQWWRZKLFKTXDOLW\GDWDLVXVHGLQ63,ZRUN


i $PRXQWRIIHHGEDFNSURYLGHGWRSURMHFWWHDPVRQWKHLUSHU


IRUPDQFH

([SORLWDWLRQRIH[LVWLQJNQRZOHGJH i ([WHQWWRZKLFKH[LVWLQJNQRZOHGJHLVH[SORLWHG


OHDUQLQJE\H[SHULHQFH i ([WHQWRIOHDUQLQJIURPSDVWH[SHULHQFH


i 'HJUHHWRZKLFKIRUPDOURXWLQHVDUHEDVHGRQSDVWH[SHULHQFH


i 'HJUHHRIV\VWHPL]DWLRQRISDVWH[SHULHQFH


i 'HJUHHRILQWHUQDOH[SHULHQFHWUDQVIHU


i ([WHQWRIULVNDYHUVLRQ 


([SORUDWLRQRIQHZNQRZOHGJH i 'HJUHHRIDGDSWDELOLW\WRUDSLGFKDQJHLQFUHDVLQJFRPSOH[LW\


OHDUQLQJE\H[SHULPHQWDWLRQ DQGHQYLURQPHQWDOXQFHUWDLQW\
i ([WHQWWRZKLFKLQQRYDWLRQFUHDWLYLW\LVHQFRXUDJHG


i ([WHQWRIYDULHW\LQWKHXVHRIPHWKRGVWHFKQLTXHVDQGWRROV


i 'HJUHHRIH[SHULPHQWDWLRQZLWKQHZLGHDVVWUDWHJLHVDQG


WHFKQRORJLHV
i $ELOLW\WRTXHVWLRQXQGHUO\LQJYDOXHV


i 'HJUHHRIIOH[LELOLW\LQWDVNH[HFXWLRQ


i 'HJUHHRIGHWDLOLQWDVNVSHFLILFDWLRQV PLQLPXPFULWLFDOVSHFLIL


FDWLRQ 
i ,PSRUWDQFHRIPDWFKLQJWKHYDULHW\DQGFRPSOH[LW\RIWKH


RUJDQL]DWLRQ¶VHQYLURQPHQW

7KHVHLWHPVZHUHHYHQWXDOO\GHOHWHGWRLPSURYHWKHUHOLDELOLW\RIWKHLQVWUXPHQW

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

 ,WHP&UHDWLRQ
8VLQJ WKH SUHYLRXVO\ PHQWLRQHG SUHVFULSWLRQV IRXQG LQ WKH OLWHUDWXUH VHYHUDO UHSUHVHQWDWLYH
LQGLFDWRUV ZHUH GHILQHG IRU HDFK IDFWRU ,Q WRWDO  LQGLFDWRUV ZHUH LQLWLDOO\ GHILQHG IRU WKH
RULJLQDOVHWRIVHYHQIDFLOLWDWLQJIDFWRUV7KHVHLQGLFDWRUVDUHSUHVHQWHGLQ$SSHQGL['
$SURFHVVVLPLODUWRWKDWRILGHQWLI\LQJWKHNH\IDFWRUVRI63,VXFFHVVZDVXVHGWRGHILQH
WKHNH\LQGLFDWRUVIRUHDFKIDFWRU+HQFHIRUHDFKIDFWRUWKHHOHYHQH[SHUWVZHUHDVNHGWR 
GHOHWH LQGLFDWRUV RI VHFRQGDU\ RU QR LPSRUWDQFH RU LQGLFDWRUV WKDW WKH\ FRQVLGHUHG LQ
DSSURSULDWHDVGHVFULSWLRQVRIWKHIDFWRUXQGHUFRQVLGHUDWLRQ  DGGQHZLQGLFDWRUVDFFRUGLQJ
WRWKHLUMXGJHPHQWDQG  JLYHHDFKRIWKHUHPDLQLQJLQGLFDWRUVDSULRULW\VFRUH
$VIRUWKHIDFWRUVDUDQNRUGHULQJZDVQRZREWDLQHGIRUWKHLQGLFDWRUVEDVHGRQWKHH[
SHUWV¶MXGJHPHQW'XULQJWKLVVWHSRIWKHH[SHUWUHYLHZSURFHVVLWEHFDPHFOHDUWKDWGLIIHUHQW
H[SHUWV SODFHG GLIIHUHQW OHYHOV RI HPSKDVLV RQ WKH LQGLFDWRUV 7KH UHVXOWV RI WKH VXEVHTXHQW
UDQN RUGHULQJ VXJJHVWHG ZKLFK LQGLFDWRUV WKDW ZHUH FRQVLGHUHG PRUH LPSRUWDQW RU OHVV
LPSRUWDQW )XUWKHUPRUH DFFRUGLQJ WR %DJR]]L   ³IRU VFDOHV FRPSULVHG RI WKH VXPV RI
LWHPVDERXWWRLWHPVDUHXVXDOO\DGHTXDWH´ S 7KXVIROORZLQJWKHH[SHUWUHYLHZWKH
ILYHWRHLJKWKLJKHVWUDQNHGLQGLFDWRUVIRUHDFKIDFWRUZHUHFKRVHQIRUDWRWDORILQGLFDWRUV
7KHVHLQGLFDWRUVDUHVKRZQLQUDQNRUGHUZLWKLQHDFKIDFWRULQ7DEOH

 &RQVWUXFWLRQRI0HDVXUHPHQW6FDOHV
%DVHGRQWKHUHVXOWVIURPWKHSUHFHGLQJVWHSZHGHILQHGRQHTXHVWLRQIRUHDFKLQGLFDWRUVXFK
WKDW WKH WKHRUHWLFDO DEVWUDFWLRQ RI HDFK LQGLFDWRU FRXOG EH UHODWHG PRUH FORVHO\ WR HYHU\GD\
ZRUNVLWXDWLRQV)XUWKHUPRUHDVXEMHFWLYHUDWLQJVFDOHDFFRPSDQLHGHDFKTXHVWLRQ
,Q VHOHFWLQJ WKH QXPEHU RI SRLQWV RQ D UDWLQJ VFDOH *XLOIRUG   VXJJHVWHG VHYHUDO
FRQVLGHUDWLRQV ,I WRR IHZ VFDOH SRLQWV DUH XVHG WKH DQVZHU VFDOH LV REYLRXVO\ FRDUVH DQG
PXFK LQIRUPDWLRQ LV ORVW EHFDXVH WKH VFDOH GRHV QRW FDSWXUH WKH GLVFULPLQDWRU\ SRZHUV WKDW
UHVSRQGHQWV DUH FDSDEOH RI PDNLQJ &RQYHUVHO\ E\ DGGLQJ WRR PDQ\ VFDOH SRLQWV WKH VFDOH
FDQEHFRPHJUDGHGVRILQHO\WKDWLWLVEH\RQGUHVSRQGHQWV¶OLPLWHGSRZHUVRIGLVFULPLQDWLRQ
,QGHHG0LOOHU  DUJXHGWKDWWKHDYHUDJHLQGLYLGXDOFDQSURFHVVVHYHQSOXVRUPLQXVWZR
WKH³PDJLFDOQXPEHU´ FKXQNVRILQIRUPDWLRQDWDWLPH
/LNHUW DQG 5RVORZ   LQYHVWLJDWHG WKH UHOLDELOLW\ RI DWWLWXGH VFDOHV E\ XVLQJ WKUHH
YDULDWLRQVRIWKH/LNHUWVFDOH,QDGGLWLRQWRWKHRULJLQDOSRLQWVFDOH /LNHUW WKH\DOVR
XVHGDSRLQWDQGDSRLQWVFDOH7KH\FRQFOXGHGWKDWWKHSRLQWVFDOHFRQVLVWHQWO\\LHOGHG
KLJKHUUHOLDELOLWLHVWKDQHLWKHURIWKHWZRRWKHUVFDOHV
0RUHUHFHQWO\/LVVLW]DQG*UHHQ  FRQGXFWHGD0RQWH&DUORVWXG\RIWKHHIIHFWVRI
WKHQXPEHURIVFDOH SRLQWV DQG KRPRJHQHLW\ XSRQ UHOLDELOLW\ 7KHLU VWXG\ VKRZHG WKDW WKHUH
ZDVDQLQFUHDVH LQ UHOLDELOLW\ DV WKH QXPEHU RISRLQWV LQFUHDVHG IURP WZR WR ILYH +RZHYHU
UHOLDELOLW\OHYHOHGRIIEH\RQGILYHVFDOHSRLQWV&RQVHTXHQWO\/LVVLW]DQG*UHHQ   FRQ
FOXGHGWKDWVLQFHUHVSRQGHQWVDUHIDOOLEOHHYHQIHZHUWKDQILYHVFDOHSRLQWVPD\EHQHFHVVDU\
4XDOLWDWLYHVWXGLHVE\YDQGH9HQDQG)HUU\  VXSSRUWWKHSUHVHQWHGFRQFOXVLRQVE\
/LNHUW DQG 5RVORZ   DQG /LVVLW] DQG *UHHQ   *XLGHG E\ WKHVH VWXGLHV SRLQW
ELSRODU/LNHUWVFDOHVZHUHFRQVWUXFWHGIRUDOOTXHVWLRQVLQRXUILQDOTXHVWLRQQDLUH5HVSRQVHV
ZHUH VFRUHG IURP  WR  ZLWK D YDOXH RI  LQGLFDWLQJ ³6WURQJO\ GLVDJUHH´ DQG D YDOXH RI 
LQGLFDWLQJ³6WURQJO\DJUHH´7KXVZHUHIHUWRHDFKTXHVWLRQDQGLWVDVVRFLDWHGSRLQWVFDOHDV
DQLWHP

±±
&+$37(5

$W\SLFDOLWHPLVSUHVHQWHGEHORZ

6WURQJO\ 6WURQJO\
GLVDJUHH 'LVDJUHH 8QGHFLGHG $JUHH DJUHH

    

0DQDJHPHQWLVDFWLYHO\VXSSRUWLQJ
SURFHVVLPSURYHPHQWDFWLYLWLHV … … … … …

5DQGRP HUURUV LQ VLQJOH LWHPV ZLOO VRPHWLPHV LQIODWH DQG VRPHWLPHV GHIODWH WKH REVHUYHG
HVWLPDWHRIWKHWUXHVFRUH7KHUHIRUHZKHQUHSHDWHGPHDVXUHPHQWVIURPWKHVDPHUHVSRQGHQWV
DUH WDNHQ RYHU WLPH WKHUH ZLOO EH LQFRQVLVWHQFLHV LQ WKH REVHUYDWLRQV &RQVHTXHQWO\ VLQJOH
LWHPPHDVXUHVLQTXHVWLRQQDLUHVWHQGWREHKLJKO\XQUHOLDEOH 1XQQDOO\DQG%HUQVWHLQ
6SHFWRU 2QWKHRWKHUKDQGZKHQPXOWLSOHLWHPVDUHFRPELQHGLQWRDQHVWLPDWHRIWKH
WUXHVFRUHHUURUVWHQGWRDYHUDJHRXWOHDYLQJDPRUHDFFXUDWHDQGFRQVLVWHQW UHOLDEOH PHDV
XUHPHQWRYHUWLPH 6SHFWRU 
+HQFHWRUHOLDEO\PHDVXUHFRPSOH[FRQFHSWVVXFKDV63,VXFFHVVDQGIDFLOLWDWLQJIDFWRUV
ZHGHYHORSHGPXOWLSOHLWHPVFDOHVZKHUHPRUHWKDQRQHTXHVWLRQZDVXVHGWRPHDVXUHHDFK
FRQFHSW 7KH DFWXDO OHYHO RI SUDFWLFH IRU HDFK IDFLOLWDWLQJ IDFWRU LV WKXV UHSUHVHQWHG E\ WKH
VXPRIWKHLWHPUDWLQJVIRUWKDWIDFWRU:HUHIHUWRWKHVHVXPVDVVFDOHVFRUHV$YHFWRURIWKH
VFDOHVFRUHVIRUWKHVL[IDFWRUVFDQWKXVEHXVHGWRSUHGLFWWKHVRIWZDUHRUJDQL]DWLRQ¶VFKDQFHV
RIVXFFHVVZLWKLWV63,SURJUDP
$V DQ H[DPSOH RI D VFDOH VHH 7DEOH   ZH SUHVHQW WKH VFDOH GHYHORSHG IRU WKH
IDFLOLWDWLQJ IDFWRU ³/HDGHUVKLS ,QYROYHPHQW´ EDVHG RQ WKH ILYH LQGLFDWRUV UHVXOWLQJ IURP WKH
H[SHUWUHYLHZSURFHVV WKHFRPSOHWHYDOLGDWHGLQVWUXPHQWLVLQFOXGHGLQ$SSHQGL[( 

7DEOH/HDGHUVKLSLQYROYHPHQWVFDOH

6WURQJO\ 6WURQJO\
GLVDJUHH 'LVDJUHH 8QGHFLGHG $JUHH DJUHH
/HDGHUVKLS,QYROYHPHQW
    

0DQDJHPHQWLVDFWLYHO\VXSSRUWLQJ
SURFHVVLPSURYHPHQWDFWLYLWLHV … … … … …
0DQDJHPHQWDFFHSWVUHVSRQVLELOLW\
IRUSURFHVVLPSURYHPHQW … … … … …
0DQDJHPHQWFRQVLGHUVSURFHVV
LPSURYHPHQWDVDZD\WRLQFUHDVH … … … … …
FRPSHWLWLYHDGYDQWDJH
0DQDJHPHQWSDUWLFLSDWHVDFWLYHO\LQ
SURFHVVLPSURYHPHQWDFWLYLWLHV … … … … …
63,LVVXHVDUHRIWHQGLVFXVVHGLQ
WRSPDQDJHPHQWPHHWLQJV … … … … …

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

 3LORW7HVWRI0HDVXUHPHQW6FDOHV
7KH QH[W VWHS LQ WKH LQVWUXPHQW GHYHORSPHQW SURFHVV ZDV D SLORW WHVW RI WKH PHDVXUHPHQW
VFDOHVDQGRIWKHRYHUDOOLQVWUXPHQW,QJHQHUDOWKHSLORWVDPSOHVKRXOGEHDV VLPLODU WR WKH
WDUJHWSRSXODWLRQDVSRVVLEOH 1XQQDOO\DQG%HUQVWHLQ)LQNDQG.RVHFRII 6LQFH
WKHSULPDU\REMHFWLYHZDVWRGHYHORSDQLQVWUXPHQWWRPHDVXUHDVRIWZDUHRUJDQL]DWLRQ¶VVFRUH
RQ WKH VL[ IDFLOLWDWLQJ IDFWRUV RI 63, VXFFHVV ILUVW OLQH VRIWZDUH PDQDJHUV DQG TXDOLW\
PDQDJHUVZHUHFRQVLGHUHGDSSURSULDWHVXEMHFWV VHH6HFWLRQVDQG ,QFOXGLQJERWKRI
WKHVH PDQDJHPHQW JURXSV DUH DOVR LPSRUWDQW LQ RUGHU WR KDYH D PRUH EDODQFHG YLHZ VLQFH
WKHLUDWWLWXGHVPD\GLIIHUZLGHO\
)XUWKHUPRUHVLQFHWKLVZDVDSLORWWHVWWKHVDPSOHVL]HZDVNHSWTXLWHVPDOO4XHVWLRQ
QDLUHV ZHUH GLVWULEXWHG WR D FRQYHQLHQW VDPSOH RI WZHOYH PDQDJHUV LQ HLJKW FRPSDQLHV WKDW
HLWKHUSDUWLFLSDWHGLQWKH63,4SURJUDPRUZHUHLQYROYHGLQDQ(66,3,((DFKPDQDJHUDV
VHVVHG KLVKHU FRPSDQ\ E\ UDWLQJ HDFK PHDVXUHPHQW LWHP XVLQJ WKH VFDOHV GHVFULEHG LQ WKH
SUHYLRXVVHFWLRQ7KHPDQDJHUVPDLOHGWKHFRPSOHWHGTXHVWLRQQDLUHVGLUHFWO\WRWKHDXWKRUWR
HQVXUHFRQILGHQWLDOLW\DQGDQRQ\PLW\RIHDFKUHVSRQVH
7KHJRDORIWKHSLORWWHVWZDVWZRIROG  WRHQVXUHWKDWWKHPHFKDQLVPVRIFRPSLOLQJWKH
TXHVWLRQQDLUH KDG EHHQ DGHTXDWH DQG   WR PDNH DQ LQLWLDO UHOLDELOLW\ DVVHVVPHQW RI WKH
PHDVXUHPHQWVFDOHV7KH ILUVWDLPRIWKHSLORWWHVWZDVDFFRPSOLVKHGE\KDYLQJ WZR SURIHV
VRUV RI 63, UHVHDUFK DQG RQH SURIHVVRU LQ SV\FKRORJLFDO WHVWLQJ UHYLHZ WKH FRPSOHWHG TXHV
WLRQQDLUHDQGFRPPHQWRQLWVOHQJWKZRUGLQJLQVWUXFWLRQVDQGIRUPDWEHIRUHLWZDVVHQWRXW
6XEVHTXHQWO\ HDFK PDQDJHU ZDV DVNHG WR PDNH WKH VDPH NLQG RI FRPPHQWV 1RQH RI WKH
FRPPHQWVIURPWKLVUHYLHZLPSOLHGDQHHGWRFKDQJHWKHTXHVWLRQQDLUH
$QDO\]LQJWKH FRUUHODWLRQ RI LWHPV ZLWKLQ HDFK VFDOH LWHPLWHP  WKH FRUUHFWHG LWHPWR
WRWDO LWHPVFDOH  FRUUHODWLRQV DQG WKH LWHP VWDQGDUG GHYLDWLRQ VFRUHV DFFRPSOLVKHG WKH
VHFRQG DLP RI WKH SLORW WHVW %DVHG RQ WKLV DQDO\VLV ZH GHOHWHG RQH LWHP LQ WKH ³(PSOR\HH
SDUWLFLSDWLRQ´ VFDOH PDUNHG ZLWK DQ DVWHULVN LQ 7DEOH   7KLV LWHP ZDV DOVR WKH ORZHVW
UDQNHGLWHPLQWKHSUHYLRXVO\GHVFULEHGH[SHUWUHYLHZRIWKH³(PSOR\HHSDUWLFLSDWLRQ´VFDOH

 6XEMHFWVDQG,QVWUXPHQW$GPLQLVWUDWLRQ
7DUJHWUHVSRQGHQWVIRUWKHVWXG\ZHUHVRIWZDUHPDQDJHUVDQGTXDOLW\PDQDJHUVLQ1RUZHJLDQ
,7FRPSDQLHVGHYHORSLQJVRIWZDUH7KHVHPDQDJHUVZHUHFKRVHQVLQFHWKH\VHUYHDVDEULGJH
EHWZHHQWKHYLVLRQVRIWRSPDQDJHPHQWDQGWKHRIWHQFKDRWLFUHDOLW\RIWKHGHYHORSHUV+HQFH
WKH\DUHWKHNH\NQRZOHGJHHQJLQHHUVLQWKHLUUHVSHFWLYHFRPSDQLHV 1RQDND1RQDND
 1RQDND DQG 7DNHXFKL   7KHVH PDQDJHUV ZHUH XVHG LQ WKLV VWXG\ WR DQVZHU RQ
EHKDOI RI WKHLU UHVSHFWLYH RUJDQL]DWLRQV 7KXV WKH XQLW RI DQDO\VLV IURP ZKLFK RULJLQDO GDWD
REVHUYDWLRQV ZHUH REWDLQHG ZDV WKH VRIWZDUH RUJDQL]DWLRQ :LWKLQ WKLV VWXG\ D VRIWZDUH
RUJDQL]DWLRQLVGHILQHGDVDZKROHFRPSDQ\RUDQLQGHSHQGHQWEXVLQHVVXQLWLQVLGHDODUJHU
FRPSDQ\WKDWKDVVRIWZDUHGHYHORSPHQWDVLWVSULPDU\EXVLQHVV
7KHREMHFWLYHZDVWRGHYHORSDQLQVWUXPHQWWKDWFRXOGEHXVHGLQFRPSDQLHVRIGLIIHUHQW
VL]HV GHYHORSLQJ HLWKHU VRIWZDUH RU FRPELQHG VRIWZDUH DQG KDUGZDUH SURGXFWV 7KHUHIRUH
PDQDJHUVZHUHFKRVHQIURPFRPSDQLHVZLWKFRUSRUDWHPHPEHUVKLSHLWKHULQWKH$VVRFLDWLRQ
RI WKH 1RUZHJLDQ 6RIWZDUH ,QGXVWU\ 352))  RU WKH 1RUZHJLDQ ,7 7HFKQRORJ\ )RUXP
,78)  7DNHQ WRJHWKHU WKHVH WZR RUJDQL]DWLRQV ZHUH FRQVLGHUHG WR EH UHSUHVHQWDWLYH IRU
VRIWZDUHGHYHORSPHQWZLWKLQWKH1RUZHJLDQ,7LQGXVWU\

±±
&+$37(5

6DPSOHVL]HLVDQLPSRUWDQWFRQVLGHUDWLRQLQWKHGLVFXVVLRQRIWKHLQWHUQDOFRQVLVWHQF\RI
PHDVXUHPHQW VFDOHV 7KXV IRU WKH SXUSRVH RI FRQVWUXFWLQJ D PHDVXUHPHQW LQVWUXPHQW ZLWK
VDWLVIDFWRU\SV\FKRPHWULFSURSHUWLHVWKHLWHPDQDO\VLVLVWKHGLPHQVLRQLQJIDFWRU*HQHUDOO\
WKHLWHPDQDO\VLVWRFKRRVHDVHWRILWHPVWKDWIRUPDQLQWHUQDOO\FRQVLVWHQWVFDOHUHTXLUHVD
VDPSOHVL]HRIDERXWWRUHVSRQGHQWV 6SHFWRU %DVHGRQWKHVHJXLGHOLQHVRXU
WDUJHWVDPSOHVL]HIRUHQVXULQJDGHTXDWHLWHPDQDO\VLVZDVDPLQLPXPRIUHVSRQGHQWV
$VZHVDZLQ6HFWLRQDUDQGRPVDPSOHRIVRIWZDUHDQGTXDOLW\PDQDJHUVIURP
WKH PHPEHUVKLS OLVWV RI WKH WZR DVVRFLDWLRQV ZHUH FRQWDFWHG E\ WHOHSKRQH WR UHTXHVW
SDUWLFLSDWLRQ LQ WKH VWXG\ SULRU WR PDLOLQJ WKH TXHVWLRQQDLUHV $ WRWDO RI  VRIWZDUH DQG
TXDOLW\ PDQDJHUV UHSUHVHQWLQJ ZKROH RUJDQL]DWLRQV RU LQGHSHQGHQW EXVLQHVV XQLWV ZLWKLQ 
VRIWZDUHFRPSDQLHVFRPSOHWHGDQGUHWXUQHGWKHTXHVWLRQQDLUHZKLFK UHSUHVHQWVDQ HIIHFWLYH
UHVSRQVH UDWH RI  SHUFHQW 7KLV LV ZHOO ZLWKLQ WKH QRUP RI    SHUFHQW IRU
UHSUHVHQWDWLYHV RI RUJDQL]DWLRQV DQG PLGOHYHO PDQDJHUV VXJJHVWHG IRU DFDGHPLF VWXGLHV E\
%DUXFK  DQGFRQVLGHUDEO\KLJKHUWKDQSULRUPDLOVXUYH\VFRQGXFWHGLQWKH1RUZHJLDQ
VRIWZDUHDQG,7LQGXVWU\$GHWDLOHGGHVFULSWLRQRIWKHVDPSOHZDVSURYLGHGLQ6HFWLRQDQG
7DEOH
,QWKHQH[WWZRVHFWLRQVZHGHVFULEHWKHUHOLDELOLW\DQDO\VLVSHUIRUPHGWRUHILQHWKHPHDV
XUHPHQWLWHPVRIWKHIDFLOLWDWLQJIDFWRUVRI63,VXFFHVV

 5HOLDELOLW\RI0HDVXUHPHQW6FDOHV
5HOLDELOLW\ UHIHUV WR WKH FRQVLVWHQF\ DQG VWDELOLW\ RI D VFRUH IURP D PHDVXUHPHQW VFDOH
$QDVWDVL DQG 8UELQD   6LQFH DOO W\SHV RI UHOLDELOLW\ DUH FRQFHUQHG ZLWK WKH GHJUHH RI
FRQVLVWHQF\RUDJUHHPHQWEHWZHHQWZRLQGHSHQGHQWO\ GHULYHG VHWV RI VFRUHV WKH\ FDQ DOO EH
H[SUHVVHG LQ WHUPV RI D FRUUHODWLRQ FRHIILFLHQW (VVHQWLDOO\ WKH FRUUHODWLRQ FRHIILFLHQW U
LQGLFDWHV WKH GHJUHH RI FRUUHVSRQGHQFH RU UHODWLRQVKLS EHWZHHQ WZR VHWV RI VFRUHV 7KH
DEVROXWHYDOXHRIWKH FRUUHODWLRQFRHIILFLHQW FDQUDQJHIURPWRZLWKSHUIHFWO\ UHOL
DEOHDQGSHUIHFWO\XQUHOLDEOH $QDVWDVLDQG8UELQD 
7KHW\SHVRIUHOLDELOLW\FRPSXWHGLQSUDFWLFHDUHUHODWLYHO\IHZ7KH\DUHVXPPDUL]HGLQ
7DEOH  LQ WHUPV RI WKH GLIIHUHQW PHWKRGV IRU PHDVXULQJ UHOLDELOLW\ VHHQ LQ UHODWLRQ WR WKH
QXPEHURIVFDOHIRUPVUHTXLUHG DQGWRWKHQXPEHURIVFDOH DGPLQLVWUDWLRQVUHTXLUHG([FHSW
IRUWKHLQWHUQDOFRQVLVWHQF\PHWKRGWKHRWKHUPHWKRGVLQ7DEOHKDYHPDMRUOLPLWDWLRQVIRU
ILHOGVWXGLHVOLNHWKHRQHSUHVHQWHGLQWKLVSDSHU
7KH WHVWUHWHVW PHWKRG UHTXLUHV WZR LQGHSHQGHQW DGPLQLVWUDWLRQV RI WKH VDPH
PHDVXUHPHQW VFDOHV RQ WKH VDPH JURXS RI SHRSOH 7KH DOWHUQDWH IRUP PHWKRG UHTXLUHV WKH
DGPLQLVWUDWLRQ RI WZR HTXLYDOHQW VFDOHV WR WKH VDPH LQGLYLGXDOV ZLWK RU ZLWKRXW D WLPH
LQWHUYDO7KHVSOLWKDOYHVPHWKRGZRUNVZHOOLQILHOGVWXGLHVEHFDXVHLWUHTXLUHVRQO\DVLQJOH
DGPLQLVWUDWLRQ RI D VLQJOH IRUP RI D VFDOH +RZHYHU LWV SUREOHP LV KRZ WR VSOLW WKH WHVW WR
REWDLQ WKH PRVW QHDUO\ HTXLYDOHQW KDOYHV EHFDXVH WKH HVWLPDWH RI WKH UHOLDELOLW\ FRHIILFLHQW
WRWDOO\GHSHQGVRQKRZWKHLWHPVDUHVSOLW

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

7DEOH&ODVVLILFDWLRQRIUHOLDELOLW\HVWLPDWLRQPHWKRGV DGDSWHGIURP$QDVWDVLDQG8UELQD
 

6FDOH)RUPV5HTXLUHG
$GPLQLVWUDWLRQV 2QH 7ZR
5HTXLUHG

2QH 6SOLW+DOYHV $OWHUQDWH)RUP LPPHGLDWH


,QWHUQDO&RQVLVWHQF\
&RHIILFLHQW$OSKD
7ZR 7HVW5HWHVW $OWHUQDWH)RUP GHOD\HG

$QLQWHUQDOFRQVLVWHQF\WHFKQLTXHWKDWRYHUFRPHVWKHVKRUWFRPLQJVRIWKHVSOLWKDOIPHWKRGLV
NQRZQ DV FRHIILFLHQW DOSKD &URQEDFK   7KLV WHFKQLTXH FRPSXWHV WKH PHDQ UHOLDELOLW\
FRHIILFLHQWHVWLPDWHVIRUDOOSRVVLEOHZD\VRIVSOLWWLQJDVHWRILWHPVLQWZR+HQFHFRHIILFLHQW
DOSKD H[SUHVVHV WKH GHJUHH WR ZKLFK LWHPV LQ D VFDOH DUH KRPRJHQHRXV 7KH IRUPXOD IRU
FRHIILFLHQWDOSKDLVJLYHQDVIROORZV &URQEDFK 

§ Q · 6'  ¦ 6'
 

D ¨ ¸ 
\ L

© Q  ¹ 6'  \

,QWKLVIRUPXODDLVWKHUHOLDELOLW\FRHIILFLHQWIRUWKHZKROHVFDOHQLVWKHQXPEHURILWHPVLQ
WKHVFDOH6'  LV WKH VWDQGDUG GHYLDWLRQ RI WRWDO VFRUHV RQ WKH VFDOH DQG 6'  LV WKH VWDQGDUG
\ L

GHYLDWLRQRILQGLYLGXDOLWHPVFRUHV&RHIILFLHQWDOSKDYDULHVEHWZHHQDQG,IWKHUHLVQR
WUXHVFRUHEXWRQO\HUURULQWKHLWHPVWKHQWKHVXPRIYDULDQFHVRIWKHLQGLYLGXDOLWHPVZLOO
EHWKHVDPHDVWKHYDULDQFHRIWKHVXPDQGFRQVHTXHQWO\DOSKDZLOOEHHTXDOWR]HUR,IRQ
WKHRWKHUKDQGDOOLWHPVDUHSHUIHFWO\UHOLDEOHDQGPHDVXUHWKHVDPHFRQFHSWWKHQFRHIILFLHQW
DOSKDZLOOEHHTXDOWRRQH&RHIILFLHQWDOSKDLVDFRQVHUYDWLYHHVWLPDWHWKDWFDQEHUHJDUGHGDV
DORZHUERXQGRIUHOLDELOLW\ 1RYLFNDQG/HZLV&DUPLQHVDQG=HOOHU 
$QLQWHUQDOFRQVLVWHQF\DQDO\VLVZDVSHUIRUPHGIRUHDFKRIWKHVL[NH\IDFLOLWDWLQJIDFWRUV
RI 63, VXFFHVV XVLQJ WKH 6366 UHOLDELOLW\ SURJUDP 6366 D E  :H DQDO\]HG WKH
FRUUHODWLRQ RI LWHPV ZLWKLQ HDFK VFDOH LWHPLWHP  WKH FRUUHFWHG LWHPWRWRWDO LWHPVFDOH
FRUUHODWLRQVWKHHIIHFWVRIUHOLDELOLW\LIWKHLWHPZDVGHOHWHGDQGWKHLWHPVWDQGDUGGHYLDWLRQ
VFRUHVWRGHWHUPLQHZKLFKLWHPVZHUHFDQGLGDWHVIRUGHOHWLRQIURPWKHVFDOH&DQGLGDWHLWHPV
IRU GHOHWLRQ ZHUH LWHPV ZLWK ORZ LWHPLWHP DQG LWHPVFDOH FRUUHODWLRQV ZKLFK ZRXOG UDLVH
DOSKDLIGHOHWHG2WKHUFDQGLGDWHLWHPVZHUHLWHPVZLWKORZYDULDQFHZKLFKZRXOGKDYHORZ
H[SODQDWRU\SRZHU+RZHYHUEHIRUHDQ\LWHPZDVGHOHWHGZHPDGHDFKHFNWRHQVXUHWKDWWKH
GRPDLQFRYHUDJHRIWKHFRQVWUXFWZRXOGQRWVXIIHU
7KLVDQDO\VLVUHYHDOHGWKDWWRREWDLQVDWLVIDFWRU\YDOXHVIRUFRHIILFLHQWDOSKDZKLOHUHWDLQ
LQJWKHGRPDLQFRYHUDJHRQO\UHTXLUHGRQHLWHPWREHHOLPLQDWHGIURPWKHH[SORLWDWLRQVFDOH
PDUNHG ZLWK DQ DVWHULVN LQ 7DEOH   7DEOH  UHSRUWV WKH RULJLQDO VHWV RI PHDVXUHPHQW
LWHPV DVVRFLDWHG ZLWK WKH NH\ IDFWRUV WKH LWHPV GURSSHG IURP WKH RULJLQDO VHWV WR LQFUHDVH
DOSKDDQGWKHUHOLDELOLW\FRHIILFLHQWVIRUWKHUHVXOWLQJVFDOHV

±±
&+$37(5

7DEOH5HOLDELOLW\DQDO\VLVUHVXOWVIRUWKHNH\IDFWRUVRI63,VXFFHVV

,WHP 1XPEHU ,WHPV


.H\)DFWRUVRI63,6XFFHVV 1XPEHUV RI,WHPV 'HOHWHG $OSKD

%XVLQHVV2ULHQWDWLRQ   1RQH 


/HDGHUVKLS,QYROYHPHQW   1RQH 
(PSOR\HH3DUWLFLSDWLRQ   1RQH 
&RQFHUQIRU0HDVXUHPHQW   1RQH 
([SORLWDWLRQRIH[LVWLQJNQRZOHGJH   1R 
([SORUDWLRQRIQHZNQRZOHGJH   1RQH 

7DEOHVKRZVWKDWWKHUHOLDELOLW\FRHIILFLHQWVUDQJHGIURPWRLQGLFDWLQJWKDWVRPH
VFDOHVDUHPRUHUHOLDEOHWKDQRWKHUVDUH$VDWLVIDFWRU\OHYHORIUHOLDELOLW\ZLOOGHSHQGRQKRZ
DPHDVXUHLVEHLQJXVHG+RZHYHULQWKH HDUO\VWDJHVRILQVWUXPHQWUHVHDUFKUHOLDELOLWLHVRI
RUKLJKHUDUHFRQVLGHUHGVXIILFLHQWIRUQDUURZFRQVWUXFWV &URQEDFK1XQQDOO\DQG
%HUQVWHLQ   DQG  WR  IRU PRGHUDWHO\ EURDG FRQVWUXFWV YDQ GH 9HQ DQG )HUU\
  )XUWKHUPRUH UHOLDELOLW\ FRHIILFLHQWV RI  RU DERYH DUH FRQVLGHUHG DFFHSWDEOH WR
FRPSDUHJURXSV )LQN DQG.RVHFRII   %HVLGHV 1XQQDOO\ DQG %HUQVWHLQ   DUJXHG
WKDW LQFUHDVLQJ UHOLDELOLWLHV EH\RQG  LQ EDVLF UHVHDUFK LV RIWHQ ZDVWHIXO %DVHG RQ WKHVH
UHFRPPHQGDWLRQVRXUWDUJHW OHYHO RI PLQLPXP UHOLDELOLW\ ZDV VHW LQ WKH  WR  UDQJH
+HQFHDOOVFDOHVGHYHORSHGIRUWKHIDFLOLWDWLQJIDFWRUVLQWKLVVWXG\ZHUHMXGJHGWREHUHOLDEOH
,Q WKH QH[W VHFWLRQ ZH GHVFULEH WKH GHWDLOHG LWHP DQDO\VLV SHUIRUPHG WR HYDOXDWH WKH
DSSURSULDWHQHVVRIHDFKLWHPLQHDFKVFDOH

 'HWDLOHG,WHP$QDO\VLV
:HPDGHDGHWDLOHGLWHPDQDO\VLVEDVHGRQ1XQQDOO\¶VPHWKRGWRHYDOXDWHWKHDVVLJQPHQWRI
LWHPV WR VFDOHV 1XQQDOO\  1XQQDOO\ DQG %HUQVWHLQ   7KH PHWKRG FRQVLGHUV WKH
FRUUHODWLRQRIHDFKLWHPZLWKHDFKVFDOHLQRUGHUWRGHWHUPLQHZKHWKHUDQLWHPEHORQJVWRWKH
VFDOHDVDVVLJQHGZKHWKHULWEHORQJVWRVRPHRWKHUVFDOHRUZKHWKHULWVKRXOGEHHOLPLQDWHG
&RPSDUHG WR LWHPV ZLWK UHODWLYHO\ ORZ FRUUHODWLRQ ZLWK WRWDO VFRUHV WKRVH WKDW KDYH KLJKHU
FRUUHODWLRQZLWKWRWDOVFRUHVKDYHPRUHYDULDQFHUHODWLQJWRWKHFRPPRQIDFWRUDPRQJLWHPV
DQG WKH\ DGG PRUH WR LQVWUXPHQW UHOLDELOLW\ 1XQQDOO\   +HQFH DQ LWHP WKDW GRHV QRW
FRUUHODWHKLJKO\ZLWKDQ\RIWKHVFDOHVVKRXOGEHHOLPLQDWHG
7KHUHDUHWZR W\SHV RI LWHPVFDOH FRUUHODWLRQ FRUUHFWHG DQG XQFRUUHFWHG 7KHFRUUHFWHG
LWHPVFDOHFRUUHODWLRQFRUUHODWHVWKHLWHPEHLQJHYDOXDWHGZLWKDOOWKHVFDOHLWHPVH[FOXGLQJ
LWVHOI ZKLOH WKH XQFRUUHFWHG LWHPVFDOH FRUUHODWLRQ FRUUHODWHV WKH LWHP LQ TXHVWLRQ ZLWK WKH
HQWLUHVHWRIFDQGLGDWHLWHPVLQFOXGLQJLWVHOI$OWKRXJKWKHXQFRUUHFWHGLWHPVFDOHFRUUHODWLRQ
PDNHV JRRG FRQFHSWXDO VHQVH WKH LWHP¶V LQFOXVLRQ LQ WKH VFDOH FDQ LQIODWH WKH FRUUHODWLRQ
FRHIILFLHQWWKXV PDNLQJ LW VSXULRXVO\ KLJK 7KH IHZHU WKH QXPEHU RI LWHPV LQ WKH VFDOH WKH
ELJJHUWKHGLIIHUHQFHWKDWWKHLQFOXVLRQRUH[FOXVLRQRIWKHLWHPXQGHUH[DPLQDWLRQZLOOPDNH
7KHUHIRUHZHIROORZHGWKHJHQHUDODGYLFHRIH[DPLQLQJWKHFRUUHFWHGLWHPVFDOHFRUUHODWLRQV
UDWKHUWKDQWKHXQFRUUHFWHG 'H9HOOLV1XQQDOO\DQG%HUQVWHLQ 

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

$IWHU HOLPLQDWLQJ WKH LWHPV LQ WKH SUHYLRXV VWHSV WKH UHPDLQLQJ LWHPV ZHUH FRUUHODWHG
ZLWK WKH WRWDO VFRUHV RI HDFK VFDOH H[FOXGLQJ LWVHOI 7KH FRUUHFWHG LWHPVFDOH FRUUHODWLRQ
PDWUL[IRUWKHIDFLOLWDWLQJIDFWRUVRI63,VXFFHVVLQ7DEOHVKRZVWKDWDOOLWHPVKDYHKLJK
FRUUHODWLRQV ZLWK WKH VFDOHV WR ZKLFK WKH\ ZHUH RULJLQDOO\ DVVLJQHG )XUWKHUPRUH DOO
FRUUHODWLRQVDUHDERYHWKHFXWRIIRIUHFRPPHQGHGE\1XQQDOO\DQG%HUQVWHLQ  
:LWKWKHH[FHSWLRQ RI WKH ³IHHGEDFN´ LWHP LWHP QR   DOO LWHPVFDOH FRUUHODWLRQV DUH
VXEVWDQWLDOO\KLJKHUWKDQWKHFRUUHVSRQGLQJFRUUHODWLRQVZLWKDOORWKHUVFDOHV+RZHYHUEDVHG
RQWKHOLWHUDWXUHUHYLHZWKHH[SHUWUHYLHZDQGRXU RZQ H[SHULHQFH ZH GHFLGHG WR NHHS WKH
IHHGEDFNLWHPZLWKLQWKHPHDVXUHPHQWVFDOHDVRULJLQDOO\DVVLJQHG7KHUHDUHWZRUHDVRQVIRU
WKLV )LUVW IHHGEDFN LV JHQHUDOO\ FRQVLGHUHG DV EHLQJ RI XWPRVW LPSRUWDQFH LQ DOO 63, ZRUN
DQGVHFRQGZHUHJDUGIHHGEDFNDVFRQFHSWXDOO\FORVHUWR³&RQFHUQIRU0HDVXUHPHQW´UDWKHU
WKDQ WR ³([SORLWDWLRQ RI ([LVWLQJ .QRZOHGJH´ 7KHUHIRUH ZH FRQFOXGHG WKDW DOO LWHPV KDG
EHHQDVVLJQHGWRWKHDSSURSULDWHVFDOHDQGWKDWQRDGGLWLRQDOLWHPVVKRXOGEHGHOHWHG

 9DOLGLW\RI0HDVXUHPHQW6FDOHV
)RUDVFDOHWREHYDOLGLWPXVWDOVREHUHOLDEOH9DOLGLW\LVGLIIHUHQWLDWHGIURPUHOLDELOLW\LQWKDW
WKHIRUPHUUHODWHVWRDFFXUDF\ZKLOHWKHODWWHUUHODWHVWRFRQVLVWHQF\$PHDVXUHPHQWVFDOHLV
YDOLG LI LW GRHV ZKDW LW LV VXSSRVHG WR GR DQG PHDVXUHV ZKDW LW LV VXSSRVHG WR PHDVXUH
&URQEDFK$QDVWDVLDQG8UELQD ,IDVFDOHLVQRWYDOLGLWLVRIOLWWOHXVHEHFDXVH
LWLVQRWPHDVXULQJ RU GRLQJ ZKDW LW LV VXSSRVHG WR EH GRLQJ 7KUHH NLQGV RI YDOLGLW\ DUH RI
VSHFLDOFRQFHUQIRUWKLVVWXG\7KHVHYDOLGLW\FRQFHUQVDUHRXWOLQHGLQ7DEOHDQGGLVFXVVHG
QH[W

 &RQWHQWYDOLGLW\
&RQWHQWYDOLGLW\KDVWRGRZLWKWKHGHJUHHWRZKLFKWKHVFDOHLWHPVUHSUHVHQW WKH GRPDLQ RI
WKHFRQFHSWXQGHUVWXG\(VVHQWLDOO\SURFHGXUHVIRUFRQWHQWYDOLGDWLRQLQYROYHWKHV\VWHPDWLF
H[DPLQDWLRQRIWKHLQVWUXPHQWFRQWHQWWRGHWHUPLQHLILWFRYHUVDUHSUHVHQWDWLYHVDPSOHRIWKH
EHKDYLRUGRPDLQWREHPHDVXUHG 'DYLV &RQWHQWYDOLGLW\LVEXLOWLQWRDWHVWIURPWKH
RXWVHWWKURXJKWKHFKRLFHRIDSSURSULDWHLWHPV $QDVWDVLDQG8UELQD 

7DEOH7KUHHEDVLFW\SHVRIYDOLGLW\LQPHDVXUHPHQWLQVWUXPHQWV

7\SHVRI9DOLGLW\ 'HILQLWLRQV

&RQWHQWYDOLGLW\ 7KHGHJUHHWRZKLFKWKHLWHPVLQWKHPHDVXUHPHQWLQVWUXPHQW
UHSUHVHQWWKHGRPDLQRUXQLYHUVHRIWKHSURFHVVHVXQGHUVWXG\
&RQVWUXFWYDOLGLW\ 7KHGHJUHHWRZKLFKWKHPHDVXUHPHQWLQVWUXPHQWUHSUHVHQWVDQG
DFWVOLNHWKHSURFHVVHVEHLQJPHDVXUHG
&ULWHULRQYDOLGLW\ 7KHGHJUHHWRZKLFKWKHPHDVXUHPHQWLQVWUXPHQWLVDEOHWRSUHGLFW
DYDULDEOHWKDWLVGHVLJQDWHGDFULWHULRQ

±±
&+$37(5

7DEOH&RUUHFWHGLWHPVFDOHFRUUHODWLRQPDWUL[

,WHP 6FDOH
.H\)DFWRUVRI63,6XFFHVV 1R      

%XVLQHVV2ULHQWDWLRQ       


6FDOH       
      
      
      

/HDGHUVKLS,QYROYHPHQW       


6FDOH       
      
      
      

(PSOR\HH3DUWLFLSDWLRQ       


6FDOH       
      
      
      
      
      

&RQFHUQIRU0HDVXUHPHQW       


6FDOH       
      
      
      
      

([SORLWDWLRQRIH[LVWLQJNQRZOHGJH       


6FDOH       
      
      
      

([SORUDWLRQRIQHZNQRZOHGJH       


6FDOH       
      
      
      
      
      
      

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

2XU SURFHGXUH IRU LQVWUXPHQW GHYHORSPHQW IROORZHG WKH JHQHUDO UHFRPPHQGDWLRQV RI


&URQEDFK  DQG6WUDXE  DQGLQFOXGHG

  $QH[KDXVWLYHVHDUFKRIWKHOLWHUDWXUHIRUDOOSRVVLEOHLWHPVWREHLQFOXGHGLQWKHVFDOHV
  $QH[SORUDWRU\VWXG\LQUHSUHVHQWDWLYHFRPSDQLHVWRILQGSRVVLEOHLWHPVDQGVFDOHV
  5HYLHZ RI WKH SURSRVHG VFDOHV E\ H[SHUWV RI ERWK SV\FKRORJLFDO WHVWLQJ DQG 63, 7KHUH
ZHUHDOVRDVNHGIRUVXJJHVWLRQVDVWRDQ\DGGLWLRQVRUGHOHWLRQVWRWKHVFDOHV
  3LORW WHVW RI WKH VFDOHV RQ D VHW RI UHVSRQGHQWV VLPLODU WR WKH WDUJHW SRSXODWLRQ 7KHVH
UHVSRQGHQWV ZHUH DOVR HQFRXUDJHG WR LQFOXGH VXJJHVWLRQV DQG FULWLFLVPV WR WKH FRQWHQWV
DQGZRUGLQJRIWKHVFDOHV

+HQFHZHDUJXHWKDWRXUVL[PHDVXUHPHQWVFDOHVUHSUHVHQWLQJWKHIDFLOLWDWLQJIDFWRUVRI63,
VXFFHVV GHYHORSHG LQ WKLV VWXG\ KDYH FRQWHQW YDOLGLW\ VLQFH VHOHFWLRQ RI PHDVXUHPHQW LWHPV
ZDVEDVHGRQJHQHUDOO\DFFHSWHGSURFHGXUHVWRREWDLQFRQWHQWYDOLGDWLRQ

 &RQVWUXFWYDOLGLW\
&RQVWUXFW YDOLGLW\ LV DQ RSHUDWLRQDO FRQFHSW WKDW H[DPLQHV ZKHWKHU WKH PHDVXUHPHQW VFDOHV
UHSUHVHQWDQGDFWOLNHWKHDWWULEXWHVEHLQJPHDVXUHG &URQEDFK1XQQDOO\DQG%HUQVWHLQ
 $VVXPLQJWKDWWKHWRWDOVFRUHRIDVFDOHLVYDOLGWKHH[WHQWWRZKLFKDQLQGLYLGXDOLWHP
PHDVXUHV WKH VDPH WKLQJ DV WKH WRWDO VFRUH LV DQ LQGLFDWRU RI WKH YDOLGLW\ RI WKDW LWHP
)XUWKHUPRUH IDFWRU DQDO\VLV LV FRQVLGHUHG WR EH ³D SRZHUIXO DQG LQGLVSHQVDEOH PHWKRG RI
FRQVWUXFW YDOLGDWLRQ´ .HUOLQJHU   7KXV LQ DGGLWLRQ WR LWHPWRWDO FRUUHODWLRQV WKH
FRQVWUXFW YDOLGLW\ RI WKH VFDOHV LQ WKH PHDVXUHPHQW LQVWUXPHQW ZDV DVVHVVHG XVLQJ IDFWRU
DQDO\VLV
$OWKRXJK PDQ\ LQYHVWLJDWRUV DGYRFDWH WKH FRQVWUXFWLRQ RI PHDVXUHPHQW LQVWUXPHQWV
WKURXJKIDFWRUDQDO\VLV6SHFWRU  DQG1XQQDOO\DQG%HUQVWHLQ  DUJXHGWKDWIDFWRU
DQDO\VLVVKRXOGUDWKHUEHXVHGDIWHUWKHLQVWUXPHQWLVFRQVWUXFWHG7KHPDLQUHDVRQIRUWKLVLV
WKDWWKHFRQVWUXFWLRQRIDPHDVXUHPHQWLQVWUXPHQWVKRXOGEHJXLGHGE\ WKHRULHV UDWKHU WKDQ
E\ UDQGRP HIIRUWV WR UHODWH WKLQJV WR RQH DQRWKHU WKURXJK ³VKRWJXQ VWDWLVWLFV´ 7KLV ILWV WKH
DSSURDFKLQWKLVUHVHDUFKZKHUHWKHFRQVWUXFWVRILQWHUHVWDUHEDVHGRQ DVXEVWDQWLDOERG\RI
SULRUUHVHDUFKDQGKDYHEHHQH[SOLFDWHGSULRUWRDQ\LWHPGHYHORSPHQW
7KH FRQVWUXFW YDOLGLW\ RI WKH VL[ PHDVXUHPHQW VFDOHV ZDV HYDOXDWHG E\ DQDO\]LQJ WKH
LWHPVRIHDFKRIWKHVFDOHVXVLQJSULQFLSDOFRPSRQHQWVDQDO\VLV+RZHYHUWKLVDQDO\VLVDVDOO
IDFWRUDQDO\VLVSURFHGXUHV LQFOXGHV VXEMHFWLYH MXGJHPHQW ZKHQ LW FRPHV WR GHWHUPLQLQJ WKH
QXPEHURIIDFWRUVDQGWKHLULQWHUSUHWDWLRQ 6SHFWRU 
6HYHUDOJXLGHOLQHVKDYHEHHQGHYHORSHGWRDVVLVWLQGHFLGLQJKRZPDQ\IDFWRUVWRH[WUDFW
7KH WZR PRVW ZLGHO\ XVHG FULWHULD DUH .DLVHU¶V    HLJHQYDOXH UXOH DQG &DWWHOO¶V
  VFUHH WHVW 7KH HLJHQYDOXH UXOH LV EDVHG RQ UHWDLQLQJ RQO\ IDFWRUV WKDW H[SODLQ PRUH
YDULDQFHWKDQWKHDYHUDJHDPRXQWH[SODLQHGE\RQHRIWKHRULJLQDOLWHPV LHFRPSRQHQWVZLWK
HLJHQYDOXH !  +RZHYHU ZKHQ =ZLFN DQG 9HOLFHU   H[DPLQHG WKH HIIHFW RI GLIIHUHQW
FULWHULDIRUH[WUDFWLQJIDFWRUVWKH\IRXQGWKDW.DLVHU¶VPHWKRGWHQGHGWRVHYHUHO\RYHUHVWLPDWH
WKH QXPEHU RI FRPSRQHQWV )XUWKHUPRUH &OLII   FDOOHG WKH UDWLRQDO EHKLQG WKH
HLJHQYDOXHUXOHLQWRTXHVWLRQDQGGHVSLWHLWVZLGHXVH1XQQDOO\DQG%HUQVWHLQ  GLGQRW
UHFRPPHQGLWEHFDXVHLWWHQGVWRVXJJHVWWRRPDQ\IDFWRUV

±±
&+$37(5

7KH VFUHH WHVW LV EDVHG RQ D VXEMHFWLYH H[DPLQDWLRQ RI WKH SORW RI HLJHQYDOXHV IRU HDFK
VXFFHVVLYH IDFWRU ORRNLQJ IRU DQ ³HOERZ´ LQ WKH SORW &DWWHOO¶V JXLGHOLQHV FDOO IRU UHWDLQLQJ
WKRVHIDFWRUVDERYHWKH³HOERZ´DQGUHMHFWLQJWKRVHEHORZLW
(DFKLWHPDOVRKDVDILQDOORDGLQJRQHDFKIDFWRU7KHVHORDGLQJVDUHWKHFRUUHODWLRQVEH
WZHHQLWHPVDQGWKHIDFWRUVWKXVWKHVTXDUHRIDORDGLQJFDQEHVHHQDVWKHDPRXQWRIYDUL
DQFH FRPPRQ WR ERWK &RPUH\   VXJJHVWHG WKDW ORDGLQJV LQ H[FHVV RI  FRXOG EH
FRQVLGHUHGIDLUWKRVHJUHDWHUWKDQDVJRRGWKRVHRIYHU\JRRGDQGWKRVHRIDV
H[FHOOHQW)RUDVWXG\ZLWKDUHODWLYHO\VPDOOQXPEHURIFDVHVWKHTXDOLW\RIDIDFWRUPXVWEH
DVVHVVHGERWKLQWHUPVRIWKHQXPEHUDQGVL]HRILWVORDGLQJV6WHYHQV  VXJJHVWHGWKDWD
UHOLDEOH IDFWRU PXVW KDYH IRXU RU PRUH ORDGLQJV RI DW OHDVW  ZKHQ WKH QXPEHU RI FDVHV LV
EHORZ
:H XVHG D FRPELQDWLRQ RI HLJHQYDOXHV FXWRII SRLQWV RI WKH VFUHH SORWV DQG IDFWRU
ORDGLQJVDVDJXLGHIRULQWHUSUHWLQJWKHGLPHQVLRQDOLW\RIWKHVFDOHV)XUWKHUPRUHHDFKVFDOH
ZDV DVVXPHG WR EH D VHSDUDWH FRQVWUXFW 7DEOH  VKRZV WKH HLJHQYDOXHV DQG LWHP ORDGLQJ
UDQJHVIRUHDFKVFDOH$QDO\VLVRIWKHHLJHQYDOXHVVKRZHGWKDWILYHRIWKHVL[VFDOHVIRUPHGD
VLQJOH IDFWRU ,Q WKH FDVH RI WKH H[SORUDWLRQ VFDOH WZR FRPSRQHQWV VHHPHG WR HPHUJH ZLWK
HLJHQYDOXHVJUHDWHUWKDQ+RZHYHUWKHHLJHQYDOXHRIWKHVHFRQGIDFWRUZDVRQO\VOLJKWO\
DERYHWKLVWKUHVKROG  
1H[WZHH[DPLQHGERWKWKHVFUHHSORWDQGWKHLWHPORDGLQJVLQRUGHUWRIXUWKHULQWHUSUHW
WKHGLPHQVLRQDOLW\RIWKHH[SORUDWLRQVFDOH7KHVFUHHSORWVKRZHGDFOHDUEUHDNDIWHUWKHILUVW
FRPSRQHQW VHH)LJXUH )XUWKHUPRUHDOOLWHPORDGLQJVIRUWKLVFRPSRQHQWZHUHJUHDWHU
WKDQ  7KH FRPELQHG UHVXOW RI WKHVH DQDO\VHV LQGLFDWHV IDLUO\ VWURQJ VXSSRUW IRU WKH
K\SRWKHVLVWKDWWKHH[SORUDWLRQVFDOHFDQEHFRQVLGHUHGDVRQHFRQVWUXFW


(LJHQYDOXH


       
&RPSRQHQW1XPEHU

)LJXUH6FUHHSORWIRUWKH([SORUDWLRQVFDOH

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

7DEOH6XPPDU\RIIDFWRUPDWULFHVIRUHDFKFRQVWUXFW

,WHP/RDGLQJ5DQJH ,WHPVZLWK
6FDOH (LJHQYDOXH IRU&RPSRQHQW /RDGLQJV!

%XVLQHVVRULHQWDWLRQ  WR  RXWRI


/HDGHUVKLSLQYROYHPHQW  WR  RXWRI
3DUWLFLSDWLRQ  WR  RXWRI
0HDVXUHPHQW  WR  RXWRI
([SORLWDWLRQ  WR  RXWRI
([SORUDWLRQ  WR  RXWRI

,QEULHIWKHUHVXOWVRIWKHIDFWRUDQDO\VLVVXSSRUWWKHYLHZWKDWHDFKRIWKHPHDVXUHPHQWVFDOHV
LQWKHTXHVWLRQQDLUHKDVDKLJKGHJUHHRIXQLGLPHQVLRQDOLW\+HQFHWKHUHLVWHQWDWLYHHYLGHQFH
RIFRQVWUXFWYDOLGLW\IRUDOOVL[VFDOHV

 &ULWHULRQYDOLGLW\
&ULWHULRQUHODWHGYDOLGLW\VRPHWLPHVFDOOHGH[WHUQDOYDOLGLW\LVFRQFHUQHGZLWKWKHGHJUHHWR
ZKLFKWKHVFDOHVXQGHUVWXG\DUHUHODWHGWRDQLQGHSHQGHQWPHDVXUHRIWKHUHOHYDQWFULWHULRQ
$QDVWDVLDQG8UELQD 
2UJDQL]DWLRQDOSHUIRUPDQFHLVDVZHDUJXHGLQ6HFWLRQWKHXOWLPDWHFULWHULRQIRUDQ\
63, DFWLYLW\ 7KH VL[ IDFLOLWDWLQJ IDFWRUV WKXV KDYH FULWHULRQUHODWHG YDOLGLW\ LI WDNHQ
FROOHFWLYHO\ WKH\ DUH KLJKO\ DQG SRVLWLYHO\ FRUUHODWHG ZLWK SHUIRUPDQFH LQ D VRIWZDUH
RUJDQL]DWLRQ 3HUIRUPDQFH LV D FRPSOH[ FRQVWUXFW KRZHYHU UHIOHFWLQJ WKH FULWHULD DQG
VWDQGDUGVXVHGE\GHFLVLRQPDNHUVWRDVVHVVWKHIXQFWLRQLQJRIDVRIWZDUHRUJDQL]DWLRQ7KDW
LVSHUIRUPDQFHLVDYDOXHMXGJHPHQWRQWKHUHVXOWVGHVLUHGIURPDQRUJDQL]DWLRQ YDQGH9HQ
DQG)HUU\ 
2EMHFWLYHPHDVXUHVRISHUIRUPDQFHDUHSUREOHPDWLFLQWKH,6ILHOG +HQGHUVRQDQG/HH
  2EMHFWLYH SURGXFWLYLW\ PHDVXUHV ± VXFK DV OLQHV RI FRGH SHU SHUVRQ SHU PRQWK ± DUH
RIWHQ XQDYDLODEOH DUH VXEMHFW WR PDQLSXODWLRQ DQG PD\ UHIOHFW WKH VSHFLILF DFFRXQWLQJ
SUDFWLFHV RI D VLWH UDWKHU WKDQ ³DFWXDO´ SHUIRUPDQFH )XUWKHU XVLQJ REMHFWLYH PHDVXUHV
DVVXPHV FRPSDUDELOLW\ DFURVV VRIWZDUH SURMHFWV GRHV QRW FRQWURO IRU GLIIHUHQFHV EHWZHHQ
SURMHFWV RU XQLTXH VLWXDWLRQDO FRQVWUDLQWV DQG WKXV UDLVHV D QHZ VHW RI PHWKRGRORJLFDO DQG
PHDVXUHPHQWLVVXHV
,QYHVWPHQWVLQ63,VKDUHPDQ\IHDWXUHVZLWKUHVHDUFKDQGGHYHORSPHQWLQYHVWPHQWVIUH
TXHQWO\ KDYLQJ FRUSRUDWHZLGH LQWDQJLEOH DQG ORQJ ODVWLQJ HIIHFWV 7KHUHIRUH TXDQWLWDWLYH
PHDVXUHV DQG ILQDQFLDO HVWLPDWHV WHQG WR EH GLIILFXOW WR REWDLQ DQG HDV\ WR PDQLSXODWH 7KH
PDLQGLVWLQFWLRQEHWZHHQWKHREMHFWLYLW\RIGLIIHUHQWVXFFHVVPHDVXUHVLVQRWDPDWWHURIXVLQJ
TXDQWLWDWLYH RU ILQDQFLDO ILJXUHV DV RSSRVHG WR GHYHORSHUV¶ RU PDQDJHUV¶ SHUFHSWLRQV )RU
H[DPSOHWKHUHWXUQRQLQYHVWPHQWQHWSUHVHQWYDOXHDQGSD\EDFNSHULRGVDUHRIWHQUHJDUGHG
DVREMHFWLYHPHDVXUHV+RZHYHUEHFDXVHRIWKHPDQ\GLIILFXOWLHVLQSUHGLFWLQJDQGDVVHVVLQJ
FRVWV DQG HVSHFLDOO\ EHQHILWV VXFK LQYHVWPHQW DQDO\VHV DUH XVXDOO\ EDVHG RQ H[SHUWV¶
VXEMHFWLYHMXGJHPHQW 6DDULQHQ=DKUDQ ,QPDQ\FDVHVWKHVXEMHFWLYHPHDVXUHV

±±
&+$37(5

PD\EHEHWWHUWKDQWKHILQDQFLDOPHDVXUHV 6DDULQHQ 7KLVLVPDLQO\GXHWRFRPSOLFDWHG


FRQWLQJHQFLHVWKDWDUHEHVWMXGJHGE\WKRVHZKRDUHUHVSRQVLEOHIRUWKHREMHFWRIHYDOXDWLRQ
)XUWKHUPRUH YDOXH MXGJHPHQWV RQ GHVLUDEOH SHUIRUPDQFH RXWFRPHV RIWHQ FKDQJH RYHU
WLPH LQ D ZD\ WKDW WKUHDWHQV WKH DSSOLHG UHOHYDQFH RI ORQJLWXGLQDO DVVHVVPHQWV RI
RUJDQL]DWLRQV )LQDOO\ GHFLVLRQ PDNHUV RIWHQ GLVDJUHH RQ D JLYHQ VHW RI FULWHULD WR HYDOXDWH
RUJDQL]DWLRQDO SHUIRUPDQFH +RZHYHU SHUIRUPDQFH PHDVXUHPHQW GRHV QRW UHTXLUH D
FRQVHQVXVRQHIIHFWLYHQHVVJRDOVFULWHULDDQGVWDQGDUGV$QRUJDQL]DWLRQDODVVHVVPHQWVLPSO\
UHTXLUHV WKDW WKH GHILQLWLRQV RI SHUIRUPDQFH EH PDGH H[SOLFLW DQG WKDW WKH UHVHDUFKHU
GHWHUPLQHVZKRVHYDOXHMXGJHPHQWVDQGFULWHULDZLOOEHRSHUDWLRQDOL]HGDQGPHDVXUHG YDQGH
9HQDQG)HUU\ 
%DVHGRQWKHSUHFHGLQJGLVFXVVLRQDQGWKDWVXEMHFWLYHSHUIRUPDQFHPHDVXUHVDUHZLGHO\
XVHGDQGDFFHSWHGLQRUJDQL]DWLRQDOUHVHDUFK /DZUHQFHDQG/RUVFK3RZHOO ZH
FRQVLGHUHGDVXEMHFWLYHHYDOXDWLRQDSSURDFKZLWKPXOWLLWHPFRQVWUXFWVDVDQDSSURSULDWHZD\
WR DVVHVV RUJDQL]DWLRQDO SHUIRUPDQFH )XUWKHUPRUH SUHYLRXV UHVHDUFK KDV VKRZQ WKDW
VXEMHFWLYH DVVHVVPHQWV RI SHUIRUPDQFH SURYLGHG E\ NQRZOHGJHDEOH PDQDJHUV KDYH D KLJK
OHYHO RI FRQYHUJHQFH ZLWK RWKHU REMHFWLYH PHDVXUHV RI SHUIRUPDQFH 9HQNDWUDPDQ DQG
5DPDQXMDP 
*HQHUDOO\ WKH LQWHQW RI 63, LV LQFUHDVHG FRPSHWLWLYH DGYDQWDJH WKURXJK LPSURYHG
VRIWZDUHTXDOLW\LQFUHDVHGSURGXFWLYLW\DQGGHFUHDVHGOHDGWLPHIRUSURGXFWGHYHORSPHQW,Q
RWKHUZRUGV63,VKRXOGOHDGWR³EHWWHUIDVWHU>DQG@FKHDSHUVRIWZDUHGHYHORSPHQW´ 6DQGHUV
  %DVHG RQ WKHVH JHQHUDO UHFRPPHQGDWLRQV ZH RSHUDWLRQDOL]HG DQG PHDVXUHG 63,
VXFFHVVDORQJWKHWZRGLPHQVLRQVGHILQHGLQWKHG\QDPLFPRGHORI63,GHYHORSHGLQ&KDSWHU
 EDVHG RQ WZR PXOWLLWHP PHDVXUHV 7KXV HDFK PDQDJHU ZDV DVNHG WR UDWH RQ SRLQW
ELSRODU/LNHUWVFDOHV  WKHOHYHORISHUFHLYHG63,VXFFHVVDQG  WKHSHUIRUPDQFHRIWKHLU
RUJDQL]DWLRQIRUWKHSDVWWKUHH\HDUVZLWKUHVSHFWWRFRVWUHGXFWLRQF\FOHWLPHUHGXFWLRQDQG
FXVWRPHUVDWLVIDFWLRQ7KLVLVVLPLODUWRWKHDSSURDFKXVHGE\7HQJHWDO  WRPHDVXUH
UHHQJLQHHULQJ SURMHFW VXFFHVV DQG WKH UHODWLRQVKLS EHWZHHQ FKDUDFWHULVWLFV RI UHHQJLQHHULQJ
SURMHFWVDQGLPSOHPHQWDWLRQVXFFHVV
7ZR LWHPV ZHUH XVHG WR PHDVXUH WKH OHYHO RI SHUFHLYHG 63, VXFFHVV ZKLOH WKUHH LWHPV
ZHUHXVHGWRPHDVXUHWKHOHYHORIRUJDQL]DWLRQDOSHUIRUPDQFH$VIRUWKHIDFLOLWDWLQJIDFWRUV
DOO LWHPV ZHUH ZULWWHQ VSHFLILFDOO\ IRU WKLV VWXG\ 7KHVH LWHPV DUH LQFOXGHG LQ WKH YDOLGDWHG
PHDVXUHPHQWLQVWUXPHQWLQ$SSHQGL[(7KHUDWLQJVIRUWKHWZRSHUIRUPDQFHGLPHQVLRQVZHUH
DYHUDJHG WR IRUPDVLQJOHPHDVXUHRIRYHUDOO63, VXFFHVV 7KH UHOLDELOLW\ FRHIILFLHQW IRU WKH
ILYHLWHPVRIWKH63,VXFFHVVPHDVXUHZDV
7KH FULWHULRQ YDOLGLW\ RI WKH PHDVXUHPHQW LQVWUXPHQW ZDV IRXQG E\ FRPSXWLQJ WKH
PXOWLSOHFRUUHODWLRQ 5 EHWZHHQ63,VXFFHVVDQGWKHPHDVXUHVRIWKHVL[IDFLOLWDWLQJIDFWRUV
7KH PXOWLSOH FRUUHODWLRQ FRHIILFLHQW ZDV  DQG WKH DGMXVWHG 5VTXDUH ZDV  WKXV H[
SODLQLQJSHUFHQWRIWKHYDULDWLRQLQ63,VXFFHVV7KXVWDNHQWRJHWKHUWKHVL[IDFWRUVKDYHD
KLJKGHJUHHRIFULWHULRQUHODWHGYDOLGLW\,QWKHQH[WFKDSWHUZHH[DPLQHWKHMRLQWFRQWULEXWLRQ
RIWKHLQGHSHQGHQWYDULDEOHVWRWKHH[SODQDWLRQRI63,VXFFHVVLQPRUHGHWDLO

±±
$1,167580(17)250($685,1*7+(.(<)$&72562)68&&(66,163,

 &KDSWHU6XPPDU\
,Q WKLV FKDSWHU ZH KDYH GHVFULEHG DQ H[WHQVLYH LQYHVWLJDWLRQ WR WKH GHYHORSPHQW RI DQ
LQVWUXPHQWIRUPHDVXULQJWKHNH\IDFWRUVRIVXFFHVVLQ63,7KHPDMRUSUHPLVHZDVWKDWLWLV
FULWLFDOWRXQGHUVWDQGWKHLPSRUWDQWIDFWRUVDIIHFWLQJ63,VXFFHVVLQRUGHUWRLPSURYHVRIWZDUH
SURFHVVHV +RZHYHU FHQWUDO WR WKLV XQGHUVWDQGLQJ LV WKH GHYHORSPHQW RI DQ LQVWUXPHQW IRU
PHDVXULQJWKHVHIDFWRUV
7KH UHVXOWV RIUHOLDELOLW\DQGYDOLGLW\DQDO\VHV VKRZHG WKDW WKH LQVWUXPHQW KDV GHVLUDEOH
SV\FKRPHWULF SURSHUWLHV 7KLV LV JRRG IRU DQ LQVWUXPHQW WKDW LV FRPSRVHG HQWLUHO\ RI QHZ
VFDOHV SDUWLFXODUO\ VLQFH WKH VFDOHV GR QRW FRQWDLQ ODUJH QXPEHUV RI LWHPV +RZHYHU
GHPRQVWUDWLQJYDOLGLW\LVDFRQWLQXRXVSURFHVVDQGYDOLGLW\LVDPDWWHURIGHJUHHUDWKHUWKDQ
DQDOORUQRQHSURSHUW\0RUHRYHURQHYDOLGDWHVWKHXVHWRZKLFKDPHDVXUHPHQWLQVWUXPHQW
LV SXW UDWKHU WKDQ WKH LQVWUXPHQW LWVHOI 1XQQDOO\ DQG %HUQVWHLQ   &RQVHTXHQWO\ LW LV
RQO\WKURXJKWKHDFFXPXODWLRQRIGDWDIURPPXOWLSOHVWXGLHVRILQVWUXPHQWXVDJHWKDWZHFDQ
PDNHVWURQJFODLPVRIYDOLGLW\
+HQFH DV WKH EDVLV IRU WHVWLQJ WKH K\SRWKHVHV GHYHORSHG LQ &KDSWHU  ZH KDYH DQ
HPSLULFDOO\ GHULYHG PRGHO RI 63, VXFFHVV DV ZHOO DV D YDOLGDWHG DQG UHOLDEOH LQVWUXPHQW WR
PHDVXUH WKH NH\ IDFWRUV RI VXFFHVV LQ 63, :H DUH WKXV QRW RQO\ DEOH WR LGHQWLI\ WKH NH\
IDFWRUV IRU VXFFHVV LQ 63, EXW DOVR WR PHDVXUH WKH VWUHQJWK RI WKHLU UHODWLRQVKLSV ZLWK 63,
VXFFHVVDVZHOODV WKHLU MRLQW FRQWULEXWLRQ DQG UHODWLYH LPSRUWDQFH WR WKH H[SODQDWLRQ RI 63,
VXFFHVV
,Q WKH QH[W FKDSWHU ZH ZLOO XVH WKLV LQVWUXPHQW WR WHVW WKH K\SRWKHVHV DQG H[SORUH WKH
UHODWLRQVKLSVWKDWZHUHSURSRVHGLQ&KDSWHU

±±
&+$37(5 
(PSLULFDO5HVXOWV

³:KRHYHUGHVLUHVFRQVWDQWVXFFHVVPXVWFKDQJHKLVFRQGXFWZLWKWKHWLPHV´
±1LFFROz0DFKLDYHOOL

,Q WKH SUHFHGLQJ FKDSWHU ZH GHVFULEHG WKH GHYHORSPHQW RI DQ LQVWUXPHQW ZLWK VDWLVIDFWRU\
SV\FKRPHWULFSURSHUWLHVIRUPHDVXULQJWKHNH\IDFWRUVRIVXFFHVVLQ63,
,QWKLVFKDSWHUZHUHSRUWRQWKHUHVXOWVRIWKHPDLQVWXG\RIXVLQJWKLVLQVWUXPHQWWRWHVW
WKH K\SRWKHVHV UHJDUGLQJ WKH NH\ IDFWRUV IRU VXFFHVV LQ 63, DQG H[SORUH WKH UHODWLRQVKLSV
EHWZHHQ WKH VXFFHVV IDFWRUV DQG WKH FRQWH[WXDO YDULDEOHV )LUVW KRZHYHU ZH UHSRUW RQ WKH
WKUHH VXSSOHPHQWDU\ FDVH VWXGLHV UHJDUGLQJ $  WKH H[SHULHQFH ZLWK JRDORULHQWHG PHDVXUH
PHQW % WKHH[SHULHQFHZLWKSDUWLFLSDWLYHVRIWZDUHSURFHVVDVVHVVPHQWDQG & WKHXWLOLW\RI
IRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJHDQGH[SHULHQFH

 &DVH6WXG\$([SHULHQFHZLWK*RDO2ULHQWHG
0HDVXUHPHQW
,QWKLVVHFWLRQZHGHVFULEHRXUH[SHULHQFHVRQWKHDSSOLFDWLRQRIJRDORULHQWHGPHDVXUHPHQW
XVLQJDPLDQG*40DVWKHEDVLVIRUV\VWHPDWLFTXDOLW\LPSURYHPHQWVLQWHOHFRPPXQLFDWLRQV
VRIWZDUHGHYHORSPHQWZLWKLQ1HUD$6 (66,SURMHFW7(/0(7 

 'HILQLQJ*40JRDOV
7KH LPSURYHPHQW H[SHULPHQW VWDUWHG ZLWK WKH GHFRPSRVLWLRQ RI SULPDU\ JRDOV IURP WKH
FRPSDQ\¶V EXVLQHVV VWUDWHJ\ LQWR VXEJRDOV DQG VXEVHTXHQWO\ LQWR *40 JRDOV )RXU JRDOV
ZHUH IRUPXODWHG DFFRUGLQJ WR WKH *40 WHPSODWH DQG UDQNHG DFFRUGLQJ WR WKHLU LPSRUWDQFH
7KLVOHGWRWKHLGHQWLILFDWLRQRIDVHWRIPRUHWKDQSULPLWLYHPHWULFV,WVRRQEHFDPHFOHDU
WKDWWKLVZRXOGOHDGWRODUJHFRVWVIRUGDWDFROOHFWLRQDQGDQDO\VLV ,Q DGGLWLRQLWFRXOGEHD
FRQVLGHUDEOHH[WUDORDGRQWKHSHUVRQQHOLQWKHEDVHOLQHSURMHFW


7KHUHVXOWVUHSRUWHGLQWKLVVHFWLRQDUHEDVHGRQ '\EnHWDO6WnOKDQHHWDO 

±±
&+$37(5

$V D UHVXOW RI WKHVH FRQVLGHUDWLRQV LW ZDV GHFLGHG WR UHGXFH WKH QXPEHU RI JRDOV IURP
IRXU WR WZR 7KLV UHGXFHG WKH QXPEHU RI SULPLWLYH PHWULFV IURP  WR  ZKLFK ZDV
FRQVLGHUHGWREHDPDQDJHDEOHQXPEHUERWKIRUWKHSURMHFWDQGIRUWKHSHRSOHLQYROYHGLQWKH
GDWDDQDO\VLVDQGRWKHUIROORZXSDFWLYLWLHV7KHVHOHFWHGJRDOVZHUH

x 5HOLDELOLW\
$QDO\]HWKHGHYHORSPHQWSURFHVVIRUWKHSXUSRVHRILPSURYHPHQWZLWKUHVSHFWWRFDXVHV
RI UHOLDELOLW\ IURP WKH YLHZSRLQW RI WKH VRIWZDUH GHYHORSPHQW WHDP LQ WKH IROORZLQJ
HQYLURQPHQW1HUD$67HOH6FDGD
x 9HULILFDWLRQDQGYDOLGDWLRQ
$QDO\]HWKHGHYHORSPHQWSURFHVVIRUWKHSXUSRVH RI LPSURYHPHQWZLWK UHVSHFW WR 9 9
HIIHFWLYHQHVV IURP WKH YLHZSRLQW RI WKH VRIWZDUH GHYHORSPHQW WHDP LQ WKH IROORZLQJ
HQYLURQPHQW1HUD$67HOH6FDGD

$VVRRQDVWKH*40JRDOVZHUHGHILQHGZHVWDUHGWRGHYHORSWKHPHDVXUHPHQWSODQ

 'HILQLQJWKHPHDVXUHPHQWSODQ
7KHZRUNRQWKHPHDVXUHPHQWSODQVWDUWHGZLWKDZRUNVKRSRQDSSO\LQJWKH *40 SURFHVV
IROORZHG E\ D KDQGVRQ H[HUFLVH 7KH ZRUNVKRS ZDV KHOG ZLWK WKH SHRSOH UHSUHVHQWLQJ WKH
YLHZSRLQWV RI WKH VHOHFWHG *40 JRDOV 7KH *40 DEVWUDFWLRQ VKHHW ZDV LQWURGXFHG WR WKH
SDUWLFLSDQWVDWWKHEHJLQQLQJRIWKLVZRUNVKRSDQGWKHSDUWLFLSDQWVZHUHGLYLGHGLQWRJURXSV
ZKRILOOHGRXWRQHDEVWUDFWLRQVKHHWSHUJRDOSHUJURXS
7KH UHVXOWLQJ DEVWUDFWLRQ VKHHWV ZHUH FRPELQHG DQG FRQIOLFWV DQG LQFRQVLVWHQFLHV ZHUH
UHVROYHG E\ JDWKHULQJ DOO LQYROYHG SHRSOH LQ D MRLQW VHVVLRQ (DFK JURXS SUHVHQWHG WKHLU
YLHZSRLQWV WR WKH UHVW RI WKH WHDP DQG WKH PHWULFV SURPRWHU ZDV UHVSRQVLEOH IRU IROORZXS
LQWHUYLHZVILQDOFODULILFDWLRQVDQG IRUILQDOL]LQJ WKH DEVWUDFWLRQ VKHHWV  RQH VKHHW SHU JRDO
)LJXUHVKRZV SDUW RI WKH ILQDO *40 VWUXFWXUH IRU 1HUD 7HOH6FDGD $6 ZKLOH 7DEOH 
VKRZVWKHUHVXOWLQJ*40DEVWUDFWLRQVKHHWIRUWKHJRDO³UHOLDELOLW\´

*RDO

4) 4) 9) 9)

0 0 0 0 0 0

3URFHVVPHDVXUHPHQWV (QYLURQPHQWPHDVXUHPHQWV

)LJXUH3DUWRI1HUD¶V*40WUHH

±±
(03,5,&$/5(68/76

7DEOH*40DEVWUDFWLRQVKHHWIRUJRDOUHOLDELOLW\

*RDO 2EMHFW 3XUSRVH 4XDOLW\IRFXV 9LHZSRLQW (QYLURQPHQW


* 'HYHORSPHQW %HWWHU &DXVHVRI 6ZGHYHORSPHQW 1HUD$6
SURFHVV XQGHUVWDQGLQJ UHOLDELOLW\ WHDP 7HOH6FDGD
4XDOLW\)RFXV 9DULDWLRQ)DFWRUV
:KDWLVWKHLQFLGHQWGHQVLW\GXULQJV\VWHPWHVW"  +RZPDQ\KRXUVDUHXVHGIRUUHYLHZSUHSDUDWLRQV"
 :KDWLVWKHIDXOWGHQVLW\GXULQJV\VWHPWHVW"  +RZJRRGDUHWKHUHTXLUHPHQWVWUDFHDELOLW\"
:KDWLVWKHIDXOWGHQVLW\DIWHUUHOHDVH"  +RZH[SHULHQFHGDUHWKHSURMHFWPHPEHUV"
+RZDUHIDXOWVGLVWULEXWHGRYHUVHYHUHQHVV  +RZPXFKDSSOLFDWLRQH[SHULHQFHGRWKHSURMHFW
FDWHJRULHV" PHPEHUVKDYH"
+RZDUHIDXOWVGLVWULEXWHGRYHUSKDVHRI  :KDWLVWKHUHVRXUFHVLWXDWLRQIRUWKHSURMHFW"
LQWURGXFWLRQ"  +RZPXFKGLGHDFKSURMHFWPHPEHUSDUWLFLSDWHLQWKH
+RZDUHIDXOWVGLVWULEXWHGRYHUIDXOWW\SHV" 26'SKDVH"
+RZPDQ\KRXUVDUHXVHGIRUFRUUHFWLQJDIDXOW  +RZPXFKGLGWKH30SDUWLFLSDWHLQWKHUHTXLUHPHQWV
DIWHUUHOHDVH" SKDVH"
 +RZPDQ\ODUJHFKDQJHVRIWHFKQRORJ\ZDVWKHUHLQ
WKHSURMHFW"
 +RZZHOOZDVWKHTXDOLW\FRQWUROOHGLQWKHSURMHFW"
%DVHOLQH+\SRWKHVLV ,PSDFWRQ%DVHOLQH+\SRWKHVLV
 00 ; <  $QLQFUHDVHLQ9)ZLOOUHGXFH4)4)4)
 00 ; <  $ORZYDOXHIRU9)ZLOOLQFUHDVH4)4)4)
 00 ; <  $QLQFUHDVHLQ9)ZLOOUHGXFH4)4)4)
 ;)DWDO<&ULWLFDO=1RQFULWLFDO  $QLQFUHDVHLQ9)ZLOOUHGXFH4)4)4)
 5(4 ;26' <'(6 ='(7 6  $EDG9)ZLOOLQFUHDVH4)4)4)
&2'( 7,17 86<6 9  $QLQFUHDVHLQ9)ZLOOUHGXFH4)4)4)4)
 ,QLW ;/RJLF <'DWD =2SW 6  $QLQFUHDVHLQ9)ZLOOGHFUHDVH4)4)4)
6FDOLQJ 7,QW&RP 88VH 9(QY :  $ODUJH9)ZLOOLQFUHDVH4)4)4)4)
;KRXUVIDXOW  $ODUJH9)ZLOOGHFUHDVH4)4)4)4)

,W WXUQHG RXW WKDW WKH SURFHVV RI GRLQJ WKH LQLWLDO JXHVVWLPDWHV RI WKH PHWULFV¶ YDOXHV WKH
³EDVHOLQH K\SRWKHVLV´ SDUW RI WKH ZRUN VKHHW  DOVR ZDV DQ RSSRUWXQLW\ WR FROOHFW DGGLWLRQDO
NQRZOHGJHDQGUHILQHRXU*40WUHH,QVLVWLQJRQWKHVHLQLWLDOJXHVWLPDWHVFDXVHGWKHGHYHO
RSHUVWRUHFRQVLGHUVRPHRIWKHVXJJHVWHGPHWULFV,WLVRQHWKLQJWRDJUHHWKDWVRPHWKLQJFDQ
EH PHDVXUHG ± WR ILQG SODXVLEOH YDOXHV LV VRPHWKLQJ TXLWH GLIIHUHQW :KHQ ZH IRU LQVWDQFH
VWDUWHGWRSURYLGHJXHVWLPDWHVIRUWKHQXPEHURIUHPDUNVSHUSDJHWKHGHYHORSHUVZHUHTXLFN
WRSRLQWRXWWKDWWKLVPXVWGLIIHUVWURQJO\IURPFRGHWRGRFXPHQWV7KXVWKHPHWULF³QXPEHU
RIUHPDUNVSHUSDJH´ZDVVSOLWLQWR³QXPEHURIUHPDUNVSHUGRFXPHQWSDJH´DQG³QXPEHURI
UHPDUNVSHUFRGHSDJH´EHIRUHWKHGHYHORSHUVZHUHDEOHWRVXSSO\UHDVRQDEOHHVWLPDWHVIRUWKH
YDOXHV7KHGHYHORSHUVODWHUFKDUDFWHUL]HGWKLVSDUWRIWKHZRUNDVDGLIILFXOWEXWXVHIXOOHDUQ
LQJSURFHVV
:HPDGHVXUHWKDWWKH*40PRGHOVDQGWKHPHDVXUHPHQWSODQRQO\FRQWDLQHGSULPLWLYH
PHWULFV7KLVZD\WKHDQVZHUWRHDFKTXHVWLRQLQWKH*40PRGHOVZDVDVLPSOHFDOFXODWLRQ
ZKHUH WKH PHDVXUHPHQWV ZHUH FRPELQHG LQWR TXDQWLILHG LWHPV WKDW GLUHFWO\ UHIOHFWHG WKH DW
WULEXWHV TXHVWLRQ ZKRVHYDOXH DQVZHU ZHZHUHLQWHUHVWHGLQ6XEVHTXHQWO\WKHXVHRIVWDQ
GDUGJUDSKVVXFKDVVFDWWHUSORWVSLHFKDUWVDQGKLVWRJUDPVYLVXDOL]HGWKHVHDQVZHUV
%DVHGRQWKHPHWULFGHILQLWLRQVZHGHVFULEHGKRZHDFKPHWULFVKRXOGEHPHDVXUHGZKHQ
LWVKRXOGEHPHDVXUHG DQG E\ ZKRP 7RJHWKHU WKLV PDGH XS WKH PHDVXUHPHQW SODQ IRU WKH
EDVHOLQHSURMHFW

±±
&+$37(5

7DEOH0HWULFVGHILQLWLRQWHPSODWH

,WHP 'HVFULSWLRQ

,G 8QLTXHLGHQWLILHURIWKHSULPLWLYHPHWULF
1DPH 1DPHRIWKHSULPLWLYHPHWULF
'HILQLWLRQ 8QDPELJXRXVGHVFULSWLRQRIWKHPHWULFLQWHUPVRIWKHSURMHFW¶V
HQYLURQPHQW
&ROOHFWLRQSURFHGXUH 'HVFULSWLRQRIWKHFROOHFWLRQSURFHGXUH
([SHFWHGYDOXH 7KHH[SHFWHGYDOXHWDNHQIURPWKH³K\SRWKHVLV´SDUWRIWKH*40
DEVWUDFWLRQVKHHW
5HVSRQVLEOH :KRLVUHVSRQVLEOHIRUFROOHFWLQJWKHGDWD

$V VRRQ DV ZH KDG D VPDOO GDWD VHW ±  YDOXHV ± ZH SHUIRUPHG VRPH WHQWDWLYH DQDO\VHV
%HVLGHV JHWWLQJ D VWDUW RQ WKH UHVXOWV RI WKH SURFHVV LPSURYHPHQW H[SHULPHQW WKLV HDUO\
DQDO\VLVKDGVHYHUDORWKHULPSRUWDQWSXUSRVHV,WKHOSHGXVWRFKHFNWKDW

x 7KH PHDVXUHPHQW SODQ ZDV SUHFLVH HQRXJK IRU WKH SHUVRQV UHVSRQVLEOH IRU WKH GDWD
FROOHFWLRQ
x :HKDGDOOWKHGDWDQHHGHGWRREWDLQXVHIXOUHVXOWVIURPWKHDQDO\VHV
x 7KHFKRVHQGDWDSUHVHQWDWLRQIRUPDWZDVVXLWHGIRUWKHIHHGEDFNPHHWLQJV
x 7KH GDWD VHOHFWHG ZRXOG SURYLGH WKH GHYHORSHUV ZLWK VXIILFLHQW LQIRUPDWLRQ IRU SURFHVV
XQGHUVWDQGLQJDQGODWHULPSURYHPHQWV

7KHILQDOPHDVXUHPHQWSODQFRQVLVWHGRIDVHWRIWDEOHV±RQHSHUPHWULF±DQGDSUHVHQWDWLRQ
GHVFULSWLRQIRUWKH DQVZHU WR HDFK TXHVWLRQ VHH 3XOIRUGHW DO  IRU DGGLWLRQDO LQIRUPD
WLRQ ,QDGGLWLRQZHPDGHDVXPPDU\WDEOHWKDWFRQWDLQHGWKHPRVWLPSRUWDQWLQIRUPDWLRQIRU
DOO WKH PHWULFV ZKHQ WKH PHWULFV ZHUH WR EH FROOHFWHG DQG UHIHUHQFHV WR WKH UHOHYDQW
UHJLVWUDWLRQIRUPV7KHWHPSODWHIRUWKHPHWULFVGHILQLWLRQVLVVKRZQLQ7DEOH

 'DWDFROOHFWLRQDQGYDOLGDWLRQ
7KHVWURQJIRFXVRQGDWDGHILQLWLRQGDWDFROOHFWLRQDQGSDUWLFLSDWLRQDWWKHVWDUWRIWKH*40
SURFHVVFUHDWHGRZQHUVKLSDQGLQWHUHVWDPRQJWKHGHYHORSHUV7KHPRVWLPSRUWDQWUHVXOWIURP
WKH*40SURFHVVZDVWKDWWKHGHYHORSHUVDQGPDQDJHPHQWIHOWWKDWWKHGDWDZHUHLPSRUWDQW
IRUWKHLUMRE+RZHYHUWKH FRPSDQ\¶VFRPPLWPHQWWRFRQWLQXRXVSURFHVVLPSURYHPHQWZDV
SUREDEO\RIHTXDOLPSRUWDQFHHVSHFLDOO\WRWKHPDQDJHUV
)RXUW\SHVRIGDWDFROOHFWLRQZDVJRLQJRQGXULQJWKH*40SURFHVVGDWDZDVFROOHFWHG

x :KLOHZRUNLQJRQWKH*40ZRUNVKHHWV7KLVZDVWKHGHYHORSHUV¶SULRUEHOLHIVIRUWKH
DQVZHUVWRWKHTXHVWLRQV
x :KLOHH[HFXWLQJWKHPHDVXUHPHQWSODQ7KLVZDVWKHDFWXDOGDWDFROOHFWHGDVSURGXFWDQG
SURFHVVPHWULFV

±±
(03,5,&$/5(68/76

x 'XULQJWKHIHHGEDFNVHVVLRQV7KLVZDVNQRZOHGJHSHUWDLQLQJWRUHODWLRQVEHWZHHQSDUD
PHWHUVDQGEHWZHHQSDUDPHWHUVDQGWKHSURMHFW¶VHQYLURQPHQW
x 'XULQJ GDWD LQWHUSUHWDWLRQ DQG GDWD DQDO\VLV 7KLV ZDV NQRZOHGJH SHUWDLQLQJ WR
VXJJHVWLRQV IRU GDWD UHILQHPHQW ZKLFK FKDUDFWHULVWLFV DUH UHOHYDQW IRU D IXUWKHU UHILQH
PHQWRIWKHGDWD

:KHQZHFRQVLGHUHGHDFKPHWULFLQLVRODWLRQZHFRXOGPDNHGRZLWKRQO\WKHWZRILUVWW\SHV
RIGDWDFROOHFWLRQ+RZHYHUZKHQZHVWDUWHGWRDQDO\]HWKHGDWDLQRUGHUWRXQGHUVWDQGDSDUW
RIWKHSURFHVVWKHRWKHUW\SHVVKRZHGWKHLULPSRUWDQFH
:KLOHZHFDPHDORQJZD\LQSODQQLQJFROOHFWLQJDQGIRUPDOL]LQJWKHWZRILUVWW\SHVRI
GDWDRQO\VPDOODWWHPSWVZHUHPDGHIRUWKHWKLUGDQGIRXUWKW\SHV 2QHRI WKH UHDVRQV ZK\
WKLV ZDV GLIILFXOW ZDV WKDW PXFK RI WKLV GDWD FROOHFWLRQ GHSHQGHG RQ NQRZOHGJH WKDW FRXOG
RQO\SDUWLDOO\EHGRFXPHQWHG

$VPHQWLRQHGLQWKHSUHYLRXVVXEVHFWLRQZHYDOLGDWHGWKHGDWDDVVRRQDVWKH\EHFDPHDYDLO
DEOH7KLVOHGWRDEHWWHUXQGHUVWDQGLQJRIWKHGDWDWKDWZHZHUHFROOHFWLQJ1RQHZPHWULFV
ZHUHLQWURGXFHGGXULQJWKLVZRUNEXWVRPHRIWKHPQHHGHGDUHGHILQLWLRQ
7KHPHWULF³1XPEHURIUHYLHZUHPDUNV´LVDFDVHLQSRLQW:KHQWKLVPHWULFZDVFKHFNHG
IRUFRUUHODWLRQZLWKWKHGRFXPHQWFRPSOH[LW\DVDVVHVVHGE\WKHGHYHORSHUVLWEHFDPHFOHDU
WKDWWKHYDULDWLRQVZHUHQRWDVH[SHFWHG7KHUHDVRQZDVFOHDU6LQFHWKHQXPEHURIUHPDUNV
LQFOXGHGWKHZKROHVSHFWUXPRIPLVWDNHV±IURPW\SRJUDSKLFDOHUURUVWRGHHSORJLFDOHUURUV±
WKHFRQWULEXWLRQIURPWKH VPDOO SUREOHPV URXJKO\SURSRUWLRQDOWRWKHVL]HRIWKHGRFXPHQW
ZDV PXFK ODUJHU WKDQ WKH FRQWULEXWLRQ IURP WKH GRFXPHQW¶V FRPSOH[LW\ 7KH GHYHORSHUV
FRQVLGHUHGWKHORJLFDOHUURUVWREHPXFKPRUHVHULRXVDQGWKXVPRUHLPSRUWDQWWRXQGHUVWDQG
$V D UHVXOW RI WKLV LW ZDV GHFLGHG WKDW ZH VKRXOG RQO\ FROOHFW WKH QXPEHU RI UHPDUNV
FRQFHUQLQJORJLFDOHUURUVDQGGLVUHJDUGWKHUHVWRIWKHUHYLHZUHPDUNV

 'DWDDQDO\VLV
$VZLWKWKH*40WKHGDWDDQDO\VLVDOVRVWDUWHGZLWKDVKRUWLQWURGXFWRU\FRXUVH7KHFRXUVH
FRQVLVWHGRIDKDOIGD\LQWURGXFWLRQWRVWDWLVWLFDOGDWDDQDO\VLVIROORZHGE\KDOIDGD\RIH[HU
FLVHV 7KH PDLQ SDUWV RI WKLV FRXUVH ZHUH SORWWLQJ WHFKQLTXHV WVWDWLVWLFV DQG $129$ ,Q
RUGHU WR PDNH WKH H[HUFLVHV UHOHYDQW WR WKH SDUWLFLSDQWV ZH XVHG GDWD FROOHFWHG IURP WKH
GHSDUWPHQW¶VGHYHORSPHQWSURMHFWV
7KHJHQHUDODSSURDFKWRGDWDDQDO\VLVZDVWRSORWWKHGDWDEHIRUHDQ\VWDWLVWLFDODQDO\VLV
ZDVDWWHPSWHG $OVR LQ RUGHU WR PDNH GDWD FROOHFWLRQ UHJLVWUDWLRQ DQG DQDO\VLV VLPSOH ZH
GHFLGHGWRXVHWKH06([FHOVSUHDGVKHHWZLWKLWVEXLOWLQVWDWLVWLFDOSDFNDJHZKLFKWXUQHGRXW
WREHVXIILFLHQWIRURXUQHHGV7KXVWKHDQDO\VLVVWUDWHJ\ZDVDVIROORZV

  3ORW WKH GDWD VHWV XQGHU FRQVLGHUDWLRQ 7ZR WKLQJV FRXOG KDSSHQ (LWKHU D FOHDU SLFWXUH
ZRXOGHPHUJHRULWGLGQRW
  ,I WKH SLFWXUH HPHUJLQJ IURP WKH GDWD SORW ZDV FOHDU D UHJUHVVLRQ DQDO\VLV RU $129$
ZDVDWWHPSWHGLQRUGHUWRVHHKRZPXFKRIWKHGDWDYDULDWLRQWKDWFRXOGEHH[SODLQHGE\D
VLPSOHPRGHO

±±
&+$37(5

,I RQ WKH RWKHU KDQG QR FOHDU SLFWXUH HPHUJHG ZH ZRXOG WU\ VRPH VWDQGDUG GDWD
WUDQVIRUPDWLRQVOLNHWKHORJRUWKHORJLWWUDQVIRUPDWLRQ,IWKLVGLGQRWKHOSZHZRXOGWDNH
WKLVDVDQLQGLFDWLRQWKDWZHQHHGHGWRORRNIRURWKHUH[SODQDWRU\SDUDPHWHUVLQRUGHUWR
XQGHUVWDQGWKLVSDUWLFXODUUHODWLRQVKLS
  ,Q DOO FDVHV WKH QHHG IRU LQWHUSUHWDWLRQ DQG VXJJHVWLRQ IRU DGGLWLRQDO SDUDPHWHUV ZHUH
GLVFXVVHG WRJHWKHU ZLWK WKH GHYHORSHUV LQ WKH IHHGEDFN VHVVLRQV 7KLV FRXOG OHDG WR WKH
QHHGIRUQHZPHWULFVQHZGHILQLWLRQVIRUVRPHRIWKHFXUUHQWPHWULFVRUDQHZSURFHGXUH
IRUGDWDFROOHFWLRQ

,QRUGHUWRSUHVHQWVHYHUDO PHWULFV RU TXHVWLRQV WRJHWKHU ZH XVHG WKH .LYLDW GLDJUDP ± DOVR
NQRZQDVWKHUDGDUFKDUW7KLVSUHVHQWDWLRQPHWKRGZDVHVSHFLDOO\XVHIXOIRUFRPSDULQJDVHW
RIPHDVXUHPHQWVDJDLQVWVRPHJRDORUDVHWRILGHDOUHVXOWV
7KHPRVWVLJQLILFDQWOHVVRQIURPWKHGDWDDQDO\VLVKRZHYHUZDVWKHJUHDWLPSRUWDQFHRI
H[SHUW RSLQLRQ 7KHVH RSLQLRQV ZHUH SXW IRUZDUG DQG GLVFXVVHG WRJHWKHU ZLWK WKH SRVVLEOH
LQWHUSUHWDWLRQVRIWKHGDWDLQGHGLFDWHGOHDUQLQJIRUXPV±WKHIHHGEDFNVHVVLRQV

 )HHGEDFNVHVVLRQV
)HHGEDFNVHVVLRQVSOD\ DQLPSRUWDQWUROHLQWKH*40PHWKRG,W VRRQWXUQHGRXWWKDW WKHVH
VHVVLRQVZHUHWKHPRVWLPSRUWDQWSDUWRIPHDVXUHPHQWEDVHGXQGHUVWDQGLQJDQGLPSURYHPHQW
LQWKH7(/0(7SURMHFW7KHVHVHVVLRQVZHUHLPSRUWDQWIRUVHYHUDOUHDVRQV7KH\KHOSHGLQ

x ,QWHUSUHWLQJ WKH GDWD 7KH GHYHORSHUV¶ LQVLJKW LQWR WKH GHYHORSPHQW SURFHVV JDYH
LPSRUWDQWLQSXWIRUWKHLQWHUSUHWDWLRQRIWKHPHDVXUHPHQWV
x 6XJJHVWLQJ DGGLWLRQDO SDUDPHWHUV WKDW FRXOG KHOS WR PDNH WKH FROOHFWHG GDWD ³PDNH
VHQVH´7KLVFRXOGJLYHULVHWRQHZPHWULFVWKDWQHHGHGWREHFROOHFWHG
x 0RYLQJIURPPHDVXUHPHQWDQGSURFHVVXQGHUVWDQGLQJWRZDUGSURFHVVLPSURYHPHQW7KLV
ZDV DFKLHYHG E\ FRPELQJ WKH GHYHORSHUV¶ FXUUHQW H[SHULHQFH DQG NQRZOHGJH ZLWK WKH
QHZLQVLJKWVSURYLGHGE\WKHPHDVXUHPHQWVDQGWKHDQDO\VLV

$OOWKHVHHIIHFWVZHUHREVHUYHGLQWKHSURMHFWDQG UHVXOWHGLQDQLPSRUWDQWOHDUQLQJSURFHVV
7KXV NQRZOHGJH DQG H[SHULHQFH DUH RI SDUDPRXQW LPSRUWDQFH IRU WKH GDWD GHILQLWLRQ GDWD
DQDO\VLVDQGLQWHUSUHWDWLRQ

 /HVVRQVOHDUQHG
7KH PRVW LPSRUWDQW OHVVRQ OHDUQHG ZDV WKDW WKH IHHGEDFN VHVVLRQV DQG FORVH LQWHUDFWLRQ
EHWZHHQWKHSURMHFWWHDPDQGWKHPHWULFVWHDPDUHWKHPRVWLPSRUWDQWPHFKDQLVPVERWKIRU
WKH RYHUDOO VXFFHVV RI WKH PHDVXUHPHQW SURJUDP DQG IRU GDWD DQDO\VLV DQG LQWHUSUHWDWLRQ
%HVLGHV PHDVXUHPHQWEDVHG LPSURYHPHQW ZDV LGHQWLILHG DV DQ LPSRUWDQW EXVLQHVV FRQFHUQ
ZLWK VWURQJ PDQDJHPHQW VXSSRUW 7KLV ZDV XQGRXEWHGO\ LPSRUWDQW IRU WKH VXFFHVV RI WKH
SURFHVVLPSURYHPHQWH[SHULPHQW
7KHXVHRIWKH*40DEVWUDFWLRQVKHHWZDVYHU\XVHIXODOWKRXJKWKHODQJXDJHXVHGFRXOG
EH ERWK KDUG WR XQGHUVWDQG HJ TXDOLW\ IRFXV  DQG FRQIXVLQJ HJ LPSDFW RQ EDVHOLQH

±±
(03,5,&$/5(68/76

K\SRWKHVLV LQWKHEHJLQQLQJ$IWHUDVKRUWLQLWLDOSKDVHKRZHYHUWKHWHDPPHPEHUVEHFDPH
IDPLOLDUZLWKLWVXVH
7KH QHHGHG HIIRUW WR IRUPXODWH SUHFLVH TXHVWLRQV LQ RUGHU WR XVH RQO\ SULPLWLYH PHWULFV
SDLG RII DV ZH ZHUH DEOH WR VLPSOLI\ ERWK GDWD SUHVHQWDWLRQV DQG DQDO\VLV UHODWHG WR WKH
TXHVWLRQV DVNHG +RZHYHU ZH VWDUWHG WR SODQ WKH H[SHULPHQW ZLWK IRXU JRDOV DQG WKHLU
FRUUHVSRQGLQJ TXHVWLRQV DQG PHWULFV 7KLV ZDV WRR DPELWLRXV DQG ZH KDG WR UHGXFH WKLV WR
WZRJRDOV7KHQXPEHURITXHVWLRQVDQGPHWULFVZDVQRWFKDQJHGEXWGXULQJGDWDDQDO\VLVZH
IRXQG WKDW VRPH ZHUH PRUH LPSRUWDQW WKDQ RWKHUV ZHUH DQG WKDW ZH FRXOG KDYH OLPLWHG
RXUVHOYHVWRFRQFHQWUDWHRQWKHVHRQO\
7KHIROORZLQJLVDOLVWRIVRPHRIWKHWUDSVZHKDYHIDOOHQLQWRRUEDUHO\DYRLGHGGXULQJ
RXUDSSOLFDWLRQRI*40LQWKH7(/0(7SURMHFW

x *40LVPXFKPRUHWKDQDPHWKRGIRUGHILQLQJDPRGHOIRUVRIWZDUHPHWULFVFROOHFWLRQ,W
LV ILUVW DQG IRUHPRVW D PHWKRG IRU WKH GHYHORSHUV WR H[WHUQDOL]H WKHLU NQRZOHGJH DQG
H[SHULHQFH)URPWKLVSRLQWRIYLHZHDFKVWHSLQWKH*40PHWKRGLVDQRSSRUWXQLW\WR
OHDUQPRUHDERXWWKHGHYHORSPHQWSURFHVVRUWRH[WHUQDOL]HPRUHRIWKHODUJHDPRXQWRI
H[SHULHQFHDQGNQRZOHGJHDOUHDG\DYDLODEOHLQWKHRUJDQL]DWLRQ
x *40 LV QRW D PHWKRG IRU GDWD DQDO\VLV ,W LV KRZHYHU D PHWKRG IRU LPSURYLQJ DQG
FORVLQJWKHORRSRIGHILQLQJFROOHFWLQJDQDO\]LQJ DQG LQWHUSUHWLQJ SURGXFW DQG SURFHVV
GDWD
x 7KHWHUP³+\SRWKHVLV´XVHGLQWKH*40ZRUNVKHHWLVKLJKO\PLVOHDGLQJ7KHUHDUHQR
K\SRWKHVHVLQ WKH VWDWLVWLFDO VHQVH LQ WKH *40 SURFHVV ,W LV DOZD\V D TXHVWLRQ RI SULRU
EHOLHIDVWKLVWHUPLVXVHGIRULQVWDQFHLQ%D\HVLDQVWDWLVWLFV
x 7KH *40 SURFHVV LV QRW DERXW TXDOLW\ 7KH SURFHVV FDQ EH XVHG LQ DQ\ PHDVXUHPHQW
VHWWLQJZKHUHDODUJHSDUWRIWKHNQRZOHGJHQHHGHGIRULPSURYHPHQWRQO\LVDYDLODEOHDV
KXPDQ NQRZOHGJH DQG H[SHULHQFH 7KH IUHTXHQW XVH RI WKH WHUP ³TXDOLW\´ LQ WKH *40
ZRUNVKHHWFDQEHFRQVLGHUHGDQDWWHPSWWRVXUIRQWKHTXDOLW\ZDYH2QWKHRWKHUKDQG
WKH*40SURFHVVLVDQLPSRUWDQWWRROIRUGDWDFROOHFWLRQLQSURFHVVLPSURYHPHQW

$OVRWKH*40PHWKRGDVLWLVSUHVHQWHGQRZGRHVQRWJLYHDQ\JXLGDQFHZKHQLWFRPHVWR
IRUPXODWLQJWKHTXHVWLRQVRQFHWKHJRDOVDUHVSHFLILHG2QHSRVVLEOHZD\WRGRWKLVFRXOGEH
WRSURFHHGDVIROORZV

 6SHFLI\WKHJRDOV
 )RUPXODWHK\SRWKHVHVUHODWHGWRHDFKJRDO
 8VHWKHVHK\SRWKHVHVWRIRUPXODWHWKHQHHGHGTXHVWLRQV

(JLIWKHJRDOLVWRXQGHUVWDQGWKHFDXVHRI;WKHK\SRWKHVLVFRXOGEHIRUPXODWHGDV³$ZLOO
LPSURYH;´)URPWKLVK\SRWKHVLVZHFRXOGGHULYHTXHVWLRQVOLNH³:KDWLVWKHYDOXHRI$"´
³+RZZLOO<LQIOXHQFH$±RU;"´DQGVRRQ7KLVZRXOGJLYHDPRUHIRFXVHGDQGWKXVPRUH
HIILFLHQWZD\RIGHULYLQJTXHVWLRQVLQWKH*40WUHH

±±
&+$37(5

 &DVH6WXG\%([SHULHQFHZLWK3DUWLFLSDWLYH6RIWZDUH
3URFHVV$VVHVVPHQW
,Q WKLV VHFWLRQ ZH GHVFULEH RXU H[SHULHQFH ZLWK WKH DGRSWLRQ RI D JHQHUDO DSSURDFK IRU
RUJDQL]DWLRQDODVVHVVPHQWDQGLWVVSHFLDOL]DWLRQWRWKHGRPDLQRIVRIWZDUHGHYHORSPHQW7KH
SURFHVV LQYROYHG UHVHDUFKHUV DQG SUDFWLWLRQHU DFWLQJ WRJHWKHU LQ D SDUWLFLSDWLYH DSSURDFK WR
GLDJQRVHSUREOHPVLQVRIWZDUHGHYHORSPHQWLQIRXURUJDQL]DWLRQVXVLQJWKHEDVLFSULQFLSOHVRI
VXUYH\ IHHGEDFN VHH HJ %DXPJDUWHO  1HII   ZKLFK LV D VSHFLDOL]HG IRUP RI
DFWLRQUHVHDUFK

 $VVHVVPHQWPHWKRG
7KHDVVHVVPHQW SURFHVV LV DQ DGDSWDWLRQ RI WKH HYDOXDWLRQ PRGHO GHYHORSHG E\ YDQ 'H 9HQ
DQG)HUU\  DQGFRQVLVWVRIVL[VWHSVDVVKRZQLQ)LJXUHDQGGHVFULEHGQH[W
,Q WKH ILUVW VWHS DVVHVVPHQW LQLWLDWLRQ WKH LQVLGHUV DQG RXWVLGHUV RI WKH RUJDQL]DWLRQ
VKRXOG FODULI\ WKHLU UHVSHFWLYH UROHV DQG WKH REMHFWLYHV RI WKH DVVHVVPHQW E\ DQVZHULQJ WKH
IROORZLQJTXHVWLRQV

  :KDWDUHWKHSXUSRVHVRISHUIRUPLQJVRIWZDUHSURFHVVDVVHVVPHQW"
  :KRDUHWKHXVHUVRIWKHDVVHVVPHQWDQGKRZZLOOWKHUHVXOWVEHXVHG"
  :KDWLVWKHVFRSHRIWKHDVVHVVPHQWLQWHUPVRIRUJDQL]DWLRQDOXQLWVDQGLVVXHV"
  7R ZKDW H[WHQW LV WKHUH D FRPPLWPHQW WR XVLQJ VFLHQWLILF PHWKRGV HJ SV\FKRPHWULF
SULQFLSOHV WRGHVLJQDQGLPSOHPHQWWKHDVVHVVPHQW"
  :KRVKRXOGFRQGXFWWKHDVVHVVPHQWDQGZKDWUHVRXUFHVDUHDYDLODEOH"

$66(660(17

,1,7,$7,21

)2&86$5($

'(/,1($7,21

&5,7(5,$

'(9(/230(17

$66(660(17

'(6,*1

$66(660(17

,03/(0(17$7,21

'$7$$1$/<6,6

$1')(('%$&.

)LJXUH3DUWLFLSDWLYHDVVHVVPHQWSURFHVV



7KHUHVXOWVUHSRUWHGLQWKLVVHFWLRQDUHEDVHGRQ '\EnDQG0RH 

±±
(03,5,&$/5(68/76

,WLVLPSRUWDQWWKDWGXHFRQVLGHUDWLRQVDUHWDNHQLQDQVZHULQJWKHVHTXHVWLRQVVLQFHWKH\
DUH FUXFLDO IRU GHWHUPLQLQJ ZKHWKHU DQ DVVHVVPHQW LV UHOHYDQW LQ WKH ILUVW SODFH DQG IRU
WDLORULQJWKHSURFHVVDQGFRQWHQWRIWKHDVVHVVPHQWWRWKHVSHFLILFQHHGVRIWKHRUJDQL]DWLRQ
7KHVHFRQGVWHSIRFXVDUHDGHOLQHDWLRQLVDQH[SORUDWLRQRIWKHRYHUDOOLVVXHVLGHQWLILHG
IRU WKH DVVHVVPHQW LQ VWHS RQH ,Q RXU H[SHULHQFH PRVW FRPSDQLHV GR QRW KDYH D VKDUHG
XQGHUVWDQGLQJ RI WKHLU VSHFLILF JRDOV $ FRQVFLRXV DQDO\VLV RI FRPPRQO\ XVHG KLJKOHYHO
SHUIRUPDQFHJRDOVDQGIRFXVDUHDVLQVWDQGDUGVDQGUHIHUHQFHPRGHOVFDQWKHUHIRUHEHXVHIXO
DV D VWDUWLQJ SRLQW IRU JURXS GLVFXVVLRQV LQ WKLV VWHS ([DPSOHV RI VXFK IRFXV DUHDV DUH
VRIWZDUH SURFHVVHV HJ FXVWRPHUVXSSOLHU HQJLQHHULQJ VXSSRUW PDQDJHPHQW DQG
RUJDQL]DWLRQ  FRPSHWLWLYH SULRULWLHV HJ SULFH TXDOLW\ IOH[LELOLW\ DQG VHUYLFH 
RUJDQL]DWLRQDOOHDUQLQJ OHDUQLQJIURPSDVWH[SHULHQFHVOHDUQLQJIURPRWKHUVDQGFXUUHQW63,
SUDFWLFHV DQGSHUFHLYHGIDFWRUVRIVXFFHVV
,Q WKH WKLUG VWHS FULWHULD GHYHORSPHQW PXOWLSOH RSHUDWLRQDO FULWHULD DUH GHYHORSHG IRU
HDFK RI WKH KLJKOHYHO JRDOV 7KH SURFHVV RI FULWHULD GHYHORSPHQW UHTXLUHV WKDW SUDFWLWLRQHUV
VHOHFW DQG GHILQH FRQFUHWH FKDUDFWHULVWLFV WKDW DUH WR EH PHDVXUHG DQG XVHG DV LQGLFDWRUV RI
JRDODWWDLQPHQW$GHFLVLRQDOVRKDVWREHWDNHQUHJDUGLQJWKHXVHRIDJJUHJDWHRUFRPSRVLWH
PHDVXUHV
7RRSHUDWLRQDOL]HWKHFULWHULDRQHTXHVWLRQLVGHILQHGIRUHDFKFKDUDFWHULVWLFVXFKWKDWWKH
WKHRUHWLFDODEVWUDFWLRQVFDQEHFORVHO\UHODWHGZLWKHYHU\GD\ZRUNVLWXDWLRQV:HDGRSWHGWKH
IRUPDWXVHGLQWKH(XURSHDQ6RIWZDUH,QVWLWXWH¶V6RIWZDUH([FHOOHQFH6XUYH\VXFKWKDW
WZR VXEMHFWLYH UDWLQJ VFDOHV DFFRPSDQ\ HDFK TXHVWLRQ RQH WR UDWH WKH FXUUHQW VWUHQJWK RU
SUDFWLFHOHYHODQGRQHWRUDWHWKHIXWXUHLPSRUWDQFH VHH)LJXUH 
)XUWKHUPRUHWRKHOSWKHFRPSDQLHVZHGHYHORSHGDVWDQGDUGTXHVWLRQQDLUHWKDWFRXOGEH
XVHG DV D VWDUWLQJ SRLQW IRU LQWHUQDO GLVFXVVLRQV DQG IRU WKH GHYHORSPHQW RI WDLORUPDGH
TXHVWLRQQDLUHV7KHVWDQGDUGTXHVWLRQQDLUHLVEDVHGRQRXUH[SHULHQFHVRISHUIRUPLQJSURFHVV
DVVHVVPHQWVLQVL[FRPSDQLHVGXULQJWKH63,4SUHSURMHFWSKDVHDQGLQFOXGHVIRXUVHFWLRQV
7KHILUVWVHFWLRQRQFRPSHWLWLYHSULRULWLHVZDVDGRSWHGIURPWKHDIRUHPHQWLRQHG(6,VXUYH\
7KHVHFRQGVHFWLRQZDVDGRSWHGIURPWKHVRIWZDUHSURFHVVDUHDVLQ,62,(&7KHWKLUG
VHFWLRQ FRQFHUQHG 63, SURFHVVHV DQG OHDUQLQJ IURP SDVW H[SHULHQFHV DQG WKH H[SHULHQFHV RI
RWKHUV )LQDOO\ WKH IRXUWK VHFWLRQ ZDV FRQFHUQHG ZLWK ILQGLQJ WKH PRVW LPSRUWDQW IDFWRUV
HQDEOLQJ63,VXFFHVVLQWKHRUJDQL]DWLRQ VHH6HFWLRQ 
7KHLVVXHVSHUWLQHQWWRVWHSIRXUDVVHVVPHQWGHVLJQUHODWHWRZKHUHWKHDVVHVVPHQWZLOO
EHFRQGXFWHG RUJDQL]DWLRQDOXQLWV WKHUROHRIWKHLQVLGHUVDQGRXWVLGHUVWKHWLPHKRUL]RQRI
WKHDVVHVVPHQWWKHXQLWRIDQDO\VLVDVZHOODVGHFLGLQJZKDWWKHVDPSOHZRXOGEHKRZWKH
GDWD ZLOO EH FROOHFWHG KRZ DJJUHJDWH FRQFHSWV ZLOO EH PHDVXUHG DQG KRZ WKH GDWD ZLOO EH
DQDO\]HG

&XUUHQWVWUHQJWK )XWXUH,PSRUWDQFH
  '(/,9(5< 
…………… $ELOLW\WRGHOLYHURQVFKHGXOH ……………

)LJXUH7\SLFDOTXHVWLRQIRUPDWIURPWKHTXHVWLRQQDLUH

±±
&+$37(5

4 XHVWLRQDQGJDS

$ E LOLW\WRG HOLYHURQ VFK HG XOH


$ YHUDJHJDSSHUSHUVRQ


)
U 

H 
T  &XUUHQW
X  VWUHQJWK
H 
Q  )XWXUH
F LP SRUWDQF

\

    

$ OWHUQDWLYHOHYHO

7 KHQXP EHURISHUVRQV / HYHOVRQHFRXOGFKRRVHEHWZ HHQ


DQVZ HULQJWKHGLIIHUHQWOHYHOV Z KHQDQVZ HULQJWKHTXHVWLRQV

)LJXUH([DPSOHRIDQLOOXVWUDWLRQRISUHOLPLQDU\ILQGLQJV

:KHQ DJJUHJDWH RU FRPSRVLWH PHDVXUHV DUH XVHG RQH VKRXOG EH FDUHIXO DERXW GHFLGLQJ WKH
FRUUHVSRQGLQJ UHTXLUHPHQWV RI SV\FKRPHWULF SURSHUWLHV VHH HJ 1XQQDOO\ DQG %HUQVWHLQ
 7KDWLVXQOHVVWKHFRPSRVLWHVFDOHVLQWKHTXHVWLRQQDLUHVDUHFRQVWUXFWHGDQGHYDOXDWHG
DORQJWKHOLQHVDVVRFLDWHGZLWKSV\FKRPHWULFWHVWVWKH\PD\SURGXFHDVVHVVPHQWUHVXOWVWKDW
DUHVHULRXVO\PLVOHDGLQJ
,WLVLPSRUWDQWKRZHYHUWRQRWHWKDWWKHPRUHULJRURXVWKHDVVHVVPHQWGHVLJQEHFRPHV
WKHJUHDWHUWKHWLPHFRVWVDQGRWKHUUHVRXUFHV H[SHQGHGRQWKHDVVHVVPHQWDUHOLNHO\WREH
7KHUHIRUHRQHVKRXOGDVNWKHTXHVWLRQDWHYHU\GHFLVLRQSRLQWZKHWKHUWKHEHQHILWVWKDWUHVXOW
IURPDPRUHVRSKLVWLFDWHGGHVLJQWRHQVXUHDFFXUDF\FRQILGHQFHJHQHUDOL]DELOLW\DQGVRRQ
DUHZRUWKWKHLQYHVWPHQWRIPRUHUHVRXUFHV
,QVWHSILYHDVVHVVPHQWLPSOHPHQWDWLRQWKHDVVHVVPHQWLVLPSOHPHQWHGDFFRUGLQJWRWKH
SURFHGXUH GHFLGHG XSRQ LQ WKH SUHYLRXV VWHS 7KH PDLQ FRQVLGHUDWLRQV GXULQJ WKLV VWHS DUH
FRPSOHWHQHVV DQG KRQHVW\ LQ GDWD FROOHFWLRQ SURFHGXUHV DQG WKH UHFRUGLQJ RI XQDQWLFLSDWHG
HYHQWVWKDWPD\LQIOXHQFHWKHDVVHVVPHQWUHVXOWV
7KH PDMRU FRQFHUQV GXULQJ VWHS VL[ GDWD DQDO\VLV DQG IHHGEDFN DUH WR SURYLGH
RSSRUWXQLWLHV IRU UHVSRQGHQWV WR SDUWLFLSDWH LQ DQDO\]LQJ LQWHUSUHWLQJ DQG OHDUQLQJ IURP WKH
UHVXOWVRIWKHDVVHVVPHQW$QGIXUWKHUPRUHWRLGHQWLI\FRQFUHWHDUHDVIRULPSURYHPHQW7KHUH
DUH PDQ\ ZD\V LQ ZKLFK WKLV FRXOG EH GRQH :H KDYH UHOLHG XSRQ KDOIGD\ ZRUNVKRSV LQ
ZKLFK SUHOLPLQDU\ ILQGLQJV RQ LQLWLDO TXHVWLRQV DQG SUREOHPV DUH SUHVHQWHG YHUEDOO\ LQ
ZULWLQJDQGZLWKLOOXVWUDWLRQV
7KHVHZRUNVKRSVEHJLQZLWKDUHYLHZRIWKHREMHFWLYHVRIWKHDVVHVVPHQWWKHIRFXVDUHDV
DQG WKH GHVLJQ DQG LPSOHPHQWDWLRQ RI WKH DVVHVVPHQW )LQGLQJV UHJDUGLQJ WKH VFRUHV RQ
FXUUHQWVWUHQJWKVDQGIXWXUHLPSRUWDQFHDUHSUHVHQWHGLQWHUPVRIDJDSDQDO\VLV1RUPDOO\WKH
SDUWLFLSDQWV UDLVH D PXOWLWXGH RI TXHVWLRQV DQG LVVXHV ZKHQ WKH ILQGLQJV DUH SUHVHQWHG DQG
WKH\WDNHSDUWLQJURXSGLVFXVVLRQVDQGUHIOHFWLRQVDVWKH\UHYLHZDQGHYDOXDWHWKHSUHOLPLQDU\
ILQGLQJV6RPHRIWKHTXHVWLRQVFDQEHFODULILHGDQGDQVZHUHGGLUHFWO\ZLWKWKHGDWDDWKDQG
RWKHUTXHVWLRQV FDQ EH DQVZHUHG E\ UHDQDO\]LQJ WKH GDWD DQG ILQDOO\ VRPH LVVXHV DUH UDLVHG

±±
(03,5,&$/5(68/76

ZKLFKFDQQRWEHUHVROYHGZLWKWKHFXUUHQWDVVHVVPHQWGDWD,QWKHODVWFDVHDGHFLVLRQKDVWR
EHWDNHQUHJDUGLQJIXUWKHUGDWDFROOHFWLRQ
7\SLFDOO\ ZH XVHG VFDWWHU SORWV EDU FKDUWV DQG KLVWRJUDPV WR LOOXVWUDWH SUHOLPLQDU\
ILQGLQJVIURPDQDVVHVVPHQWLQRUGHUWRKLJKOLJKWJDSVEHWZHHQFXUUHQWOHYHOVRISUDFWLFHVDQG
IXWXUHLPSRUWDQFHDQGWKHGLVSHUVLRQRIUHVSRQVHVERWKZLWKLQDQGEHWZHHQJURXSV
)LJXUH  VKRZV DQ H[DPSOH RI DQ LOOXVWUDWLRQ WKDW ZDV XVHG LQ D IHHGEDFN VHVVLRQ
SUHVHQWLQJSUHOLPLQDU\ILQGLQJVIURPDQDVVHVVPHQW6RPHRIWKHLQIRUPDWLRQZDVSUHVHQWHG
YHUEDOO\7KHH[WUDLQIRUPDWLRQIRUWKLVJUDSKZDV³RIWKHUHVSRQGHQWVKDYHDJDSWKDWLV
ODUJHUWKDQRUHTXDOWRRQH´

 /HVVRQVOHDUQHG

  $VVHVVPHQWLQLWLDWLRQ
x %\LQYROYLQJPRUHWKDQRQHJURXSLQWKHDVVHVVPHQWWKHUHH[LVWSRVVLELOLWLHVIRUPXOWLSOH
YLHZVDQGLQWHUHVWLQWKHGLVFXVVLRQDQGDQDO\VLVSKDVH
  )RFXVDUHDGHOLQHDWLRQDQGFULWHULDGHYHORSPHQW
x $ WHDP VKRXOG EH SXW WRJHWKHU LQ WKH FRPSDQ\ SHUIRUPLQJ WKH DVVHVVPHQW LQ RUGHU WR
FRQVWUXFWDWDLORUPDGHTXHVWLRQQDLUH
x 7KHWLPHQHHGHGWRFRPSOHWHWKHTXHVWLRQQDLUHVKRXOGQRWH[FHHGPLQXWHV DERXW
TXHVWLRQV  ,I WKHUH LV D SUREOHP ZLWK QRW FRYHULQJ DOO WKH DUHDV LGHQWLILHG GXULQJ WKH
LQLWLDWLRQSKDVHWKHFRPSDQ\VKRXOGFRQGXFWPRUHWKDQRQHDVVHVVPHQW
x 7KHUHVKRXOGEH D FORVH FRRSHUDWLRQ EHWZHHQ WKH RXWVLGHUV DQG WKH LQVLGHUV &RPSDQLHV
RIWHQKDYHSUREOHPVGLVWLQJXLVKEHWZHHQLPSRUWDQWDQGOHVVLPSRUWDQWTXHVWLRQV,QVXFK
FDVHVSHRSOHIURPWKHRXWVLGHZLOOEHDEOHWRKHOSE\SRVLQJ³VWXSLG´TXHVWLRQV
x ,WLVYHU\LPSRUWDQWIRUWKHRXWVLGHUVWRJHWWRNQRZWKHFRPSDQ\ZHOOHQRXJKWREHDEOH
WRJLYHXVHIXODGYLFH7RDFKLHYH WKLV LW LV FULWLFDO WKDW WKH\ ZRUN FORVHO\ WRJHWKHU ZLWK
WKHSHRSOHLQWKHFRPSDQ\SHUIRUPLQJWKHDVVHVVPHQW

  $VVHVVPHQWGHVLJQ
x +ROG D SUHVHQWDWLRQ IRU WKH SHUVRQV SDUWLFLSDWLQJ LQ WKH DVVHVVPHQW 7KLV SUHVHQWDWLRQ
VKRXOG EH ERWK PRWLYDWLQJ IRU WKH DVVHVVPHQW DQG VHFXUH WKDW HYHU\ERG\ KDV WKH VDPH
XQGHUVWDQGLQJRIWKHTXHVWLRQVDQGWKHJRDOVRIWKHDVVHVVPHQW
x 'XULQJ WKH DVVHVVPHQW WKHUH ZLOO DOZD\V EH GLVFXVVLRQV UHJDUGLQJ WKH LQWHUSUHWDWLRQ RI
TXHVWLRQV ,W LV WKHUHIRUH DGYDQWDJHRXV WR OHW WKH SDUWLFLSDQWV FRQGXFW WKH DVVHVVPHQW DW
WKHVDPHWLPH
x $OOLQIRUPDWLRQVKRXOGEHWUHDWHGDVFRQILGHQWLDO,IQRWWKHUHZLOODOZD\VEHVRPHRQHQRW
VSHDNLQJIURPWKHKHDUW

  $VVHVVPHQWLPSOHPHQWDWLRQ
x 'R QRW ZDLW WRR ORQJ EHIRUH SHUIRUPLQJ WKH IHHGEDFNVHVVLRQ 7KLV PD\ OHDG WR ORVV RI
63,IRFXVLQWKHGHSDUWPHQWFRPSDQ\

±±
&+$37(5

x ,IGHILQLWLRQVRITXHVWLRQVDUHGLVFXVVHGGXULQJLPSOHPHQWDWLRQLWLVZLVHWRGRFXPHQWWKH
FRQFOXVLRQV RI WKHVH GLVFXVVLRQV 'XULQJ WKH DQDO\VLV DQG IHHGEDFN VHVVLRQ LW LV KLJKO\
SRVVLEOHWKDWWKHVHTXHVWLRQVZLOOEHGLVFXVVHGDJDLQDQGWKHSDUWLFLSDQWVZLOOQRWDOZD\V
UHPHPEHUKRZWKH\LQWHUSUHWHGWKHVHGXULQJWKHDVVHVVPHQW
  'DWDDQDO\VLVDQGIHHGEDFN
x 'R QRW OHDYH WKH IHHGEDFN VHVVLRQ ZLWKRXW LGHQWLI\LQJ FRQFUHWH DUHDV IRU LPSURYHPHQW
7KHVHDUHDVZLOOEHLQSXWWRWKHQH[WSKDVHRILPSURYHPHQW±DFWLRQSODQQLQJ
x 7RKDYHDXVHIXOGLVFXVVLRQLQWKLVVHVVLRQPDNHVXUHWKHJURXSSDUWLFLSDWLQJLVQRWWRR
ODUJHRUWRRVPDOO ,IWKHUHLVDELJ JURXSWKHDVVHVVPHQWOHDGHULQWKH FRPSDQ\VKRXOG
SUHSDUHWKHGDWDWRVXJJHVWVRPHNH\DUHDVEHIRUHWKHKDOIGD\ZRUNVKRS7KHLGHDOVL]H
RIWKHJURXSLV±SHRSOH

0D\EHWKHPRVWYDOXDEOHOHVVRQOHDUQHGZDVWKHQHHGIRUWKHDVVHVVPHQWWREHFORVHO\DOLJQHG
ZLWKDQGWDLORUHGWRWKHFRPSDQ\¶VRYHUDOOVWUDWHJ\:LWKRXWWKLVLWLVKDUGWRJHWDFFHSWDQFH
E\WKHPDQDJHUVOHDGLQJWRIHZHUUHVRXUFHVDQGORZSULRULW\,WLVDOVRQHFHVVDU\ZLWKDWLJKW
WLPHVFKHGXOH:DLWLQJWRRORQJEHWZHHQWKHVWHSVZLOORQO\ORZHUWKHLQWHUHVWDQGPRWLYDWLRQ

 &DVH6WXG\&([SORULQJWKH8WLOLW\RI)RUPDO5RXWLQHVWR
7UDQVIHU.QRZOHGJHDQG([SHULHQFH
7R IXUWKHU YDOLGDWH WKH OHDUQLQJ F\FOH LQ RXU G\QDPLF PRGHO RI 63, ZH PDGH D VHSDUDWH
HPSLULFDO VWXG\ ZLWK  GHYHORSHUV DQG  PDQDJHUV LQ ILYH ,7 FRPSDQLHV RQ WKH XWLOLW\ RI
IRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJHDQGH[SHULHQFH2ISDUWLFXODUFRQFHUQZDVWKHHIIHFWRI
SDUWLFLSDWLRQ RQ WKH UHODWLRQVKLS EHWZHHQ RUJDQL]DWLRQDO PHPRU\ DQG ORFDO NQRZLQJ DQG
SRWHQWLDOGLIIHUHQFHVLQRSLQLRQEHWZHHQGHYHORSHUVDQGPDQDJHUVUHJDUGLQJWKHXWLOLW\RIWKH
RUJDQL]DWLRQV¶URXWLQHV

'DWDFROOHFWLRQIRFXVHGRQDQVZHULQJWKHIROORZLQJIRXUUHVHDUFKTXHVWLRQV

4 :KDWLVWKHNQRZOHGJHRIWKHURXWLQHVEHLQJXVHG"
4 +RZDUHWKHVHURXWLQHVEHLQJXVHG"
4 +RZDUHWKH\XSGDWHG"
4 +RZHIIHFWLYHDUHWKH\DVDPHGLXPIRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFH"

7KHLQWHUYLHZJXLGHXVHGWRDQVZHUWKHVHTXHVWLRQVLVLQFOXGHGLQ$SSHQGL[%

 .QRZOHGJHRIURXWLQHV
$OO UHVSRQGHQWV KDG D IDLUO\ JRRG NQRZOHGJH RI WKH URXWLQHV WKDW ZHUH LQ SODFH LQ WKHLU
UHVSHFWLYH FRPSDQLHV ,Q IDFW WZR WKLUGV RI WKH UHVSRQGHQWV VKRZHG JRRG NQRZOHGJH DERXW



7KHUHVXOWVUHSRUWHGLQWKLVVHFWLRQDUHEDVHGRQ &RQUDGLDQG'\En 

±±
(03,5,&$/5(68/76

WKH FRQWHQW RI WKH URXWLQHV 7DEOH  LOOXVWUDWHV WKLV DQG VKRZV KRZ ZHOO GHYHORSHUV DQG
PDQDJHUVZHUHDEOHWRGHVFULEHWKHVSHFLILFFRQWHQWVRIWKHURXWLQHVLQWKHLUFRPSDQ\
+RZHYHUZKHQLWFDPHWRNQRZOHGJH DERXW KRZ WKH URXWLQHV ZHUH LQWURGXFHG  RI
WKH GHYHORSHUV GLG QRW NQRZ DQ\WKLQJ DERXW WKLV SURFHVV 2Q WKH RWKHU KDQG RQO\ RQH
PDQDJHUGLGQRWNQRZDERXWWKHLQWURGXFWLRQSURFHVV$OOLQDOOLWWXUQHGRXWWKDWDERXW
RIWKH GHYHORSHUV DQG  RI WKH PDQDJHUV KDG DFWLYHO\ SDUWLFLSDWHG LQ WKH LQWURGXFWLRQ RI
URXWLQHV 7DEOH 
,W VHHPHG WR EH D FRPPRQ XQGHUVWDQGLQJ UHJDUGLQJ WKH REMHFWLYH RI KDYLQJ IRUPDO
URXWLQHV 0RVW UHVSRQGHQWV VDLG WKDW VXFK URXWLQHV ZHUH XVHIXO ZLWK UHVSHFW WR TXDOLW\
DVVXUDQFH 2WKHU UHVSRQGHQWV VDLG WKDW WKH\ ZRXOG HQDEOH D PRUH XQLILHG ZD\ RI ZRUNLQJ
+RZHYHUWKH\HPSKDVL]HGWKDW

³5RXWLQHVVKRXOGQRWEHIRUPDOLVWLFEXWUDWKHUXVHIXODQGQHFHVVDU\´

5HVSRQGHQWVLQWKHWKUHH,62FHUWLILHGFRPSDQLHVFODLPHGWKDWWKHLUURXWLQHVZHUHILUVW
DQG IRUHPRVW HVWDEOLVKHG WR ³JHW WKH FHUWLILFDWH RQ WKH ZDOO´ DQG WKDW WKH TXDOLW\ RI WKHLU
VRIWZDUH SURFHVVHV KDG JDLQHG OLWWOH RU QRWKLQJ IURP WKH ,62 FHUWLILFDWLRQ 2QH RI WKH
UHVSRQGHQWVH[SUHVVHGKLVYLHZVRQWKLVE\WKHIROORZLQJH[DPSOH

³<RXPLJKWEH,62FHUWLILHGWRSURGXFH OLIHEHOWV LQ FRQFUHWH DV ORQJ DV \RX SXW WKH H[DFW
VDPHDPRXQWRIFRQFUHWHLQHDFKOLIHEHOW´

$OWKRXJKVRPHRIWKHUHVSRQGHQWVZHUHFULWLFDOWRWKHURXWLQHVVWDWLQJWKDW

³RIWKHURXWLQHVDUHXVHIXOZKLOHWKHUHPDLQLQJLVQRQVHQVH´

0RVWUHVSRQGHQWVQHYHUWKHOHVVKDGDJRRGLPSUHVVLRQRIWKHURXWLQHVW\SLFDOO\VWDWLQJWKDW

³5RXWLQHVDUHDSUHUHTXLVLWHIRULQWHUQDOFROODERUDWLRQ´

³5RXWLQHVDUHDUHDVVXUDQFHDQGRIJUHDWKHOS´

 8VHRIURXWLQHV
6RIWZDUHGHYHORSHUVDQGPDQDJHUVDJUHHGRQWKHGHJUHHWRZKLFKWKHURXWLQHVZHUHXVHG,Q
JHQHUDO WKH\ DQVZHUHG WKDW DERXW  RI WKH URXWLQHV ZHUH LQ XVH DQG WKDW WKH PRUH
H[SHULHQFHG GHYHORSHUV XVHG WKH URXWLQHV WR D OHVVHU H[WHQW WKDQ WKH PRUH LQH[SHULHQFHG
GHYHORSHUVGR

7DEOH.QRZOHGJHRIFRPSDQ\URXWLQHV

6RIWZDUHGHYHORSHUV 0DQDJHUV
Q  Q 
)UHTXHQF\ 3HUFHQW )UHTXHQF\ 3HUFHQW

/LWWOH    
6RPH    
0XFK    

±±
&+$37(5

7DEOH'HJUHHRILQYROYHPHQWGXULQJLQWURGXFWLRQRIURXWLQHV

'HJUHHRILQYROYHPHQW
/RZ +LJK
)UHTXHQF\ 3HUFHQW )UHTXHQF\ 3HUFHQW

'HYHORSHUV    
0DQDJHUV    

)XUWKHUPRUHLWZDVDFRPPRQDJUHHPHQWWKDW

³7KHUHLVQRSRLQWLQKDYLQJURXWLQHVWKDWDUHQRWFRQVLGHUHGXVHIXO´

+RZHYHUWKHVWDWXVRIWKHURXWLQHV DPRQJWKHVRIWZDUH GHYHORSHUV ZDV KLJKO\ GLYHUJHQW DV


VHHQIURPWKHIROORZLQJVWDWHPHQWV

³7KHURXWLQHVDUHJHQHUDOO\JRRGDQGXVHIXOEXWVRPHGHYHORSHUVDUHIUXVWUDWHGUHJDUGLQJ
WKHLUXVH´

³7KHV\VWHPLVEXUHDXFUDWLF±LWZDVEHWWHUEHIRUHZKHQZHKDGPRUHIUHHGRPWRGHFLGH
IRURXUVHOYHVZKDWVKRXOGEHVWEHGRQH´

³7KHURXWLQHVDUHHDV\WRXVH´

³5RXWLQHVDUHXQLQWHUHVWLQJDQGUHYLVLRQPHHWLQJVDUHERULQJ´

 8SGDWLQJRIURXWLQHV
1RQH RI WKH FRPSDQLHV KDG VFKHGXOHG UHYLVLRQV DV SDUW RI WKH SURFHVV IRU XSGDWLQJ WKHLU
URXWLQHV0RVWDQVZHUVWRWKLVLVVXHZHUHUDWKHUYDJXH6RPHUHVSRQGHQWVH[SODLQHGWKDWVXFK
UHYLVLRQV ZHUH LQIRUPDOO\ WULJJHUHG ZKLOH RWKHU UHVSRQGHQWV GLG QRW NQRZ KRZ WR SURSRVH
DQGLPSOHPHQWFKDQJHVWRH[LVWLQJURXWLQHV
+RZHYHUUHVSRQGHQWVIURPDOORIWKHFRPSDQLHVERWKPDQDJHUVDQGVRIWZDUHGHYHORSHUV
VDLG WKDW DOO HPSOR\HHV LQ WKHLU UHVSHFWLYH FRPSDQLHV FRXOG SDUWLFLSDWH LQ WKH UHYLVLRQ
DFWLYLWLHVLIWKH\ZDQWHGWR

 5RXWLQHVDVDPHGLXPIRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFH
7KHDQVZHUVWR WKLV LVVXH YDULHG D ORW DQG LQGLFDWHG KLJKO\ GLIIHUHQW DWWLWXGHV UHJDUGLQJ WKH
HIIHFWLYHQHVVRIIRUPDOURXWLQHVIRUNQRZOHGJHDQGH[SHULHQFHWUDQVIHU3DUWLFXODUO\LWVHHPHG
WREHDFOHDUGLIIHUHQFHLQMXGJPHQWEHWZHHQVRIWZDUHGHYHORSHUVDQGPDQDJHUV:KLOHVHYHQ
RIWKHWHQPDQDJHUVUHJDUGHGZULWWHQURXWLQHVDVDQHIILFLHQWPHGLXPIRUNQRZOHGJHWUDQVIHU
QRQHRIWKHGHYHORSHUVGLG)XUWKHUPRUHKDOIRIWKHGHYHORSHUVFRQVLGHUHGVXFKURXWLQHVWREH
LQHIILFLHQWIRUNQRZOHGJHWUDQVIHUZKLOHRQO\RQHRIWKHPDQDJHUVVKDUHGWKLVYLHZ
7\SLFDOO\PDQDJHUVVDLGWKDWZULWWHQURXWLQHVZHUHLPSRUWDQWDVPHDQVIRUUHSODFLQJWKH
NQRZOHGJHRIWKHSHRSOHWKDWKDGOHIWWKHFRPSDQ\6RIWZDUHGHYHORSHUVRQWKHRWKHUKDQG

±±
(03,5,&$/5(68/76

GLG QRW PDNH VXFK D FOHDU FRQQHFWLRQ EHWZHHQ H[SHULHQFH NQRZOHGJH WUDQVIHU DQG IRUPDO
URXWLQHV 2QH VRIWZDUH GHYHORSHU VDLG WKDW GLIIHUHQW JURXSV ZLWKLQ WKH FRPSDQ\ QHYHU UHDG
HDFKRWKHU¶VUHSRUWVZKLOHDQRWKHUGHYHORSHUPDLQWDLQHGWKDWLWZRXOGWDNHWRRPXFKWLPHWR
OHDUQDERXWWKHH[SHULHQFHRIWKHRWKHUJURXSV6HYHUDORIWKHGHYHORSHUVH[SODLQHGWKHLUYLHZV
E\VWDWLQJWKDWWKHGRFXPHQWDWLRQZDVQRWJRRGHQRXJKLWZDVKDUGWRILQGERULQJWRXVHDQG
WKDWLWWDNHVWRRPXFKWLPH
:KHQDVNHGDERXWXVHIXODOWHUQDWLYHVWRZULWWHQURXWLQHVWKHUHVSRQGHQWVDQVZHUHGWKDW
WKH\ UHJDUGHG VRPH NLQG RI ³([SHULHQFH EDVH´ RU ³1HZVJURXS´ DV WKH KLJKHVW UDQNHG
DOWHUQDWLYH 2WKHU KLJKUDQNHG DOWHUQDWLYHV ZHUH ³6RFLDOL]DWLRQ´ ³'LVFXVVLRQ JURXSV´
³([SHULHQFH UHSRUWV´ ³*URXS PHHWLQJV´ DQG ³2QWKHMRE WUDLQLQJ´ 7DEOH  VKRZV WKHVH
DOWHUQDWLYHVLQUDQNRUGHU LVEHVW IRUVRIWZDUHGHYHORSHUVDQGPDQDJHUVUHVSHFWLYHO\
:HDOVRDVNHGWKHUHVSRQGHQWV DERXW ZKDWWKH\ UHJDUGHGDVWKHPRVWLPSRUWDQWEDUULHUV
DJDLQVWWUDQVIHURINQRZOHGJHDQGH[SHULHQFH1HDUO\DOORIWKHPVDLGWKDWVXFKWUDQVIHUILUVW
DQGIRUHPRVWLVDSHUVRQDOPDWWHUGHSHQGLQJRQKRZPXFKHDFKLQGLYLGXDOZKLVKHVWRVKDUH
WKHLUOHVVRQVOHDUQHGZLWKRWKHUV)XUWKHUPRUHWKHZLOOLQJQHVVWRVKDUHGHSHQGVRQDYDLODEOH
WLPHSHUVRQDOLW\VHOILQWHUHVWDQGFRPSDQ\FXOWXUH
$V VKRZQ LQ 7DEOH  VHYHQ VL[ GHYHORSHUV DQG RQH PDQDJHU  RI WKH  UHVSRQGHQWV
DQVZHUHG D GHILQLWH ³1R´ WR WKH TXHVWLRQ UHJDUGLQJ WKH HIILFLHQF\ RI ZULWWHQ URXWLQHV DV D
PHGLXP IRU WUDQVIHU RI NQRZOHGJH DQG H[SHULHQFH /LNHZLVH VHYHQ UHVSRQGHQWV PDQDJHUV
RQO\  DQVZHUHG DQ HTXDOO\ FOHDU ³<HV´ WR WKH VDPH TXHVWLRQ 7KH ODVW QLQH UHVSRQGHQWV
DQVZHUHG VRPHZKHUH LQ EHWZHHQ DQG VDLG WKDW LQ VRPH FDVHV ZULWWHQ URXWLQHV FRXOG EH
HIIHFWLYHZKLOHLQRWKHUVLWXDWLRQVWKH\ZRXOGUDWKHUEHDEDUULHU
'XH WR WKH UDWKHU VPDOO VDPSOH VL]H LQ WKLV SDUW RI WKH VWXG\ DQG WKH ORZ H[SHFWHG
IUHTXHQF\LQVHYHUDORIWKHFHOOVLQ7DEOHZHFRPSDUHGWKHUHVSRQGHQWV¶DVVHVVPHQWVRI
WKH URXWLQHV DQG WKHLU MRE IXQFWLRQ XVLQJ )LVKHU¶V H[DFW SUREDELOLW\ WHVW :LWK WKLV WHVW WKH
H[DFWSUREDELOLW\ RUVLJQLILFDQFHOHYHO WKDWWKHREWDLQHGUHVXOWLVSXUHO\DSURGXFWRIFKDQFH
LVFDOFXODWHG +D\V 7KHWHVWVWDWLVWLFRIZDVKLJKO\VLJQLILFDQW S WZR
WDLOHG  7KXV ZH UHMHFWHG WKH K\SRWKHVLV RI LQGHSHQGHQFH DQG FRQFOXGHG WKDW WKHUH LV D
GLIIHUHQFHLQWKHGLVWULEXWLRQRIDVVHVVPHQWRIWKHXVHIXOQHVVRIIRUPDOURXWLQHVDVDQHIILFLHQW
PHGLXP IRU WUDQVIHU RI NQRZOHGJH DQG H[SHULHQFH EHWZHHQ VRIWZDUH GHYHORSHUV DQG
PDQDJHUV

7DEOH$OWHUQDWLYHPHGLDIRUNQRZOHGJHWUDQVIHU

5DQN
0HGLXP 'HYHORSHUV 0DQDJHUV

([SHULHQFHEDVHQHZVJURXSV  
6RFLDOL]DWLRQ  
'LVFXVVLRQJURXSV  
([SHULHQFHUHSRUWV  
2QWKHMREWUDLQLQJ  
:RUNZLWKH[WFRQVXOWDQWV  
*URXSPHHWLQJV  

±±
&+$37(5

7DEOH'R\RXUHJDUGZULWWHQURXWLQHVDVDQHIILFLHQWPHGLXPIRUWUDQVIHURINQRZOHGJH
DQGH[SHULHQFH"

6RIWZDUHGHYHORSHUV 0DQDJHUV
Q  Q 
)UHTXHQF\ 3HUFHQW )UHTXHQF\ 3HUFHQW

<HV    
%RWK    
1R    

7DEOH'HJUHHRILQYROYHPHQWYVDVVHVVPHQWRIIRUPDOURXWLQHVDVDQHIILFLHQWPHGLXP
IRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFH

'HJUHHRILQYROYHPHQW
(IILFLHQWPHGLXP" /RZ +LJK

<HV  
%RWK  
1R  

6LQFHVRIWZDUHGHYHORSHUVKDGEHHQ LQYROYHG LQ WKH SURFHVV RI LQWURGXFLQJ WKH URXWLQHV WR D
PXFKOHVVHUH[WHQWWKDQWKHPDQDJHUV DERXWRIWKHGHYHORSHUVDQGRIWKHPDQDJHUV
KDG DFWLYHO\ SDUWLFLSDWHG LQ WKH LQWURGXFWLRQ RI URXWLQHV VHH 7DEOH   ZH FRPSDUHG WKH
UHVSRQGHQW¶VDVVHVVPHQWRIWKHURXWLQHVZLWKWKHOHYHORILQYROYHPHQWXVLQJ)LVKHU¶VH[DFWWHVW
7DEOH 7KHWHVWVWDWLVWLFRIZDVKLJKO\VLJQLILFDQW SWZRWDLOHG 7KXV
ZHFRQFOXGHGWKDWWKHUHLVDGLIIHUHQFHLQWKHDVVHVVPHQWRIWKHXVHIXOQHVVRIIRUPDOURXWLQHV
DVDQHIILFLHQWPHGLXPIRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFHZLWKUHVSHFWWRWKHGHJUHHRI
LQYROYHPHQWLQWKHLQWURGXFWLRQSURFHVV

 0DLQ6XUYH\7KH.H\)DFWRUVRI6XFFHVVLQ63,
,Q WKLV VHFWLRQ ZH UHSRUW RQ WKH UHVXOWV IURP WHVWLQJ WKH K\SRWKHVHV DQG H[SORULQJ WKH
UHODWLRQVKLSVLQWKH PDLQ TXDQWLWDWLYH VXUYH\ )LUVW KRZHYHU ZH PDNH DQ HYDOXDWLRQ RI WKH
DQDO\WLFDODVVXPSWLRQVXQGHUO\LQJWKHDQDO\VHVE\H[DPLQLQJWKHVWDWLVWLFDOSURSHUWLHVRI WKH
LQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV

 (YDOXDWLRQRIDQDO\WLFDODVVXPSWLRQV
6LQFH ZH DUH WHVWLQJ WKH K\SRWKHVHV LQ WKLV VWXG\ XVLQJ SDUDPHWULF VWDWLVWLFV VXFK DV WKH
3HDUVRQ SURGXFWPRPHQW FRUUHODWLRQ FRHIILFLHQW WKH WWHVW WKH ) VWDWLVWLF DQG PXOWLSOH
UHJUHVVLRQDQDO\VLVLWLVHVVHQWLDOWKDWWKHDVVXPSWLRQVRIWKHVHDQDO\VHVEHPHW0HHWLQJWKHVH
DVVXPSWLRQV ZLOO HQVXUH WKDW WKH GDWD REWDLQHG DUH WUXO\ UHSUHVHQWDWLYH DQG WKDW ZH KDYH

±±
(03,5,&$/5(68/76

REWDLQHG WKH EHVW UHVXOWV SRVVLEOH +HQFH WKH SXUSRVH RI WKLV VHFWLRQ LV WR DGGUHVV WKH
DVVHVVPHQWRIERWKWKHLQGLYLGXDOYDULDEOHVDQGWKHRYHUDOOUHODWLRQVKLSVRIWKHYDULDWH
,Q WKH FRXUVH RI DQDO\]LQJ WKH ELYDULDWH FRUUHODWLRQV FDOFXODWLQJ WKH UHJUHVVLRQ
FRHIILFLHQWV DQG HVWLPDWLQJ WKH GHSHQGHQW YDULDEOH ZH H[DPLQHG ZKHWKHU WKH IXQGDPHQWDO
DVVXPSWLRQV XQGHUO\LQJ PXOWLSOH UHJUHVVLRQ DQDO\VLV ZHUH PHW 7KHUHIRUH WKH IROORZLQJ
DVVXPSWLRQVZHUHH[DPLQHGQRUPDOLW\KRPRVFHGDVWLFLW\OLQHDULW\ DQGLQGHSHQGHQFHRIWKH
HUURU WHUPV 'DYLV   ,Q DGGLWLRQ ZH H[DPLQHG SRWHQWLDOO\ LQIOXHQWLDO REVHUYDWLRQV
RXWOLHUV DQGWKHGHJUHHRIFROOLQHDULW\DQGPXOWLFROOLQHDULW\
7KHILUVWDQGPRVWIXQGDPHQWDODVVXPSWLRQLQSDUDPHWULFVWDWLVWLFVDQGKHQFHLQPXOWLSOH
UHJUHVVLRQDQDO\VLVLVWKHQRUPDOLW\RIWKHGDWD7ZRLPSRUWDQWFKDUDFWHULVWLFVWRPHDVXUHWKH
QRUPDOLW\ RI WKH GDWD GLVWULEXWLRQV NXUWRVLV DQG VNHZQHVV DUH UHSRUWHG LQ 7DEOH  :KLOH
NXUWRVLVLVDPHDVXUHRIWKH³SHDNHGQHVV´RU³IODWQHVV´RIDGDWDGLVWULEXWLRQFRPSDUHGZLWK
WKHQRUPDOGLVWULEXWLRQVNHZQHVVLVDPHDVXUHRIWKHV\PPHWU\RIDGLVWULEXWLRQ +DLUHWDO
 ,QDGGLWLRQZHWHVWHG WKH DVVXPSWLRQ RI QRUPDOLW\ PRUH IRUPDOO\ WKURXJK XVH RI WKH
RQHVDPSOH .ROPRJRURY6PLUQRY WHVW IRU QRUPDOLW\ ZKLFK FDOFXODWHV WKH OHYHO RI
VLJQLILFDQFH IRU WKH GLIIHUHQFH IURP D QRUPDO GLVWULEXWLRQ 7KH .ROPRJRURY6PLUQRY =
VWDWLVWLFIRUDOOYDULDEOHVDUHUHSRUWHGLQ7DEOHWRJHWKHUZLWKWKHFRUUHVSRQGLQJSYDOXHV
%RWK NXUWRVLV DQG VNHZQHVV VKRXOG KDYH DQ DEVROXWH YDOXH VPDOOHU WKDQ RQH .DSODQ
  $QRWKHU FRPPRQ FULWHULRQ LV WKDW WKH UDWLR RI HDFK RI WKHVH VWDWLVWLFV WR LWV VWDQGDUG
HUURU VKRXOG EH OHVV WKDQ  DQG JUHDWHU WKDQ ± 6366 E  ([DPLQLQJ WKH YDOXHV RI
VNHZQHVVDQGNXUWRVLVLQ7DEOHJDYHQRVHULRXVFRQFHUQLQWKLVVWXG\VLQFHWKHLUYDOXHVIRU
DOOVFDOHPHDQVZHUHUHODWLYHO\ORZ ]HURLQGLFDWLQJQRUPDOVSUHDG $OOUDWLRVRINXUWRVLVDQG
VNHZQHVVWRLWVVWDQGDUGHUURUKDGDQDEVROXWHYDOXHVPDOOHUWKDQ+HQFHWKHVNHZQHVVDQG
NXUWRVLVFRHIILFLHQWVRIDOOYDULDEOHVLQGLFDWHVXSSRUWIRUQRUPDOLW\
)XUWKHUPRUH WKH .ROPRJRURY6PLUQRY = ZDV FRPSXWHG IURP WKH ODUJHVW GLIIHUHQFH
EHWZHHQWKHREVHUYHGDQGWKHRUHWLFDOFXPXODWLYHGLVWULEXWLRQIXQFWLRQVIRUHDFKYDULDEOH7KH
QXOOK\SRWKHVLVLVWKDWWKHVDPSOHGLVWULEXWLRQLVQRUPDOO\GLVWULEXWHG6RLIWKH=VWDWLVWLFLV
VLJQLILFDQW WKHQ WKH QXOO K\SRWKHVLV LV UHMHFWHG DQG WKH DVVXPSWLRQ RI QRUPDOLW\ LV QRW
VXSSRUWHG1RQHRIWKH.ROPRJRURY6PLUQRY=YDOXHVZHUHVLJQLILFDQWDWSEXWERWK
EXVLQHVVRULHQWDWLRQ = S  DQGLQYROYHGOHDGHUVKLS = S  VKRZHG
YDOXHVH[DFWO\DWWKHOHYHORIVLJQLILFDQFH

7DEOH7HVWVIRUQRUPDOLW\RIWKHLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV

.XUWRVLV 6NHZQHVV
9DULDEOH .XUWRVLV VWGHUURU 6NHZQHVV VWGHUURU .6= 6LJ
,QGHSHQGHQW
%XVLQHVVRULHQWDWLRQ      
,QYROYHGOHDGHUVKLS      
(PSOR\HHSDUWLFLSDWLRQ      
0HDVXUHPHQW      
([SORLWDWLRQ      
([SORUDWLRQ      
'HSHQGHQW
2YHUDOO63,VXFFHVV      

±±
&+$37(5

7DEOH7HVWVRIKRPRJHQHLW\RIYDULDQFHV

,QGHSHQGHQWYDULDEOH /HYHQH6WDWLVWLF 6LJQLILFDQFH

%XVLQHVVRULHQWDWLRQ  


,QYROYHGOHDGHUVKLS  
(PSOR\HHSDUWLFLSDWLRQ  
0HDVXUHPHQW  
([SORLWDWLRQ  
([SORUDWLRQ  

%DVHGRQDQRYHUDOODVVHVVPHQWRIWKHUHVXOWVIURPH[DPLQLQJWKHPHDQVVWDQGDUGGHYLDWLRQV
VNHZQHVVNXUWRVLVDQGWKHRQHVDPSOH.ROPRJRURY6PLUQRYWHVWVIRUHDFKRIWKHYDULDEOHV
ZHFRQFOXGHGWKDWWKHDVVXPSWLRQRIQRUPDOLW\LVVXSSRUWHGIRUDOOYDULDEOHV
7KH VHFRQG DVVXPSWLRQ WKDW KDV WR DSSO\ LV KRPRVFHGDVWLFLW\ ZKLFK UHIHUV WR WKH
DVVXPSWLRQWKDWWKHGHSHQGHQWYDULDEOHH[KLELWVHTXDOOHYHOVRIYDULDQFHDFURVVYDOXHVRIWKH
LQGHSHQGHQW YDULDEOHV +RPRVFHGDVWLFLW\ LV GHVLUDEOH EHFDXVH WKH YDULDQFH RI WKH GHSHQGHQW
YDULDEOHEHLQJH[SODLQHGLQWKHGHSHQGHQFHUHODWLRQVKLSVKRXOGQRWEHFRQFHQWUDWHGLQRQO\D
OLPLWHG UDQJH RI WKH LQGHSHQGHQW YDOXHV +DLU HW DO   7KH PRVW FRPPRQO\ XVHG
VWDWLVWLFDO WHVW IRU KRPRJHQHLW\ RI YDULDQFHV LV WKH /HYHQH WHVW RI HTXDO YDULDQFHV 7KH QXOO
K\SRWKHVLVLVWKDWWKHHUURUYDULDQFHRIWKHGHSHQGHQWYDULDEOHLVHTXDODFURVVWKHLQGHSHQGHQW
YDULDEOHV 6366E +HQFHLIWKH/HYHQHVWDWLVWLFLVVLJQLILFDQWWKHQWKHQXOOK\SRWKHVLV
LVUHMHFWHGDQGWKHDVVXPSWLRQRIKRPRVFHGDVWLFLW\LVQRWVXSSRUWHG$FFRUGLQJWR+DLUHWDO
  WKH VWDWLVWLFDO WHVWV IRU VLJQLILFDQFH ZLWK WKH /HYHQH VWDWLVWLF VKRXOG EH PRUH
FRQVHUYDWLYHIRUH[DPSOHXVLQJLQVWHDGRI
7KH DQDO\VLV RI YDULDQFH EHWZHHQ 63, VXFFHVV DQG HDFK RI WKH LQGHSHQGHQW YDULDEOHV
VXSSRUWV WKH DVVXPSWLRQ RI KRPRVFHGDVWLFLW\ VLQFH QRQH RI WKH /HYHQH WHVWV IRU HTXDO
YDULDQFHVVKRZQLQ7DEOHZHUHVLJQLILFDQWDWS)RUWKHLQYROYHGOHDGHUVKLSVFDOH
WKHVLJQLILFDQFHOHYHOZDVLQGLFDWLQJWKDWWKHHTXDOYDULDQFHK\SRWKHVLVLVUHMHFWHGDWWKH
OHYHORIVLJQLILFDQFHDQGWKDW63,VXFFHVVH[KLELWVGLIIHUHQWOHYHOVRIYDULDQFHDFURVVWKH
UDQJH RI LQYROYHG OHDGHUVKLS DW WKLV OHYHO RI VLJQLILFDQFH +RZHYHU WKLV VXJJHVWLRQ LV QRW
VXSSRUWHGDWWKHOHYHORIVLJQLILFDQFH&RQVHTXHQWO\ZHFRQFOXGHWKDWWKHDVVXPSWLRQRI
KRPRVFHGDVWLFLW\DFURVVWKHUDQJHRILQGHSHQGHQWYDULDEOHVLVVXSSRUWHG
7KHWKLUGDVVXPSWLRQWKDWKDVWRDSSO\LVWKHOLQHDULW\RIWKHUHODWLRQVKLSEHWZHHQWKHGH
SHQGHQW DQG LQGHSHQGHQW YDULDEOHV 7KLV UHODWLRQVKLS UHSUHVHQWV WKH GHJUHH WR ZKLFK WKH
FKDQJH LQ WKH GHSHQGHQW YDULDEOH LV DVVRFLDWHG ZLWK WKH LQGHSHQGHQW YDULDEOH +DLU HW DO
 6LQFHFRUUHODWLRQVRQO\UHSUHVHQWWKHOLQHDUDVVRFLDWLRQEHWZHHQYDULDEOHVDQ\QRQOLQ
HDUHIIHFWVZLOOQRWEHUHSUHVHQWHGLQWKH FRUUHODWLRQYDOXH 7KXV D YLRODWLRQ RI WKH OLQHDULW\
DVVXPSWLRQPD\UHVXOWLQDQXQGHUHVWLPDWLRQRIWKHDFWXDOVWUHQJWKRIWKHUHODWLRQVKLS
:H DVVHVVHG OLQHDULW\ E\ DQ DQDO\VLV RI YDULDQFH WDEOH WHVWLQJ WKH DVVXPSWLRQ WKDW WKH
PHDQRIWKHGHSHQGHQWYDULDEOHLVDOLQHDUIXQFWLRQRIHDFKRIWKHLQGHSHQGHQWYDULDEOHV7KH
QXOOK\SRWKHVLVLVWKDWWKHPHDQRIWKHGHSHQGHQWYDULDEOHLVDOLQHDUIXQFWLRQRIWKHYDOXHRI
WKHLQGHSHQGHQWYDULDEOH 6366E +HQFHLIWKHGHYLDWLRQIURPOLQHDULW\LVVLJQLILFDQW
WKHQ WKH QXOO K\SRWKHVLV LV UHMHFWHG DQG WKH DVVXPSWLRQ RI OLQHDULW\ LV QRW VXSSRUWHG 7DEOH

±±
(03,5,&$/5(68/76

 VKRZV WKH ) VWDWLVWLF DQG FRUUHVSRQGLQJ VLJQLILFDQFH OHYHOV WKDW ZDV FRPSXWHG IRU 63,
VXFFHVVE\DOOLQGHSHQGHQWYDULDEOHV
1RQH RI WKH GHYLDWLRQV IURP OLQHDULW\ ZHUH VLJQLILFDQW DW WKH  OHYHO RI VLJQLILFDQFH
LPSO\LQJWKDWWKHDVVXPSWLRQRIOLQHDULW\LVVXSSRUWHGIRUDOOYDULDEOHVDWWKLVOHYHO+RZHYHU
WKH UHODWLRQVKLS ZLWK WKH H[SORLWDWLRQ VFDOH )   S    ZDV VLJQLILFDQW DW WKH 
OHYHOUHMHFWLQJWKHQXOOK\SRWKHVLVRIOLQHDULW\DWWKLVOHYHO2QWKHRWKHUKDQGZHZLOOQRWXVH
WKH PXOWLSOH UHJUHVVLRQ DQDO\VLV WR DVVHVV WKH PDJQLWXGH RI WKH UHJUHVVLRQ FRHIILFLHQWV EXW
RQO\ WHVW IRU WKHLU VLJQLILFDQFH LQ WKH UHJUHVVLRQ HTXDWLRQ LQ RUGHU WR GHWHUPLQH WKH OHYHO RI
VXSSRUW IRU WKH UHVHDUFK K\SRWKHVHV %DVHG RQ WKHVH UHVXOWV ZH FRQFOXGHG WKDW WKH OLQHDULW\
DVVXPSWLRQ ZDV VXIILFLHQWO\ VXSSRUWHG +RZHYHU ZH VKRXOG EH DZDUH RI D SRVVLEOH
XQGHUHVWLPDWLRQ RI WKH VWUHQJWK RI WKH DFWXDO UHODWLRQVKLS EHWZHHQ WKH H[SORLWDWLRQ YDULDEOH
DQG63,VXFFHVV
7KHIRXUWKDVVXPSWLRQLVWKHLQGHSHQGHQFHRIWKHHUURUWHUPVZKLFKGHDOVZLWKWKHHIIHFW
RIFDUU\RYHUIURPRQHREVHUYDWLRQWRDQRWKHU7KDWLVZHDVVXPHWKDWDQ\SUHGLFWHGYDOXHLV
QRWUHODWHGWRDQ\RWKHUSUHGLFWLRQ:HFDQEHVWLGHQWLI\VXFKDQRFFXUUHQFHE\H[DPLQLQJWKH
SDWWHUQ LQ WKH UHVLGXDOV +DLU HW DO   7KH 'XUELQ:DWVRQ WHVW IRU VHULDO FRUUHODWLRQ
PHDVXUHV WKH DVVRFLDWLRQ EHWZHHQ DGMDFHQW UHVLGXDOV DQG KHQFH SRVVLEOH YLRODWLRQV RI WKH
LQGHSHQGHQFHDVVXPSWLRQ$VDUXOHRIWKXPEDWHVWVWDWLVWLFVFORVHWRLQGLFDWHVWKDWWKHUHLV
QR SUREOHP RI DVVRFLDWLRQ EHWZHHQ DGMDFHQW UHVLGXDOV 7KH 'XUELQ:DWVRQ VWDWLVWLF LQ WKH
VDPSOHZDV%DVHGRQWKLVUHVXOWZHFRQFOXGHGWKDWWKHLQGHSHQGHQFH DVVXPSWLRQ ZDV
VXSSRUWHG
)LQDOO\ZHPDGHDQDVVHVVPHQWRIHDFKREVHUYDWLRQDFURVVWKHVHWRIYDULDEOHVLQRUGHUWR
LGHQWLI\ DQ\ REVHUYDWLRQV WKDW DUH LQIOXHQWLDO DQG WR GHWHUPLQH ZKHWKHU WKH\ VKRXOG EH
H[FOXGHG IURP WKH DQDO\VLV &RRN¶V GLVWDQFH LV FRQVLGHUHG WKH VLQJOH PRVW UHSUHVHQWDWLYH
PHDVXUH RI LQIOXHQFH RQ RYHUDOO ILW LQ PXOWLSOH UHJUHVVLRQ DQDO\VLV +DLU HW DO   ,W
PHDVXUHV WKH FKDQJH LQ WKH SUHGLFWHG YDOXHV ZKHQ WKH LWK FDVH LV GHOHWHG DV ZHOO DV WKH
REVHUYDWLRQ¶VGLVWDQFHIURPWKHRWKHUREVHUYDWLRQV OHYHUDJH $UXOHRIWKXPE LV WR LGHQWLI\
REVHUYDWLRQV ZLWK D &RRN¶V GLVWDQFH RI  RU JUHDWHU 7KH KLJKHVW &RRN¶V GLVWDQFH LQ WKH
VDPSOH ZDV  ZKLFK LV FRQVLGHUDEO\ ORZHU WKDQ WKH WKUHVKROG RI  +HQFH QR
REVHUYDWLRQVZHUHH[FOXGHGIURPWKHPXOWLSOHUHJUHVVLRQDQDO\VLVDQGQRIXUWKHUDQDO\VLVRI
LQIOXHQWLDOREVHUYDWLRQVZDVPDGH

7DEOH7HVWVIRUOLQHDULW\RIWKHUHODWLRQVKLSEHWZHHQWKHGHSHQGHQWDQGLQGHSHQGHQW
YDULDEOHV

,QGHSHQGHQWYDULDEOH )6WDWLVWLF 6LJQLILFDQFH

%XVLQHVVRULHQWDWLRQ  


,QYROYHGOHDGHUVKLS  
(PSOR\HHSDUWLFLSDWLRQ  
0HDVXUHPHQW  
([SORLWDWLRQ  
([SORUDWLRQ  

±±
&+$37(5

,Q DQ\ LQWHUSUHWDWLRQ RI WKH UHJUHVVLRQ YDULDWH ZH VKRXOG ZH DZDUH RI WKH LPSDFW RI
FROOLQHDULW\DQGPXOWLFROOLQHDULW\&ROOLQHDULW\LVWKH H[SUHVVLRQ IRU WKH UHODWLRQVKLS EHWZHHQ
WZR LQGHSHQGHQW YDULDEOHV +DLU HW DO   $ PHDQV RI LGHQWLI\LQJ FROOLQHDULW\ LV DQ
H[DPLQDWLRQ RI WKH FRUUHODWLRQ PDWUL[ IRU WKH LQGHSHQGHQW YDULDEOHV 7KH SUHVHQFH RI KLJK
FRUUHODWLRQ JHQHUDOO\WKRVHRIDQGDERYH LVWKHILUVWLQGLFDWLRQRIVXEVWDQWLDOFROOLQHDULW\
+DLUHWDOS 
7DEOHVKRZVWKHPHDQVVWDQGDUGGHYLDWLRQVDQGFRUUHODWLRQVDPRQJWKHLQGHSHQGHQW
YDULDEOHV 2XW RI  FRUUHODWLRQV EHWZHHQ WKH LQGHSHQGHQW YDULDEOHV WZR KDYH D FRUUHODWLRQ
FRHIILFLHQWODUJHUWKDQ7KHKLJKHVWFRUUHODWLRQ  LVEHWZHHQLQYROYHGOHDGHUVKLSDQG
EXVLQHVV RULHQWDWLRQ %U\PDQ DQG &UDPHU   VXJJHVWHG  LQVWHDG RI  DV WKH
WKUHVKROG ³7KH 3HDUVRQ¶V U EHWZHHQ HDFK SDLU RI LQGHSHQGHQW YDULDEOHV VKRXOG QRW H[FHHG
RWKHUZLVHWKHLQGHSHQGHQWYDULDEOHVWKDWVKRZDUHODWLRQVKLSDWRULQH[FHVVRIPD\
EH VXVSHFWHG RI H[KLELWLQJ PXOWLFROOLQHDULW\´ LELG S   +RZHYHU DOO FRUUHODWLRQ
FRHIILFLHQWVLQWKLVUHVHDUFKDUHEHORZWKHFXWRIIRIIRUWKHFROOLQHDULW\SUREOHP
0XOWLFROOLQHDULW\ LV WKH H[SUHVVLRQ IRU WKH UHODWLRQVKLS EHWZHHQ PRUH WKDQ WZR
LQGHSHQGHQWYDULDEOHV +DLUHWDO 7KDWLVRQHRIWKHLQGHSHQGHQWYDULDEOHVLVDOLQHDU
FRPELQDWLRQ RI RWKHU LQGHSHQGHQW YDULDEOHV 7ZR FRPPRQ PHDVXUHV IRU DVVHVVLQJ
PXOWLFROOLQHDULW\ DUH WKH WROHUDQFH YDOXH DQG LWV UHFLSURFDO ± WKH YDULDQFH LQIODWLRQ IDFWRU
9,)  7ROHUDQFH LV WKH DPRXQW RI YDULDELOLW\ RI WKH VHOHFWHG LQGHSHQGHQW YDULDEOH QRW
H[SODLQHG E\ WKH RWKHU LQGHSHQGHQW YDULDEOHV +DLU HW DO   $ YDULDEOH ZLWK YHU\ ORZ
WROHUDQFH FRQWULEXWHV OLWWOH LQIRUPDWLRQ WR D PRGHO DQG FDQ FDXVH FRPSXWDWLRQDO SUREOHPV
7KXV VPDOO WROHUDQFH YDOXHV DQG FRUUHVSRQGLQJO\ KLJK 9,) YDOXHV  GHQRWH KLJK
PXOWLFROOLQHDULW\
$FRPPRQ FXWRII WKUHVKROG LV D WROHUDQFH YDOXH RI  DQG WKXV D 9,) YDOXH RI 
+DLUHWDO 7KLVFXWRIIYDOXHFRUUHVSRQGVWRDPXOWLSOHFRUUHODWLRQRI+RZHYHU
UHVWULFWLQJWKHPXOWLSOHFRUUHODWLRQWRVLPLODUWRWKHUXOHDSSOLHGIRUWKHSDLUZLVHFRUUHOD
WLRQ PDWUL[ ZRXOG UHVXOW LQ D WROHUDQFH YDOXH RI  7KXV DQ\ YDULDEOHV ZLWK WROHUDQFH
YDOXHVEHORZ RUD9,)DERYH ZRXOGKDYHDPXOWLSOHFRUUHODWLRQRIPRUHWKDQ

7DEOH,WHPPHDQVVWDQGDUGGHYLDWLRQVDQGFRUUHODWLRQVDPRQJWKHLQGHSHQGHQW
YDULDEOHV

,QGHSHQGHQWYDULDEOH 0HDQ 6'      

%XVLQHVVRULHQWDWLRQ   


,QYROYHGOHDGHUVKLS    
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW      
([SORLWDWLRQ       
([SORUDWLRQ        

S S S


 $OOWWHVWVDUHRQHWDLOHG

±±
(03,5,&$/5(68/76

7DEOH7HVWVIRUPXOWLFROOLQHDULW\EHWZHHQWKHLQGHSHQGHQWYDULDEOHV

9DULDQFH
,QGHSHQGHQWYDULDEOH 5 7ROHUDQFH ,QIODWLRQ)DFWRU

%XVLQHVVRULHQWDWLRQ   


,QYROYHGOHDGHUVKLS   
(PSOR\HHSDUWLFLSDWLRQ   
0HDVXUHPHQW   
([SORLWDWLRQ   
([SORUDWLRQ   

7R LQYHVWLJDWH WKH SRWHQWLDO SUREOHP RI PXOWLFROOLQHDULW\ ZH UHJUHVVHG HDFK LQGHSHQGHQW
YDULDEOH DJDLQVW WKH UHPDLQLQJ LQGHSHQGHQW YDULDEOHV 7KH PXOWLSOH FRUUHODWLRQ FRHIILFLHQWV
UHVXOWLQJ IURP WKHVH UHJUHVVLRQV VKRZQ LQ 7DEOH  DUH KLJK EXW WKH\ GR QRW UHSUHVHQW
PXOWLFROOLQHDULW\SUREOHPVVLQFHWKH\DUHDOOEHORZ7KHKLJKHVW9,)YDOXHLQWKHVDPSOH
ZDV  7KHVH UHVXOWV LQGLFDWH WKDW LQWHUSUHWDWLRQ RI WKH UHJUHVVLRQ YDULDWH FRHIILFLHQWV
VKRXOGQRWEHDIIHFWHGDGYHUVHO\E\FROOLQHDULW\DQGPXOWLFROOLQHDULW\LQWKLVUHVHDUFK
,Q FRQFOXVLRQ NXUWRVLV VNHZQHVV DQG WKH RQHVDPSOH .ROPRJRURY6PLUQRY WHVWV DUH
ZLWKLQ WKH DFFHSWDEOH UDQJH IRU WKH QRUPDO GLVWULEXWLRQ DVVXPSWLRQ 7KH DVVXPSWLRQV RI
KRPRVFHGDVWLFLW\ OLQHDULW\ DQG LQGHSHQGHQFH RI WKH HUURU WHUPV ZHUH VXSSRUWHG DQG QR
LQIOXHQWLDO REVHUYDWLRQV ZHUH LGHQWLILHG )XUWKHUPRUH LQYHVWLJDWLRQV RI FROOLQHDULW\ DQG
PXOWLFROOLQHDULW\ LQGLFDWH QR SUREOHPV +HQFH WKH LQYHVWLJDWLRQV RI WKH VWDWLVWLFDO SURSHUWLHV
RIWKHLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHVGRQRWFDXVHFRQFHUQIRUWHVWLQJWKHK\SRWKHVHV
:LWK WKH VDPSOH GHHPHG DGHTXDWH IRU WKH REMHFWLYHV RI WKH VWXG\ DQG WKH DVVXPSWLRQV
DVVHVVHG IRU WKH LQGHSHQGHQW DQG GHSHQGHQW YDULDEOHV ZH QRZ SURFHHG WR WHVWLQJ WKH
K\SRWKHVHV

 7HVWLQJLQGLYLGXDOUHODWLRQVKLSV
+\SRWKHVHVWKURXJKFRQVLGHUWKHLQGLYLGXDOUHODWLRQVKLSVEHWZHHQ63,VXFFHVVDQGHDFKRI
WKH VL[ LQGHSHQGHQW YDULDEOHV 7KH WHVWLQJ RI WKHVH K\SRWKHVHV FDOOV IRU WKH XVH RI ELYDULDWH
FRUUHODWLRQV,QDGGLWLRQWRH[DPLQHHDFKLQGHSHQGHQWYDULDEOH¶VFRUUHODWLRQZLWKRYHUDOO63,
VXFFHVVZHDOVRH[DPLQHGWKHFRUUHODWLRQVZLWKHDFKRIWKHWZRXQGHUO\LQJVXFFHVVPHDVXUHV
SHUFHLYHGOHYHORIVXFFHVVDQGRUJDQL]DWLRQDOSHUIRUPDQFH+RZHYHUDSSURSULDWHWHVWVRIWKH
ELYDULDWHFRUUHODWLRQVUHTXLUHWKDWWKHWZRFRQWH[WXDOIDFWRUVHQYLURQPHQWDQGRUJDQL]DWLRQDO
VL]HEHSDUWLDOOHGIURPWKHDQDO\VLV7DEOHVKRZVERWKWKH]HURRUGHUFRUUHODWLRQVDQGWKH
SDUWLDOFRUUHODWLRQVZKHQWKH HIIHFWVRIWKH FRQWH[WXDOYDULDEOHVKDYHEHHQUHPRYHGEHWZHHQ
WKHLQGHSHQGHQWYDULDEOHVDQGHDFKRIWKH63,VXFFHVVPHDVXUHV

+\SRWKHVLV%DVHG RQ WKH GLVFXVVLRQ LQ&KDSWHU  ZH GHILQHG EXVLQHVV RULHQWDWLRQ DV WKH
H[WHQW WR ZKLFK 63, JRDOV DQG DFWLRQV DUH DOLJQHG ZLWK H[SOLFLW DQG LPSOLFLW EXVLQHVV JRDOV
DQGVWUDWHJLHV)XUWKHUPRUHZHDUJXHGWKDWEXVLQHVVRULHQWDWLRQLVDNH\IDFWRUWRIDFLOLWDWHD
VXFFHVVIXO 63, SURJUDP &HWHULV SDULEXV K\SRWKHVLV  63, VXFFHVV LV SRVLWLYHO\ DVVRFLDWHG
ZLWKEXVLQHVVRULHQWDWLRQ

±±
&+$37(5

7DEOH7HVWVRIK\SRWKHVHV+±+

2YHUDOO 3HUFHLYHG 2UJDQL]DWLRQDO


63,VXFFHVV OHYHORIVXFFHVV SHUIRUPDQFH
9DULDEOH 1  U SU U SU U SU

%XVLQHVV2ULHQWDWLRQ      


,QYROYHGOHDGHUVKLS      
(PSOR\HHSDUWLFLSDWLRQ      
0HDVXUHPHQW      
([SORLWDWLRQ      
([SORUDWLRQ      

S S S


 $OOWWHVWVDUHRQHWDLOHG
 3DUWLDOU SU LVWKHFRUUHODWLRQEHWZHHQWKHVXFFHVVPHDVXUHDQGWKHLQGHSHQGHQWYDULDEOHZKHQ
WKHFRQWH[WXDOIDFWRUV HQYLURQPHQWDQGRUJDQL]DWLRQDOVL]H DUHKHOGFRQVWDQW

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQEXVLQHVVRULHQWDWLRQDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUHUUHSUHVHQWVWKHFRUUHODWLRQEHWZHHQEXVLQHVVRULHQWDWLRQDQG63,VXFFHVV

+$ 7KHUHZLOOEHDSRVLWLYHFRUUHODWLRQEHWZHHQEXVLQHVVRULHQWDWLRQDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH ]HURRUGHU 3HDUVRQ FRUUHODWLRQ UHVXOWV EHWZHHQ EXVLQHVV RULHQWDWLRQ DQG RYHUDOO 63,
VXFFHVVVKRZHGDSRVLWLYHDQGKLJKO\VLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S 
7KH ]HURRUGHU FRUUHODWLRQV ZLWK SHUFHLYHG OHYHO RI VXFFHVV U   S    DQG
RUJDQL]DWLRQDOSHUIRUPDQFH U S  ZHUH DOVRSRVLWLYHDQGKLJKO\VLJQLILFDQW
)XUWKHUPRUH DOO SDUWLDO FRUUHODWLRQV ZHUH SRVLWLYH DQG VLJQLILFDQW UDQJLQJ IURP SU  
S  WR SU   S    6LQFH DOO FRUUHODWLRQV ZHUH SRVLWLYH DQG KLJKO\
VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV
EXVLQHVVRULHQWDWLRQLVSRVLWLYHO\DVVRFLDWHGZLWK63,VXFFHVV

+\SRWKHVLV %DVHG RQ WKH GLVFXVVLRQ LQ &KDSWHU  ZH GHILQHG LQYROYHG OHDGHUVKLS DV WKH
H[WHQW WR ZKLFK OHDGHUV DW DOO OHYHOV LQ WKH RUJDQL]DWLRQ DUH JHQXLQHO\ FRPPLWWHG WR DQG
DFWLYHO\SDUWLFLSDWHVLQ63,)XUWKHUPRUHZHDUJXHGWKDWLQYROYHGOHDGHUVKLSLVDNH\IDFWRUWR
IDFLOLWDWH D VXFFHVVIXO 63, SURJUDP &HWHULV SDULEXV K\SRWKHVLV  63, VXFFHVV LV SRVLWLYHO\
DVVRFLDWHGZLWKLQYROYHGOHDGHUVKLS

±±
(03,5,&$/5(68/76

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQLQYROYHGOHDGHUVKLSDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUHUUHSUHVHQWVWKHFRUUHODWLRQEHWZHHQLQYROYHGOHDGHUVKLSDQG63,VXFFHVV

+$ 7KHUHZLOOEHDSRVLWLYHFRUUHODWLRQEHWZHHQLQYROYHGOHDGHUVKLSDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH ]HURRUGHU 3HDUVRQ FRUUHODWLRQ UHVXOWV EHWZHHQ LQYROYHG OHDGHUVKLS DQG RYHUDOO 63,
VXFFHVVVKRZHGDSRVLWLYHDQGKLJKO\VLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S 
7KH ]HURRUGHU FRUUHODWLRQV ZLWK SHUFHLYHG OHYHO RI VXFFHVV U   S    DQG
RUJDQL]DWLRQDOSHUIRUPDQFH U S  ZHUH DOVRSRVLWLYHDQGKLJKO\VLJQLILFDQW
)XUWKHUPRUH DOO SDUWLDO FRUUHODWLRQV ZHUH SRVLWLYH DQG VLJQLILFDQW UDQJLQJ IURP SU  
S  WR SU   S    6LQFH DOO FRUUHODWLRQV ZHUH SRVLWLYH DQG KLJKO\
VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV
LQYROYHGOHDGHUVKLSLVSRVLWLYHO\DVVRFLDWHGZLWK63,VXFFHVV

+\SRWKHVLV%DVHGRQWKHGLVFXVVLRQLQ&KDSWHUZHGHILQHGHPSOR\HHSDUWLFLSDWLRQDVWKH
H[WHQW WR ZKLFK HPSOR\HHV XVH WKHLU NQRZOHGJH DQG H[SHULHQFH WR GHFLGH DFW DQG WDNH
UHVSRQVLELOLW\IRU63,)XUWKHUPRUHZHDUJXHGWKDWHPSOR\HHSDUWLFLSDWLRQLVDNH\ IDFWRUWR
IDFLOLWDWH D VXFFHVVIXO 63, SURJUDP &HWHULV SDULEXV K\SRWKHVLV  63, VXFFHVV LV SRVLWLYHO\
DVVRFLDWHGZLWKHPSOR\HHSDUWLFLSDWLRQ

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQHPSOR\HHSDUWLFLSDWLRQDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUHUUHSUHVHQWVWKHFRUUHODWLRQEHWZHHQHPSOR\HHSDUWLFLSDWLRQDQG63,VXFFHVV

+$ 7KHUHZLOOEHDSRVLWLYHFRUUHODWLRQEHWZHHQHPSOR\HHSDUWLFLSDWLRQDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH ]HURRUGHU 3HDUVRQ FRUUHODWLRQ UHVXOWV EHWZHHQ HPSOR\HH SDUWLFLSDWLRQ DQG RYHUDOO 63,
VXFFHVVVKRZHGDSRVLWLYHDQGKLJKO\VLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S 
7KH ]HURRUGHU FRUUHODWLRQV ZLWK SHUFHLYHG OHYHO RI VXFFHVV U   S    DQG
RUJDQL]DWLRQDOSHUIRUPDQFH U S  ZHUH DOVRSRVLWLYHDQGKLJKO\VLJQLILFDQW
)XUWKHUPRUH DOO SDUWLDO FRUUHODWLRQV ZHUH SRVLWLYH DQG VLJQLILFDQW UDQJLQJ IURP SU  
S  WR SU   S    6LQFH DOO FRUUHODWLRQV ZHUH SRVLWLYH DQG KLJKO\

±±
&+$37(5

VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV
HPSOR\HHSDUWLFLSDWLRQLVSRVLWLYHO\DVVRFLDWHGZLWK63,VXFFHVV

+\SRWKHVLV%DVHGRQWKHGLVFXVVLRQLQ&KDSWHUZHGHILQHGFRQFHUQIRUPHDVXUHPHQWDV
WKHH[WHQWWRZKLFKWKH VRIWZDUH RUJDQL]DWLRQ FROOHFWV DQG XWLOL]HV TXDOLW\ GDWD WR JXLGH DQG
DVVHVVWKHHIIHFWVRI63,DFWLYLWLHVDQGDUJXHGWKDWFRQFHUQIRUPHDVXUHPHQWLVDNH\IDFWRUWR
IDFLOLWDWH D VXFFHVVIXO 63, SURJUDP &HWHULV SDULEXV K\SRWKHVLV  63, VXFFHVV LV SRVLWLYHO\
DVVRFLDWHGZLWKWKHXVHRIPHDVXUHPHQW

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQFRQFHUQIRUPHDVXUHPHQWDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUHUUHSUHVHQWVWKHFRUUHODWLRQEHWZHHQFRQFHUQIRUPHDVXUHPHQWDQG63,VXFFHVV

+$ 7KHUHZLOOEHDSRVLWLYHFRUUHODWLRQEHWZHHQFRQFHUQIRUPHDVXUHPHQWDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH]HURRUGHU3HDUVRQFRUUHODWLRQUHVXOWVEHWZHHQFRQFHUQIRUPHDVXUHPHQWDQGRYHUDOO63,
VXFFHVVVKRZHGDSRVLWLYHDQGKLJKO\VLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S 
7KH ]HURRUGHU FRUUHODWLRQV ZLWK SHUFHLYHG OHYHO RI VXFFHVV U   S    DQG
RUJDQL]DWLRQDOSHUIRUPDQFH U S  ZHUH DOVRSRVLWLYHDQGKLJKO\VLJQLILFDQW
)XUWKHUPRUH DOO SDUWLDO FRUUHODWLRQV ZHUH SRVLWLYH DQG VLJQLILFDQW UDQJLQJ IURP SU  
S  WR SU   S    6LQFH DOO FRUUHODWLRQV ZHUH SRVLWLYH DQG KLJKO\
VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV
FRQFHUQIRUPHDVXUHPHQWLVSRVLWLYHO\DVVRFLDWHGZLWK63,VXFFHVV

+\SRWKHVLV  ,Q &KDSWHU  ZH GHILQHG OHDUQLQJ VWUDWHJ\ DV WKH H[WHQW WR ZKLFK D VRIWZDUH
RUJDQL]DWLRQ LV HQJDJHG LQ WKH H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG LQ WKH H[SORUDWLRQ RI
QHZ NQRZOHGJH )XUWKHUPRUH ZH DUJXHG WKDW EDODQFLQJ WKH UHILQHPHQW RI WKH H[LVWLQJ VNLOO
EDVH ZLWK WKH H[SHULPHQWDWLRQ RI QHZ LGHDV DUH LPSRUWDQW LQ RUGHU WR ILQG DOWHUQDWLYHV WKDW
LPSURYHRQROGRQHV&HWHULVSDULEXVK\SRWKHVLV63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWK
H[SORLWDWLRQRIH[LVWLQJNQRZOHGJH

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQH[SORLWDWLRQRIH[LVWLQJNQRZOHGJHDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUHUUHSUHVHQWVWKHFRUUHODWLRQEHWZHHQH[SORLWDWLRQRIH[LVWLQJNQRZOHGJHDQG63,
VXFFHVV

±±
(03,5,&$/5(68/76

+$ 7KHUHZLOOEHDSRVLWLYHFRUUHODWLRQEHWZHHQH[SORLWDWLRQRIH[LVWLQJNQRZOHGJHDQG63,
VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH ]HURRUGHU 3HDUVRQ FRUUHODWLRQ UHVXOWV EHWZHHQ H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG
RYHUDOO63,VXFFHVVVKRZHGDSRVLWLYHDQGKLJKO\VLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S
 7KH]HURRUGHUFRUUHODWLRQVZLWKSHUFHLYHGOHYHORIVXFFHVV U S
DQG RUJDQL]DWLRQDO SHUIRUPDQFH U   S    ZHUH DOVR SRVLWLYH DQG KLJKO\
VLJQLILFDQW)XUWKHUPRUHDOOSDUWLDOFRUUHODWLRQVZHUHSRVLWLYHDQGVLJQLILFDQWUDQJLQJIURPSU
 S WRSU  S 6LQFHDOOFRUUHODWLRQVZHUHSRVLWLYHDQGKLJKO\
VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV
H[SORLWDWLRQRIH[LVWLQJNQRZOHGJHLVSRVLWLYHO\DVVRFLDWHGZLWK63,VXFFHVV

+\SRWKHVLV,QDGGLWLRQWRK\SRWKHVLVDQGWKHDUJXPHQWFRQFHUQLQJWKHEDODQFHEHWZHHQ
WKH UHILQHPHQW RI WKH H[LVWLQJ VNLOO EDVH ZLWK WKH H[SHULPHQWDWLRQ RI QHZ LGHDV D VHFRQG
K\SRWKHVLV ZDV GHILQHG UHJDUGLQJ OHDUQLQJ VWUDWHJ\ &HWHULV SDULEXV K\SRWKHVLV  63,
VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKH[SORUDWLRQRIQHZNQRZOHGJH

+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHUHLVQRUHODWLRQVKLSEHWZHHQH[SORUDWLRQRIQHZNQRZOHGJHDQG63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+U 

ZKHUH U UHSUHVHQWV WKH FRUUHODWLRQ EHWZHHQ H[SORUDWLRQ RI QHZ NQRZOHGJH DQG 63,
VXFFHVV

+$ 7KHUH ZLOO EH D SRVLWLYH FRUUHODWLRQ EHWZHHQ H[SORUDWLRQ RI QHZ NQRZOHGJH DQG 63,
VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+$U!

7KH]HURRUGHU3HDUVRQFRUUHODWLRQUHVXOWVEHWZHHQH[SORUDWLRQRIQHZNQRZOHGJHDQGRYHUDOO
63,VXFFHVVVKRZHGDSRVLWLYHDQGVLJQLILFDQWFRUUHODWLRQFRHIILFLHQWRI S 7KH
]HURRUGHUFRUUHODWLRQVZLWKSHUFHLYHGOHYHORIVXFFHVV U S DQGRUJDQL]DWLRQDO
SHUIRUPDQFH U  S    ZHUH DOVR SRVLWLYH DQG VLJQLILFDQW )XUWKHUPRUH DOO SDUWLDO
FRUUHODWLRQVZHUHSRVLWLYHDQGVLJQLILFDQWUDQJLQJIURPSU  S WRSU  S
 6LQFHDOO FRUUHODWLRQV ZHUH SRVLWLYH DQG VLJQLILFDQW WKH QXOO K\SRWKHVLV ZDV UHMHFWHG
DQG WKH DOWHUQDWH K\SRWKHVLV DFFHSWHG 7KDW LV H[SORUDWLRQ RI QHZ NQRZOHGJH LV SRVLWLYHO\
DVVRFLDWHGZLWK63,VXFFHVV
7DNHQ WRJHWKHU DOO ]HURRUGHU DQG SDUWLDO FRUUHODWLRQV LQYROYHG LQ WHVWLQJ K\SRWKHVHV 
WKURXJKZHUHVLJQLILFDQWDQGLQWKHK\SRWKHVL]HGGLUHFWLRQV7KLVLQGLFDWHVVXSSRUW IRUWKH
YDOLGLW\RIDOOPDMRUPHDVXUHVXVHGLQWKLVUHVHDUFK7KXVWKHILQGLQJVLQ7DEOHVXSSRUW
+\SRWKHVHV  WKURXJK  DORQJ ZLWK WKH XQGHUO\LQJ DVVXPSWLRQ WKDW 63, SURYLGHV LQFUHDVHG
OHYHOVRISHUIRUPDQFHWRWKHVRIWZDUHFRPSDQ\

±±
&+$37(5

 7HVWLQJRYHUDOOUHODWLRQVKLSV
%HVLGHV H[DPLQLQJ WKH LQGHSHQGHQW FRQWULEXWLRQV RI HDFK RI WKH LQGHSHQGHQW YDULDEOHV DV
UHSUHVHQWHG E\ K\SRWKHVHV  WKURXJK  ZH DOVR H[DPLQHG WKH MRLQW FRQWULEXWLRQ RI WKH
LQGHSHQGHQW YDULDEOHV WR WKH H[SODQDWLRQ RI 63, VXFFHVV )XUWKHUPRUH RXU DLP ZDV DOVR WR
FRQVLGHU WKHLU FRQWULEXWLRQ WR WKH YDULDWH DQG LWV SUHGLFWLRQV LQ RUGHU WR LGHQWLI\ WKH FULWLFDO
IDFWRUVIRU63,VXFFHVV

+\SRWKHVLV+\SRWKHVLVFDQEHVWDWHGLQWKHQXOODQGDOWHUQDWHDVIROORZV

+ 7KHVL[LQGHSHQGHQWYDULDEOHVLQWKHWKHRUHWLFDOIUDPHZRUNZLOOQRWVLJQLILFDQWO\H[SODLQ
WKHYDULDQFHLQ63,VXFFHVV

7KLVLVVWDWLVWLFDOO\H[SUHVVHGE\+5 

ZKHUH 5 5VTXDUH  UHSUHVHQWV WKH SURSRUWLRQ RI YDULDQFH LQ 63, VXFFHVV WKDW FDQ EH
DFFRXQWHGIRUE\WKHVL[LQGHSHQGHQWYDULDEOHV

+$ 7KH VL[ LQGHSHQGHQW YDULDEOHV RI EXVLQHVV RULHQWDWLRQ LQYROYHG OHDGHUVKLS HPSOR\HH
SDUWLFLSDWLRQ FRQFHUQ IRU PHDVXUHPHQW H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG
H[SORUDWLRQRIQHZNQRZOHGJHZLOOVLJQLILFDQWO\H[SODLQDODUJHDPRXQWRIYDULDQFHLQ
63,VXFFHVV

$ ³ODUJH´ DPRXQW LV GHILQHG DV D ODUJH HIIHFW VL]H I t  DFFRUGLQJ WR &RKHQ¶V 
  FDWHJRUL]DWLRQ VHH &KDSWHU  IRU PRUH GHWDLOV UHJDUGLQJ RSHUDWLRQDOL]DWLRQ RI HIIHFW
VL]HV ZKHUH

 5
I 
 5

7KXVLQWHUPVRIWKHHIIHFWVL]HWKHVTXDUHGPXOWLSOHFRUUHODWLRQFDQEHH[SUHVVHGDV

I
5 

 I

*LYHQ WKLV UHODWLRQVKLS EHWZHHQ HIIHFW VL]H I  DQG WKH VTXDUHG PXOWLSOH FRUUHODWLRQ 5  D
ODUJHHIIHFWVL]HRIItFRUUHVSRQGVWRDVTXDUHGPXOWLSOHFRUUHODWLRQRI5tDQGD
PXOWLSOHFRUUHODWLRQFRHIILFLHQWRI5t
:HDSSOLHGPXOWLSOHUHJUHVVLRQDQDO\VLVE\IRUPLQJWKHYDULDWHRILQGHSHQGHQWYDULDEOHV
WRWHVWWKLVK\SRWKHVLV 7KH PRGHO VXPPDU\ RI WKH PXOWLSOH UHJUHVVLRQ DQDO\VLV EHWZHHQ WKH
VL[LQGHSHQGHQWYDULDEOHVDQGWKHGHSHQGHQWYDULDEOHLVVKRZQLQ7DEOHWKHDQDO\VLVRI
YDULDQFHLQ7DEOHDQGWKHUHJUHVVLRQFRHIILFLHQWVLQ7DEOH7KHPXOWLSOHFRUUHODWLRQ
FRHIILFLHQW5RI WKH VL[ LQGHSHQGHQW YDULDEOHV ZLWK WKH GHSHQGHQW YDULDEOH ZDV  DQG WKH
DGMXVWHG 5VTXDUH ZDV  DV FRPSDUHG WR D FRHIILFLHQW RI PXOWLSOH GHWHUPLQDWLRQ ± 5
VTXDUH±RI WKXVH[SODLQLQJSHUFHQWRIWKHYDULDWLRQLQ63,VXFFHVV)XUWKHUPRUHWKH

±±
(03,5,&$/5(68/76

)YDOXH RI  ZDV KLJKO\ VLJQLILFDQW S    LQGLFDWLQJ WKDW WKHUH LV D VWURQJ
UHODWLRQVKLSEHWZHHQWKHVL[LQGHSHQGHQWYDULDEOHVDQG63,VXFFHVV
,QRWKHUZRUGVWKHUHVXOWVLQGLFDWHWKDWDODUJHDPRXQW  RIWKHYDULDQFH DGMXVWHG
5VTXDUH  LQ 63, VXFFHVV KDV EHHQ KLJKO\ VLJQLILFDQWO\ S    H[SODLQHG E\ WKH VL[
LQGHSHQGHQW YDULDEOHV +HQFH WKH QXOO K\SRWKHVLV ZDV UHMHFWHG DQG WKH DOWHUQDWH K\SRWKHVLV
DFFHSWHG7KDWLVWKHVL[LQGHSHQGHQWYDULDEOHVRIEXVLQHVVRULHQWDWLRQLQYROYHGOHDGHUVKLS
HPSOR\HH SDUWLFLSDWLRQ FRQFHUQ IRU PHDVXUHPHQW H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG
H[SORUDWLRQ RI QHZ NQRZOHGJH VLJQLILFDQWO\ H[SODLQ D ODUJH DPRXQW RI WKH YDULDQFH LQ 63,
VXFFHVV
+RZHYHU WKH DERYH UHVXOW RQO\ DSSOLHV WR VDPSOH YDOXHV 7KHUHIRUH LQ RUGHU WR PDNH
LQIHUHQFHVDERXWWKHPXOWLSOHFRUUHODWLRQZHXVHG.RQLVKL¶V  H[WHQVLRQRIWKH)LVKHUU
WR=WUDQVIRUPDWLRQWRWHVWWKHH[DFWK\SRWKHVLVWKDWWKHSRSXODWLRQYDOXHRI5LVODUJH7KDWLV
ZHWHVWHGWKHPRGLILHGQXOOK\SRWKHVLV

+0U

DJDLQVWWKHDOWHUQDWLYH

+0$Ut

7KHWHVWVWDWLVWLF&5LVUHIHUUHGWRWKHQRUPDOGLVWULEXWLRQ .RQLVKL DQGJLYHQE\

­  ½
&5 ®= 5  ] U 
 U 1  

.  U  ¾ 1  
¯ ¿

LQ ZKLFK =5 LV WKH )LVKHU = YDOXH FRUUHVSRQGLQJ WR WKH VDPSOH 5 YDOXH ]U LV WKH )LVKHU =
YDOXHFRUUHVSRQGLQJWRWKHSRSXODWLRQUYDOXHVWDWHGLQWKHQXOOK\SRWKHVLV.LVWKHQXPEHURI
SUHGLFWRUYDULDEOHVDQG1LVWKHVDPSOHVL]H
7KHWHVWVWDWLVWLFIRUWKHPRGLILHGQXOOK\SRWKHVLVZLWK. SUHGLFWRUYDULDEOHVDVDPSOH
VL]HRI1 DQGDVDPSOHPXOWLSOHFRUUHODWLRQRI5 ZDV&5 ,QDVWDQGDUG
QRUPDOGLVWULEXWLRQDYDOXHRILVKLJKO\VLJQLILFDQWDQGWKXVIDOOVRXWVLGHWKHDFFHSWDQFH
UHJLRQ IRU WKH D   OHYHO +HQFH LQ OLJKW RI WKH VDPSOH HYLGHQFH ZH UHMHFWHG WKH QXOO
K\SRWKHVLVWKDWWKH WUXH YDOXH RI WKH PXOWLSOH FRUUHODWLRQ LV OHVV WKDQ  DQG DFFHSWHG WKH
DOWHUQDWHK\SRWKHVLVWKDWWKHVL[SUHGLFWRUYDULDEOHVVLJQLILFDQWO\ S H[SODLQDODUJH
DPRXQW Ut RIWKHYDULDQFHLQ63,VXFFHVV
7KH FRQWULEXWLRQV RI HDFK LQGHSHQGHQW YDULDEOH WR WKH YDULDWH KRZHYHU GLIIHU
VXEVWDQWLDOO\ $V FDQ EH VHHQ LQ 7DEOH  WZR RI WKH LQGHSHQGHQW YDULDEOHV ± LQYROYHG
OHDGHUVKLS DQG H[SORUDWLRQ RI QHZ NQRZOHGJH ± GLG QRW FRQWULEXWH VLJQLILFDQWO\ WR WKH
H[SODQDWLRQ RI 63, VXFFHVV 2I WKH UHPDLQLQJ IRXU VLJQLILFDQW YDULDEOHV HPSOR\HH
SDUWLFLSDWLRQVHHPVWREHDVVRFLDWHGZLWKWKHKLJKHVWH[SODQDWRU\SRZHUVLQFHLWDFKLHYHGWKH
KLJKHVW VWDQGDUGL]HG UHJUHVVLRQ FRHIILFLHQW E   W   S    1H[W FDPH
EXVLQHVVRULHQWDWLRQ E W S IROORZHGE\FRQFHUQIRUPHDVXUHPHQW E
  W   S    DQG ILQDOO\ H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH E   W
 S  ,W LV LPSRUWDQW WR QRWH KRZHYHU WKDW WKH ZHLJKWV WKH LQGHSHQGHQW YDULDEOHV
FDUU\ LQ WKH PXOWLSOH UHJUHVVLRQ HTXDWLRQ DUH DOZD\V UHODWLYH WR WKH HQWLUH VHW RI SUHGLFWRUV
HPSOR\HG +D\V 7KDWLVWKHSUHGLFWLYHVWUHQJWKWKDWVRPHLQGHSHQGHQWYDULDEOHVHHPV

±±
&+$37(5

WRVKRZIRUWKHGHSHQGHQWYDULDEOHPD\GLIIHULIWKHVHWRIUHPDLQLQJYDULDEOHVLVDOWHUHG7R
IXUWKHULQWHUSUHWWKHLQGLYLGXDOFRQWULEXWLRQVWRWKHYDULDWHDQGGHWHUPLQHWKHFULWLFDOIDFWRUVRI
63, VXFFHVV ZH DSSOLHG WKH VWHSZLVH UHJUHVVLRQ SURFHGXUH ZKLFK LV GHVFULEHG LQ WKH QH[W
VHFWLRQ
7KHWZRFRQWH[WXDOIDFWRUVZHUHDGGHGWRWKHPRGHOWRWHVWWKHVHQVLWLYLW\RIWKHYDULDWHWR
RUJDQL]DWLRQDO VL]H DQG HQYLURQPHQWDO WXUEXOHQFH 7KH HVWLPDWHG FRHIILFLHQWV RI WKH
LQGHSHQGHQW YDULDEOHV RI WKH RULJLQDO PRGHO ZHUH QRW VLJQLILFDQWO\ FKDQJHG E\ WKH
LQWURGXFWLRQ RI WKH FRQWH[WXDO IDFWRUV 7KH UHVXOWV KROG IRU VPDOO DV ZHOO DV ODUJH VRIWZDUH
RUJDQL]DWLRQVDQGIRURUJDQL]DWLRQVRSHUDWLQJLQVWDEOHDVZHOODVLQWXUEXOHQWHQYLURQPHQWV
7KHVHUHVXOWVVXSSRUWWKHUREXVWQHVVRIWKHRULJLQDOUHJUHVVLRQPRGHOUHVXOWV)XUWKHUPRUHWKH
PRGHOZLWKWKHWZRFRQWH[WXDOIDFWRUVDGGHG 5VTXDUH DGMXVWHG5VTXDUH )
S GLGQRWH[SODLQVLJQLILFDQWO\PRUHYDULDQFHDVFRPSDUHGZLWKWKHRULJLQDO
PRGHO 5VTXDUH DGMXVWHG5VTXDUH ) S 

7DEOH0XOWLSOHUHJUHVVLRQPRGHOVXPPDU\XVLQJDOOLQGHSHQGHQWYDULDEOHV

$GMXVWHG 6WG(UURURI
5 5VTXDUH 5VTXDUH WKHHVWLPDWH

   

7DEOH0XOWLSOHUHJUHVVLRQDQDO\VLVRIYDULDQFHXVLQJDOOLQGHSHQGHQWYDULDEOHV

6XPRI 0HDQ
VTXDUHV 'I VTXDUH )UDWLR

5HJUHVVLRQ    


5HVLGXDOV   

S

7DEOH0XOWLSOHUHJUHVVLRQEHWZHHQDOOLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV

8QVWDQGDUGL]HG 6WDQGDUGL]HG
FRHIILFLHQWV FRHIILFLHQWV
9DULDEOHV % 6WGHUURU %HWD WYDOXH

%XVLQHVV2ULHQWDWLRQ    


,QYROYHGOHDGHUVKLS    
(PSOR\HHSDUWLFLSDWLRQ    
0HDVXUHPHQW    
([SORLWDWLRQ    
([SORUDWLRQ    

S S S

±±
(03,5,&$/5(68/76

 ([DPLQLQJLQGLYLGXDOFRQWULEXWLRQVWRWKHYDULDWH
7RH[DPLQHWKHFRQWULEXWLRQVRIHDFKLQGHSHQGHQWYDULDEOHWRWKHYDULDWHZHDSSOLHGVWHSZLVH
UHJUHVVLRQZLWKIRUZDUGVHOHFWLRQ:LWKWKLVSURFHGXUHZHVWDUWHGE\DGGLQJWKHLQGHSHQGHQW
YDULDEOH ZLWK WKH JUHDWHVW FRQWULEXWLRQ $GGLWLRQDO LQGHSHQGHQW YDULDEOHV ZHUH VHOHFWHG LQ
WHUPV RI WKH LQFUHPHQWDO H[SODQDWRU\ SRZHU WKH\ FRXOG DGG WR WKH UHJUHVVLRQ PRGHO
,QGHSHQGHQW YDULDEOHV ZHUH DGGHG DV ORQJ DV WKHLU SDUWLDO FRUUHODWLRQ FRHIILFLHQWV ZHUH
VWDWLVWLFDOO\ VLJQLILFDQW )XUWKHUPRUH LQGHSHQGHQW YDULDEOHV FRXOG DOVR EH GURSSHG LI WKHLU
SUHGLFWLYH SRZHU GURSSHG WR D QRQVLJQLILFDQW OHYHO ZKHQ DQRWKHU LQGHSHQGHQW YDULDEOH ZDV
DGGHGWRWKHPRGHO:HXVHGFRQYHQWLRQDOVWHSZLVHFULWHULDLHWKHSUREDELOLW\RI)WRHQWHU
ZDV d  DQG WKH SUREDELOLW\ RI )WRUHPRYH ZDV t  7KDW LV WKH VTXDUHG SDUW
FRUUHODWLRQ RUJDLQLQ63,VXFFHVVYDULDQFHDFFRXQWHGIRU KDGWREHVLJQLILFDQWDWRUEH\RQG
WKHOHYHOIRUDQ\QHZYDULDEOHWREHVHOHFWHGIRULQFOXVLRQLQWKHUHJUHVVLRQHTXDWLRQ
8VLQJWKHVWHSZLVHSURFHGXUHIRXURIWKHVL[LQGHSHQGHQWYDULDEOHVZHUHLQFOXGHGLQWKH
ILQDOPRGHO7KH\ZHUHHQWHUHGLQWRWKHHTXDWLRQLQWKHIROORZLQJRUGHUEXVLQHVVRULHQWDWLRQ
HPSOR\HH SDUWLFLSDWLRQ FRQFHUQ IRU PHDVXUHPHQW DQG H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH
7KXV WKH ILQDO PRGHO LQFOXGHG WKH VDPH IRXU YDULDEOHV WKDW ZHUH VLJQLILFDQW LQ WKH IXOO
UHJUHVVLRQPRGHO
7KHVWHSZLVHUHJUHVVLRQPRGHOVXPPDU\LQ7DEOHVKRZVWKDW5VTXDUHIRUWKHILQDO
PRGHO LV  DQG DGMXVWHG 5VTXDUH LV  7KHVH YDOXHV DUH FRPSDUDEOH WR WKH IXOO
UHJUHVVLRQ PRGHO ZLWK DOO VL[ LQGHSHQGHQW YDULDEOHV WKDW VKRZHG DQ 5VTXDUH YDOXH RI 
DQGDGMXVWHG5VTXDUHRI VHH7DEOH ,QRWKHUZRUGVWKHMRLQWSUHGLFWLYHSRZHURI
WKHIRXULQGHSHQGHQWYDULDEOHVUHVXOWLQJIURPWKHVWHSZLVHUHJUHVVLRQLQFOXGHGLQPRGHO'LV
FRPSDUDEOH WR WKH SUHGLFWLYH SRZHU RI WKH IXOO UHJUHVVLRQ PRGHO ZKLFK LQFOXGHV DOO VL[
LQGHSHQGHQWYDULDEOHV
7KHVWDQGDUGL]HGVWHSZLVHUHJUHVVLRQFRHIILFLHQWVDUHUHSRUWHGLQ7DEOH2IWKHIRXU
LQGHSHQGHQWYDULDEOHVLQFOXGHGLQWKHILQDOPRGHOEXVLQHVVRULHQWDWLRQVHHPVWREHDVVRFLDWHG
ZLWK WKH KLJKHVW H[SODQDWRU\ SRZHU VLQFH LW DFKLHYHG WKH KLJKHVW VWDQGDUGL]HG UHJUHVVLRQ
FRHIILFLHQW E W S 1H[WFDPHHPSOR\HHSDUWLFLSDWLRQ E W
S IROORZHGE\FRQFHUQIRUPHDVXUHPHQW E W S DQG
ILQDOO\H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH E   W   S    &RPSDUHG WR WKH
UHVXOWV IURP WKH IXOO UHJUHVVLRQ PRGHO ZLWK DOO VL[ LQGHSHQGHQW YDULDEOHV WKH SUHGLFWLYH
VWUHQJWKRIHDFKYDULDEOHKDYHQRWEHHQFRQVLGHUDEO\DOWHUHGDOWKRXJKWKHUDQNRUGHUEHWZHHQ
WKH WZR YDULDEOHV ZLWK WKH KLJKHVW H[SODQDWRU\ SRZHU KDV FKDQJHG +RZHYHU DV ZH PDGH
FOHDU LQ WKH SUHFHGLQJ VHFWLRQ WKH ZHLJKWV WKH LQGHSHQGHQW YDULDEOHV FDUU\ LQ WKH PXOWLSOH
UHJUHVVLRQHTXDWLRQDUHDOZD\VUHODWLYHWRWKHHQWLUHVHWRISUHGLFWRUVHPSOR\HG
7KH UHVXOWV RI WKH VWHSZLVH UHJUHVVLRQ FRQILUP WKH IXOO PXOWLSOH UHJUHVVLRQ DQDO\VLV
UHJDUGLQJ WKH FRQWULEXWLRQV RI HDFK LQGHSHQGHQW YDULDEOH WR WKH YDULDWH +HQFH JLYHQ WKH
RULJLQDOVHWRIVL[LQGHSHQGHQWYDULDEOHVWKHIRXUYDULDEOHVHPSOR\HHSDUWLFLSDWLRQEXVLQHVV
RULHQWDWLRQ FRQFHUQ IRU PHDVXUHPHQW DQG H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH FDQ EH
FRQVLGHUHGDVFULWLFDOIDFWRUVIRU63,VXFFHVV
,Q6HFWLRQZHIRXQGWKDWPXOWLFROOLQHDULW\VKRXOGQRWKDYHDVXEVWDQWLDOLPSDFWRQ
WKHHVWLPDWHGUHJUHVVLRQYDULDWH+RZHYHUWKHUHVXOWVRIWKHPXOWLSOHUHJUHVVLRQDQDO\VLVVKRZ
WKDW LW QHYHUWKHOHVV GRHV KDYH DQ LPSDFW RQ WKH FRPSRVLWLRQ RI WKH YDULDWH DQG WKDW
FRUUHODWLRQV DPRQJ WKH LQGHSHQGHQW YDULDEOHV PD\ PDNH VRPH YDULDEOHV UHGXQGDQW LQ WKH
SUHGLFWLYHHIIRUWZKLFKLVWKHFDVHIRULQYROYHGOHDGHUVKLSDQGH[SORUDWLRQRIQHZNQRZOHGJH

±±
&+$37(5

+RZHYHU DV VKRZQ LQ 6HFWLRQ  WKLV GRHV QRW UHIOHFW WKHLU LQGLYLGXDO UHODWLRQVKLSV
ZLWKWKHGHSHQGHQWYDULDEOHEXWLQVWHDGLQGLFDWHVWKDWLQDPXOWLYDULDWHFRQWH[WWKH\DUHQRW
QHHGHGWRJHWKHUZLWKWKHUHPDLQLQJVHWRIIRXULQGHSHQGHQWYDULDEOHVWRH[SODLQWKHYDULDQFH
LQ 63, VXFFHVV 7KHUHIRUH ZH FDQQRW GHWHUPLQH WKH LPSRUWDQFH RI LQGHSHQGHQW YDULDEOHV
EDVHGVROHO\RQWKHGHULYHGYDULDWHVLQFHUHODWLRQVKLSVDPRQJWKHLQGHSHQGHQWYDULDEOHVPD\
³PDVN´ UHODWLRQVKLSV WKDW DUH QRW QHHGHG IRU SUHGLFWLYH SXUSRVHV EXW UHSUHVHQW VXEVWDQWLYH
H[SODQDWRU\ILQGLQJVQRQHWKHOHVV

7DEOH6WHSZLVHUHJUHVVLRQPRGHOVXPPDU\±ILQDOPRGHO

$GMXVWHG 6WGHUURURI
0RGHO 5 5VTXDUH 5VTXDUH WKHHVWLPDWH

$    

%    

&    

'    

0RGHO$EXVLQHVVRULHQWDWLRQ
0RGHO%EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQ
0RGHO&EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQPHDVXUHPHQW
0RGHO'EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQPHDVXUHPHQWH[SORLWDWLRQ

7DEOH6WHSZLVHUHJUHVVLRQDQDO\VLVRIYDULDQFH

6XPRI 0HDQ
0RGHO VTXDUHV 'I VTXDUH )UDWLR

$ 5HJUHVVLRQ    


5HVLGXDOV   

% 5HJUHVVLRQ    

5HVLGXDOV   

& 5HJUHVVLRQ    

5HVLGXDOV   

' 5HJUHVVLRQ    

5HVLGXDOV   

S
0RGHO$EXVLQHVVRULHQWDWLRQ
0RGHO%EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQ
0RGHO&EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQPHDVXUHPHQW
0RGHO'EXVLQHVVRULHQWDWLRQSDUWLFLSDWLRQPHDVXUHPHQWH[SORLWDWLRQ

±±
(03,5,&$/5(68/76

7DEOH6WHSZLVHUHJUHVVLRQFRHIILFLHQWV

8QVWDQGDUGL]HG 6WDQGDUGL]HG
FRHIILFLHQWV FRHIILFLHQWV
9DULDEOHV % 6WGHUURU %HWD WYDOXH

%XVLQHVV2ULHQWDWLRQ    


(PSOR\HHSDUWLFLSDWLRQ    
0HDVXUHPHQW    
([SORLWDWLRQ    

S S S

7DEOH5HVXOWVRIDVVHVVLQJWKHVWXG\¶VUHVHDUFKK\SRWKHVHV

+\SRWKHVLV 5HVXOW &RPPHQWV

 6WURQJVXSSRUW %RWK]HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHKLJKO\
VLJQLILFDQWDQGWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWLVDOVRKLJKO\
VLJQLILFDQW
 3DUWLDOVXSSRUW =HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHKLJKO\VLJQLILFDQW
+RZHYHUWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWVIRUWKHYDULDEOHLVQRW
VLJQLILFDQW
 6WURQJVXSSRUW %RWK]HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHKLJKO\
VLJQLILFDQWDQGWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWLVDOVRKLJKO\
VLJQLILFDQW
 6WURQJVXSSRUW %RWK]HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHKLJKO\
VLJQLILFDQWDQGWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWLVDOVRKLJKO\
VLJQLILFDQW
 6WURQJVXSSRUW %RWK]HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHKLJKO\
VLJQLILFDQWDQGWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWLVDOVRKLJKO\
VLJQLILFDQW
 3DUWLDOVXSSRUW =HURRUGHUDQGSDUWLDOELYDULDWHFRUUHODWLRQVDUHVLJQLILFDQW
+RZHYHUWKHPXOWLSOHUHJUHVVLRQFRHIILFLHQWIRUWKHYDULDEOHLVQRW
VLJQLILFDQW
 6WURQJVXSSRUW %RWKPXOWLSOHUHJUHVVLRQDQGVWHSZLVHUHJUHVVLRQDQDO\VLVVKRZ
WKDWWKHVHWRIVL[LQGHSHQGHQWYDULDEOHVH[SODLQDKLJKO\VLJQLILFDQW
DQGKLJKSHUFHQWDJHRIWKHYDULDQFHLQ63,VXFFHVV

,QFRQFOXVLRQERWKWKHPXOWLSOHUHJUHVVLRQDQDO\VLVDQGWKHVWHSZLVHUHJUHVVLRQDQDO\VLVKDYH
JLYHQDGGLWLRQDOVXSSRUWIRUK\SRWKHVHV   DQG  )XUWKHUPRUH WKH VWHSZLVH UHJUHVVLRQ
DQDO\VLVKDVDOVRJLYHQDGGLWLRQDOVXSSRUWIRUK\SRWKHVLV+RZHYHUWKHUHJUHVVLRQDQDO\VHV
GLGQRWVXSSRUWK\SRWKHVHVDQGSURYLGHGWKDWDOOK\SRWKHVHVDUHFRQVLGHUHGDVRQHVHW,Q
RWKHUZRUGVFRQVLGHULQJERWKELYDULDWHFRUUHODWLRQDQDO\VHVDQGPXOWLSOHUHJUHVVLRQDQDO\VHV
ZHILQGVWURQJVXSSRUWIRUK\SRWKHVHVDQGDQGSDUWLDOVXSSRUWIRUK\SRWKHVHV
DQG VHH7DEOH 

±±
&+$37(5

 ([SORULQJWKHHIIHFWVRIHQYLURQPHQWDOFRQGLWLRQV
7R H[DPLQH ZKHWKHU D VRIWZDUH RUJDQL]DWLRQ¶V HQYLURQPHQWDO FRQGLWLRQV DIIHFWV LWV VXFFHVV
IDFWRUVDQGWKHUHVXOWLQJSHUIRUPDQFHZHFRPSDUHGWKHHIIHFWVRIHQYLURQPHQWDOVWDELOLW\RU
WXUEXOHQFH$VH[SODLQHGLQ6HFWLRQZHGHILQHGFRQWUDVWHGFULWHULRQJURXSVEDVHGRQWKH
XSSHUDQGORZHUWKLUGRIWKHVDPSOHGLVWULEXWLRQ7KXVVWDELOLW\ZDVGHILQHGDVWKHORZHUWKLUG
1    DQG WXUEXOHQFH ZDV GHILQHG DV WKH XSSHU WKLUG 1    RI WKH HQYLURQPHQW
GLVWULEXWLRQ
:HH[DPLQHGWKHHIIHFWVRIHQYLURQPHQWDOFRQGLWLRQVE\FRPSDULQJWKHGLIIHUHQFHVRIWKH
PHDQVEHWZHHQRUJDQL]DWLRQVRSHUDWLQJLQVWDEOHDQGWXUEXOHQWHQYLURQPHQWVXVLQJWZRWDLOHG
WWHVWV 5HVXOWV RI WKHVH WHVWV DUH VXPPDUL]HG LQ 7DEOH  )RU HDFK FRQVWUXFW WKH WDEOH
SURYLGHVWKHPHDQVFRUHVWDQGDUGGHYLDWLRQDQGWYDOXH
1R VWDWLVWLFDOO\ VLJQLILFDQW GLIIHUHQFHV EHWZHHQ VWDEOH DQG WXUEXOHQW HQYLURQPHQWV ZHUH
REVHUYHGIRUWKHGHSHQGHQWRULQGHSHQGHQWYDULDEOHV7RVKHGDGGLWLRQDOOLJKWRQWKLVILQGLQJ
ZHVXEVHTXHQWO\FRPSDUHGWKHOHYHORIWXUEXOHQFHEHWZHHQODUJHDQGVPDOORUJDQL]DWLRQVDQG
DOVREHWZHHQVXFFHVVIXODQGOHVVVXFFHVVIXORUJDQL]DWLRQV+RZHYHUWKHUHZDVQRVWDWLVWLFDOO\
VLJQLILFDQW GLIIHUHQFH QHLWKHU LQ WKH PHDQ OHYHO RI HQYLURQPHQWDO WXUEXOHQFH EHWZHHQ ODUJH
DQGVPDOORUJDQL]DWLRQV 7DEOH QRUEHWZHHQVXFFHVVIXODQGOHVVVXFFHVVIXORUJDQL]DWLRQV
7DEOH 

7DEOH6WDEOHYHUVXVWXUEXOHQWHQYLURQPHQW

6WDEOH Q  7XUEXOHQW Q 


0HDQ 6' 0HDQ 6' WYDOXH

63,VXFFHVVIDFWRUV
%XVLQHVV2ULHQWDWLRQ     
,QYROYHGOHDGHUVKLS     
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW     
([SORLWDWLRQ     
([SORUDWLRQ     

3HUIRUPDQFH
2YHUDOO63,VXFFHVV     

 $OOWWHVWVDUHWZRWDLOHG

7DEOH/HYHORIWXUEXOHQFHLQODUJHYHUVXVVPDOOVRIWZDUHRUJDQL]DWLRQV

/DUJH Q  6PDOO Q 


0HDQ 6' 0HDQ 6' WYDOXH

(QYLURQPHQWDOFRQGLWLRQV     

 7ZRWDLOHGWWHVW

±±
(03,5,&$/5(68/76

7DEOH/HYHORIWXUEXOHQFHLQVXFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

6XFFHVVIXO Q  /HVVVXFFHVVIXO Q 


0HDQ 6' 0HDQ 6' WYDOXH

(QYLURQPHQWDOFRQGLWLRQV     

 7ZRWDLOHGWWHVW

 ([SORULQJWKHHIIHFWVRIRUJDQL]DWLRQDOVL]H
7RH[DPLQHZKHWKHUDVRIWZDUHRUJDQL]DWLRQ¶VVL]HDIIHFWVLWVVXFFHVVIDFWRUVDQGWKHUHVXOWLQJ
63,VXFFHVVZHFRPSDUHGVPDOO dGHYHORSHUV1  DQGODUJH tGHYHORSHUV1
 RUJDQL]DWLRQV7KHHIIHFWVRIRUJDQL]DWLRQDOVL]HZHUHH[DPLQHGE\WHVWLQJWKHGLIIHUHQFHV
RI WKH PHDQV EHWZHHQ WKH VPDOO DQG ODUJH RUJDQL]DWLRQV XVLQJ WZRWDLOHG WWHVWV 5HVXOWV RI
WKHVH WHVWV DUH VXPPDUL]HG LQ 7DEOH  )RU HDFK FRQVWUXFW WKH WDEOH SURYLGHV WKH PHDQ
VFRUHVWDQGDUGGHYLDWLRQDQGWYDOXH
)LYHRIWKHVL[LQGHSHQGHQWYDULDEOHVVKRZHGDVWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHEHWZHHQ
ODUJH DQG VPDOO VRIWZDUH RUJDQL]DWLRQV /DUJH RUJDQL]DWLRQV UHSRUWHG D VLJQLILFDQWO\ JUHDWHU
H[WHQW RI EXVLQHVV RULHQWDWLRQ W   S    FRQFHUQ IRU PHDVXUHPHQW W   S 
  DQG LQYROYHG OHDGHUVKLS W   S    WKDQ VPDOO RUJDQL]DWLRQV +RZHYHU VPDOO
RUJDQL]DWLRQVUHSRUWHGDKLJKO\VLJQLILFDQWO\JUHDWHUH[WHQWRIH[SORUDWLRQRIQHZNQRZOHGJH W
S DQGDVLJQLILFDQWO\JUHDWHUH[WHQWRIHPSOR\HHSDUWLFLSDWLRQ W S
  WKDQ ODUJH RUJDQL]DWLRQV 7KH ODVW LQGHSHQGHQW YDULDEOH WKH H[WHQW RI H[SORLWDWLRQ RI
H[LVWLQJNQRZOHGJHZHUHVLPLODULQODUJHDQGVPDOORUJDQL]DWLRQV)XUWKHUPRUHZLWKUHVSHFW
WR RUJDQL]DWLRQDO SHUIRUPDQFH ODUJH VRIWZDUH RUJDQL]DWLRQV UHSRUWHG D VLJQLILFDQWO\ KLJKHU
RYHUDOO63,VXFFHVV W S WKDQVPDOORUJDQL]DWLRQV
7R IXUWKHU H[DPLQH WKH HIIHFWV RI RUJDQL]DWLRQDO VL]H ZH FRPSDUHG WKH UHVSRQVHV IURP
ODUJH VXFFHVVIXO VRIWZDUH RUJDQL]DWLRQV ZLWK WKH UHVSRQVHV IURP ODUJH OHVV VXFFHVVIXO
RUJDQL]DWLRQV 7KHVH UHVXOWV DUH WDEXODWHG LQ 7DEOH  7KH FRPSDULVRQ UHYHDOHG WKDW ZLWK
WKH H[FHSWLRQ RI H[SORUDWLRQ RI QHZ NQRZOHGJH ODUJH VXFFHVVIXO RUJDQL]DWLRQV UHSRUWHG
H[HFXWLQJDOORIWKH DFWLYLWLHV GHILQHG E\ WKH LQGHSHQGHQW YDULDEOHV WR D VLJQLILFDQWO\ JUHDWHU
H[WHQWWKDQODUJHOHVVVXFFHVVIXORUJDQL]DWLRQV
6LPLODUO\ ZH PDGH D FRPSDULVRQ EHWZHHQ VPDOO VXFFHVVIXO VRIWZDUH RUJDQL]DWLRQV DQG
VPDOO OHVV VXFFHVVIXO RUJDQL]DWLRQV $V VKRZQ LQ 7DEOH  VPDOO VXFFHVVIXO RUJDQL]DWLRQV
UHSRUWHG H[HFXWLQJ DOO RI WKH DFWLYLWLHV GHILQHG E\ WKH LQGHSHQGHQW YDULDEOHV WR D KLJKO\
VLJQLILFDQWO\ S    JUHDWHU H[WHQW WKDQ VPDOO OHVV VXFFHVVIXO RUJDQL]DWLRQV )XUWKHU
PRUHFRPSDULQJWKHVHUHVXOWVZLWKWKHUHVXOWVRIWKHODUJHRUJDQL]DWLRQVZHREVHUYHWKDWWKH
GLIIHUHQFHVRIWKHPHDQVEHWZHHQWKHODUJHRUJDQL]DWLRQVDUHVPDOOHUWKDQWKHFRUUHVSRQGLQJ
GLIIHUHQFHVRIWKHPHDQVEHWZHHQWKHVPDOORUJDQL]DWLRQV

±±
&+$37(5

)LQDOO\ZHFRPSDUHGVPDOODQGODUJHVRIWZDUHRUJDQL]DWLRQVWKDWZHUHVXFFHVVIXO7DEOH
VKRZVWKHGLIIHUHQFHVWKDWDSSHDUWRH[LVWEHWZHHQVPDOODQGODUJHRUJDQL]DWLRQVKDYLQJ
63,VXFFHVV$VFDQEHVHHQERWKVPDOODQGODUJHVXFFHVVIXORUJDQL]DWLRQVUHSRUWHGWKHVDPH
OHYHO RI VXFFHVV 6WDWLVWLFDOO\ VLJQLILFDQW GLIIHUHQFHV ZHUH REVHUYHG IRU WZR RI WKH VL[
LQGHSHQGHQW YDULDEOHV 6PDOO VXFFHVVIXO RUJDQL]DWLRQV UHSRUWHG KLJKHU OHYHOV RI HPSOR\HH
SDUWLFLSDWLRQ W   S    DQG H[SORUDWLRQ RI QHZ NQRZOHGJH W   S  
WKDQWKHODUJHURUJDQL]DWLRQV

7DEOH/DUJHYHUVXVVPDOOVRIWZDUHRUJDQL]DWLRQV

/DUJH Q  6PDOO Q 


0HDQ 6' 0HDQ 6' WYDOXH

63,VXFFHVVIDFWRUV
%XVLQHVV2ULHQWDWLRQ     
,QYROYHGOHDGHUVKLS     
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW     
([SORLWDWLRQ     
([SORUDWLRQ     

3HUIRUPDQFH
2YHUDOO63,VXFFHVV     

S S S S


 $OOWWHVWVDUHWZRWDLOHG

7DEOH/DUJHVXFFHVVIXOYHUVXVODUJHOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

/DUJHVXFFHVVIXO /DUJHOHVVVXFFHVVIXO
Q  Q 
0HDQ 6' 0HDQ 6' WYDOXH

63,VXFFHVVIDFWRUV
%XVLQHVV2ULHQWDWLRQ     

,QYROYHGOHDGHUVKLS     
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW     
([SORLWDWLRQ     
([SORUDWLRQ     


S  S S S S
 $OOWWHVWVDUHWZRWDLOHG

±±
(03,5,&$/5(68/76

7DEOH6PDOOVXFFHVVIXOYHUVXVVPDOOOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

6PDOOVXFFHVVIXO 6PDOOOHVVVXFFHVVIXO
Q  Q 
0HDQ 6' 0HDQ 6' WYDOXH

63,VXFFHVVIDFWRUV
%XVLQHVV2ULHQWDWLRQ     
,QYROYHGOHDGHUVKLS     
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW     
([SORLWDWLRQ     
([SORUDWLRQ     

S
 $OOWWHVWVDUHWZRWDLOHG

7DEOH/DUJHVXFFHVVIXOYHUVXVVPDOOVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

/DUJHVXFFHVVIXO 6PDOOVXFFHVVIXO
Q  Q 
0HDQ 6' 0HDQ 6' WYDOXH

63,VXFFHVVIDFWRUV
%XVLQHVV2ULHQWDWLRQ     
,QYROYHGOHDGHUVKLS     
(PSOR\HHSDUWLFLSDWLRQ     
0HDVXUHPHQW     
([SORLWDWLRQ     
([SORUDWLRQ     

3HUIRUPDQFH
2YHUDOO63,VXFFHVV     

S S
 $OOWWHVWVDUHWZRWDLOHG

±±
&+$37(5

 ([SORULQJWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[WDQGPRGHVRI
OHDUQLQJ
7RH[DPLQHWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[WDQGPRGHVRIOHDUQLQJZHVWXG
LHG WKH EDODQFH EHWZHHQ H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ NQRZ
OHGJH6SHFLILFDOO\ZHVWXGLHGKRZRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDOWXUEXOHQFHDIIHFWHG
WKLVEDODQFH VHH'\EnE (IIHFWVRIRUJDQL]DWLRQDOVL]HZHUHFRPSDUHGE\FRQWUDVWLQJ
ODUJH RUJDQL]DWLRQV ZLWK VPDOO RUJDQL]DWLRQV 6LPLODUO\ WKH HIIHFWV RI HQYLURQPHQWDO WXUEX
OHQFHZHUHH[DPLQHGE\FRQWUDVWLQJVWDEOHHQYLURQPHQWVZLWKWXUEXOHQWHQYLURQPHQWV
$VH[SODLQHGLQ&KDSWHUZHGHILQHGFRQWUDVWHGFULWHULRQJURXSVEDVHGRQWKHXSSHUDQG
ORZHUWKLUGRIWKHVDPSOHGLVWULEXWLRQ7KXVVWDELOLW\ZDVGHILQHGDVWKHORZHUWKLUG 1 
DQGWXUEXOHQFHZDVGHILQHGDVWKHXSSHUWKLUG 1  RIWKHHQYLURQPHQWGLVWULEXWLRQ/LNH
ZLVHODUJHRUJDQL]DWLRQV FRQVLVWHG RI WKH XSSHU WKLUG t  GHYHORSHUV1    DQG VPDOO
RUJDQL]DWLRQVRIWKHORZHUWKLUG d GHYHORSHUV1    RI WKH RUJDQL]DWLRQ VL]H GLVWULEX
WLRQ
7KH HIIHFWV RI RUJDQL]DWLRQDO VL]H DQG HQYLURQPHQWDO FRQGLWLRQV RQ WKH OHDUQLQJ PRGHV
ZHUH H[DPLQHG E\ FRPSDULQJ WKH HVWLPDWHG PDUJLQDO PHDQV RI H[SORLWDWLRQ RI H[LVWLQJ
NQRZOHGJHDQGH[SORUDWLRQRIQHZNQRZOHGJHUHVSHFWLYHO\XVLQJWZRZD\DQDO\VLVRIYDUL
DQFH $129$ ZLWKRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDVWKHWZRFODVVLILFDWLRQYDULDEOHV
5HVXOWVVKRZHGWKDWVPDOOVRIWZDUHRUJDQL]DWLRQVNHSWWKHVDPHOHYHORIH[SORLWDWLRQERWK
LQVWDEOHDQGWXUEXOHQWHQYLURQPHQWV+RZHYHUWKH\HQJDJHGLQVLJQLILFDQWO\ S PRUH
H[SORUDWLRQLQWXUEXOHQWHQYLURQPHQWVWKDQWKH\GLGLQVWDEOHHQYLURQPHQWV,WLVLPSRUWDQWWR
QRWHWKDWWKHLQFUHDVHGOHYHORIH[SORUDWLRQGLGQRWGULYHRXWH[SORLWDWLRQ,QRWKHUZRUGVZH
IRXQGVXSSRUWIRUWKHSURSRVLWLRQWKDWLQFUHDVHGHQYLURQPHQWDOWXUEXOHQFHUHTXLUHVLQFUHDVHG
OHYHOVRILPSURYLVDWLRQ

+LJK +LJK
H[SORLWDWLRQ

H[SORUDWLRQ

 
I I
R R

O O
H H
Y Y
H H
/ /

/RZ /RZ

6WDEOH (19,5210(17 7XUEXOHQW 6WDEOH (19,5210(17 7XUEXOHQW

6:25*$1,=$7,21
6PDOO  /DUJH !

D E

)LJXUH,PSURYHPHQWVWUDWHJ\YHUVXVRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDOWXUEXOHQFHIRU
D H[SORLWDWLRQDQG E H[SORUDWLRQLQVPDOODQGODUJHRUJDQL]DWLRQV



7KHUHVXOWVUHSRUWHGLQWKLVVHFWLRQDUHEDVHGRQ '\EnE 

±±
(03,5,&$/5(68/76

6LPLODU WR WKH VPDOO RUJDQL]DWLRQV ODUJH VRIWZDUH RUJDQL]DWLRQV GLG QRW GLIIHU
VLJQLILFDQWO\ LQ WKHLU OHYHO RI H[SORLWDWLRQ EHWZHHQ VWDEOH DQG WXUEXOHQW HQYLURQPHQWV ,Q
FRQWUDVW WR WKH VPDOO RUJDQL]DWLRQV KRZHYHU LQFUHDVHG WXUEXOHQFH GLG QRW OHDG WR LQFUHDVHG
OHYHOVRIH[SORUDWLRQ2QWKHFRQWUDU\WKHODUJHURUJDQL]DWLRQVVHHPHGWRORZHUWKHLUOHYHOVRI
H[SORUDWLRQGXULQJWXUEXOHQWHQYLURQPHQWV+RZHYHUWKLVGLIIHUHQFHZDVQRWVLJQLILFDQW
,W LV LQWHUHVWLQJ WR QRWH WKDW DV WKHUH ZDV QR GLIIHUHQFH LQ WKH OHYHO RI H[SORLWDWLRQ
EHWZHHQ VPDOO DQG ODUJH RUJDQL]DWLRQV UHJDUGOHVV RI WKH HQYLURQPHQW WKHUH ZDV D PDUNHG
GLIIHUHQFH LQ WKH OHYHO RI H[SORUDWLRQ VHH )LJXUH E  7KH UHVXOWV VKRZHG WKDW VPDOO
VRIWZDUH RUJDQL]DWLRQV HQJDJHG LQ VLJQLILFDQWO\ S    PRUH H[SORUDWLRQ LQ WXUEXOHQW
HQYLURQPHQWVWKDQODUJHVRIWZDUHRUJDQL]DWLRQ
7KHVH UHVXOWV VXSSRUWV WKH DVVHUWLRQ WKDW VPDOO VRIWZDUH RUJDQL]DWLRQV LQ WXUEXOHQW
HQYLURQPHQWVUHTXLUHLPSURYHPHQWVWUDWHJLHVWKDWDUHPRUHFORVHO\ DOLJQHGZLWKH[SORUDWLYH
EHKDYLRUZKLOHDWWKHVDPHWLPHSURPRWLQJWKHH[SORLWDWLRQRISDVWH[SHULHQFHV$VGLVFXVVHG
LQ&KDSWHUDQGDOVRLQ'\En E WKLVLVDWWKHKHDUWRIDQLPSURYHPHQWVWUDWHJ\EDVHG
RQLPSURYLVDWLRQ

 ([SORULQJWKHHIIHFWVRIRWKHURUJDQL]DWLRQDOFKDUDFWHULVWLFV
,Q DGGLWLRQWRH[DPLQLQJ WKH HIIHFWV RI HQYLURQPHQWDO WXUEXOHQFH DQG RUJDQL]DWLRQDO VL]H RQ
63, VXFFHVV ZH DOVR H[DPLQHG WKH HIIHFWV RI VRPH RWKHU FKDUDFWHULVWLFV RI WKH UHVSRQGHQW¶V
RUJDQL]DWLRQV 7KHVH FKDUDFWHULVWLFV ZHUH LQGXVWU\ VHFWRU SURGXFW EXVLQHVV DQG ZKHWKHU WKH
RUJDQL]DWLRQ KDG D TXDOLW\ V\VWHP LQ XVH RU QRW 7KH HIIHFWV RI WKHVH RUJDQL]DWLRQDO
FKDUDFWHULVWLFVZHUHH[DPLQHGE\WHVWLQJWKHIUHTXHQF\GLVWULEXWLRQVRIWKHVXFFHVVIXODQGOHVV
VXFFHVVIXORUJDQL]DWLRQV XVLQJ 3HDUVRQ FKLVTXDUH WHVWV RI DVVRFLDWLRQ 5HVXOWV RI WKHVH WHVWV
DUH VXPPDUL]HG LQ 7DEOH  )RU HDFK FKDUDFWHULVWLF WKH WDEOH SURYLGHV WKH IUHTXHQF\
SHUFHQWDQGWKH3HDUVRQFKLVTXDUHVWDWLVWLF
7KH QXOO K\SRWKHVLV IRU WKH 3HDUVRQ FKLVTXDUH WHVW RI DVVRFLDWLRQ LV WKDW WKH URZ DQG
FROXPQ YDULDEOHV DUH LQGHSHQGHQW RI HDFK RWKHU %\ GHILQLWLRQ WZR WDEOH YDULDEOHV DUH
LQGHSHQGHQWLIWKHSUREDELOLW\WKDWDFDVHIDOOVLQDVSHFLILFFHOOLVWKHSURGXFWRILWVPDUJLQDO
SUREDELOLWLHV 6366E 7KHFRPSXWHGFKLVTXDUHVWDWLVWLFIRUWKHLQGXVWU\VHFWRUSDUWRI
7DEOHZDVVWDWLVWLFDOO\VLJQLILFDQW F GI S +RZHYHUDUXOHRIWKXPE
LVWKDWIRUFRQWLQJHQF\WDEOHVZLWKPRUHWKDQDVLQJOHGHJUHHRIIUHHGRPQRPRUHWKDQRI
WKHFHOOVVKRXOGKDYHDQH[SHFWHGIUHTXHQF\RIOHVVWKDQ +D\V &OHDUO\WKLVUXOHLV
YLRODWHG VLQFH  RI WKH FHOOV KDYH H[SHFWHG IUHTXHQF\ OHVV WKDQ  $ QRUPDO SUDFWLFH IRU
GHDOLQJZLWKWKLVSUREOHPLVWRSRROFDWHJRULHVLQRUGHUWRDWWDLQODUJHUH[SHFWHGIUHTXHQFLHV
+RZHYHUZHIRXQGQRQDWXUDOFDWHJRULHVRQZKLFKWREDVHVXFKDSRROLQJ&RQVHTXHQWO\ZH
FDQQRW UHMHFW WKH K\SRWKHVLV RI LQGHSHQGHQFH ,Q RWKHU ZRUGV GHVSLWH WKH VWDWLVWLFDOO\
VLJQLILFDQW FKLVTXDUH YDOXH ZH GR QRW KDYH HQRXJK HYLGHQFH WR VXSSRUW WKH FODLP WKDW
LQGXVWU\VHFWRUDQG63,VXFFHVVDUHDVVRFLDWHG

±±
&+$37(5

7DEOH6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

6XFFHVVIXO /HVVVXFFHVVIXO
Q  Q 

)UHTXHQF\ 3HUFHQW )UHTXHQF\ 3HUFHQW F

,QGXVWU\VHFWRU 
3XEOLFVHFWRU    
%DQNLQJILQDQFH    
0DQXIDFWXULQJ    
,7VHFWRU    
2WKHU    

3URGXFWEXVLQHVV 
6WDQGDUGDSSOLFDWLRQV    
7DLORUPDGHVROXWLRQV    

4XDOLW\V\VWHPLQXVH 
<HV    
1R    

S S
 $OOFKLVTXDUHWHVWVDUHWZRWDLOHG
 )RULQGXVWU\VHFWRUFHOOV  KDYHH[SHFWHGIUHTXHQF\OHVVWKDQ

6LPLODUO\DVIRULQGXVWU\VHFWRUZHFKHFNHGLI63,VXFFHVVYDU\E\WKHPDLQW\SHRISURGXFW
EXVLQHVV LH VWDQGDUG DSSOLFDWLRQV ± ³VKHOIZDUH´ ± IRU WKH PDVV PDUNHW YHUVXV WDLORU PDGH
VROXWLRQVIRULQGLYLGXDOFXVWRPHUV LQWKHVRIWZDUHRUJDQL]DWLRQV+RZHYHUWKH3HDUVRQFKL
VTXDUHVWDWLVWLFRIDVVRFLDWLRQUHTXHVWHGIRUWHVWLQJWKHSUHPLVHWKDWW\SHRISURGXFWEXVLQHVV
DQG 63, VXFFHVV DUH LQGHSHQGHQW RI HDFK RWKHU ZDV QRW VLJQLILFDQW 7KXV WKHUH ZDV QR
DVVRFLDWLRQEHWZHHQW\SHRISURGXFWEXVLQHVVDQG63,VXFFHVV
)LQDOO\ ZH FRPSXWHG WKH 3HDUVRQ FKLVTXDUH VWDWLVWLF IRU WHVWLQJ WKH SRVVLEOH
LQGHSHQGHQFHRIKDYLQJDTXDOLW\V\VWHPLQXVHDQG63,VXFFHVV$VVKRZQLQ7DEOHWKH
FKLVTXDUHVWDWLVWLFZDVKLJKO\VLJQLILFDQW F GI S 7KXVZHUHMHFWHGWKH
K\SRWKHVLV RI LQGHSHQGHQFH DQG FRQFOXGHG WKDW WKHUH LV DQ DVVRFLDWLRQ EHWZHHQ KDYLQJ D
TXDOLW\V\VWHPLQXVHDQGH[SHULHQFLQJ63,VXFFHVV

 ([SORULQJWKHHIIHFWVRIWKHUHVSRQGHQWV·FKDUDFWHULVWLFV
7R H[DPLQH WKH SRVVLEOH HIIHFWV RI WKH UHVSRQGHQWV¶ FKDUDFWHULVWLFV RQ 63, VXFFHVV ZH
FRPSDUHG WKH VXFFHVVIXO DQG OHVV VXFFHVVIXO RUJDQL]DWLRQV ZLWK UHVSHFW WR WKH UHVSRQGHQWV¶
H[SHULHQFHHGXFDWLRQDQGMREIXQFWLRQ([SHULHQFHZDVPHDVXUHGDORQJWZRGLPHQVLRQV 
FRPSDQ\ H[SHULHQFH DQG   VRIWZDUH H[SHULHQFH &RPSDQ\ H[SHULHQFH ZDV GHILQHG DV WKH
QXPEHU RI \HDUV ZRUNHG LQ WKH RUJDQL]DWLRQ ZKLOH VRIWZDUH H[SHULHQFH ZDV GHILQHG DV WKH
WRWDOQXPEHURI\HDUVZRUNHGZLWKVRIWZDUHGHYHORSPHQW7KXVZHFRPSDUHGWKHGLIIHUHQFHV
RIWKHPHDQVEHWZHHQWKHVXFFHVVIXODQGOHVVVXFFHVVIXORUJDQL]DWLRQVXVLQJWZRWDLOHGWWHVWV

±±
(03,5,&$/5(68/76

5HVXOWVRIWKHVHWHVWVDUHVXPPDUL]HGLQ7DEOH)RUHDFKFRQVWUXFWWKHWDEOHSURYLGHVWKH
PHDQVFRUHVWDQGDUGGHYLDWLRQDQGWYDOXH
7KH UHVXOWV VKRZHG QR VWDWLVWLFDOO\ VLJQLILFDQW GLIIHUHQFH EHWZHHQ VXFFHVVIXO DQG OHVV
VXFFHVVIXO RUJDQL]DWLRQV ZLWK UHVSHFW WR VRIWZDUH H[SHULHQFH +RZHYHU UHVSRQGHQWV LQ
VXFFHVVIXORUJDQL]DWLRQVUHSRUWHGKLJKHUOHYHOVRIFRPSDQ\H[SHULHQFH W S WKDQ
WKHUHVSRQGHQWVLQWKHOHVVVXFFHVVIXORUJDQL]DWLRQV
,QDGGLWLRQWRH[SHULHQFHZHFRPSDUHGWKHUHVSRQGHQWV¶OHYHORIHGXFDWLRQDQGWKHLUMRE
IXQFWLRQ EHWZHHQ WKH VXFFHVVIXO DQG OHVV VXFFHVVIXO RUJDQL]DWLRQV XVLQJ 3HDUVRQ FKLVTXDUH
WHVWV RI DVVRFLDWLRQ 5HVXOWV RI WKHVH WHVWV DUH VXPPDUL]HG LQ 7DEOH  )RU HDFK
FKDUDFWHULVWLF WKH WDEOH SURYLGHV WKH IUHTXHQF\ SHUFHQW DQG WKH 3HDUVRQ FKLVTXDUH VWDWLVWLF
1RQHRIWKHFKLVTXDUHYDOXHVZDVVWDWLVWLFDOO\VLJQLILFDQW7KXVZHDFFHSWHGERWKK\SRWKHVHV
RILQGHSHQGHQFHDQGFRQFOXGHGWKDWWKHUHLVQHLWKHUDQDVVRFLDWLRQEHWZHHQHGXFDWLRQDQG63,
VXFFHVVQRUEHWZHHQMREIXQFWLRQDQG63,VXFFHVV

7DEOH6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

6XFFHVVIXO /HVVVXFFHVVIXO
Q  Q 
([SHULHQFH 0HDQ 6' 0HDQ 6' WYDOXH

&RPSDQ\H[SHULHQFH     


6RIWZDUHH[SHULHQFH     

S
 $OOWWHVWVDUHWZRWDLOHG

7DEOH6XFFHVVIXOYHUVXVOHVVVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV

6XFFHVVIXO /HVVVXFFHVVIXO
Q  Q 

)UHTXHQF\ 3HUFHQW )UHTXHQF\ 3HUFHQW F

(GXFDWLRQ 
%DFKHORU¶VGHJUHH    
0DVWHU¶VGHJUHH    
'RFWRUDOGHJUHH    
2WKHU    

-REIXQFWLRQ 
4XDOLW\PDQDJHU    
6RIWZDUHPDQDJHU    

 $OOFKLVTXDUHWHVWVDUHWZRWDLOHG

±±
&+$37(5

 &KDSWHU6XPPDU\
,Q WKLV FKDSWHU ZH ILUVW UHSRUWHG RQ RXU H[SHULHQFHV ZLWK JRDORULHQWHG PHDVXUHPHQW DQG
SDUWLFLSDWLYH VRIWZDUH SURFHVV DVVHVVPHQW 7KH PDLQ OHVVRQ OHDUQHG IURP WKHVH FDVH VWXGLHV
ZDV WKDW SDUWLFLSDWLRQ FRPELQHG ZLWK DQ H[SOLFLW EXVLQHVV RULHQWDWLRQ ZHUH WKH WZR PRVW
LPSRUWDQWIDFWRUVIRU63,VXFFHVV
6XEVHTXHQWO\ WR IXUWKHU YDOLGDWH WKH OHDUQLQJ F\FOH LQ RXU G\QDPLF PRGHO RI 63, ZH
UHSRUWHGRQDVHSDUDWHHPSLULFDOVWXG\RQWKHXWLOLW\RIIRUPDOURXWLQHVWRWUDQVIHUNQRZOHGJH
DQGH[SHULHQFH7KHUHVXOWVVKRZWKDWGHYHORSHUVDUHUDWKHUVNHSWLFDODWXVLQJZULWWHQURXWLQHV
XQOHVV WKH\ SDUWLFLSDWH LQ GHYHORSLQJ WKHP ZKLOH TXDOLW\ DQG WHFKQLFDO PDQDJHUV DUH WDNLQJ
WKHXWLOLW\RIURXWLQHVIRUJUDQWHG
7KHQZHUHSRUWHGWKHUHVXOWVRIWKHPDLQTXDQWLWDWLYHVXUYH\:HVWDUWHGE\HYDOXDWLQJ
WKH DQDO\WLFDO DVVXPSWLRQV XQGHUO\LQJ WKH DQDO\VHV XVHG IRU WHVWLQJ WKH K\SRWKHVHV E\
H[DPLQLQJWKHVWDWLVWLFDOSURSHUWLHVRIWKHLQGHSHQGHQWDQGGHSHQGHQWYDULDEOHV:HH[DPLQHG
WKH DVVXPSWLRQV RI QRUPDOLW\ KRPRVFHGDVWLFLW\ OLQHDULW\ DQG LQGHSHQGHQFH RI WKH HUURU
WHUPV DV ZHOO DV DQ\ SRWHQWLDOO\ LQIOXHQWLDO REVHUYDWLRQV RXWOLHUV  DQG WKH GHJUHH RI
FROOLQHDULW\ DQG PXOWLFROOLQHDULW\ WR YDOLGDWH WKH DSSOLFDELOLW\ RI SDUDPHWULF VWDWLVWLFV 7KH
UHVXOWVRIWKHVHWHVWVVKRZHGWKDWDOOYDULDEOHVZHUHZLWKLQWKHDFFHSWDEOHUDQJHIRUWKHQRUPDO
GLVWULEXWLRQ DVVXPSWLRQ DQG WKDW WKH DVVXPSWLRQV RI KRPRVFHGDVWLFLW\ OLQHDULW\ DQG
LQGHSHQGHQFH RI WKH HUURU WHUPV ZHUH VXSSRUWHG )XUWKHUPRUH QR LQIOXHQWLDO REVHUYDWLRQV
ZHUH LGHQWLILHG DQG WKH LQYHVWLJDWLRQV RI FROOLQHDULW\ DQG PXOWLFROOLQHDULW\ LQGLFDWHG QR
SUREOHPV ,Q RWKHU ZRUGV WKHUH ZHUH QR H[WUHPH YLRODWLRQV WR WKH EDVLF DVVXPSWLRQV
XQGHUO\LQJWKHFKRVHQGDWDDQDO\VLVWHFKQLTXHVWKDWFRXOGMXVWLI\WKHXVHRIOHVVSRZHUIXOQRQ
SDUDPHWULFVWDWLVWLFV
1H[W ZH WHVWHG WKH K\SRWKHVHV XVLQJ ELYDULDWH FRUUHODWLRQDO DQG SDUWLDO FRUUHODWLRQDO
DQDO\VHV DV ZHOO DV PXOWLSOH UHJUHVVLRQ DQG VWHSZLVH UHJUHVVLRQ DQDO\VHV 5HVXOWV RI WKH
ELYDULDWH FRUUHODWLRQDO DQDO\VHV VKRZHG VXSSRUW IRU K\SRWKHVHV  ±  DQG UHVXOWV RI WKH
UHJUHVVLRQ DQDO\VHV VKRZHG VXSSRUW IRU K\SRWKHVLV  +RZHYHU WKH UHJUHVVLRQ DQDO\VHV GLG
QRW VXSSRUW K\SRWKHVHV  DQG  SURYLGHG WKDW DOO K\SRWKHVHV DUH FRQVLGHUHG DV RQH VHW
&RQVLGHULQJ ERWK ELYDULDWH FRUUHODWLRQ DQDO\VHV DQG PXOWLSOH UHJUHVVLRQ DQDO\VHV ZH ILQG
VWURQJVXSSRUWIRUK\SRWKHVHVDQGDQGSDUWLDOVXSSRUWIRUK\SRWKHVHVDQG VHH
7DEOH 
)LQDOO\ ZH H[DPLQHG WKH UHODWLRQVKLSV EHWZHHQ WKH VXFFHVV IDFWRUV DQG WKH FRQWH[WXDO
YDULDEOHV 6SHFLILFDOO\ ZH H[DPLQHG WKH HIIHFWV RI HQYLURQPHQWDO FRQGLWLRQV DQG
RUJDQL]DWLRQDOVL]HRQWKHVXFFHVVIDFWRUVDQGRQ63,VXFFHVV7KH UHVXOWVVKRZHGWKDWWKHUH
DUHLPSRUWDQWGLIIHUHQFHVEHWZHHQVPDOODQGODUJHRUJDQL]DWLRQVVSHFLILFDOO\ZLWKUHVSHFWWR
GHDOLQJZLWKDWXUEXOHQWHQYLURQPHQW$OVRZHH[DPLQHGWKHHIIHFWVRIRWKHURUJDQL]DWLRQDO
FKDUDFWHULVWLFV RI WKH UHVSRQGHQW¶V RUJDQL]DWLRQV RQ 63, VXFFHVV 7KHVH FKDUDFWHULVWLFV ZHUH
LQGXVWU\VHFWRUSURGXFWEXVLQHVVDQGZKHWKHUWKHRUJDQL]DWLRQKDGDTXDOLW\V\VWHPLQXVHRU
QRW 7R H[DPLQH WKH SRVVLEOH HIIHFWV RI WKH UHVSRQGHQWV¶ FKDUDFWHULVWLFV RQ 63, VXFFHVV ZH
FRPSDUHG WKH VXFFHVVIXO DQG OHVV VXFFHVVIXO RUJDQL]DWLRQV ZLWK UHVSHFW WR WKH UHVSRQGHQWV¶
H[SHULHQFHHGXFDWLRQDQGMREIXQFWLRQ
,QWKHQH[WFKDSWHUZHGLVFXVVWKHUHVXOWVUHSRUWHGLQWKLVFKDSWHUDQGWKHLULPSOLFDWLRQV
IRUWKHRU\PHWKRGRORJ\DQGSUDFWLFH

±±
&+$37(5 
'LVFXVVLRQDQG,PSOLFDWLRQV

³7KHPRVWIUXLWIXOGHYHORSPHQWVKDYHDOZD\VHPHUJHG
ZKHUHWZRGLIIHUHQWNLQGVRIWKLQNLQJPHW´
±:HUQHU+HLVHQEHUJ

7KH JRDO RI WKLV VWXG\ ZDV WR H[DPLQH WKH LPSRUWDQFH RI RUJDQL]DWLRQDO LVVXHV WR EHWWHU
XQGHUVWDQGKRZVRIWZDUHRUJDQL]DWLRQVFDQHQDEOH63,:HZHUHLQWHUHVWHGLQDQVZHULQJWKH
IROORZLQJ WKUHH TXHVWLRQV   :KDW DUH WKH NH\ OHDUQLQJ SURFHVVHV LQ VXFFHVVIXO VRIWZDUH
RUJDQL]DWLRQV"   :KDW DUH WKH NH\ IDFWRUV RI VXFFHVV LQ VRIWZDUH SURFHVVHV LPSURYHPHQW"
 :KDWDUHWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[WDQGPRGHVRIOHDUQLQJLQVRIW
ZDUHRUJDQL]DWLRQV"
7KHUHVXOWVIURPWKLVVWXG\VXJJHVWWKDWWKHG\QDPLFPRGHORI63,SUHVHQWHGLQ&KDSWHU
LV D XVHIXO FRQFHSWXDOL]DWLRQ RI SURFHVV LPSURYHPHQW LQ VRIWZDUH RUJDQL]DWLRQV 7KH PRGHO
DQVZHUVWKHWKUHHUHVHDUFKTXHVWLRQVE\H[SOLFLWO\GLVWLQJXLVKLQJEHWZHHQWKUHHPDMRUVHWVRI
YDULDEOHV WKDW LQIOXHQFH RXWFRPH OHDUQLQJ F\FOH IDFLOLWDWLQJ IDFWRUV DQG RUJDQL]DWLRQDO
FRQWH[W %DVHG RQ WKLV PRGHO WKLV VWXG\ KDV TXDOLWDWLYHO\ DQDO\]HG WKH OHDUQLQJ F\FOH DQG
TXDQWLWDWLYHO\DQDO\]HGWKHLPSDFWRIWKHIDFLOLWDWLQJIDFWRUVRQWKHRXWFRPHDQGWKHLPSDFWRI
RUJDQL]DWLRQDOFRQWH[WRQPRGHVRIOHDUQLQJ7KHPDMRUILQGLQJWKDWRUJDQL]DWLRQDOLVVXHVDUH
VLJQLILFDQWSUHGLFWRUVRI63,VXFFHVVHPSKDVL]HVWKHLPSRUWDQFHRIFUHDWLQJHQDEOLQJFRQWH[WV
ZLWKLQVRIWZDUHRUJDQL]DWLRQV7KLVKDVVHYHUDOLPSRUWDQWLPSOLFDWLRQV
,QWKLVFKDSWHUZHGLVFXVVWKHDQVZHUVWRWKHUHVHDUFKTXHVWLRQVDORQJZLWKWKUHHVHWVRI
VXFK LPSOLFDWLRQV 7KH ILUVW LQYROYHV WKHRUHWLFDO LPSOLFDWLRQV RIIHULQJ QHZ LQVLJKWV LQWR D
G\QDPLF PRGHO RI 63, WKDW FRPH RXW RI WKH ILQGLQJV RI WKLV VWXG\ 7KH VHFRQG LV UHODWHG WR
PHWKRGRORJ\ DQG LQYROYHV FRQWULEXWLRQV UHJDUGLQJ WKH FRQGXFW RI 63, UHVHDUFK )LQDOO\ WKH
WKLUG VHW LQYROYHV SUDFWLFDO LPSOLFDWLRQV DQG UHFRPPHQGDWLRQV IRU VRIWZDUH PDQDJHUV DQG
VRIWZDUH GHYHORSHUV LQWHUHVWHG LQ LPSOHPHQWLQJ D VXFFHVVIXO 63, SURJUDP ZLWKLQ WKHLU
RUJDQL]DWLRQV

±±
&+$37(5

:HXVHDGLDOHFWLFDSSURDFKWRGLVFXVVWKHLPSOLFDWLRQVIRUWKHRU\DQGPHWKRGRORJ\7KLV
DSSURDFKDFFHSWVWKHGLYHUVLW\RIDVVXPSWLRQVDQGNQRZOHGJHFODLPVDVDQLQHYLWDEOHDVSHFW
RI RUJDQL]DWLRQDO OHDUQLQJ DQG 63, DQG LW DWWHPSWV WR XVH WKH GLIIHUHQFHV DPRQJ FRPSHWLQJ
SHUVSHFWLYHV DV D PHDQV RI FRQVWUXFWLQJ QHZ PRGHV RI XQGHUVWDQGLQJ ,Q FRQWUDVW WR
DSSURDFKHVWKDWWU\WRHOLPLQDWHGLYHUVLW\DQGXQFHUWDLQW\E\VHDUFKLQJIRUWKH³EHVWSUDFWLFH´
WKHGLDOHFWLFDODSSURDFKGHOLEHUDWHO\FRXQWHUSRVHVWKHLQVLJKWVRIGLIIHUHQWSHUVSHFWLYHVLQWKH
KRSHWKDWDFRPSOHWHO\QHZPRGHRIXQGHUVWDQGLQJZLOOHPHUJHIURPWKHGHEDWHJHQHUDWHGE\
WKLVRSSRVLWLRQ
7KH LPSRUWDQFH RI GLDOHFWLF WKLQNLQJ LQ VRIWZDUH GHYHORSPHQW KDV DOVR EHHQ QRWHG E\
HJ%MHUNQHV'DKOERPDQG0DWKLDVVHQ6RGDQ‘JULP DQG
LQ WKH VWXG\ RI RUJDQL]DWLRQV E\ HJ %HQVRQ  0RUJDQ  7HWHQEDXP  
)XUWKHUPRUH GLDOHFWLF WKLQNLQJ LV DOVR VHHQ LQ FRQWHPSRUDU\ UHVHDUFK WKDW SURYLGHV ³WUDQV
FXOWXUDO´EULGJHVEHWZHHQWKH³WZRFXOWXUHV´RIVFLHQFHDQGWKHKXPDQLWLHV 5RVHQ 

 7KH/HDUQLQJ3URFHVVHVLQ63,
7KH ILUVW UHVHDUFK TXHVWLRQ IRFXVHG RQ LGHQWLI\LQJ WKH NH\ SURFHVVHV WKDW FRPSULVH WKH
OHDUQLQJ F\FOH RI VXFFHVVIXO VRIWZDUH RUJDQL]DWLRQV $ WKHRUHWLFDO LQYHVWLJDWLRQ DQ LQGHSWK
SLORWFDVHVWXG\ &DVH$ DFURVVFDVHDQDO\VLVRIWZHOYHVRIWZDUHRUJDQL]DWLRQV &DVH%&
DQG '  DQG RXU RZQ FRQVXOWLQJ H[SHULHQFH SURYLGHG WKH EDFNJURXQG IRU DQVZHULQJ WKH
TXHVWLRQ *URXQGHG LQ WKHVH GDWD ZH LGHQWLILHG WKH IRXQGDWLRQV RI WKH OHDUQLQJ VRIWZDUH
RUJDQL]DWLRQ &KDSWHU DQGFRQVWUXFWHGDG\QDPLFPRGHORI63, &KDSWHU 

 )RXQGDWLRQV
+RZZHSHUFHLYHNQRZOHGJHDQGWKHSURFHVVRI FRPLQJWRNQRZSURYLGHV WKH EDVLV IRU 63,
SUDFWLFH ,I ZH EHOLHYH WKDW VRIWZDUH GHYHORSHUV SDVVLYHO\ UHFHLYH LQIRUPDWLRQ WKHQ SULRULW\
ZLOOEHRQNQRZOHGJHWUDQVPLVVLRQDQGDVVRFLDWHGWRROV,IRQWKHRWKHUKDQGZHEHOLHYHWKDW
WKH\DFWLYHO\FRQVWUXFWNQRZOHGJHLQWKHLUDWWHPSWVWRPDNHVHQVHRIWKHLUZRUOGWKHQ63,ZLOO
OLNHO\HPSKDVL]HWKHGHYHORSPHQWRIPHDQLQJDQGXQGHUVWDQGLQJ
,Q DFFRUGDQFH ZLWK WKH ODWWHU WKH ILQGLQJV IURP WKLV VWXG\ FRPELQHG ZLWK RXU SULRU
H[SHULHQFHOHGXVWRDQ HPSKDVLVRQ 63, DV RUJDQL]DWLRQDO OHDUQLQJ ± DV D FROOHFWLYH DELOLW\
H[SUHVVHGLQDQGWKURXJKWKHRUJDQL]DWLRQV¶SURGXFWDQGVHUYLFHRULHQWHGSUDFWLFHVUHODWHGWR
VRIWZDUHGHYHORSPHQW)XUWKHUPRUHLWOHGXVWRHPSKDVL]HDPRUHDGDSWLYHDQGDFWLYHYLHZRI
NQRZOHGJH UDWKHU WKDQ WKH WUDGLWLRQDO VWDWLF DQG SDVVLYH YLHZ $V D UHVXOW ZH GHULYHG WKH
IROORZLQJIRXUIRXQGDWLRQVRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ

x 6RFLDO OHDUQLQJ ZKLFK IRFXVHV RQ 63, DV D VRFLDO FROODERUDWLYH DFWLYLW\ ZLWKLQ WKH
FRQWH[WRIDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
x 6HQVHPDNLQJ ZKLFK LV DLPHG DW FRQVWUXFWLQJ PHDQLQJ DQG H[SUHVVLQJ WKH EDVLF
DVVXPSWLRQVDQGYDOXHVWKDWDUHYLWDOWRWKHVRIWZDUHRUJDQL]DWLRQDQGLWVPHPEHUV
x .QRZOHGJHFUHDWLRQZKLFKLVDLPHGDWJHQHUDWLQJQHZNQRZOHGJHDQGQHZFRPSHWHQ
FLHVWKDWHQDEOHRUEURDGHQWKHVRIWZDUHRUJDQL]DWLRQ¶VSRWHQWLDOUDQJHRIDFWLRQV

±±
',6&866,21$1',03/,&$7,216

x 3XUSRVHIXODFWLRQZKLFKIRFXVHVRQXVLQJWKHQHZLQWHUSUHWDWLRQVDQGQHZNQRZOHGJH
WRFRQVWUXFWLPSURYHGFRXUVHVRIDFWLRQ

$FFRUGLQJO\ ZH IRXQG WKDW VXFFHVVIXO VRIWZDUH RUJDQL]DWLRQV ZHUH DEOH WR HQDEOH VHQVH
PDNLQJ NQRZOHGJH FUHDWLRQ DQG SXUSRVHIXO DFWLRQV LQ RUGHU WR OHDUQ DQG LPSURYH WKHLU
VRIWZDUH SURFHVVHV VHH &KDSWHUV  DQG   7KLV VXJJHVWV WKDW VXFFHVVIXO 63, UHTXLUHV D
FRPPLWPHQW WR OHDUQLQJ DQG WKDW RUJDQL]DWLRQDO NQRZOHGJH LV FRQVWUXFWHG WKURXJK WKH
FROODERUDWLYH DFWLRQ RI RUJDQL]DWLRQDO PHPEHUV 7KLV YLHZ RQ 63, FRUUHVSRQGV WR D GHVLJQ
SHUVSHFWLYHRQVRIWZDUH $GOHUDQG:LQRJUDG:LQRJUDG:LQRJUDGDQG)ORUHV
  DQG NQRZOHGJH PDQDJHPHQW %URZQ DQG 'XJXLG D E )LVFKHU DQG 2VWZDOG
  ,Q WKLV SHUVSHFWLYH ZRUNLQJ OHDUQLQJ DQG 63, LV UHODWHG LQ PXFK WKH VDPH ZD\ DV
%URZQDQG'XJXLG¶V  XQLILHGYLHZRIZRUNLQJOHDUQLQJDQGLQQRYDWLRQ
%DVHG RQ WKHVH LQVLJKWV ZH FRQVWUXFWHG D G\QDPLF PRGHO RI 63, ZKLFK HPEUDFHV WKH
OHDUQLQJ SURFHVVHV DQG WKH NH\ IDFWRUV IRU VXFFHVV UHTXLUHG IRU GHVFULELQJ VRIWZDUH
RUJDQL]DWLRQVDVOHDUQLQJV\VWHPV$PDMRUFRQFHUQZDVWRHVWDEOLVKDFRQFHSWXDOIUDPHZRUN
ZKLFK VWUXFWXUHG WKH RUJDQL]DWLRQDO OHDUQLQJ SURFHVV WKXV IDFLOLWDWLQJ WKH GLIIXVLRQ RI
NQRZOHGJHDQGH[SHULHQFHZLWKLQDQGEHWZHHQJURXSVRIVRIWZDUHGHYHORSHUV
)XUWKHUPRUH ZH IRXQG WKDW RUJDQL]DWLRQDO OHDUQLQJ DQG 63, LV D FRQWLQXRXV DQG
VLPXOWDQHRXV GLDOHFWLF LQWHUSOD\ EHWZHHQ WZR FRPSRQHQWV WKH NQRZOHGJH WKDW WKH
RUJDQL]DWLRQ KDV HVWDEOLVKHG RYHU WLPH DQG WKH NQRZLQJ RI WKH RUJDQL]DWLRQ¶V PHPEHUV LQ
WKHLUUHVSHFWLYHFRQWH[WV:HZLOOGLVFXVVHDFKRIWKHVHLQWXUQ

 &RPPXQLWLHVRISUDFWLFH
7KURXJKRXW WKLV VWXG\ ZH KDYH IRFXVHG RQ ORFDO NQRZLQJ DV DQ RQJRLQJ SURFHVV RI VRFLDO
FRQVWUXFWLRQ DQG FROOHFWLYH DFWLRQ WKDW LV HPEHGGHG LQ WKH VRIWZDUH RUJDQL]DWLRQ¶V WDVNV
UHODWLRQVKLSVDQGWRROV VHH6HFWLRQVDQG 7KLVFRQFHSWXDOL]DWLRQKDVWXUQHGRXWWR
EHDQDFFXUDWHGHVFULSWLRQRIWKHUHDOLW\H[SHULHQFHGE\VRIWZDUHGHYHORSHUV HJ&DVH$%
DQG& ZLWKLQWKHFRQWH[WRI63,WKH\DUHUHIOHFWLYHSUDFWLWLRQHUVZKRVWUXJJOHWRXQGHUVWDQG
DQGVROYHLOOGHILQHGSUREOHPV
:HIRXQGWKDWOHDUQLQJLVDIXQGDPHQWDOSDUWRIVRIWZDUHGHYHORSPHQWZKLFKFRXOGQRW
EHGLYRUFHGIURPWKHVSHFLILFFRQWH[WLQZKLFKLWWDNHVSODFH7KLVREVHUYDWLRQVXSSRUWV%URZQ
DQG 'XJXLG¶V   SHUVSHFWLYH RQ OHDUQLQJLQZRUNLQJ DQG WKDW OHVVRQVOHDUQHG FDQQRW
HDVLO\ EH WUDQVIHUUHG IURP RQH VHWWLQJ WR DQRWKHU 7KHUHIRUH ERWK H[SHUWLVH DQG WKH
FRRUGLQDWLRQ RI VXFK H[SHUWLVH LQ D VSHFLILF FRQWH[W DUH LPSRUWDQW IRU LPSURYLQJ WKH
SHUIRUPDQFH RI D VRIWZDUH WHDP )DUDM DQG 6SURXOO   &RQVHTXHQWO\ DQ\ URXWLQHV
JHQHUDOL]DWLRQVRU RWKHU PHDQV WKDW VWULS DZD\ FRQWH[W VKRXOG EH WUHDWHG ZLWK FDXWLRQ 7KLV
VXJJHVWV WKDW VRIWZDUH SUREOHPV DUH QRW JLYHQ EXW PXVW EH IUDPHG DQG VROYHG LQ HDFK
SDUWLFXODU FDVH )XUWKHUPRUH LW VXJJHVWV WKDW VRIWZDUH GHYHORSHUV DUH WKH SULPH NQRZOHGJH
FUHDWRUVLQVRIWZDUHRUJDQL]DWLRQVDQGWKDWNQRZOHGJHFUHDWLRQLVDQLQWULQVLFSDUWRISUDFWLFH
/DYH DQG :HQJHU   H[SODLQHG WKLV VRUW RI VLPXOWDQHRXV ZRUNLQJ DQG OHDUQLQJ LQ
WHUPVRIERWKWKHSUDFWLFHDQGWKHFRPPXQLW\7KH\DUJXHGWKDWOHDUQLQJDSUDFWLFHLQYROYHV
EHFRPLQJDPHPEHURID³FRPPXQLW\RISUDFWLFH´DQGWKHUHE\XQGHUVWDQGLQJLWVZRUNDQGLWV
ODQJXDJHIURPWKHLQVLGH7KLVSHUVSHFWLYHKDVLPSRUWDQWLPSOLFDWLRQVIRU63,VLQFHOHDUQLQJ
FDQQRW VLPSO\ EH YLHZHG DV D PDWWHU RI DFTXLULQJ LQIRUPDWLRQ LW UHTXLUHV GHYHORSLQJ WKH
³GLVSRVLWLRQ´ ³GHPHDQRU´ DQG ³RXWORRN´ RI WKH SUDFWLWLRQHU %URZQ DQG 'XJXLG E 

±±
&+$37(5

)XUWKHUPRUHOLNH2UU¶V  VWXG\RI WHFKQLFDO UHSV DQG :HQJHU¶V   VWXG\ RI FODLPV
SURFHVVRUVRXUILQGLQJVUHYHDOHGWKHLPSRUWDQFHRIWKHJURXSWRERWKZKDWDQGKRZVRIWZDUH
RUJDQL]DWLRQVOHDUQ
7KXVWKHSUDFWLFHRIWKHVRIWZDUHWHDPWXUQHGRXWWREHWKHPRVWLPSRUWDQWHQYLURQPHQW
IRU 63, VLQFH LW ERWK VKDSHV DQG HQDEOHV RUJDQL]DWLRQDO OHDUQLQJ 7KLV LPSOLHV WKDW 63, LV
VRPHWKLQJWKDWFDQQRWEHLVRODWHGIURPWKHRQJRLQJSUDFWLFHRIVRIWZDUHGHYHORSPHQWZKLFK
LQWXUQKDVLPSRUWDQWFRQVHTXHQFHVIRUWKHZD\VLQZKLFK63,DFWLYLWLHVVKRXOGEHRUJDQL]HG
$QLPSRUWDQWFKDOOHQJHWKHUHIRUHLVWKHQHHGWRDFTXLUHDQHZPLQGVHW±DPLQGVHWWKDWQR
ORQJHU YLHZV VRIWZDUH GHYHORSHUV DV SDVVLYH UHFHLYHUV RI LQIRUPDWLRQ EXW DV DFWLYH
FRQVWUXFWRUVRINQRZOHGJH.QRZOHGJHLVQRWVRPHWKLQJWKDWLVKDQGHGGRZQIURPDERYHLW
LVFRQVWUXFWHGFROODERUDWLYHO\LQWKHFRQWH[WRIZRUN
6XFK D SUDFWLFH DQG FRPPXQLW\ RULHQWDWLRQ KDV DOVR EHHQ QRWHG LQ RWKHU VWXGLHV RI
VRIWZDUH GHYHORSPHQW )RU H[DPSOH &RPPXQLFDWLRQV RI WKH $&0 KDG D VSHFLDO HGLWLRQ
GHYRWHGWRWKHWRSLF LQ LWV 2FWREHU  LVVXH ,Q WKDW LVVXH WKH OHDG DUWLFOH E\ &RQVWDQWLQH
  LQWURGXFHG D FRQFLVH WKHRUHWLFDO IUDPHZRUN IRU PDNLQJ VHQVH RI WKH GLYHUVH
SRVVLELOLWLHVLQWKHRUJDQL]LQJRIVRIWZDUHGHYHORSPHQWDVDFROOHFWLYHKXPDQDFWLYLW\
,QWKHLUVWXG\RIDVRIWZDUHGHVLJQWHDP:DO]HWDO  H[DPLQHGWKHUROHDQGSURFHVV
RINQRZOHGJHDFTXLVLWLRQVKDULQJ DQGLQWHJUDWLRQ7KHLUVWXG\VXSSRUWV RXU REVHUYDWLRQV RI
WKHLPSRUWDQFHRIFRQWH[WVHQVLWLYHOHDUQLQJDQGWKDWPXFKRIWKHNQRZOHGJHWKDWLVSDUWRID
WHDP¶VPHPRU\LVQRWFDSWXUHGE\IRUPDOGRFXPHQWV VHH6HFWLRQ )XUWKHUPRUHVWXGLHV
E\ )DUDM DQG 6SURXOO   *ODVV   *XLQDQ HW DO   DQG 6DZ\HU DQG *XLQDQ
 KDYHVKRZQWKDWVRFLDOSURFHVVHVVXFKDVWKHOHYHORILQIRUPDOFRRUGLQDWLRQDUHPRUH
LPSRUWDQWLQH[SODLQLQJWKHYDULDQFHLQVRIWZDUHWHDPSHUIRUPDQFHWKDQVRIWZDUHPHWKRGVDQG
WRRO XVDJH $OVR &XUWLV HW DO   'H0DUFR DQG /LVWHU   DQG 6FDFFKL 
HPSKDVL]HGWKHLPSRUWDQFHRIXQGHUVWDQGLQJKRZKXPDQDQGRUJDQL]DWLRQDOIDFWRUVDIIHFWWKH
H[HFXWLRQ RI VRIWZDUH GHYHORSPHQW WDVNV DQG FRQVHTXHQWO\ WKDW WKH GHYHORSPHQW DQG
LPSURYHPHQWRIVRIWZDUHV\VWHPVPXVWEHDQDO\]HGDVDEHKDYLRUDOSURFHVV
6LQFHNQRZLQJLVQRWGHILQHGRXWVLGHWKHORFDO³UHJLPHRIFRPSHWHQFH´ :HQJHU 
VRIWZDUHWHDPVFUHDWHERXQGDULHVRUGLVFRQWLQXLWLHVRYHUWLPHEHWZHHQWKRVHZKRKDYHEHHQ
SDUWLFLSDWLQJDQGWKRVHZKRKDYHQRW6RZKLOHWKHFUHDWLRQRIORFDONQRZOHGJHGHHSHQVWKH
LQVLJKWVRIWKHWHDPLWFDQVLPXOWDQHRXVO\FUHDWHSUREOHPVIRURUJDQL]DWLRQDOFRPPXQLFDWLRQ
FRRUGLQDWLRQDQGFROODERUDWLRQ
+RZHYHUERXQGDULHVDUHDOVRSODFHVZKHUHQHZDQGLQQRYDWLYHSUDFWLFHVRIWHQVWDUW7KLV
VXJJHVWV WKDW RUJDQL]DWLRQDO OHDUQLQJ UHTXLUH D EDODQFH EHWZHHQ ORFDO SUDFWLFH DQG RUJDQL]D
WLRQDOUHLILFDWLRQ2QWKHRQHKDQGVRIWZDUHWHDPVDUHRUJDQL]DWLRQDODVVHWVWKURXJKWKHGHSWK
RI HQJDJHPHQW DQG OHDUQLQJ WKH\ GHYHORS 2Q WKH RWKHU KDQG WKH ORFDOLW\ RI VXFK OHDUQLQJ
HQWDLOWKHGDQJHUWKDWXVHIXOFRQQHFWLRQVEH\RQGWKHERXQGDULHVRIDQ\JLYHQSUDFWLFHPD\QRW
EHDSSDUHQWRUVRXJKW 7KXV WKH ORFDOLWLHV DQG ERXQGDULHV FUHDWHG E\ VRIWZDUH WHDPV UHIOHFW
DQGVKDSHWKHOHDUQLQJSURFHVVHVLQ63,
7KLV VXJJHVWV WKDW WKH OHDUQLQJ DUFKLWHFWXUH RI D VRIWZDUH RUJDQL]DWLRQ EH FRPSRVHG RI
ERWKFRPPXQLWLHVDQGERXQGDULHV³%URNHULQJ´LH³FRQQHFWLRQVSURYLGHGE\SHRSOHZKRFDQ
LQWURGXFHHOHPHQWVRIRQHSUDFWLFHLQWRDQRWKHU´ :HQJHUS LVDQLPSRUWDQWW\SH
RI FRQQHFWLRQ IRU EULGJLQJ ORFDO SUDFWLFHV )RU VXVWDLQHG RUJDQL]DWLRQDO OHDUQLQJ DQG 63,
KRZHYHU EURNHULQJ QHHGV WR EH VXSSOHPHQWHG E\ DQRWKHU W\SH RI FRQQHFWLRQV ³ERXQGDU\
REMHFWV´ ,Q WKH QH[W VHFWLRQ WKHUHIRUH ZH GLVFXVV WKH UROH RI RUJDQL]DWLRQDO PHPRU\ LQ
SURYLGLQJVXFKFRQQHFWLRQVEHWZHHQORFDOSUDFWLFHV

±±
',6&866,21$1',03/,&$7,216

 /LYLQJRUJDQL]DWLRQDOPHPRU\
$ FHQWUDO FRPSRQHQW RI D VRIWZDUH RUJDQL]DWLRQ¶V OHDUQLQJ DUFKLWHFWXUH LV D UHSRVLWRU\ IRU
VWRULQJ NQRZOHGJH ± DQ RUJDQL]DWLRQDO PHPRU\ +RZHYHU DV ZH VDZ LQ &DVH & WKH PHUH
SUHVHQFHRIDQRUJDQL]DWLRQDOPHPRU\V\VWHPGRHVQRWHQVXUHWKDWVRIWZDUHRUJDQL]DWLRQVZLOO
OHDUQ)RUVXVWDLQHGRUJDQL]DWLRQDOOHDUQLQJDQG63,WZRVHHPLQJO\GLVSDUDWH JRDOV PXVW EH
VHUYHG VLPXOWDQHRXVO\ )LUVW RUJDQL]DWLRQDO PHPRULHV PXVW VHUYH ZRUN E\ PDNLQJ VWRUHG
LQIRUPDWLRQ UHOHYDQW WR WKH VLWXDWLRQ E\ KHOSLQJ VRIWZDUH GHYHORSHUV PDNH VHQVH RI WKH
SUREOHPVWKH\IDFH6HFRQGRUJDQL]DWLRQDOPHPRULHVPXVWEHH[WHQGHGDQGXSGDWHGDVWKH\
DUHXVHGWRVXSSRUWZRUNSUDFWLFHV7KLVVXJJHVWV WKDW RUJDQL]DWLRQDO PHPRULHV DUH G\QDPLF
DQG FROODERUDWLYH LQIRUPDWLRQ VSDFHV ZKLFK DUH DFWLYHO\ LQWHJUDWHG LQWR WKH VRIWZDUH SURF
HVVHVDQGVRFLDOSUDFWLFHVRIWKHWHDPWKDWFRQVWUXFWVWKHP
:KLOHWKHSUREOHPVIDFLQJVRIWZDUHWHDPVDUHXQLTXHWKH\DUHRIWHQVLPLODUWRSUHYLRXVO\
VROYHG SUREOHPV 7KLV LQYROYHV ERWK SUREOHPV DQG RSSRUWXQLWLHV VLQFH WKH SURFHVV RI
LQWHUSUHWLQJ RUJDQL]DWLRQDO NQRZOHGJH PXVW GHDO ZLWK SULRU H[SHULHQFH DQG DQ DOUHDG\
LQWHUQDOL]HGERG\ RI NQRZOHGJH ± LW FDQQRW FRQVWUXFW ORFDO UHDOLW\ H[ QLKLOR 7KLV SUHVHQWV D
SUREOHP WR 63, EHFDXVH WKH DOUHDG\ LQWHUQDOL]HG NQRZOHGJH KDV D WHQGHQF\ WR SHUVLVW
:KDWHYHU QHZ NQRZOHGJH LV WR EH LQWHUQDOL]HG PXVW VRPHKRZ EH VXSHULPSRVHG XSRQ WKH
DOUHDG\H[LVWLQJ NQRZOHGJH 7KHUH LV WKHUHIRUH D SRWHQWLDO SUREOHP RI FRQVLVWHQF\ EHWZHHQ
WKH RULJLQDO DQG WKH QHZ LQWHUQDOL]DWLRQV 7R HVWDEOLVK DQG PDLQWDLQ VXFK FRQVLVWHQF\ SUH
VXSSRVHVFRQFHSWXDOSURFHGXUHVWRLQWHJUDWHGLIIHUHQWERGLHVRINQRZOHGJH
7UDGLWLRQDOO\ VXFK LQWHJUDWLRQ KDV EHHQ WKH UHDOP RI NQRZOHGJH HQJLQHHUV PHPEHUV RI
6(3*¶VRUWKHDQDO\VWVLQ([SHULHQFH)DFWRULHV ,Q DVRFLDOFRQVWUXFWLRQSHUVSHFWLYHNQRZO
HGJHLQWHJUDWLRQLVSDUWRIWKHVRIWZDUHGHYHORSHUV¶GDLO\ZRUN7KLVSUHVHQWVDQHZFKDOOHQJH
VLQFHPRVWGHYHORSHUVGRQRWFRQVLGHUWKLVDVSDUWRIWKHLUFRUHUHVSRQVLELOLW\$PDMRUFRQFHUQ
IRU RXU DSSURDFK WR 63, WKHUHIRUH LV WR FDSWXUH WKH NQRZOHGJH JHQHUDWHG IURP ORFDO ZRUN
SURFHVVHVZLWKRXWH[WUDHIIRUWE\WKHGHYHORSHUVDQGWRKHOSWKHPFRQVROLGDWHDQGJOREDOL]H
WKLV NQRZOHGJH LQ WKH IRUP RI H[SHULHQFH SDFNDJHV WKDW FDQ EH VWRUHG LQ RUJDQL]DWLRQDO
PHPRU\
+RZHYHUDJHQHUDOREVHUYDWLRQLVWKDWPDQ\VXFK³H[SHULHQFHEDVHV´ZKLFKDUHILOOHGXS
ZLWK SUHVXPDEO\ XVHIXO OHVVRQV OHDUQHG WLSV DQG GDWD DUH QRW EHLQJ XVHG 7KHUH FRXOG EH
VHYHUDOH[SODQDWLRQVIRUWKLV2QHLVWKDWPDQ\VXFKH[SHULHQFHEDVHV DUH FUHDWHGE\NQRZO
HGJHHQJLQHHUVRUTXDOLW\HQJLQHHUVDQGILOOHGZLWKZKDWPDQDJHUVWKLQNLVXVHIXOIRUWKHSHR
SOH WKH\ PDQDJH %XW DV ZH KDYH VHHQ HJ &DVH &  WKH GLIIHUHQFHV EHWZHHQ RFFXSDWLRQDO
FXOWXUHVDUHRIWHQVRODUJHWKDWLWVKRXOGFRPHDVQRVXUSULVHWKDWGHYHORSHUVXVXDOO\GRQ¶WILQG
WKHPDQDJHUV¶WLSVYHU\XVHIXO ,QWHUHVWLQJO\ H[SHULHQFH EDVHV WKDW DUH ILOOHG ZLWK LQGLYLGXDO
GHYHORSHU¶VLGHDVDUHQRWRIPXFKKHOSHLWKHU,QIDFW³7KHPRUHDGDWDEDVHFRQWDLQVHYHU\
RQH¶VIDYRULWHLGHDWKHPRUHXQXVDEOHLWEHFRPHV´ %URZQDQG'XJXLGDS 
$Q H[DPSOH RI JHWWLQJ SDVW WKHVH SUREOHPV LV WKH ZD\ LQ ZKLFK ;HUR[ GHVLJQHG WKHLU
ZRUOGZLGH (XUHND GDWDEDVH WR SUHVHUYH UHVRXUFHIXO LGHDV RYHU WLPH DQG GHOLYHU WKHP RYHU
VSDFH %URZQ DQG 'XJXLG D  -XVW DV NQRZOHGJH LV FLUFXODWHG ZLWKLQ WKH VFLHQWLILF
FRPPXQLW\ ;HUR[ HVWDEOLVKHG D SURFHVV RI SHHU UHYLHZV LQ ZKLFK DFNQRZOHGJHG H[SHUWV
UHYLHZDQ\WLSVRU LGHDV SULRU WR LQFOXVLRQ LQ WKH GDWDEDVH &RQVHTXHQWO\ WKH UHSV XVLQJ WKH
V\VWHPNQRZWKDWWKHWLSVWKDWKDYHVXUYLYHGWKHUHYLHZSURFHVV±DQGWKHGDWDEDVHDVDZKROH
±DUHUHOHYDQWUHOLDEOHDQGSUREDEO\QRWUHGXQGDQW)XUWKHUPRUHDQGDOVRLQDFFRUGDQFHZLWK
WKHWUDGLWLRQVRIWKHVFLHQWLILFFRPPXQLW\WKHUHSVGRQ¶WJHWSDLGIRUWKHLUWLSV+RZHYHUWKHLU

±±
&+$37(5

QDPHVDUHDWWDFKHGWRWKHWLSVVRWKDWWKRVHZKR VXEPLW JRRG WLSV HDUQ SRVLWLYH UHFRJQLWLRQ


WKXVEXLOGLQJVRFLDOFDSLWDOWKURXJKWKHTXDOLW\RIWKHLUWLSV
)XUWKHUPRUH LQ RXU FRQVWUXFWLYLVW DSSURDFK WR 63, WKH LQIRUPDWLRQ QHHGV RI LQGLYLGXDO
GHYHORSHUV RU VRIWZDUH WHDPV DUH XQSUHGLFWDEOH 7KHLU QHHGV IRU LQIRUPDWLRQ DULVH IURP D
SDUWLFXODU VLWXDWLRQ LQ ZKLFK GHYHORSHUV VWUXJJOH WR XQGHUVWDQG D SUREOHP 7KLV VLWXDWLRQ
GLFWDWHV WKH LQIRUPDWLRQ GHPDQG DQG SURYLGHV WKH FRQWH[W IRU OHDUQLQJ 6XFK RQGHPDQG
LQIRUPDWLRQWKXVLQWHJUDWHVZRUNLQJDQGOHDUQLQJEHFDXVHWKHQHHGIRUOHDUQLQJFRPHVIURP
ZRUNDQGEHFDXVH WKH OHDUQLQJ WDNHV SODFH ZLWKLQ WKH FRQWH[W RI WKH ZRUN VLWXDWLRQ 7KLV LV
VLPLODU WR WKH XQLILHG YLHZ RQ ZRUNLQJ OHDUQLQJ DQG LQQRYDWLRQ H[SUHVVHG E\ %URZQ DQG
'XJXLG  
$OVRZHKDYHVHHQWKDWWKHLQIRUPDOLW\IRXQGZLWKLQWKHORFDOSUDFWLFHRIVRIWZDUHWHDPV
GLIIHUV IURPWKH H[SOLFLWQHVV DQG IRUPDOLW\ RIWHQ GHPDQGHGEHWZHHQ WHDPV HJ &DVH $ DQG
&  7KLV KDV LPSRUWDQW LPSOLFDWLRQV IRU WKH ZD\V LQ ZKLFK WHFKQRORJ\ FDQ VXSSRUW
RUJDQL]DWLRQDO PHPRULHV %DVLFDOO\ VXFK WHFKQRORJLHV PXVW EH DEOH WR VXSSRUW GLIIHUHQW
GHJUHHV RI IRUPDOLW\ GHSHQGLQJ RQ WKH W\SHV RI SURFHVVHV WKH\ DUH PHDQW WR VXSSRUW 7KLV
PHDQV WKDW WHFKQRORJLHV IRU RUJDQL]DWLRQDO PHPRU\ V\VWHPV PXVW QRW RQO\ VXSSRUW WKH
GLIIXVLRQRIH[LVWLQJNQRZOHGJHWKH\PXVWDOVRVXSSRUWWKHFUHDWLRQRIQHZNQRZOHGJH
7KXV VXSSRUWHG E\ WKH YLHZV RI )LVFKHU DQG 2VWZDOG   WKH SUHFHGLQJ GLVFXVVLRQ
VXJJHVWVWKDWVRIWZDUHRUJDQL]DWLRQVVKRXOGFRQVWUXFWOLYLQJRUJDQL]DWLRQDOPHPRULHVZLWKGXH
FRQVLGHUDWLRQWRWKHIROORZLQJGHVLJQSULQFLSOHV

x 7KH\ DUH LQIRUPDWLRQ VSDFHV RZQHG E\ WKH SHRSOH DQG FRPPXQLWLHV ZKR XVH WKHP WR
GHYHORSVRIWZDUHQRWE\PDQDJHPHQWRUWKHTXDOLW\GHSDUWPHQW
x 7KH\VXSSRUWWKHFROODERUDWLYHDQGHYROXWLRQDU\GHVLJQRIFRPSOH[VRIWZDUHV\VWHPVE\
SURYLGLQJDPHDQVWRLQWHJUDWHWKHPDQ\FRQWULEXWLRQVRIPDQ\SHRSOH
x 7KH\ DUH RSHQ DQG HYROYDEOH V\VWHPV VHUYLQJ QRW RQO\ DV LQIRUPDWLRQ UHSRVLWRULHV EXW
DOVRDVPHGLXPVRIFRPPXQLFDWLRQFRRUGLQDWLRQFROODERUDWLRQDQGLQQRYDWLRQ
x 7KH\FDQHYROYHWKURXJKPDQ\VPDOOFRQWULEXWLRQVE\PDQ\SHRSOH UDWKHUWKDQ WKURXJK
ODUJHFRQWULEXWLRQVE\DIHZSHRSOH DVKDVEHHQWKHFDVHIRUSUHYLRXVNQRZOHGJHEDVHG
V\VWHPV 

 7KH.H\)DFWRUVRI6XFFHVVLQ63,
,QDGGUHVVLQJWKHVHFRQGUHVHDUFKTXHVWLRQZHSHUIRUPHGDTXDQWLWDWLYHVXUYH\WRLQYHVWLJDWH
WKHNH\IDFWRUVRIVXFFHVVLQ 63, VHH 6HFWLRQ   7KH UHVXOWV RI WKH ELYDULDWH FRUUHODWLRQDO
DQG PXOWLSOH UHJUHVVLRQ DQDO\VHV LQGLFDWH VXSSRUW IRU DOO RI WKH K\SRWKHVHV LQ WKH SURSRVHG
WKHRU\ DQG GHPRQVWUDWH WKH H[LVWHQFH RI LPSRUWDQW IDFWRUV IRU 63, VXFFHVV VHH 7DEOH  
7KHVH ILQGLQJV DGG DQ LPSRUWDQW QHZ GLPHQVLRQ WR (6( UHVHDUFK LQ WKDW WKH\ YHULI\ WKH
LPSRUWDQFHRIRUJDQL]DWLRQDOIDFWRUVIRU63,VXFFHVV7KLVVXJJHVWVWKDWUDWKHUWKDQWU\LQJWR
LPLWDWHWHFKQLFDOSURFHGXUHVVRIWZDUHRUJDQL]DWLRQVVKRXOGIRFXVWKHLU63,HIIRUWVRQFUHDWLQJ
DQRUJDQL]DWLRQDOFXOWXUHZLWKLQZKLFKWKHVHSURFHGXUHVFDQWKULYH7KLVGLIIHUVVXEVWDQWLDOO\
IURP WKDW IRXQG LQ PRVW RI WKH H[LVWLQJ 63, OLWHUDWXUH ZKLFK IRFXVHV DOPRVW HQWLUHO\ RQ
VRIWZDUHHQJLQHHULQJWRROVDQGWHFKQLTXHV

±±
',6&866,21$1',03/,&$7,216

2XU DQDO\VHV VKRZHG WKDW 63, VXFFHVV GHSHQGV FULWLFDOO\ RQ VL[ RUJDQL]DWLRQDO IDFWRUV
EXVLQHVVRULHQWDWLRQ LQYROYHG OHDGHUVKLS HPSOR\HH SDUWLFLSDWLRQ FRQFHUQ IRU PHDVXUHPHQW
H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ NQRZOHGJH ,Q WKH IROORZLQJ
VXEVHFWLRQVZHGLVFXVVWKHLPSRUWDQFHRIHDFKRIWKHVHIDFWRUV

 %XVLQHVVRULHQWDWLRQ
%XVLQHVV RULHQWDWLRQ WKDW LV WKH H[WHQW WR ZKLFK 63, JRDOV DQG DFWLRQV DUH DOLJQHG ZLWK
H[SOLFLWDQGLPSOLFLWEXVLQHVVJRDOVDQGVWUDWHJLHVZDVLGHQWLILHGDVRQHRIWKHIDFWRUVZLWKWKH
VWURQJHVWLQIOXHQFHRQ63,VXFFHVV U SSU S 7KLVVXSSRUWV
WKHK\SRWKHVLVWKDW63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWKEXVLQHVVRULHQWDWLRQ
7KLV ILQGLQJ LV LPSRUWDQW DQG VXJJHVWV WKDW ERWK SUDFWLWLRQHUV DQG UHVHDUFKHUV VKRXOG
GLUHFW VLJQLILFDQW HIIRUW WRZDUG XQGHUVWDQGLQJ VKDUHG GRPDLQ NQRZOHGJH EHWZHHQ VRIWZDUH
DQG EXVLQHVV H[HFXWLYHV +RZHYHU DV ZH SRLQWHG RXW LQ &KDSWHU  WKHUH DUH WZR EDVLF
FRQGLWLRQV IRU HVWDEOLVKLQJ VXFK FRQQHFWLRQV DQG PDNLQJ FRPPXQLFDWLRQV EHWZHHQ WKHVH
JURXSV HIIHFWLYH )LUVW HDFK JURXS PXVW UHVSHFW WKH H[SHUWLVH RI WKH RWKHU DQG PXVW
DFNQRZOHGJHWKHUHOHYDQFHRIWKDWH[SHUWLVHWRWKHLURZQSUREOHPV6HFRQGHDFKJURXSPXVW
KDYH VXIILFLHQW NQRZOHGJH DQG XQGHUVWDQGLQJ RI WKH RWKHU JURXSV¶ SUREOHPV WR EH DEOH WR
FRPPXQLFDWHHIIHFWLYHO\DERXWWKHP
,WLVLPSRUWDQW WR UHPHPEHU WKDW H[SHULHQFH KDV VKRZQ WKDW VXFK VKDUHG XQGHUVWDQGLQJV
DUHXQOLNHO\WRRFFXU XQOHVV D VXIILFLHQW QXPEHU RI PHPEHUV RI HDFK JURXS KDYH KDG DFWXDO
H[SHULHQFH ZLWK WKH DFWLYLWLHV DQG UHVSRQVLELOLWLHV RI WKH RWKHU JURXSV 6LPRQ   7KLV
VXJJHVWVWKDWWKHVRIWZDUHRUJDQL]DWLRQVKRXOGEHDFWLYHLQFUHDWLQJWKHSRVVLELOLWLHVIRUVXFK
FRQQHFWLRQVWREH IRUPHG IRU H[DPSOH WKURXJK SHUVRQQHO URWDWLRQ SURJUDPV DQG SURPRWLRQ
DQGUHFUXLWPHQWVWUDWHJLHV
7KH FULWLFDO LPSRUWDQFH RI D EXVLQHVV RULHQWDWLRQ LQ 63, VXJJHVWV WKDW VRIWZDUH
RUJDQL]DWLRQV VKRXOG IRFXV RQ ERWK VKRUWWHUP DQG ORQJWHUP DOLJQPHQW RI 63, JRDOV ZLWK
EXVLQHVVJRDOV7KH\VKRXOGIRFXVDWWHQWLRQRQKRZWRERWKDFKLHYHDKLJKGHJUHHRIPXWXDO
XQGHUVWDQGLQJRIFXUUHQWREMHFWLYHVDVZHOODVRQKRZWRDFKLHYHFRQJUXHQFHRIORQJWHUP63,
JRDOVZLWKEXVLQHVVVWUDWHJLHV7KHLPSRUWDQFHRIEXVLQHVVRULHQWDWLRQZDVDOVRFRQILUPHGE\
RXUVWXGLHVLQ&DVH$RIJRDORULHQWHGPHDVXUHPHQWLQ1HUD$6 VHH6HFWLRQ DQGE\RXU
VWXGLHVLQ&DVH%RIVRIWZDUHSURFHVVDVVHVVPHQWLQIRXURIWKH63,4FRPSDQLHV VHH6HFWLRQ
 2QHRIWKHNH\OHVVRQVOHDUQHGIURPWKHODWWHUVWXG\ZDVWKDWWKHDVVHVVPHQWVKRXOGEH
FORVHO\DOLJQHGZLWKDQGWDLORUHGWRWKHFRPSDQ\¶VRYHUDOOVWUDWHJ\:LWKRXWWKLVLWZRXOGEH
KDUGWRJHWDFFHSWDQFHE\WKHPDQDJHUVZKLFKZRXOGOHDGWRIHZHUUHVRXUFHVDQGORZSULRULW\
7KXV WKH LPSRUWDQFH RI DOLJQLQJ 63, JRDOV ZLWK EXVLQHVV JRDOV LPSOLHV WKDW LI WKH 63,
VWUDWHJ\ LV QRW NHSW LQ OLQH ZLWK FKDQJHV LQ WKH EXVLQHVV VWUDWHJ\ WKHUH LV D ULVN WKDW WKH
RUJDQL]DWLRQ¶VVRIWZDUHSURFHVVHVPD\ HQGXSDV DEXUGHQ UDWKHU WKDQ DGYDQFH WKH EXVLQHVV
7KHUHIRUHRXUUHVXOWVDOVRVXJJHVWWKDWXQGHUVWDQGLQJWKHEXVLQHVVDQGRUJDQL]DWLRQDOFRQWH[W
LVFULWLFDOIRUDFKLHYLQJDOLJQPHQWEHWZHHQ63,DFWLYLWLHVDQGEXVLQHVVVWUDWHJ\ZKLFKLQWXUQ
LV RI SDUDPRXQW LPSRUWDQFH IRU WKH VXFFHVV RI WKH 63, SURJUDP 6LPLODUO\ E\ YLHZLQJ WKH
RUJDQL]DWLRQDVDOLYLQJRUJDQLVP=DKUDQ  FRPSDUHGWKHLQWURGXFWLRQRIDQHZSURFHVV
ZLWKWUDQVSODQWLQJDQHZRUJDQ,IWKHQHZSURFHVVLVQRWDOLJQHGZLWKWKHEXVLQHVVVWUDWHJ\RU
GRHVQRWPDWFKWKHRUJDQL]DWLRQ¶VFXOWXUHLWZLOOEHUHMHFWHGE\WKH³RUJDQL]DWLRQDO´ERG\

±±
&+$37(5

 ,QYROYHGOHDGHUVKLS
,QYROYHGOHDGHUVKLSZDVGHILQHGDVWKHH[WHQWWRZKLFKOHDGHUVDWDOOOHYHOVLQWKHRUJDQL]DWLRQ
DUH JHQXLQHO\ FRPPLWWHG WR DQG DFWLYHO\ SDUWLFLSDWH LQ 63, ,W KDG D VWURQJ DQG KLJKO\
VLJQLILFDQWFRUUHODWLRQZLWKRYHUDOO63,VXFFHVV U SSU S 
ZKLFK VXSSRUWV WKH K\SRWKHVLV WKDW 63, VXFFHVV LV SRVLWLYHO\ DVVRFLDWHG ZLWK LQYROYHG
OHDGHUVKLS
$ VXUSULVLQJ UHVXOW KRZHYHU LV WKH LQVLJQLILFDQW LPSRUWDQFH RI LQYROYHG OHDGHUVKLS LQ
SUHGLFWLQJ63,VXFFHVV$OOWKHPDLQVWXGLHVRQZKLFKWKLVLQYHVWLJDWLRQLVEDVHG HJ*UDG\
 +XPSKUH\   =DKUDQ   VKDUH D VWURQJ EHOLHI LQ WKH LPSRUWDQFH RI
PDQDJHPHQWFRPPLWPHQWIRUWKHVXFFHVVIXOLPSOHPHQWDWLRQRI63,)XUWKHUPRUHWKHTXDOLW\
PDQDJHPHQWOLWHUDWXUH HJ&URVE\'HPLQJ-XUDQDQG*RGIUH\ DQGWKH
RUJDQL]DWLRQDO OHDUQLQJ OLWHUDWXUH HJ $UJ\ULV DQG 6FK|Q  1RQDND DQG 7DFKHXFKL
 6HQJH   DOVR VHHP WR VKDUH D VWURQJ EHOLHI LQ WKH LPSRUWDQFH RI PDQDJHPHQW
FRPPLWPHQWIRULPSURYLQJRUJDQL]DWLRQDOSHUIRUPDQFH:LWKWKLVEDFNJURXQGLWLVVXUSULVLQJ
ERWK IURP D WKHRUHWLFDO DQG SUDFWLFDO SHUVSHFWLYH WKDW LQYROYHG OHDGHUVKLS GHILQHG DV WKH
H[WHQW WR ZKLFK OHDGHUV DW DOO OHYHOV LQ WKH RUJDQL]DWLRQ DUH JHQXLQHO\ FRPPLWWHG WR DQG
DFWLYHO\ SDUWLFLSDWH LQ 63, LV D QRQVLJQLILFDQW SUHGLFWRU RI 63, VXFFHVV 7KHUH FRXOG EH
VHYHUDOH[SODQDWLRQVIRUWKLV
)LUVWDVZHIRXQGLQ6HFWLRQPXOWLFROOLQHDULW\VKRXOGQRWKDYHDVXEVWDQWLDOLPSDFW
RQWKHHVWLPDWHGUHJUHVVLRQYDULDWHLQWKLVLQYHVWLJDWLRQ+RZHYHUWKHUHVXOWVRIWKHPXOWLSOH
UHJUHVVLRQ DQDO\VLV VKRZ WKDW PXOWLFROOLQHDULW\ QHYHUWKHOHVV GRHV KDYH DQ LPSDFW RQ WKH
FRPSRVLWLRQRIWKHYDULDWHDQGWKDWFRUUHODWLRQVDPRQJWKHLQGHSHQGHQWYDULDEOHVPD\PDNH
VRPHYDULDEOHVUHGXQGDQWLQWKHSUHGLFWLYHHIIRUW7KLVLVWKHFDVHIRULQYROYHGOHDGHUVKLSDQG
DOVR IRU H[SORUDWLRQ RI QHZ NQRZOHGJH +RZHYHU DV VKRZQ LQ 6HFWLRQ  WKLV GRHV QRW
UHIOHFWWKHLULQGLYLGXDOUHODWLRQVKLSVZLWKWKHGHSHQGHQWYDULDEOH,QVWHDGLWLQGLFDWHVWKDWLQD
PXOWLYDULDWHFRQWH[WWKH\DUHQRWQHHGHGWRJHWKHUZLWKWKHUHPDLQLQJVHWRIIRXULQGHSHQGHQW
YDULDEOHV SDUWLFLSDWLRQ EXVLQHVV RULHQWDWLRQ PHDVXUHPHQW DQG H[SORLWDWLRQ  WR H[SODLQ WKH
YDULDQFH LQ 63, VXFFHVV 7KHUHIRUH ZH FDQQRW GHWHUPLQH WKH LPSRUWDQFH RI LQYROYHG
OHDGHUVKLSEDVHGVROHO\RQWKHGHULYHGYDULDWHVLQFHUHODWLRQVKLSVZLWKWKHRWKHULQGHSHQGHQW
YDULDEOHVPD\³PDVN´UHODWLRQVKLSVWKDWDUHQRWQHHGHGIRUSUHGLFWLYHSXUSRVHVEXWUHSUHVHQW
VXEVWDQWLYHH[SODQDWRU\ILQGLQJVQRQHWKHOHVV
6HFRQGWKHUROHRIPDQDJHPHQWLVRIWHQWRHQVXUHWKDW63,JRDOVDQGDFWLRQVDUHFORVHO\
DOLJQHG ZLWKEXVLQHVV JRDOV DQG VWUDWHJLHV ZKLFK LV LQGLFDWHG E\ WKH KLJKO\ VLJQLILFDQW S 
  FRUUHODWLRQ FRHIILFLHQW RI  LQ 7DEOH  EHWZHHQ EXVLQHVV RULHQWDWLRQ DQG
LQYROYHG OHDGHUVKLS 7KLV VXJJHVWV WKDW LQYROYHG OHDGHUVKLS LV LPSRUWDQW WKURXJK EXVLQHVV
RULHQWDWLRQ7KHIROORZLQJVWDWHPHQW IURP RQH RI WKH VRIWZDUH PDQDJHUV SDUWLFLSDWLQJ LQ WKH
PDQDJHPHQWH[SHULHQFHIRUXPLQ63,4VXEVWDQWLDWHVWKLV

6RIWZDUH PDQDJHUV FDQ GR ZKDWHYHU WKH\ ZDQW DV ORQJ DV WKH\ RSHUDWH ZLWKLQ WKH
RUJDQL]DWLRQ¶V RYHUDOO SODQV DQG VWUDWHJLHV 7KHUHIRUH PDQDJHPHQW FRPPLWPHQW LV PRVW
LPSRUWDQWLQJXLGLQJ63,DFWLYLWLHVLQWKHULJKWGLUHFWLRQ

7KLV LV DOVR LQ DJUHHPHQW ZLWK *UDG\¶V   ILQGLQJV IURP KLV ORQJLWXGLQDO VWXGLHV LQ
+HZOHWW3DFNDUGWKDWEXVLQHVVDVSHFWVLQWKHRUJDQL]DWLRQ¶V63,HIIRUWVKDVDVWURQJLQIOXHQFH
RQPDQDJHPHQWFRPPLWPHQW)XUWKHUPRUH'HERXDQG.XQW]PDQQ&RPEHOOHV  DUJXHG
WKDWPDQDJHPHQWFRPPLWPHQWLPSOLHVEXVLQHVVRULHQWDWLRQDQGYLFHYHUVD

±±
',6&866,21$1',03/,&$7,216

)LQDOO\DODUJHSDUWRIWKHSXEOLVKHGDQGWKXVUHYLHZHGVWXGLHVRQTXDOLW\PDQDJHPHQW
RUJDQL]DWLRQDO OHDUQLQJ DQG 63, DUH IURP WKH 8QLWHG 6WDWHV 7KHUH DUH KRZHYHU LPSRUWDQW
FXOWXUDOGLIIHUHQFHVEHWZHHQWKH8QLWHG6WDWHVDQG(XURSHLQJHQHUDO 0HVVQDU]E DQG
EHWZHHQWKH 8QLWHG 6WDWHV DQG 6FDQGLQDYLD LQ SDUWLFXODU (KQ   7KH 1RUZHJLDQ :RUN
(QYLURQPHQW $FW IRU H[DPSOH VWLSXODWHV WKDW WKH HPSOR\HU KDV WR QHJRWLDWH ZLWK WKH
HPSOR\HHV EHIRUH PDNLQJ ³PDMRU FKDQJHV´ LQ SURGXFWLRQ 7KH UHODWLYHO\ KLJK GHJUHH RI
ZRUNSODFH GHPRFUDF\ DQG VRFLRWHFKQLFDO WUDGLWLRQ LQ 6FDQGLQDYLDQ FRXQWULHV VXJJHVWV D
KLJKHU LPSRUWDQFH RI HPSOR\HH SDUWLFLSDWLRQ DQG D FRUUHVSRQGLQJO\ PLQRU LPSRUWDQFH RI
LQYROYHG OHDGHUVKLS LQ SUHGLFWLQJ 63, VXFFHVV 7KLV LV DOVR LQGLFDWHG E\ WKH UHVXOWV RI WKH
PXOWLSOHUHJUHVVLRQDQDO\VLVWKDWVKRZHGWKDWWRJHWKHUZLWKEXVLQHVVRULHQWDWLRQ E W
 S    HPSOR\HH SDUWLFLSDWLRQ E   W   S    ZDV WKH PRVW
LPSRUWDQWIDFWRULQSUHGLFWLQJ63,VXFFHVV

 (PSOR\HHSDUWLFLSDWLRQ
7RJHWKHUZLWKEXVLQHVVRULHQWDWLRQHPSOR\HHSDUWLFLSDWLRQLHWKHH[WHQWWRZKLFKHPSOR\HHV
XVH WKHLU NQRZOHGJH DQG H[SHULHQFH WR GHFLGH DFW DQG WDNH UHVSRQVLELOLW\ IRU 63, ZDV
LGHQWLILHG DV RQH RI WKH IDFWRUV ZLWK WKH VWURQJHVW LQIOXHQFH RQ 63, VXFFHVV U   S 
 SU   S    7KLV VXSSRUWV WKH K\SRWKHVLV WKDW 63, VXFFHVV LV SRVLWLYHO\
DVVRFLDWHG ZLWK HPSOR\HH SDUWLFLSDWLRQ 7KLV LV QRW VXUSULVLQJ VLQFH HPSOR\HH SDUWLFLSDWLRQ
DQG WKH ZD\ SHRSOH DUH WUHDWHG KDV EHHQ QRWHG WR EH D FUXFLDO IDFWRU LQ RUJDQL]DWLRQDO
PDQDJHPHQW DQG GHYHORSPHQW HYHU VLQFH WKH IDPRXV SURGXFWLYLW\ VWXGLHV DW :HVWHUQ
(OHFWULF¶V +DZWKRUQH SODQW LQ WKH V 0D\R    7KH UHVXOWV RI WKHVH VWXGLHV
VWDUWHGDUHYROXWLRQLQPDQDJHPHQWWKLQNLQJVKRZLQJWKDWHYHQURXWLQHMREVFDQEHLPSURYHG
LIWKHZRUNHUVDUHWUHDWHGZLWKUHVSHFW
$OVR WKH LQWHUYLHZV FRQGXFWHG LQ &DVH & WR H[SORUH WKH GLIIXVLRQ RI NQRZOHGJH DQG
H[SHULHQFH LQ VRIWZDUH RUJDQL]DWLRQV VHH 6HFWLRQ   VWURQJO\ VXSSRUWV WKH LPSRUWDQFH RI
SDUWLFLSDWLRQ DV D NH\ IDFWRU IRU VXFFHVV 7KH UHVXOWV RI WKHVH LQWHUYLHZV VKRZHG WKH
LPSRUWDQFH RI SDUWLFLSDWLRQ GXULQJ WKH GHYHORSPHQW DQG LQWURGXFWLRQ RI IRUPDO URXWLQHV
9LHZHG LQ WKH OLJKW RI RXU UHVXOWV LW LV QRW VXUSULVLQJ WKDW UHVHDUFK RQ IRUPDOL]DWLRQ RIWHQ
SUHVHQWV FRQIOLFWLQJ HPSLULFDO ILQGLQJV UHJDUGLQJ LWV HIILFLHQF\ 7KLV GLYHUJHQFH FDQ EH
H[SODLQHG E\ WKH IDFW WKDW PRVW SULRU UHVHDUFK KDV IRFXVHG RQ GLIIHUHQW GHJUHHV RI
IRUPDOL]DWLRQDQGKDVSDLGLQVXIILFLHQWDWWHQWLRQWRGLIIHUHQWW\SHVRIIRUPDOL]DWLRQ
$GOHUDQG%RU\V  H[SDQGHGRQWKLVLQWKHLUVWXG\RIWKHHQDEOLQJDQGFRHUFLYHW\SHV
RI IRUPDOL]DWLRQ ,Q DQ HQDEOLQJ W\SH RI IRUPDOL]DWLRQ SURFHGXUHV SURYLGH RUJDQL]DWLRQDO
PHPRU\ DV D UHVRXUFH WR FDSWXUH OHVVRQVOHDUQHG RU EHVW SUDFWLFHV 7KH FRUH LGHD LV WKDW
³JRRG´ SURFHGXUHV DUH WKRVH VHHQ DV YDOXDEOH UHVRXUFHV WKDW KHOS SUDFWLWLRQHUV PHHW
FXVWRPHUV¶QHHGV%\FRQWUDVWLQDFRHUFLYHW\SHRIIRUPDOL]DWLRQSURFHGXUHVDUHDVXEVWLWXWH
IRU UDWKHU WKDQ D FRPSOHPHQW WR FRPPLWPHQW ,QVWHDG RI SURYLGLQJ FRPPLWWHG HPSOR\HHV
ZLWK DFFHVV WR DFFXPXODWHG RUJDQL]DWLRQDO OHDUQLQJ DQG ³EHVW SUDFWLFH´ WHPSODWHV FRHUFLYH
SURFHGXUHV DUH GHVLJQHG WR IRUFH UHOXFWDQW FRPSOLDQFH DQG WR UHPRYH QRQFRPSOLDQW HIIRUWV
9LHZ LQ WKLV OLJKW IRUPDO URXWLQHV DUH SHUFHLYHG DV D FRQVLGHUDEOH EDUULHU WR RUJDQL]DWLRQDO
OHDUQLQJDQG63,
2XU UHVXOWV UHJDUGLQJ WKH GHYHORSHUV¶ DVVHVVPHQW RI WKH URXWLQHV LQ WKHLU UHVSHFWLYH
RUJDQL]DWLRQV FORVHO\ UHVHPEOH WKH FRHUFLYH W\SH RI IRUPDOL]DWLRQ +RZHYHU WKH GHYHORSHUV
ZHUH FOHDUO\ QRW DJDLQVW IRUPDO URXWLQHV ,Q IDFW WKH\ H[SUHVVHG YLHZV LQ IDYRU RI VXFK

±±
&+$37(5

URXWLQHV HVSHFLDOO\ WKRVH WKDW FDSWXUHG SULRU SURMHFW H[SHULHQFH &RQWUDU\ WR WKH H[LVWLQJ
URXWLQHVZKLFKWKH\GHHPHGFRHUFLYHWKH\VRXJKWURXWLQHVRIWKHHQDEOLQJW\SH)XUWKHUPRUH
RXU VWXG\ LQ &DVH % RI WDLORU PDGH DVVHVVPHQWV WR IRFXV VRIWZDUH SURFHVV LPSURYHPHQW
DFWLYLWLHV LQ IRXU RI WKH 63,4 FRPSDQLHV VKRZHG WKDW D VWUXFWXUHG SURFHVV HPSKDVL]LQJ
SDUWLFLSDWLRQLQHDFKDQGHYHU\VWHSZDVDNH\IDFWRUIRUVXFFHVV VHH6HFWLRQ 
7KLVVXJJHVWVWKDWSHRSOHWHQGWRVXSSRUWZKDWWKH\ KDYH SDUWLFLSDWHG LQ FUHDWLQJ RU WR
XVH %HUJHU DQG /XFNPDQQ¶V   ZRUGV ³LW LV PRUH OLNHO\ WKDW RQH ZLOO GHYLDWH IURP
SURJUDPPHV VHW XS IRU RQH E\ RWKHUV WKDQ IURP SURJUDPPHV WKDW RQH KDV KHOSHG HVWDEOLVK
RQHVHOI´ LELGS 7KXVZHOHDUQDJUHDWGHDOPRUHIURPRXURZQH[SHULHQFHWKDQZHGR
IURPWKRVHZKRDUHH[SHULHQFHG

 &RQFHUQIRUPHDVXUHPHQW
&RQFHUQ IRU PHDVXUHPHQW ZDV GHILQHG DV WKH H[WHQW WR ZKLFK WKH VRIWZDUH RUJDQL]DWLRQ
FROOHFWV DQG XWLOL]HV TXDOLW\ GDWD WR JXLGH DQG DVVHVV WKH HIIHFWV RI 63, DFWLYLWLHV ,W KDG D
VWURQJDQGKLJKO\VLJQLILFDQWFRUUHODWLRQZLWKRYHUDOO63,VXFFHVV U SSU
S ZKLFKVXSSRUWVWKHK\SRWKHVLVWKDW63,VXFFHVVLVSRVLWLYHO\DVVRFLDWHGZLWK
FRQFHUQ IRU PHDVXUHPHQW 7KLV VXJJHVWV WKDW VLJQLILFDQW SURJUHVV LQ VRIWZDUH GHYHORSPHQW
GHSHQGV RQ DQ DELOLW\ WR PHDVXUH DVSHFWV RI WKH SURFHVV DQG WKH UHVXOWLQJ DUWLIDFWV DQG WR
PDNH DQDO\WLFDO MXGJHPHQWV EDVHG RQ WKH UHVXOWV RI WKHVH PHDVXUHPHQWV 7KXV D ODFN RI
PHDVXUHPHQWOHDGVWRDODFNRIHPSLULFDOYDOLGDWLRQRIVRIWZDUHWHFKQLTXHVDQGXOWLPDWHO\WR
DQLQDELOLW\RIWKHRUJDQL]DWLRQWRHYDOXDWHQHZ RUROG LGHDVDQGWRVHSDUDWHVRXQGDQGXVHIXO
SUDFWLFHVIURPFXUUHQWIDGV
7UDGLWLRQDOO\PHDVXUHPHQWV\VWHPVDUHXVHGWRSURYLGHXSSHUPDQDJHPHQWZLWKGDWDIRU
GHFLVLRQ PDNLQJ DQG WR DVVHVV WKH HIIHFWV RI RUJDQL]DWLRQDO DFWLRQV $OWKRXJK WKLV LV VWLOO
LPSRUWDQW RXU FRQFHSW RI PHDVXUHPHQW QRW RQO\ LQFOXGHV WKHVH WUDGLWLRQDO XVHV LW DOVR
LQFOXGHVDYDLODELOLW\DQGIHHGEDFNRIGDWDDQGWKHXVHRIGDWDWRJXLGH63,DFWLRQV6RZKLOH
PHDVXUHPHQWLQLWVHOIFDQKDYHDVLJQLILFDQWHIIHFWRQRUJDQL]DWLRQDOEHKDYLRU 1DGOHU 
&DVH$VXJJHVWWKDW WKH PRVW HIIHFWLYH XVH RI GDWD IRU RUJDQL]DWLRQDO OHDUQLQJ DQG 63, LV WR
IHHG WKH GDWD EDFN LQ VRPH IRUP WR WKH RUJDQL]DWLRQ¶V PHPEHUV VHH 6HFWLRQ  DQG '\En
H  6XFK IHHGEDFN UHJDUGLQJ DFWXDO SHUIRUPDQFH QRW RQO\ PRWLYDWHV FKDQJH LQ WKH
EHKDYLRU RI LQGLYLGXDOV JURXSV DQG RUJDQL]DWLRQV LW FDQ DOVR JXLGH FKDQJH LQ D VSHFLILF
GLUHFWLRQ+RZHYHULQRUGHUIRUIHHGEDFNWRFKDQJHEHKDYLRUWKURXJKWKHVHPHFKDQLVPVWKH
GDWDPXVWEHSHUFHLYHGDVYDOLGDQGDFFXUDWH$OVRWKHFRQGLWLRQVVXUURXQGLQJWKHIHHGEDFN
SURFHVVPXVWVXSSRUWWKHQRQWKUHDWHQLQJXVHRIGDWDIRULGHQWLI\LQJDQGVROYLQJSUREOHPV
7KLVVXJJHVWVWKDWZLWKRXWFOHDUDQGFRQVLVWHQWIHHGEDFNWRKHOSPRQLWRUVRIWZDUHWHDPV¶
SURJUHVVWRZDUGWKHLUJRDOVDQGWKHHIIHFWVRIWKHLUDFWLRQVLWLVGLIILFXOWWROHDUQ%HVLGHVRXU
UHVXOWVGHPRQVWUDWHWKDWPHDVXUHPHQWLVPHDQLQJOHVVZLWKRXWLQWHUSUHWDWLRQDQGMXGJHPHQWE\
WKRVH ZKR ZLOO PDNH GHFLVLRQV DQG WDNH DFWLRQV EDVHG RQ WKHP :LWKLQ WKH FRQWH[W RI 63,
WKHUHIRUHLWLVLPSRUWDQWWKDW PHDVXUHPHQW V\VWHPV DUH GHVLJQHG E\ VRIWZDUH GHYHORSHUV IRU
OHDUQLQJUDWKHU WKDQ E\ PDQDJHPHQW IRU FRQWURO $OVR DV ZH VDZ LQ &DVH $ DQ LPSRUWDQW
REVHUYDWLRQLVWKDWDIHZPHDVXUHVWKDWDUHGLUHFWO\UHODWHGWRWKHVRIWZDUHSURFHVVDUHEHWWHU
WKDQ D PXOWLWXGH RI PHDVXUHV WKDW SURGXFH D ODFN RI IRFXV DQG FRQIXVLRQ DERXW ZKDW LV
LPSRUWDQW DQG ZKDW LV QRW VHH 6HFWLRQ   0RUHRYHU VXFK PHDVXUHV VKRXOG EH FORVHO\
DOLJQHGZLWKWKHRUJDQL]DWLRQ¶VEXVLQHVVVWUDWHJ\ 5LINLQ 

±±
',6&866,21$1',03/,&$7,216

2XUILQGLQJVWKXVVXJJHVWWKDWGDWDEDVHGPHWKRGVLQJHQHUDODQGIHHGEDFNLQSDUWLFXODU
DUH HIIHFWLYH WRROV IRU WKH VXFFHVVIXO DSSOLFDWLRQ RI 63, )XUWKHUPRUH RXU ILQGLQJV VXSSRUW
1DGOHU¶V  FRQFOXVLRQVVXJJHVWLQJWKDWWKHSURFHVVRIXVLQJGDWDLVDQLPSRUWDQWIDFWRU
LQIOXHQFLQJKRZHIIHFWLYHPHDVXUHPHQWV\VWHPVZLOOEHWKDWIHHGEDFNLVPRVWHIIHFWLYHZKHQ
FRPELQHGZLWKGLIIHUHQWLQWHUYHQWLRQVDQGWKDWGLIIHUHQWVLWXDWLRQVUHTXLUHGLIIHUHQWIHHGEDFN
GHVLJQV 7KHUHIRUH NQRZOHGJH DERXW KRZ WKLQJV DUH FDQ EH D SRWHQWLDO IRUFH WKDW PRYHV
VRIWZDUHRUJDQL]DWLRQVWRZDUGKRZWKLQJVVKRXOGEH

 /HDUQLQJVWUDWHJ\
7ZR IXQGDPHQWDOO\ GLIIHUHQW OHDUQLQJ VWUDWHJLHV ZHUH LGHQWLILHG DV SDUW RI RXU LQYHVWLJDWLRQ
H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ NQRZOHGJH &RQVHTXHQWO\ ZH
GHILQHG OHDUQLQJ VWUDWHJ\ DV WKH H[WHQW WR ZKLFK D VRIWZDUH RUJDQL]DWLRQ LV HQJDJHG LQ WKH
H[SORLWDWLRQRIH[LVWLQJ NQRZOHGJH DQG LQ WKH H[SORUDWLRQ RI QHZ NQRZOHGJH %RWK OHDUQLQJ
VWUDWHJLHV KDG D VLJQLILFDQW FRUUHODWLRQ ZLWK RYHUDOO 63, VXFFHVV ZKLFK VXSSRUWV WKH
K\SRWKHVHV WKDW 63, VXFFHVV LV SRVLWLYHO\ DVVRFLDWHG ZLWK WKH H[SORLWDWLRQ RI H[LVWLQJ
NQRZOHGJH U   S   SU   S    DQG ZLWK WKH H[SORUDWLRQ RI QHZ
NQRZOHGJH U SSU S 
+RZHYHU DV LQ WKH FDVH RI LQYROYHG OHDGHUVKLS H[SORUDWLRQ RI QHZ NQRZOHGJH KDG DQ
LQVLJQLILFDQWLPSRUWDQFHLQSUHGLFWLQJ63,VXFFHVV:HVHHWZRSODXVLEOHH[SODQDWLRQVIRUWKLV
)LUVW DV ZH H[SODLQHG ZLWK UHVSHFW WR LQYROYHG OHDGHUVKLS UHODWLRQVKLSV ZLWK WKH RWKHU
LQGHSHQGHQWYDULDEOHVPD\³PDVN´UHODWLRQVKLSVWKDWDUHQRWQHHGHGIRUSUHGLFWLYHSXUSRVHV
EXW UHSUHVHQW VXEVWDQWLYH H[SODQDWRU\ ILQGLQJV QRQHWKHOHVV 7KHUHIRUH ZH FDQQRW GHWHUPLQH
WKHLPSRUWDQFHRIH[SORUDWLRQRIQHZNQRZOHGJHEDVHGVROHO\RQWKHGHULYHGYDULDWH
6HFRQG RXU FRQFHSW RI H[SORUDWLRQ LQFOXGHV LVVXHV VXFK DV LQQRYDWLRQ DQG FUHDWLYLW\
TXHVWLRQLQJRI³HVWDEOLVKHG´ WUXWKV IOH[LELOLW\ PLQLPXP FULWLFDO VSHFLILFDWLRQ DQG GLYHUVLW\
ZKLFKZLWKLQDVRFLRWHFKQLFDOSHUVSHFWLYHFDQEHVHHQDV FORVHO\UHODWHGWRFRQFHSWLRQVRI
SDUWLFLSDWLRQ7KLVLVLQGLFDWHGE\WKHKLJKO\VLJQLILFDQW S FRUUHODWLRQFRHIILFLHQWRI
LQ7DEOHEHWZHHQHPSOR\HHSDUWLFLSDWLRQDQGH[SORUDWLRQRIQHZNQRZOHGJHZKLFK
VXJJHVWVWKDWH[SORUDWLRQRIQHZNQRZOHGJHLVLPSRUWDQWWKURXJKHPSOR\HHSDUWLFLSDWLRQ
7KXV WKH UHVXOWV VXJJHVW WKDW ERWK PRGHV RI OHDUQLQJ DUH LPSRUWDQW IRU VXFFHVVIXO 63,
0RUH LPSRUWDQWO\ WKH\ VXJJHVW WKDW VRIWZDUH RUJDQL]DWLRQV VKRXOG EDODQFH WKHLU OHDUQLQJ
HIIRUWV EHWZHHQ H[SORLWDWLRQ DQG H[SORUDWLRQ VHH 6HFWLRQ   7KXV UHO\LQJ RQ SDVW
H[SHULHQFH DQG GDWD DV WKH VROH EDVLV IRU SURFHVV LPSURYHPHQW QHFHVVDULO\ OHDGV WR DQ
LPSURYHPHQW VWUDWHJ\ WKDW LV SDVW RULHQWHG VXSSRUWLQJ DQG OHJLWLPL]LQJ SDVW DQG FXUUHQW
SUDFWLFHV&RQVHTXHQWO\VXFKVWUDWHJLHVPD\OHDGWRDODFNRIQRYHOW\DQGIUHVKSHUVSHFWLYHV
DVZHOODVDQRYHUHPSKDVLVRQWKHWHVWLQJRIDOUHDG\HVWDEOLVKHGWKHRULHVDQGLGHDVRUDVRQH
RIWKHVRIWZDUHPDQDJHUVLQRXUVWXG\H[SUHVVHGLW

5HO\LQJRQSDVWH[SHULHQFHDORQHWRSUHSDUHIRUWKHIXWXUHLVOLNHVWHHULQJDFDUE\ORRNLQJLQ
WKHUHDUPLUURU,QVWDEOHDQGZHOONQRZQWHUULWRULHVLWPLJKWGRWKHMRE,QQHZDQGXQNQRZQ
WHUULWRULHVLWZLOOPRVWFHUWDLQO\OHDGWRGLVDVWHU

,QRXUH[SHULHQFHWKHVLWXDWLRQLVHYHQPRUHG\QDPLFLWLVPRUHOLNHZDONLQJDFURVVDJODFLHU
LQZKLFKWKHUHDUHVRPHVDIHURXWHVVRPHXQVDIHURXWHVDQGVRPHURXWHV\RXGRQ¶W\HWNQRZ
LIWKH\DUHVDIHRUQRW+RZHYHULFHIORZV±LWPRYHVFRQVWDQWO\7KHUHIRUHURXWHVWKDWZHUH
VDIH\HVWHUGD\DUHQRWQHFHVVDULO\VDIHWRGD\DQGYLFHYHUVD

±±
&+$37(5

 7KH(IIHFWVRI2UJDQL]DWLRQDO&RQWH[W
7KHWKLUGUHVHDUFKTXHVWLRQIRFXVHGRQWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDO FRQWH[W DQG
PRGHVRIOHDUQLQJLQVRIWZDUHRUJDQL]DWLRQV$VZHVDZLQWKHSUHYLRXVVHFWLRQWZRPRGHVRI
OHDUQLQJZHUHLGHQWLILHGLQWKLVVWXG\H[SORLWDWLRQRIH[LVWLQJNQRZOHGJHDQGH[SORUDWLRQRI
QHZ NQRZOHGJH $OVR DV ZH VDZ LQ 6HFWLRQ  ZH LGHQWLILHG WZR FRQWH[WXDO YDULDEOHV WR
FDSWXUHWKHPRVWLQIOXHQWLDOVRXUFHVRIYDULDWLRQHQYLURQPHQWDOWXUEXOHQFHDQGRUJDQL]DWLRQDO
VL]H (IIHFWV RI RUJDQL]DWLRQDO VL]H ZHUH FRPSDUHG E\ FRQWUDVWLQJ ODUJH RUJDQL]DWLRQV ZLWK
VPDOO RUJDQL]DWLRQV ZKLOH WKH HIIHFWV RI HQYLURQPHQWDO WXUEXOHQFH ZHUH H[DPLQHG E\ FRQ
WUDVWLQJVWDEOHHQYLURQPHQWVZLWKWXUEXOHQWHQYLURQPHQWV

 (QYLURQPHQWDOWXUEXOHQFH
$VUHSRUWHGLQWKHSUHYLRXVFKDSWHU VHH6HFWLRQ QRVWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHV
ZHUH IRXQG EHWZHHQ RUJDQL]DWLRQV RSHUDWLQJ LQ VWDEOH RU WXUEXOHQW HQYLURQPHQWV IRU WKH
GHSHQGHQW DQG LQGHSHQGHQW YDULDEOHV )XUWKHUPRUH WKHUH ZDV QR VWDWLVWLFDOO\ VLJQLILFDQW
GLIIHUHQFH QHLWKHU LQ WKH PHDQ OHYHO RI HQYLURQPHQWDO WXUEXOHQFH EHWZHHQ ODUJH DQG VPDOO
RUJDQL]DWLRQVQRUEHWZHHQVXFFHVVIXODQGOHVVVXFFHVVIXORUJDQL]DWLRQV
7KLVILQGLQJLVLQDJUHHPHQWZLWKHJ'HHSKRXVHHWDO¶V  UHVXOWVIURPDVXUYH\RI
SURMHFWVIURPGLIIHUHQWRUJDQL]DWLRQVUHJDUGLQJWKHHIIHFWLYHQHVVRIVRIWZDUHSURFHVVHVRQ
SURMHFW SHUIRUPDQFH $ORQJ ZLWK VXFK SUDFWLFHV DV SURFHVV WUDLQLQJ XVHU FRQWDFW GHVLJQ
UHYLHZV DQG SURWRW\SLQJ WKH\ IRXQG WKDW VWDEOH HQYLURQPHQWV KDG OLWWOH LPSDFW RQ SURMHFW
RXWFRPHV
$FFRUGLQJO\ WKHUH LV QR VXSSRUW IRU WKH FRPPRQO\ KHOG EHOLHI DPRQJ ERWK UHVHDUFKHUV
DQG PDQDJHUV ZLWKLQ WKH VRIWZDUH FRPPXQLW\ WKDW VXFFHVV GHSHQGV XSRQ VWDELOLW\ DQG WKH
DELOLW\WRSUHGLFWFKDQJHVLQWKHHQYLURQPHQW3UHGLFWDELOLW\LVDSURSHUW\RIVLPSOHV\VWHPV
5HDOLW\LVGLIIHUHQWWKHHQYLURQPHQWLVQRWDVLPSOHV\VWHP2QWKHFRQWUDU\LWLVKLJKO\FRP
SOH[ LV QRW SUHGLFWDEOH LV QRW HQWLUHO\ NQRZDEOH DQG LV GHILQLWHO\ QRW FRQWUROODEOH E\ WKH
VRIWZDUH PDQDJHU RU WKH VRIWZDUH RUJDQL]DWLRQ 7KH VRRQHU ZH DGPLW WKLV WR RXUVHOYHV WKH
VRRQHU ZH FDQ GHYHORS PRUH XVHIXO PRGHOV IRU LPSURYLQJ WKH SURFHVV RI VRIWZDUH GHYHORS
PHQW
6RZKLOH+XPSKUH\  DQGRWKHUV HJ)ORUDFDQG&DUOHWRQ KDYHDUJXHGWKDW
VWDELOLW\ DQG SUHGLFWDELOLW\ OLHV DW WKH KHDUW RI DOO SURFHVV PDQDJHPHQW DQG SURFHVV
LPSURYHPHQWHIIRUWVRXUUHVXOWVFOHDUO\VKRZWKDWWKLVLVQRWWKHRQO\URDGWRVXFFHVV,QGHHG
RXUUHVXOWVVXJJHVWWKDWVXFKFRQGLWLRQVKDYHQRLQIOXHQFHRQWKHOHYHORI63,VXFFHVV
7KLV VXJJHVWV WKDW LW¶V WLPH ZH GLVWDQFH RXUVHOYHV IURP WKH DVVXPSWLRQV XQGHUO\LQJ WKH
UDWLRQDOLVWLFOLQHDUPRGHORIVRIWZDUHHQJLQHHULQJDQGDGPLWWKDWUHDOLW\IRUPRVWVRIWZDUHRU
JDQL]DWLRQV LV D QRQGHWHUPLQLVWLF PXOWLGLUHFWLRQDO IOX[ WKDW LQYROYHV FRQVWDQW QHJRWLDWLRQ
DQGUHQHJRWLDWLRQDPRQJDQGEHWZHHQWKHVRFLDOJURXSVVKDSLQJWKHVRIWZDUH
7KLV UHTXLUHV DQ LPSURYHPHQW DSSURDFK WKDW UHFRJQL]HV   WKH QHHG IRU D GUDPDWLFDOO\
VKRUWHUWLPHIUDPHEHWZHHQSODQQLQJDQG DFWLRQ   WKDW WKH SODQQLQJ RI DQ DFWLRQ GRHV QRW
SURYLGH DOO WKH GHWDLOV RI LWV LPSOHPHQWDWLRQ DQG ILQDOO\   WKDW FUHDWLYLW\ LV QHFHVVDU\ WR
PDNHVHQVHRIWKHHQYLURQPHQW:HFRQVLGHULPSURYLVDWLRQDVVXFKDQLPSURYHPHQWDSSURDFK
WR EHWWHU XQGHUVWDQG WKH UHODWLRQVKLS EHWZHHQ DFWLRQ DQG OHDUQLQJ LQ VRIWZDUH RUJDQL]DWLRQV
)XUWKHUPRUHLPSURYLVDWLRQDWWKHORFDOOHYHOLVQRWRQO\DOHJLWLPDWHDOWHUQDWLYHWRPRGHOVRI
SODQQHGFKDQJHEXWDOVRQHFHVVDU\IRUHIIHFWLYHNQRZOHGJHFUHDWLRQDQG63, '\EnE 

±±
',6&866,21$1',03/,&$7,216

,WLVLPSRUWDQWWRHPSKDVL]HWKDWZHPXVWGLIIHUHQWLDWHEHWZHHQHQYLURQPHQWDOWXUEXOHQFH
DQGRUJDQL]DWLRQDOWXUEXOHQFH6RZKLOHWKHUHZDVQRVWDWLVWLFDOO\VLJQLILFDQWGLIIHUHQFHLQWKH
PHDQOHYHORIHQYLURQPHQWDOWXUEXOHQFHEHWZHHQVXFFHVVIXODQGOHVVVXFFHVVIXORUJDQL]DWLRQV
UHVSRQGHQWV LQ VXFFHVVIXO RUJDQL]DWLRQV UHSRUWHG KLJKHU OHYHOV RI FRPSDQ\ H[SHULHQFH W
S WKDQWKHUHVSRQGHQWVLQWKHOHVVVXFFHVVIXORUJDQL]DWLRQV7KXVVLQFHPXFKRI
DQ RUJDQL]DWLRQ¶V PHPRU\ LV VWRUHG LQ KXPDQ KHDGV DQG RQO\ D OLWWOH RI LW LV SXW GRZQ RQ
SDSHU RU KHOG LQ FRPSXWHU PHPRULHV WXUQRYHU RI SHUVRQQHO LV D JUHDW WKUHDW WR ORQJWHUP
RUJDQL]DWLRQDOPHPRU\DQGVXFFHVVIXO63, VHH6HFWLRQ 

 2UJDQL]DWLRQDOVL]H
7KHILQGLQJVIURPWKLVVWXG\VKRZHGWKDWWKHUHDUHIXQGDPHQWDOGLIIHUHQFHVEHWZHHQVPDOODQG
ODUJH VRIWZDUH RUJDQL]DWLRQV :LWK UHVSHFW WR RUJDQL]DWLRQDO SHUIRUPDQFH LQ JHQHUDO ODUJH
VRIWZDUHRUJDQL]DWLRQVUHSRUWHGDKLJKHUOHYHORIRYHUDOO63,VXFFHVV W S WKDQ
VPDOORUJDQL]DWLRQV7KLVLVFRQVLVWHQWZLWKHJ7HU]LRYVNLDQG6DPVRQ¶V  ILQGLQJWKDW
ODUJHUFRPSDQLHVWHQGWRJDLQJUHDWHUEHQHILWVIURP740WKDQVPDOOHUILUPV7KLVLVDOVRDV
H[SHFWHGJLYHQWKDWDQRUJDQL]DWLRQZLOOJURZODUJHUZLWKUHSHDWHGVXFFHVV+RZHYHU ZKHQ
FRPSDULQJ VPDOO VXFFHVVIXO RUJDQL]DWLRQV ZLWK ODUJH VXFFHVVIXO RUJDQL]DWLRQV WKHUH ZDV QR
GLIIHUHQFHLQWKHOHYHORI63,VXFFHVV
:KDW¶V PRUH LPSRUWDQW KRZHYHU LV WKDW ODUJH VXFFHVVIXO DQG VPDOO VXFFHVVIXO
RUJDQL]DWLRQV GLIIHU IXQGDPHQWDOO\ LQ WKHLU UHVSHFWLYH DSSURDFK WR 63, VSHFLILFDOO\ ZLWK
UHVSHFWWRSDUWLFLSDWLRQDQGWKHSUHIHUUHGPRGHRIOHDUQLQJ$VFDQEHVHHQIURP7DEOH
VPDOOVXFFHVVIXORUJDQL]DWLRQVUHSRUWHGKLJKHUOHYHOVRIHPSOR\HHSDUWLFLSDWLRQ W S
 DQGH[SORUDWLRQRIQHZNQRZOHGJH W S WKDQWKHODUJHURUJDQL]DWLRQV
)XUWKHUPRUH ZKLOH RUJDQL]DWLRQV ZLWK D TXDOLW\ V\VWHP LQ XVH VKRZHG KLJKHU OHYHOV RI 63,
VXFFHVV WKDQ WKRVH ZKR KDG QR VXFK V\VWHP LQGXVWU\ VHFWRU DQG SURGXFW EXVLQHVV KDG QR
VLJQLILFDQW HIIHFW RQ VXFFHVV $OVR DV ZH VDZ LQ WKH SUHYLRXV VHFWLRQ FRPSDQ\ H[SHULHQFH
ZDVDQLPSRUWDQWIDFWRULQGLIIHUHQWLDWLQJVXFFHVVIXOIURPWKHOHVVVXFFHVVIXORUJDQL]DWLRQV
7KXVFRQWUDU\WRWKH FODLPVSXWIRUZDUGLQWKHTXDOLW\ PDQDJHPHQW OLWHUDWXUH WKDW LGHDO
TXDOLW\ PDQDJHPHQW VKRXOG QRW EH DIIHFWHG E\ FRQWH[WXDO YDULDEOHV VHH 6HFWLRQ   WKHVH
ILQGLQJV VXJJHVWV WKDW LW GRHV LQGHHG ZKHQ LW FRPHV WR LPSOHPHQWDWLRQ LVVXHV 7KLV LV
FRQVLVWHQWZLWKUHFHQWUHVHDUFKRQRUJDQL]DWLRQVL]H HJ*URWK/DZOHU DQGRQ
TXDOLW\PDQDJHPHQWFRPSDULQJODUJHDQGVPDOOILUPV)RUH[DPSOHLQDVXUYH\RI 86
DQG &DQDGLDQ ILUPV $KLUH DQG *ROKDU   IRXQG WKDW ZKLOH VPDOO VXFFHVVIXO ILUPV
LPSOHPHQWHG 740 HOHPHQWV DW OHDVW DV HIIHFWLYHO\ DV ODUJH ILUPV VPDOO ILUPV UHOLHG RQ DQ
LPSOHPHQWDWLRQ VWUDWHJ\ WKDW LQYROYHG VLJQLILFDQWO\ KLJKHU OHYHOV RI HPSOR\HH LQYROYHPHQW
DQGIOH[LELOLW\WKDQWKHODUJHUILUPV¶VWUDWHJ\
$OVRLQDVWXG\RI%35LQ&DQDGLDQHQWHUSULVHV5D\PRQGHWDO  IRXQGWKDW
WKH VPDOO DQG PHGLXPVL]HG HQWHUSULVHV 60(V  SHUFHLYHG DQ RYHUDOO OHYHO RI DGYDQWDJHV
HTXDOWRWKDWRIWKHODUJHHQWHUSULVHV0RUHRYHUWKH\ IRXQGWKDWWKH60(VDSSURDFKWR %35
ZDVOHVVULJRURXVPRUHUHVHPEOLQJDVRFLRWHFKQLFDODSSURDFK
2XU ILQGLQJV UHJDUGLQJ WKH GLIIHUHQFHV EHWZHHQ ODUJH DQG VPDOO FRPSDQLHV DUH DOVR
FRQVLVWHQW ZLWK WKH YLHZV H[SUHVVHG E\ 0RKDPHG )D\DG¶V 0DXUL /DLWLQHQ¶V DQG 5REHUW
:DUG¶V ³7KLQNLQJ 2EMHFWLYHO\´ FROXPQ LQ &RPPXQLFDWLRQV RI WKH $&0 
UHJDUGLQJ VRIWZDUH HQJLQHHULQJ DQG 63, LQ VPDOO RUJDQL]DWLRQV 6LPLODU YLHZV ZHUH DOVR
SUHVHQWHG LQ WKH VSHFLDO VHFWLRQ RI WKH 6HSWHPEHU2FWREHU  LVVXH RI ,((( 6RIWZDUH RQ

±±
&+$37(5

VRIWZDUH HQJLQHHULQJ LQ WKH VPDOO HJ '\En E /DLWLQHQ HW DO   DQG DOVR E\
%URGPDQ DQG -RKQVRQ   DQG %DWLVWD DQG GH )LJXHLUHGR   UHJDUGLQJ WKH
LPSOHPHQWDWLRQRI&00LQVPDOORUJDQL]DWLRQV
7KXV WR DQVZHU WKH WKLUG UHVHDUFK TXHVWLRQ WKH HIIHFWV RI RUJDQL]DWLRQDO VL]H DQG
HQYLURQPHQWDOFRQGLWLRQVRQWKHOHDUQLQJPRGHVZHUHH[DPLQHGE\FRPSDULQJWKHHVWLPDWHG
PDUJLQDO PHDQV RI H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ NQRZOHGJH
XVLQJ WZRZD\ DQDO\VLV RI YDULDQFH $129$  ZLWK RUJDQL]DWLRQDO VL]H DQG HQYLURQPHQW DV
WKHWZRFODVVLILFDWLRQYDULDEOHV VHH6HFWLRQV 
,W LV LQWHUHVWLQJ WR QRWH WKDW DV WKHUH ZDV QR GLIIHUHQFH LQ WKH OHYHO RI H[SORLWDWLRQ
EHWZHHQ VPDOO DQG ODUJH RUJDQL]DWLRQV UHJDUGOHVV RI WKH HQYLURQPHQW WKHUH ZDV D PDUNHG
GLIIHUHQFH LQ WKH OHYHO RI H[SORUDWLRQ VHH )LJXUH E  7KH UHVXOWV VKRZHG WKDW VPDOO
VRIWZDUHRUJDQL]DWLRQVHQJDJHGLQVLJQLILFDQWO\ S PRUHH[SORUDWLRQLQWXUEXOHQWHQ
YLURQPHQWVWKDQODUJHVRIWZDUHRUJDQL]DWLRQ
7KLVVXJJHVWVWKDWWKHPDLQGLIIHUHQFHEHWZHHQVPDOODQGODUJHVRIWZDUHRUJDQL]DWLRQVLV
WKH ZD\V LQ ZKLFK WKH\ UHDFW WR XQVWDEOH DQG FKDQJLQJ VWLPXOXV VLWXDWLRQV ,Q VPDOO
RUJDQL]DWLRQVWKHUHVSRQVHWRDFKDQJHGVLWXDWLRQZDVDQLQFUHDVHGOHYHORIH[SORUDWLRQ7KLV
VXSSRUWV WKH DVVHUWLRQ WKDW VPDOO VRIWZDUH RUJDQL]DWLRQV LQ WXUEXOHQW HQYLURQPHQWV UHTXLUH
OHDUQLQJVWUDWHJLHVWKDWDUHPRUHFORVHO\DOLJQHGZLWKH[SORUDWLYHEHKDYLRUZKLOHDWWKHVDPH
WLPH SURPRWLQJ WKH H[SORLWDWLRQ RI SDVW H[SHULHQFHV $V GLVFXVVHG LQ &KDSWHU  DQG DOVR LQ
'\EnE WKLVLVDWWKHKHDUWRIDQ63,VWUDWHJ\EDVHGRQLPSURYLVDWLRQ
+RZHYHU ZKLOH PRVW VRIWZDUH PDQDJHUV DJUHHG WKDW FKDQJHV LQ WKHLU FRPSHWLWLYH
HQYLURQPHQWDUHIDVWDQGLQFUHDVLQJO\XQSUHGLFWDEOHPDQDJHUVRIODUJHVRIWZDUHRUJDQL]DWLRQV
VWLOO UHOLHG RQ OHDUQLQJ IURP H[SHULHQFH WR SUHSDUH IRU WKH IXWXUH UDWKHU WKDQ H[SORULQJ QHZ
SRVVLELOLWLHV7KH\WHQGHGWRJHQHUDWHWKHVDPHUHVSRQVHHYHQZKHQWKHVWLPXOLKDGFKDQJHG
7KH\NHSWGRLQJZKDWWKH\GLGZHOOUDWKHUWKDQULVNIDLOXUH7KLVEHKDYLRULVVXSSRUWHGE\WKH
RUJDQL]DWLRQDOOLWHUDWXUHZKLFKVXJJHVWV WKDW ODUJH RUJDQL]DWLRQV DUH OHVV OLNHO\ WR FKDQJH LQ
UHVSRQVHWRHQYLURQPHQWDOFKDQJHVWKDQVPDOORUJDQL]DWLRQV7KHUHFRXOGEHPDQ\UHDVRQVIRU
WKLV PRGH RI OHDUQLQJ 7XVKPDQ DQG 5RPDQHOOL   IRU H[DPSOH DUJXHG WKDW LQFUHDVHG
VL]HOHDGVWRLQFUHDVHGFRPSOH[LW\LQFUHDVHGFRQYHUJHQFHDQGWKXVLQFUHDVHGLQHUWLD
/LNHZLVH 0LQW]EHUJ   SRVWXODWHG WKDW WKH ODUJHU DQ RUJDQL]DWLRQ LV WKH PRUH
IRUPDOL]HG LV LWV EHKDYLRU 6R ZKLOH VPDOO RUJDQL]DWLRQV FDQ UHPDLQ RUJDQLF ODUJH
RUJDQL]DWLRQV GHYHORS EXUHDXFUDFLHV ZLWK MRE VSHFLDOL]DWLRQ DQG VKDUS GLYLVLRQV RI ODERU
HPSKDVL]LQJVWDELOLW\RUGHUDQGFRQWURO$VDFRQVHTXHQFHWKH\RIWHQKDYHJUHDWGLIILFXOWLHV
LQ DGDSWLQJ WR FKDQJLQJ FLUFXPVWDQFHV EHFDXVH WKH\ DUH GHVLJQHG WR DFKLHYH SUHGHWHUPLQHG
JRDOV±WKH\DUHQRWGHVLJQHGIRULQQRYDWLRQ
)URP D OHDUQLQJ SHUVSHFWLYH KRZHYHU LQHUWLD GHYHORSV DV D UHVXOW RI WKH RUJDQL]DWLRQ¶V
SHUIRUPDQFHKLVWRU\ /DQWDQG0H]LDV /DUJHRUJDQL]DWLRQVWHQGWREHVXFFHVVIXOVLQFH
DQ RUJDQL]DWLRQ ZLOO JURZ ODUJHU ZLWK UHSHDWHG VXFFHVV +RZHYHU VLQFH VXFFHVV UHGXFHV WKH
SUREDELOLW\RIFKDQJHLQDWDUJHWRULHQWHGRUJDQL]DWLRQ &\HUWDQG0DUFK ODUJH
VRIWZDUHRUJDQL]DWLRQVZLOOEHOHVVOLNHO\WRFKDQJHZKHQWKHHQYLURQPHQWFKDQJHV
$QRWKHUH[SODQDWLRQZKLFKLVDOVRDGLUHFWFRQVHTXHQFHRIXVLQJ³EHVWSUDFWLFH´PRGHOV
VXFKDVWKH&00LVWKHLQVWLWXWLRQDOL]HGURXWLQHV,QVWDEOHVLWXDWLRQVVXFKURXWLQL]DWLRQFDQ
EHFRPHDQHIIHFWLYHZD\RIGHYHORSLQJVRIWZDUHEXWLWFDQDOVRGULYHRXWWKHH[SORUDWLRQRI
QHZDOWHUQDWLYHURXWLQHV7KHGHHSHUWKHVHURXWLQHVDUHJURXQGHGLQWKHRUJDQL]DWLRQDOFXOWXUH
WKH PRUH GLIILFXOW WKH\ DUH WR FKDQJH DQG PRUH HDVLO\ WKH\ WXUQ LQWR DQ REVWDFOH WR
LPSURYHPHQW

±±
',6&866,21$1',03/,&$7,216

$IXUWKHUH[SODQDWLRQLVWKDWWKHUDWLRQDOLVWLFDSSURDFKWRVRIWZDUHGHYHORSPHQWFRQVLGHUV
IDLOXUHDVXQDFFHSWDEOH7KLVLVFRQVLVWHQWZLWKWKHJRDORISURPRWLQJVWDELOLW\DQGVKRUWWHUP
SHUIRUPDQFH DV LV WKH FDVH LQ H[SORLWDWLRQ ,Q WKLV VLWXDWLRQ VXFFHVV SURYLGHV DQ H[FHOOHQW
IRXQGDWLRQ IRU LQFUHDVHG UHOLDELOLW\ 2Q WKH RWKHU KDQG VXFFHVV WHQGV WR HQFRXUDJH WKH
PDLQWHQDQFH RI WKH VWDWXV TXR E\ JHQHUDWLQJ VLQJOHORRS OHDUQLQJ )DLOXUH KRZHYHU FDQ
JHQHUDWHGRXEOHORRSOHDUQLQJLQZKLFKSHRSOHTXHVWLRQWKHDVVXPSWLRQVEHKLQGWKHLUIDLOXUHV
DVZHOODVWKHIDLOXUHVWKHPVHOYHV7KHDEVHQFHRIIDLOXUHH[SHULHQFHVFDQWKHUHIRUHUHVXOWLQ
GHFUHDVHGRUJDQL]DWLRQDOFRPSHWHQFHZKHQIDFHGZLWKFKDQJLQJDQGWXUEXOHQWHQYLURQPHQWV
7KHUHIRUH LW LV LPSRUWDQW WR QRWH WKDW VXFFHVVIXO 63, UHTXLUHV WROHUDQFH IRU IDLOXUH DQG
WKDWIDLOXUHLVDQHVVHQWLDOSUHUHTXLVLWHERWKIRUOHDUQLQJDQGIRUFKDOOHQJLQJWKHVWDWXVTXR:H
PXVW WKXV EH DEOH WR WXUQ XQH[SHFWHG SUREOHPV DQG IDLOXUH LQWR OHDUQLQJ RSSRUWXQLWLHV
$EGHO+DPLGDQG0DGQLFN 

 ,PSOLFDWLRQVIRU7KHRU\
7KHNH\WRRXUG\QDPLFPRGHORI63,OLHVLQXQGHUVWDQGLQJWKHGLDOHFWLFQDWXUHRIWKHOHDUQLQJ
SURFHVVHVDQGWKHLUHQDEOLQJFRQGLWLRQV VHH&KDSWHU 0RVWLPSRUWDQWO\LVWKHUHFRJQLWLRQ
RIWKHGLDOHFWLFDOSURFHVVEHWZHHQJHQHUDWLRQRIQHZNQRZOHGJHWKURXJKDFWLRQUHVXOWLQJLQ
RUJDQL]DWLRQDO NQRZOHGJH DQG WKH LQWHUSUHWDWLRQ RI WKLV RUJDQL]DWLRQDO NQRZOHGJH WKURXJK
VHQVHPDNLQJLQWRORFDONQRZLQJ
:HKDYHFRPHXSZLWKVHYHUDOGLDOHFWLFUHODWLRQVKLSVLQWKLVVWXG\+RZHYHURXUILQGLQJV
VXJJHVW WKDW WKH IROORZLQJ IRXU UHODWLRQVKLSV DUH VSHFLILFDOO\ LPSRUWDQW IRU DGYDQFLQJ WKH
WKHRUHWLFDOEDVLVRI63,

x 7KHWDFLW±H[SOLFLWQH[XV
x 7KHORFDO±JOREDOQH[XV
x 7KHNQRZOHGJH±DFWLRQQH[XV
x 7KHH[SORUDWLRQ±H[SORLWDWLRQQH[XV

:H LQWHJUDWH HDFK RI WKHVH GLDOHFWLF UHODWLRQVKLSV WR IRUP D G\QDPLF V\QWKHVLV ,W LV WKHVH
V\QWKHVHVWKDWIRUPWKHSULPDU\FRQWULEXWLRQVRIWKLVUHVHDUFKWRWKHWKHRU\RI63,

 7KHWDFLW²H[SOLFLWQH[XV
2XU UHVXOWV HJ &DVH &  KDYH JLYHQ FOHDU LQGLFDWLRQV WKDW WKHUH LV D GHHSO\ URRWHG WHQVLRQ
EHWZHHQWDFLWDQGH[SOLFLWNQRZOHGJHDWDOOOHYHOVLQVRIWZDUH RUJDQL]DWLRQV VHH 6HFWLRQ 
DQG'\EnE 7KLVLVLQOLQHZLWKREVHUYDWLRQVPDGHWKURXJKRXWWKHKLVWRU\RIVFLHQFH
ZKHUH ZH KDYH ZLWQHVVHG D FRQWURYHUV\ UHJDUGLQJ ZKLFK W\SHV RI NQRZOHGJH WKDW FDQ EH
WUXVWHG 3RSSHU   )RU H[DPSOH ZLWKLQ WKH XQLYHUVLW\ FXOWXUH WKH QRWLRQ RI ³REMHFWLYH´
NQRZOHGJHZKLFKLVGHHSO\URRWHGLQWHFKQLFDOUDWLRQDOLW\LVJLYHQPXFKPRUHYDOXHWKDQWKH
H[SHULHQWLDODQGSUDFWLFDOVNLOOVHPERGLHGLQVRFLDODQGZRUNLQJOLIHDFWLYLWLHV
+RZHYHU WR H[FOXGH WKH WDFLW H[SHULHQWLDO  NQRZOHGJH IURP WKH H[SOLFLW IRUPDO
NQRZOHGJHLVWRXQGHUPLQHWKHGLYHUVLW\RIVRFLDODQGFXOWXUDOFRQWH[WVRINQRZOHGJHDQGWKH
GLYHUVLWLHV RI LQWHUDFWLRQ 7KLV OHDGV WR GHILQLQJ WKH SRWHQWLDO RI 63, PDLQO\ LQ WHUPV RI

±±
&+$37(5

WHFKQRORJLFDO LQIUDVWUXFWXUHV DQG GHILQLQJ WKH WUDQVIHU DQG GLVVHPLQDWLRQ RI NQRZOHGJH LQ
WHUPVRIIRUPDOURXWLQHVDQGVWDQGDUGV7KHGDQJHURIWKLVIRFXVLVWKDWLWLVOLNHO\WRH[FOXGH
VRIWZDUHFRPPXQLWLHVDQGRUJDQL]DWLRQVZKRVHNQRZOHGJHGRHVQRWILWLQWRWKHVHHQJLQHHULQJ
RULHQWHGQRWLRQVRIWKHUDWLRQDOLVWLFWUDGLWLRQ
$V ZH VDZ LQ &KDSWHU  WKH OHDUQLQJ F\FOH FHQWHUV RQ WKH FUHDWLRQ RI ERWK WDFLW DQG
H[SOLFLW NQRZOHGJH DQG PRUH LPSRUWDQWO\ RQ WKH G\QDPLF LQWHUFKDQJH EHWZHHQ WKHVH WZR
DVSHFWVRINQRZOHGJHWKURXJKJHQHUDWLQJDQGLQWHUSUHWLQJ7KXVDIDLOXUHWREXLOGDGLDORJXH
EHWZHHQWDFLWDQGH[SOLFLWNQRZOHGJHFDQFDXVHSUREOHPVIRURUJDQL]DWLRQDOOHDUQLQJDQG63,
)RUH[DPSOHDV ZH VDZ LQ &DVH & SXUHO\ UHO\LQJ RQ HLWKHU IRUPDO URXWLQHV RU IDFHWRIDFH
LQWHUDFWLRQ DUH WZR H[WUHPHV WKDW ERWK KDYH GUDZEDFNV VHH 6HFWLRQ   1HJOHFWLQJ D
VRIWZDUH WHDP¶V QHHG WR PDNH VHQVH RI RUJDQL]DWLRQDO NQRZOHGJH PLJKW HDVLO\ OHDG WR
VXSHUILFLDOLQWHUSUHWDWLRQVZKLFKKDVOLWWOHUHOHYDQFHIRUORFDOUHDOLW\2QWKHRWKHUKDQGDVZH
GLVFXVVHGLQ 6HFWLRQ  WKH VKDUHG SUDFWLFH FUHDWHG E\ SXUH VRFLDOL]DWLRQ ZLWKLQ D VRIWZDUH
WHDPPLJKWEHGLIILFXOWWRDSSO\LQILHOGVEH\RQGWKHVSHFLILFFRQWH[WLQZKLFKLWZDVFUHDWHG
7KXVJHQHUDWLQJQHZH[SOLFLWNQRZOHGJHE\DUWLFXODWLQJWDFLWNQRZOHGJHDQGLQWHUSUHWLQJ
RUJDQL]DWLRQDO NQRZOHGJH WR H[WHQG D VRIWZDUH WHDP¶V WDFLW NQRZOHGJH EDVH DUH WKH FULWLFDO
VWHSVLQWKHOHDUQLQJSURFHVV7KHPDLQUHDVRQIRUWKLVLVWKDWERWKRIWKHVHSURFHVVHVUHTXLUH
SHUVRQDO FRPPLWPHQW ,QGHHG WKDW LV DOVR LQ DJUHHPHQW ZLWK RXU ILQGLQJ WKDW HPSOR\HH
SDUWLFLSDWLRQDUHRQHRIWKHFULWLFDOIDFWRUVIRUVXFFHVVLQ63,
7KHLQKHUHQWSDUDGR[LQWKHWDFLWH[SOLFLWQH[XVLVWKDWZKLOHWKHH[SOLFLWGLPHQVLRQPDNHV
NQRZOHGJHDQGH[SHULHQFHHDVLHUWRGLIIXVHDQGUHSURGXFHDWWKHVDPHWLPHLWXQGHUPLQHVWKH
WUDGLWLRQDOIRUPVRISDUWLFLSDWLRQDQGFROODERUDWLRQDWZRUN7KXVEULQJLQJDERXWDVHSDUDWLRQ
RI WKH KXPDQ ZRUN IURP WKH ZRUNSODFH )URP D PDQDJHPHQW SRLQW RI YLHZ H[WHUQDOL]DWLRQ
PD\JLYHULVHWRQHZSDWWHUQVRIZRUNDQGRUJDQL]DWLRQLQZKLFKHPSOR\HHVFXVWRPHUVDQG
SURGXFWVDUHVHHQDVFRPSRQHQWVRIDQLQIRUPDWLRQQHWZRUN2QWKHRWKHUKDQGWKHVHSDUDWLRQ
RIZRUNIURPWKHZRUNSODFHPD\DOVROHDGWRDGHJUDGDWLRQRIWKHWUDGLWLRQDOVRFLDOIHDWXUHVRI
WKHZRUNSODFHFXOWXUHVXFKDVWHDPZRUNSDUWLFLSDWLRQDQGWUXVW7KLVLVXQIDYRUDEOHLQOLJKW
RIRXUILQGLQJVWKDWSDUWLFLSDWLRQDQGFRPSDQ\H[SHULHQFHDUHLPSRUWDQWIDFWRUVWKDWGLIIHUHQ
WLDWHVVXFFHVVIXOIURPOHVVVXFFHVVIXORUJDQL]DWLRQV,QEDODQFLQJWKHWDFLWDQGH[SOLFLWWKHUH
IRUHWKHSULPDU\IRFXVVKRXOGEHRQWKHQHJRWLDWLRQRIPHDQLQJDQGXVHIXOQHVVUDWKHUWKDQRQ
WKHWHFKQLTXHVRILQIRUPDWLRQDFTXLVLWLRQDQGWUDQVPLVVLRQ:KLOHWKHODWWHUWHFKQLTXHVFOHDUO\
QHHGWREHLQSODFHLQWKHOHDUQLQJF\FOHWKH\VKRXOGQRWEHFRPHWKHSULPDU\IRFXVRI63,
&RQVHTXHQWO\ WKH FKDOOHQJH IDFLQJ 63, UHVHDUFK LV WR HVWDEOLVK D V\PELRVLV EHWZHHQ
SHRSOHDQGWHFKQRORJ\DQGWKHUHIRUHDV\PELRVLVEHWZHHQWKHWDFLWDQGH[SOLFLWGLPHQVLRQVRI
NQRZOHGJH7KLVV\PELRVLVUHFRJQL]HVWKHHVVHQWLDOFRQWULEXWLRQRIWKHH[SOLFLWNQRZOHGJHDV
D JOREDO UHVRXUFH IRU NQRZOHGJH WUDQVIHU DQG GHYHORSPHQW +RZHYHU LW HPSKDVL]HV WKDW
VXVWDLQDEOHLPSURYHPHQWV GHSHQG XSRQ ORFDO FDSDFLW\ IRU WKH LQWHUSUHWDWLRQ DEVRUSWLRQ DQG
XVH RI NQRZOHGJH LQ GLYHUVH VLWXDWLRQV DQG WKLV LQ WXUQ GHSHQGV RQ WKH OHYHO RI
LQWHUGHSHQGHQFH EHWZHHQ ORFDO DQG JOREDO NQRZOHGJH 7KH WDFLW GLPHQVLRQ RI NQRZOHGJH
QHHGVWREHEURXJKW EDFN LQWR WKH RUJDQL]DWLRQ¶V PHPRU\ DV D ZD\ RI SUHSDULQJ LQGLYLGXDOV
DQGWHDPVWRPDVWHUWKHWHFKQRORJ\UDWKHUWKDQWHFKQRORJ\PDVWHULQJWKHP7KXVWRVSOLWWDFLW
IURPH[SOLFLWNQRZOHGJHLVWRPLVVWKHSRLQW±WKHWZRDUHLQVHSDUDEO\UHODWHG

±±
',6&866,21$1',03/,&$7,216

 7KHORFDO²JOREDOQH[XV
6RIWZDUHGHYHORSPHQWOLNHDOOKXPDQDFWLRQLVDOZD\VDQGDWHYHU\PRPHQWFRQIURQWHGZLWK
VSHFLILFFRQGLWLRQVDQGFKRLFHV2QWKHRQHKDQGVRIWZDUHGHYHORSHUVVHOHFWZKDWWKH\XQGHU
VWDQG WR EH WKH UHOHYDQW DVSHFWV RI RUJDQL]DWLRQDO NQRZOHGJH DQG RQ WKH RWKHU KDQG WKRVH
UHOHYDQWDVSHFWVRIWKHORFDOFRQGLWLRQVZLWKLQZKLFKWKHLUDFWLRQVWDNHSODFHDQGWU\WRILWWKH
WZRWRJHWKHU0RUHRYHUVRIWZDUHGHYHORSHUVSRVVHVVORFDONQRZOHGJHWKDWFDQQRWEHVXUYH\HG
DV D ZKROH DQG DOVR SDUW RI WKHLU NQRZOHGJH RULJLQDWHV IURP RXWVLGH WKH RUJDQL]DWLRQ ,W LV
WKLVWHQVLRQEHWZHHQWKHRUJDQL]DWLRQVSHFLILFKDELWXVDQGWKHORFDOFRQGLWLRQVLQZKLFKLWLV
LQVWDQWLDWHGWKDWH[SODLQV ZK\ D VRIWZDUH SURMHFW¶V GHYHORSPHQW SURFHVV LV QHLWKHU D UHSOLFD
WLRQRIDQLGHDOL]HGSURFHVVPRGHOQRUDQH[QLKLORFRQVWUXFWLRQ
7KXVLQWKHFRQWH[WRIRXUG\QDPLFPRGHORI63,WKHORFDODQGJOREDODUHUHODWHGOHYHOV
RIOHDUQLQJWKDWDOZD\VFRH[LVWDQGVKDSHHDFKRWKHU7KHUHIRUHZHQHHGWRILQGQHZZD\VRI
LQWHUORFNLQJORFDODQGJOREDONQRZOHGJHEDVHVIRUVRIWZDUHGHYHORSPHQWLQRUGHUWRPHHWWKH
FRQGLWLRQVIRURUJDQL]DWLRQDOOHDUQLQJDQG63,
2XUILQGLQJVIURP&DVH&VKRZHGWKDWVRIWZDUHGHYHORSHUVSUHIHUORFDONQRZOHGJHWKDWLV
FORVH LQ VSDFH DQG WLPH WR JOREDO NQRZOHGJH WKDW LV PRUH GLVWDQW ([HFXWLYH PDQDJHUV DQG
TXDOLW\ PDQDJHUV RQ WKH RWKHU KDQG SUHIHU JOREDO NQRZOHGJH VHH 6HFWLRQ   $V FDQ EH
VHHQIURP7DEOHORFDONQRZOHGJHLVSULPDULO\FRQFHUQHGZLWKXQLTXHVLWXDWLRQVDQGDFWXDO
SURFHVVHV ZKLOH JOREDO NQRZOHGJH LV FRQFHUQHG ZLWK DEVWUDFW JHQHUDOL]DWLRQV )XUWKHUPRUH
E\ FRPELQLQJ WKH ORFDOJOREDO GLPHQVLRQ ZLWK WKH WDFLWH[SOLFLW GLPHQVLRQ ZH VHH IURP
)LJXUHKRZZHFDQFDWHJRUL]HVRPHRIWKHPDLQW\SHVRINQRZOHGJHLQ63,
:KLOH ORFDO NQRZOHGJH LV HIIHFWLYH IRU VRIWZDUH WHDPV DQG ORFDO PDQDJHPHQW LW LV
GLIILFXOWWRJHQHUDOL]HIURPRQHVHWWLQJWRDQRWKHUDQGFRQVHTXHQWO\RIOLPLWHGXVHIRURWKHUV
WKDQLWVFUHDWRUV+RZHYHUWKHVHOLPLWDWLRQVWRORFDONQRZOHGJHDUHDV ZHKDYHVHHQLQWKH
DUHDVWKDWRFFXS\H[HFXWLYHPDQDJHUVDQGTXDOLW\PDQDJHU6RZKLOHH[HFXWLYHPDQDJHUVDQG
TXDOLW\ PDQDJHUV WHQG WR UHZDUG DEVWUDFW FRQFHSWXDOL]DWLRQV DQG GLVWDQFLQJ IURP LQGLYLGXDO
FDVHVVRIWZDUHGHYHORSHUVDQGORFDOPDQDJHUVWHQGWRUHZDUGFRQFUHWHWKLQNLQJDQGFORVHQHVV
WRWKHLQGLYLGXDOFDVH
7KHVHGLIIHUHQFHVFDQFUHDWHDWHQVLRQWKDWFDQEHGHWULPHQWDOIRURUJDQL]DWLRQDOOHDUQLQJ
DQG 63, XQOHVV ZH WU\ WR XQGHUVWDQG LW DQG HQJDJH LQ HIIRUWV RI EXLOGLQJ D V\PELRWLF
UHODWLRQVKLSEHWZHHQORFDOGLYHUVLW\DQGJOREDOXQLW\,QRWKHUZRUGVDPDMRULPSOLFDWLRQRI
WKLVLQYHVWLJDWLRQLVDQLQFUHDVLQJDZDUHQHVVDQGKHLJKWHQHGUHFRJQLWLRQRIWKHQHHGWRVWULNH
DEDODQFHEHWZHHQVHQVLWLYHQHVVWRXQLTXHORFDOFRQWH[WVDQGWKHQHHGWRVWDQGDUGL]HXQLIRUP
VROXWLRQVDFURVVPXOWLSOHFRQWH[WV

7DEOH&KDUDFWHULVWLFVRIORFDODQGJOREDONQRZOHGJH

/RFDO.QRZOHGJH *OREDO.QRZOHGJH

x &RQFUHWHTXDOLWDWLYHGHVFULSWLRQVRIXQLTXH x $EVWUDFWTXDQWLWDWLYHGHVFULSWLRQVRINH\
VLWXDWLRQV SHUIRUPDQFHLQGLFDWRUV
x 5HSUHVHQWDWLRQVRIDFWXDOSURFHVVHV x 5HSUHVHQWDWLRQVRIPHDQVDQGYDULDQFHV
x &RQQHFWVRXWFRPHWRWKHSURFHVVHVLQWKH x 5HSUHVHQWDWLRQVRIRXWFRPHVRIDEVWUDFW
VLWXDWLRQ SURFHVVHV
x &ORVHLQVSDFHDQGWLPHWRSUDFWLFH x 'LVWDQWIURPSUDFWLFH

±±
&+$37(5

7DFLWNQRZOHGJH

([SHULHQFH

*OREDO /RFDO

NQRZOHGJH NQRZOHGJH

´%HVWSUDFWLFHVµ &DVHVWXGLHV

([SOLFLWNQRZOHGJH

)LJXUH'LIIHUHQWW\SHVRINQRZOHGJHLQ63,

7KH SUREOHP ZLWK JOREDO NQRZOHGJH DQG VWDQGDUGL]DWLRQ LQ 63, LV WKDW XQLIRUPLW\ SURGXFHV
FRQWH[W LQVHQVLWLYH WDUJHWV PHWKRGV DQG SURFHVVHV 7KLV YLHZ DVVXPHV D KRPRJHQHRXV
XQGHUVWDQGLQJ RI RUJDQL]DWLRQDO UHDOLW\ VHSDUDWLQJ NQRZOHGJH IURP LWV FRQWH[W 7KLV
VHSDUDWLRQ WKHQ FRQWULEXWHV WR ZLGHQLQJ WKH JXOI EHWZHHQ NQRZOHGJH DQG H[SHULHQFH VHH
6HFWLRQ   7KH ULVN RI SXUVXLQJ ³EHVW SUDFWLFH´ DSSURDFKHV WR 63, LV WKHUHIRUH WKDW LW
OHDGVWRWKH³RQHEHVWZD\´RINQRZOHGJHLPSRVLQJLWDVWKH³ORZHVWFRPPRQGHQRPLQDWRU´
LQZKLFKVRIWZDUHGHYHORSHUVDQGWHDPVORVHWKHLUFRQWH[WXDOEHDULQJV
+RZHYHU RXU ILQGLQJV VXJJHVW WKDW LPSURYHPHQW SURFHVVHV DUH KLJKO\ FRQWH[WXDOO\
HPEHGGHG VHH6HFWLRQV ,WPXVWWKHUHIRUHEHHPSKDVL]HGWKDWWKHHVVHQWLDOFRQGLWLRQ
RI NQRZOHGJH WUDQVIHU LV WKDW WKH ORFDO JURXSV SRVVHVV WKH HGXFDWLRQDO H[SHULHQWLDO DQG
OHDUQLQJLQIUDVWUXFWXUHVZKLFKVXSSRUWWKHVKDULQJDEVRUSWLRQDQGXVHRIJOREDONQRZOHGJH
6LPSOH IDLWK LQ WKH WHFKQLFDO DVSHFWV RI WUDQVIHUULQJ NQRZOHGJH DQG H[SHULHQFH PLVVHV WKH
HVVHQWLDOFRQGLWLRQRIFRQWH[WDQGVRFLDOPHGLDWLRQLQPDNLQJVHQVHDQGSXUSRVHIXOXVDJHRI
NQRZOHGJH$OORI D WHDP¶V ORFDO NQRZOHGJH LWV DELOLW\ WR LQWHUSUHW GDWD IURP D FRQWH[W DQG
SUHYLRXVH[SHULHQFHLWVDELOLW\WRGLVFHUQWKHLPSRUWDQWIURPWKHXQLPSRUWDQWDQGWRMXVWLI\
DQGPDNHVHQVHRIDFWLRQDOWHUQDWLYHVLVLPSRVVLEOHWRHPEHGRUPLPLFLQDJOREDOV\VWHP
$VZHKDYHDOUHDG\VHHQHPSOR\HHSDUWLFLSDWLRQDQGEXVLQHVVRULHQWDWLRQDUHWZRRIWKH
PRVW FULWLFDO IDFWRU IRU VXFFHVV LQ 63, :LWK UHVSHFW WR WKH ORFDOJOREDO QH[XV SDUWLFLSDWLRQ
UHSUHVHQWVWKHORFDOZKLOHEXVLQHVVRULHQWDWLRQUHSUHVHQWVWKHJOREDO7KLVVXJJHVWVWKDWZLWKLQ
WKHQRUPVRIWKHRUJDQL]DWLRQ¶VEXVLQHVVVWUDWHJ\SDUWLFLSDWLRQVKRXOGEHLQWHQGHGWRH[SORLW
WKHGLYHUVLW\ZLWKLQDQGEHWZHHQVRIWZDUHWHDPVWRFUHDWHD³VSDFHRISRVVLELOLW\´ *MHUVYLN
 WKDWFDQEH XWLOL]HG LQ 63, 7KLV ZD\ WKH VRIWZDUH RUJDQL]DWLRQ FDQ EDODQFH WKH ORFDO
DQG WKH JOREDO E\ NHHSLQJ LWV FRPPRQ VWUXFWXUHV DQG URXWLQHV WR D EDUH PLQLPXP WKXV
DYRLGLQJXQQHFHVVDU\FORVXUHLQLWVRUJDQL]DWLRQDOOHDUQLQJDQG63,DFWLYLWLHV

±±
',6&866,21$1',03/,&$7,216

 7KHNQRZOHGJH²DFWLRQQH[XV
%HLQJH[SHULHQFHG KDYLQJ NQRZOHGJH DQG EDODQFLQJ WKH WHQVLRQV EHWZHHQ WKH WDFLW DQG WKH
H[SOLFLW DQG EHWZHHQ WKH ORFDO DQG WKH JOREDO LV DV ZH KDYH MXVW GLVFXVVHG RI XWPRVW
LPSRUWDQFH WR 63, +RZHYHU MXVW DV KDYLQJ NQRZOHGJH DERXW KRUVHV LV QRW WKH VDPH DV DQ
DELOLW\WRULGHWRLPSURYHVRIWZDUHGHYHORSPHQWSURFHVVHVNQRZOHGJHH[SHULHQFHDQGDFWLRQ
DUHDOOPDQGDWRU\
2QH RI WKH LQVLJKWV IURP WKLV LQYHVWLJDWLRQ LV WKDW ZKLOH PRVW RI WKH VRIWZDUH
RUJDQL]DWLRQVLQIDFWKDYHNQRZOHGJHRIZKDWWRGRLQRUGHUWRLPSURYH VHH6HFWLRQ WKH\
IUHTXHQWO\ IDLO LQ WXUQLQJ WKLV NQRZOHGJH LQWR DFWLRQ 7KLV PLJKW DOVR H[SODLQ ZK\ VRIWZDUH
HGXFDWLRQ DQG JHQHUDO VRIWZDUH H[SHULHQFH GLG QRW LQIOXHQFH WKH OHYHO RI 63, VXFFHVV VHH
6HFWLRQ ±LWLVDFWLRQWKDWFRXQWVQRWWKHRUHWLFDONQRZOHGJHDORQH7KLVLVVLPLODUWRWKH
³SHUIRUPDQFHSDUDGR[´REVHUYHGE\&RKHQ  ³0DQDJHUVNQRZZKDWWRGRWRLPSURYH
SHUIRUPDQFHEXWDFWXDOO\LJQRUHRUDFWLQFRQWUDGLFWLRQWRHLWKHUWKHLUVWURQJHVWLQVWLQFWVRUWR
WKHGDWDDYDLODEOHWRWKHP´ LELGS 
7KHUHDUHVHYHUDOSRVVLEOHH[SODQDWLRQVIRUWKLVSKHQRPHQRQ2QHLVWKDWWKHFRQFHSWLRQ
RINQRZOHGJHDVVRPHWKLQJH[SOLFLWDQGTXDQWLILDEOHOHDGVRUJDQL]DWLRQVWRRYHUHVWLPDWHWKH
LPSRUWDQFHRIWKHWDQJLEOHSURJUDPPDWLFDVSHFWVRIZKDWFRPSHWLWRUVGRDQGXQGHUHVWLPDWH
WKH LPSRUWDQFH RI WKH XQGHUO\LQJ SKLORVRSK\ WKDW JXLGHV ZKDW WKH\ GR DQG ZK\ WKH\ GR LW
7KHUHLVWKHUHIRUHDGDQJHUWKDWVRIWZDUHRUJDQL]DWLRQVZLOODGRSWZKDW&DUG  FDOOHGD
³FDUJRFXOWPHQWDOLW\´WRZDUG63,

,QWKHODWHWKDQGHDUO\WKFHQWXULHVUXUDOQDWLYHVRI0HODQHVLDDJURXSRILVODQGVLQWKH
VRXWKHUQ 3DFLILF REVHUYHG WKDW YDOXDEOH FDUJRHV RI IRRG DQG RWKHU JRRGV DUULYHG E\ VKLS
DQGSODQHDW(XURSHDQKDUERUVDQGDLUSRUWV7KH\UHDVRQHGWKDWLIWKH\FRQVWUXFWHGKDUERUV
DQGDLUSRUWV RUDWOHDVWWKLQJVWKDWORRNHGOLNHKDUERUVDQGDLUSRUWVIURPDGLVWDQFH YDOXDEOH
FDUJRHV ZRXOG DUULYH IRU WKHP WRR 6R PDQ\ UXUDO 0HODQHVLDQV JDYH XS WKHLU WUDGLWLRQDO
DFWLYLWLHVRIIDUPLQJ DQG ILVKLQJ LQ WKH SXUVXLW RI FDUJR 2FFDVLRQDOO\ D VKLS RU SODQH ZRXOG
DUULYHEXWVXFKRFFDVLRQVUHDOO\ZHUHDFFLGHQWV LELGS 

2EYLRXVO\ WKH 0HODQHVLDQV RI WKDW WLPH RQO\ SDUWLDOO\ XQGHUVWRRG WKH V\VWHP EHKLQG WKH
PRYHPHQWRIVKLSVDQGSODQHV&DUG¶V  H[DPSOHLVWKXVDQH[WUHPHH[DPSOHRIZKDW
FDQ KDSSHQ ZKHQ OHVV NQRZOHGJHDEOH SHRSOH WU\ WR FRS\ D VXFFHVVIXO EHKDYLRU RU SUDFWLFH
ZLWKRXWOHDUQLQJDERXWWKHSKLORVRSK\RQZKLFKLWLVJURXQGHG
$QRWKHU UHDVRQ IRU WKH REVHUYHG JDS EHWZHHQ NQRZOHGJH DQG DFWLRQ LV WKDW WKH PRVW
REYLRXVVROXWLRQVRIWHQWHQGWREHGLVFRXQWHGIRUWKHUHDVRQWKDWWKH\VHHPWRRRUGLQDU\7KH
NH\OHVVRQLVWKXVWRWDFNOHREYLRXVWKLQJV6WLOODQRWKHUUHDVRQIRUWKHNQRZOHGJHDFWLRQJDS
LVWKDWDFWLRQLQHYLWDEO\LQYROYHVDJUHDWHUULVNRIIDLOXUHWKDQSODQQLQJGHFLVLRQPDNLQJDQG
WDONV )XUWKHUPRUH PDQDJHUV RIWHQ EHOLHYH WKDW MXVW EHFDXVH D GHFLVLRQ KDV EHHQ PDGH
VRPHWKLQJ ZLOO KDSSHQ +RZHYHU DV %UXQVVRQ   KDV VKRZQ LQ KLV DQDO\VLV RI
RUJDQL]DWLRQDOK\SRFULV\WDONGHFLVLRQDQGDFWLRQLVRIWHQQRWFRQQHFWHG
7KHUHDUHQRHDV\DQVZHUVWRFORVHWKHJDSEHWZHHQNQRZOHGJHDQGDFWLRQ+RZHYHURXU
ILQGLQJVVXJJHVWWKDWWRRPDQ\PDQDJHUVDQGGHYHORSHUVDOLNHIDOOLQWRWKHWUDSRIWKH³FDUJR
FXOWPHQWDOLW\´ZDQWLQJWROHDUQ³KRZ´LQWHUPVRIWRROVDQGWHFKQLTXHVUDWKHUWKDQ³ZK\´LQ
WHUPV RI XQGHUO\LQJ SKLORVRSK\ DQG JXLGDQFH IRU DFWLRQ $OVR VLQFH OHDUQLQJ E\ GRLQJ E\
GHILQLWLRQ HOLPLQDWHV WKH NQRZOHGJHDFWLRQ JDS WKLV VXJJHVWV WKDW ZH VKRXOG IRFXV RQ
WKHRULHVWKDWDUHJURXQGHGLQLQGXVWULDOH[SHULHQFHE\GHYHORSLQJSUDFWLFHRULHQWHGWKHRULHV
)XUWKHUPRUH HYLGHQFH VXJJHVWV WKDW  SHUFHQW RI ODUJHVFDOH UHHQJLQHHULQJ DQG
TXDOLW\ LPSURYHPHQW HIIRUWV GR QRW SURGXFH WKH GHVLUHG UHVXOWV &RKHQ  +DPPHU DQG

±±
&+$37(5

&KDPS\  0RUJDQ   7KLV VXJJHVWV WKDW UDWKHU WKDQ ODUJHVFDOH FRPSOH[ DQG
DEVWUDFWWKHRULHVZHVKRXOGGHYHORSDFWLRQDEOH63,WKHRULHVWKDWDUHFORVHLQVSDFHDQGWLPHWR
SUDFWLFH IRFXVLQJ RQ JHQHUDWLQJ VKRUWWHUP LQFUHPHQWDO JDLQV DQG VPDOO ZLQV IRU H[DPSOH
WKURXJK WKH XVH RI ³PLFURZRUOGV´ $EGHO+DPLG  6DXHU HW DO  6HQJH  
0RUHRYHUVXFKDSSURDFKHVVKRXOGEHLPSURYLVDWLRQDOLQQDWXUHYDOXLQJDQDWWLWXGHRIDFWLRQ
DQG WKH LPSRUWDQFH RI OHDUQLQJ E\ H[SHULPHQWDWLRQ 7R VOLJKWO\ UHSKUDVH %HQMDPLQ 'LVUDHOL
ZH VKRXOG UHPHPEHU WKDW DFWLRQ PD\ QRW DOZD\V EULQJ LPSURYHPHQW EXW WKHUH LV QR
LPSURYHPHQWZLWKRXWDFWLRQ

 7KHH[SORUDWLRQ²H[SORLWDWLRQQH[XV
$V ZH VDZ LQ 6HFWLRQ  D VSHFLILF FKDOOHQJH IRU VXFFHVVIXO 63, LQYROYHV EDODQFLQJ WKH
UHILQHPHQWRIWKHH[LVWLQJVNLOOEDVHZLWKWKHH[SHULPHQWDWLRQRIQHZLGHDVWRILQGDOWHUQDWLYHV
WKDWLPSURYHRQROGLGHDV7KLVLQVLJKWLVLPSRUWDQWDQGXQIRUWXQDWHO\LWLVQRWSDUWRIFXUUHQW
³EHVW SUDFWLFH´ PRGHOV 7KHUHIRUH WR GLVFXVV WKH LPSOLFDWLRQV RI WKH WHQVLRQV EHWZHHQ 63,
VWUDWHJLHV EDVHG RQ H[SORUDWLRQ DQG 63, VWUDWHJLHV EDVHG RQ H[SORLWDWLRQ ZH VWDUW E\
H[DPLQLQJ WKH LPSOLFDWLRQV RI DGKHULQJ WR DQ H[SORLWDWLRQ VWUDWHJ\ DV GHYLVHG E\ ³EHVW
SUDFWLFH´PRGHOV VHH'\EnE 
%DVLFDOO\WKHUHDUHWKUHHZD\VLQZKLFKDVRIWZDUHRUJDQL]DWLRQFDQLPSURYHLWVSURFHVV
FDSDELOLW\XVLQJ³EHVWSUDFWLFH´PRGHOVVXFKDVWKH&00 )ORUDFDQG&DUOHWRQ LWFDQ
LQFUHDVHWKHDYHUDJHSHUIRUPDQFH LHWKHPHDQRIWKHSHUIRUPDQFHGLVWULEXWLRQ LWFDQUHGXFH
WKHYDULDQFHLQSHUIRUPDQFH LHLQFUHDVHSUHGLFWDELOLW\ RULWFDQXVHDFRPELQDWLRQRIERWK
,QFUHDVHGDYHUDJHSHUIRUPDQFHLVD JHQHUDO IHDWXUH RI H[SHULHQWLDO OHDUQLQJ DQG LW LV FOHDUO\
EHQHILFLDOIRUFRPSHWLWLYHDGYDQWDJH5HGXFHGYDULDQFHKRZHYHULVQRWQHFHVVDULO\DQDGYDQ
WDJH,QIDFWIRUPRVWVPDOOVRIWZDUHFRPSDQLHVFRPSHWLWLRQFDQWXUQUHGXFHGYDULDQFHLQWR
DPDMRUGLVDGYDQWDJH
7RH[DPLQHWKH³EHVWSUDFWLFH´DSSURDFKWRLPSURYHPHQWDQGLWVFRQVHTXHQFHVIRUFRP
SHWLWLYHQHVV ZH FRQVLGHU D VLPSOH PRGHO GHYLVHG E\ 0DUFK   ZKLFK DVVXPHV WKDW
VXUYLYDO LV EDVHG RQ FRPSDUDWLYH SHUIRUPDQFH ZLWKLQ D JURXS RI FRPSHWLQJ RUJDQL]DWLRQV
)XUWKHUPRUHHDFKVLQJOHSHUIRUPDQFHLVGUDZQIURPDSHUIRUPDQFHGLVWULEXWLRQVSHFLILFWRD
SDUWLFXODURUJDQL]DWLRQ7KHPHDQRIWKHGLVWULEXWLRQ UHIOHFWV WKH RUJDQL]DWLRQ¶V DELOLW\ OHYHO
DQGWKHYDULDQFHUHIOHFWVWKHRUJDQL]DWLRQ¶VUHOLDELOLW\
)RUVPDOOVRIWZDUHRUJDQL]DWLRQVSHUIRUPDQFHVDPSOHVDUHDOVRVPDOO5HODWLYHSRVLWLRQ
GRHVQRWGHSHQGRQDELOLW\DORQHEXWLVDFRQVHTXHQFHRIDELOLW\DQGUHOLDELOLW\ /HYLQWKDODQG
0DUFK 0RUHRYHUWKHFRPSHWLWLYHHQYLURQPHQWRIPRVWVPDOOVRIWZDUHRUJDQL]DWLRQVLV
VXFK WKDW RQO\ WKH EHVW VXUYLYH ± DQG VXUYLYDO GHSHQGV RQ KDYLQJ DQ H[WUHPH SHUIRUPDQFH
GUDZ 7KXV LPSURYLQJ DYHUDJH DELOLW\ KHOSV UHODWLYHO\ OLWWOH DQG LQFUHDVLQJ UHOLDELOLW\
UHGXFLQJYDULDQFH FDQGHWULPHQWDOO\DIIHFWVXUYLYDO
,Q WKH H[WUHPH FDVH ZKHUH WKH RUJDQL]DWLRQ IDFHV RQO\ RQH FRPSHWLWRU LQFUHDVHV LQ
DYHUDJH SHUIRUPDQFH DOZD\V SD\V RII ZKHUHDV FKDQJHV LQ YDULDQFH KDYH QR HIIHFW RQ FRP
SHWLWLYHDGYDQWDJH+RZHYHUZKHQWKHUHDUHVHYHUDOFRPSHWLWRUVLQFUHDVHVLQHLWKHUWKHPHDQ
RU WKH YDULDQFH KDYH D SRVLWLYH HIIHFW $V WKH QXPEHU RI FRPSHWLWRUV LQFUHDVHV WKH
FRQWULEXWLRQRIWKHYDULDQFHWRFRPSHWLWLYHDGYDQWDJHLQFUHDVHV8OWLPDWHO\DVWKHQXPEHURI
FRPSHWLWRUVJRHVWRLQILQLW\WKHPHDQSHUIRUPDQFHEHFRPHVLUUHOHYDQW 0DUFK 
7KH DUJXPHQW EHKLQG &00¶V LPSURYHPHQW DSSURDFK LV WKDW DV VRIWZDUH SURFHVVHV DUH
VWDQGDUGL]HGDQGWHFKQLTXHVDUHOHDUQHGWKHWLPHUHTXLUHG WR DFFRPSOLVK GHYHORSPHQW WDVNV

±±
',6&866,21$1',03/,&$7,216

ZLOOEHUHGXFHGSURGXFWLYLW\ DQGWKH TXDOLW\ RI WDVN SHUIRUPDQFH ZLOO EH LQFUHDVHG WRJHWKHU
ZLWK WKH UHOLDELOLW\ RI WDVN SHUIRUPDQFH 3DXON HW DO   0DUFK¶V   PRGHO LPSOLHV
WKDWLIWKHLQFUHDVHLQUHOLDELOLW\FRPHVDVDFRQVHTXHQFHRIUHGXFLQJWKHOHIWKDQGWDLORIWKH
SHUIRUPDQFH GLVWULEXWLRQ VHH )LJXUH D  WKH OLNHOLKRRG RI ILQLVKLQJ ODVW DPRQJ VHYHUDO
FRPSHWLWRUV LV UHGXFHG ZLWKRXW FKDQJLQJ WKH OLNHOLKRRG RI ILQLVKLQJ ILUVW %XW LI SURFHVV
LPSURYHPHQWUHGXFHVWKHULJKWKDQGWDLORIWKHGLVWULEXWLRQLWPD\HDVLO\GHFUHDVHWKHFKDQFH
RI EHLQJ EHVW DPRQJ WKH FRPSHWLWRUV GHVSLWH LQFUHDVHV LQ WKH RUJDQL]DWLRQ¶V DYHUDJH SHU
IRUPDQFH
Frequency

Failures
Successes

Performance
(a) M1 M2
Frequency

Successes
Failures

Performance
(b) M2 M1

)LJXUH7KHLPSDFWRIDELOLW\DQGUHOLDELOLW\RQSHUIRUPDQFH0GHQRWHVWKHPHDQ
SHUIRUPDQFHRIWKHGLVWULEXWLRQV6KDGHGDUHDVVKRZZKHUH³LPSURYLVLQJ´RUJDQL]DWLRQVDUH
PRUHVXFFHVVIXOWKDQ³EHVWSUDFWLFH´RUJDQL]DWLRQV

±±
&+$37(5

$QLPSURYHPHQWVWUDWHJ\WKDWVLPXOWDQHRXVO\LQFUHDVHVDYHUDJHSHUIRUPDQFHDQGLWVUHOL
DELOLW\LVWKHUHIRUHQRWD JXDUDQWHHRI FRPSHWLWLYHDGYDQWDJH VHH)LJXUH D  7KH FRQVH
TXHQFHV RI VXFK D VWUDWHJ\ LV WKDW LW KHOSV LQ FRPSHWLWLRQ WR DYRLG UHODWLYHO\ ORZ SRVLWLRQV
ZKHUHDV LW KDV D QHJDWLYH HIIHFW LQ FRPSHWLWLRQ ZKHUH ILQLVKLQJ QHDU WKH WRS LV LPSRUWDQW
7KXVWKHSULFHRIUHOLDELOLW\LVDVPDOOHUFKDQFHRISULPDF\
,I RXU PDLQ JRDO LV WR LQFUHDVH WKH FRPSHWLWLYH DGYDQWDJH RI VPDOO  VRIWZDUH RUJDQL
]DWLRQVLWLVWLPHWRPRYHDZD\IURPWKHPRGHOEDVHGRQHVL]HILWVDOOWKLQNLQJRIWKHV
,QVWHDGZHVKRXOGSURFHHGWRLPSURYHPHQWVWUDWHJLHVWKDWIRFXVRQOHDUQLQJIURPRXUVXFFHVV
1RODQ WRLQFUHDVHWKHSHUIRUPDQFHGLVWULEXWLRQ¶VULJKWKDQGWDLOZKLOHDWWKHVDPHWLPH
UHGXFLQJWKHOHIWKDQG WDLO E\ OHDUQLQJ IURP RXU IDLOXUHV $EGHO+DPLG DQG 0DGQLFN 
6LWNLQ   VHH )LJXUH E  $V ZH DUJXHG LQ &KDSWHU  DQG DOVR LQ '\En E 
LPSURYLVDWLRQLVVXFKDQDSSURDFKWR63,WKDWV\QWKHVL]HVH[SORLWDWLRQDQGH[SORUDWLRQDQGLV
WKXVRIFULWLFDOLPSRUWDQFHIRUVXFFHVV
%DVHG RQ H[LVWLQJ NQRZOHGJH DQG H[SHULHQFH VXFK LPSURYLVDWLRQ EXLOGV RQ $ULVWRWOH¶V
FRQFHSW RI SKURQHVLV ³WKH DELOLW\ WR VSRW WKH DFWLRQ FDOOHG IRU LQ DQ\ VLWXDWLRQ´ 7RXOPLQ
 S   DQG /pYL6WUDXVV¶   FRQFHSW RI EULFRODJH WKH DELOLW\ WR ³PDNH GR ZLWK
µZKDWHYHULVWRKDQG¶´ S 6HHQLQWKLVOLJKWFUHDWLQJDQHQDEOLQJFRQWH[WIRU63,FDQEH
VHHQDVDVRFLDOO\FRQVWUXFWHGSULQFLSOHRI³UHJXODWHG´LPSURYLVDWLRQLQZKLFKWUDGLWLRQDQG
FUHDWLYLW\LQWHUVHFWVWRJHQHUDWHDQGLQWHUSUHWQHZNQRZOHGJH

 ,PSOLFDWLRQVIRU0HWKRGRORJ\
,QWKLVVHFWLRQZHSUHVHQWLPSRUWDQWPHWKRGRORJLFDOLPSOLFDWLRQVRIRXUUHVHDUFKZKLFK63,
UHVHDUFKHUVDQGFRQVXOWDQWV FRXOG DFW XSRQ LQ RUGHU WR KHOS VRIWZDUH RUJDQL]DWLRQV LPSURYH
)RXUPHWKRGRORJLFDOLPSOLFDWLRQVDUHLGHQWLILHG

x 7KHSRVLWLYLVW±LQWHUSUHWLYLVWQH[XV
x 7KHULJRU±UHOHYDQFHQH[XV
x 7KHFRQYHUJHQFH±GLYHUJHQFHQH[XV
x 7KHSURFHVV±SUDFWLFHQH[XV

7KHILUVWRIWKHVHWKHSRVLWLYLVWLQWHUSUHWLYLVWQH[XVZDVGLVFXVVHGDWOHQJWKLQ6HFWLRQDQG
ZLOO QRW EH UHSHDWHG KHUH 7KH FRQFOXVLRQ IURP WKDW VHFWLRQ ZDV WKDW GHVSLWH VHHPLQJO\
LQFRPSDWLEOHDSSURDFKHV LW LV QRW RQO\ SRVVLEOH EXW DOVR QHFHVVDU\ WR DSSO\ PL[HG PHWKRGV
UHVHDUFKLQ(6()XUWKHUPRUHZHFRQFOXGHGWKDWPL[LQJTXDOLWDWLYHDQGTXDQWLWDWLYHUHVHDUFK
PHWKRGVVKRXOGEHEDVHGXSRQDSUDJPDWLFDSSURDFK7KLVV\QWKHVL]HVWKHGLDOHFWLFEHWZHHQ
SRVLWLYLVPDQGLQWHUSUHWLYLVPDQGRIIHUVDSUDFWLFDOEDVLVIRUUHVHDUFKLQDQDSSOLHGILHOGVXFK
DV 63, 7KH UDLVRQ G¶rWUH IRU D SUDJPDWLF DSSURDFK WR (6( UHVHDUFK LV WR OLQN WKHRU\ DQG
SUDFWLFHWKURXJKPL[HGPHWKRGGHVLJQVDQGWULDQJXODWLRQ

 7KHULJRU²UHOHYDQFHQH[XV
,Q JHQHUDO FRPSXWHU VFLHQWLVWV WHQG WR DGKHUH WR DQ ³DGKRF´ HYDOXDWLRQ RI WKHLU UHVHDUFK
SXEOLVKLQJ LGHDV ZLWK OLWWOH RU QR VFLHQWLILF DVVHVVPHQW )HQWRQ HW DO  *ODVV  

±±
',6&866,21$1',03/,&$7,216

)XUWKHUPRUHSRRUWKHRU\GHYHORSPHQWDQGLQDGHTXDWHPHDVXUHPHQWRIFRQVWUXFWVVHHPVWREH
WKHQRUPIRUPRVWVWXGLHVLQ63, '\EnD $GGLWLRQDOO\PRVWRIWKHUHVHDUFKGRQHVRIDU
LVIDLOLQJWRLQIOXHQFH LQGXVWULDO SUDFWLFH 3RWWV   7KH UHVXOW RI WKLV QHJOLJHQFH RI ERWK
ULJRUDQGUHOHYDQFHLVZKDW*ODVV  WHUPHGWKH³VRIWZDUHUHVHDUFKFULVLV´
$V ZH VDZ LQ &KDSWHU  (6( UHVHDUFK VHHNV WR DGGUHVV WKLV FULVLV E\ HQFRXUDJLQJ D
VWURQJHUHPSKDVLVRQPHWKRGRORJLFDOULJRU7KLVLVLPSRUWDQWVLQFHULJRULVDQHFHVVDU\EDVLV
LQ DQ\ UHVHDUFK WKDW SXUSRUWV WR EH UHOHYDQW :LWKRXW ULJRU DOO ZH KDYH LV MXVW ³DQDO\WLFDO
DGYRFDF\UHVHDUFK´+RZHYHUWUHDWLQJ(6(DVDQDWXUDOSURFHVVUDWKHUWKDQDVRFLDOSURFHVV
DVLVWRRRIWHQGRQH WKHUH LV D GDQJHU WKDW ZH DUH ORRNLQJ DW LW LQ WKH ZURQJ ZD\ 3IOHHJHU
D ,WLVWKHUHIRUHDSUHVVLQJQHHGWRDYRLGWKDW(6(UHVHDUFKEHFRPHVDQ,YRU\7RZHU
DFWLYLW\ ZLWK DQ HPSKDVLV RQ ULJRU RYHU UHOHYDQFH WR SUDFWLFH $V DQ H[DPSOH RI VXFK D
JURZLQJDZDUHQHVVWKHILUVWHGLWLRQRI)HQWRQ¶V  ERRN6RIWZDUH0HWULFVKDGWKHVXEWLWOH
$5LJRURXV$SSURDFK,QWKHVHFRQGHGLWLRQ )HQWRQDQG3IOHHJHU WKHULJRURXVIUDPH
ZRUN ZDV VWLOO VWUHVVHG EXW WKH HPSKDVLV ZDV QRZ PRUH RQ LWV SUDFWLFDO DSSOLFDWLRQ ZKLFK
ZDVUHIOHFWHGE\WKHFKDQJHLQWKHVXEWLWOHRIWKHERRNWR$5LJRURXVDQG3UDFWLFDO$SSURDFK
6R ZKLOH ULJRU LV D QHFHVVDU\ FRQGLWLRQ IRU UHOHYDQW (6( UHVHDUFK LW LV QRW VXIILFLHQW
5HOHYDQWUHVHDUFKPXVWDOVREHJURXQGHGLQLQGXVWULDOSURMHFWVLQRUGHUWRGHYHORSDSUDJPDWLF
³LQGXVWU\DVODERUDWRU\´DSSURDFKWKDWQDUURZVWKHJXOIEHWZHHQUHVHDUFKDQGSUDFWLFH 3RWWV
  $PRQJ RWKHU WKLQJV WKLV PHDQV DV ZH KDYH VHHQ WKURXJKRXW WKLV WKHVLV D JUHDWHU
HPSKDVLVRQRUJDQL]DWLRQDOFRQWH[W)DLOXUHWRLQFOXGHVXFKRUJDQL]DWLRQDOLVVXHVPD\H[SODLQ
VRPH RI WKH LQDGHTXDF\ DQG GLVVDWLVIDFWLRQ ZLWK WKH H[LVWLQJ PRGHOEDVHG 63, DSSURDFKHV
WKH\ GR QRW DGGUHVV UHDO RUJDQL]DWLRQV 7KXV WR PDNH 63, UHVHDUFK UHOHYDQW UHVHDUFKHUV
VKRXOG FROODERUDWH ZLWK SUDFWLWLRQHUV LQ UHDO VLWXDWLRQV DQG UHDO RUJDQL]DWLRQV LGHQWLI\LQJ
UHOHYDQWSUREOHPVWKURXJKFORVHLQYROYHPHQWZLWKLQGXVWULDOSURMHFWV
7KHFDVHVWXGLHVLQ7(/0(763,4DQG352),7ZHUHRUJDQL]HGDFFRUGLQJWRWKH(66,
3,(PRGHO VHH'\EnG ZKLFKE\QRZLVDZHOOSURYHQLQGXVWU\DVODERUDWRU\DSSURDFK
WR63,)XUWKHUPRUHLWLVLPSRUWDQWWRQRWHWKDWLQWKLVPRGHOWKHUHVHDUFKHULVQRWDQHXWUDO
REVHUYHUGHWDFKHGIURPSUDFWLFHDVZRXOGKDYHEHHQWKHFDVHLQDUHVHDUFKDSSURDFKEDVHG
SXUHO\RQSRVLWLYLVP $V ZH VDZ LQ6HFWLRQ  SRVLWLYLVW UHVHDUFK HPSKDVL]HV WKH ULJRURXV
VWXG\ RI REMHFWV ZLWKRXW LQIOXHQFLQJ WKHP ,Q LQGXVWULDO 63, UHVHDUFK SURJUDPV DV LQ WKH
SUHVHQWLQYHVWLJDWLRQKRZHYHUDQLPSRUWDQWSDUWRIWKHLQGXVWU\¶VPRWLYDWLRQWRSDUWLFLSDWHLV
WKDWWKH UHVHDUFKHUV DFWLYHO\ SDUWLFLSDWH ZLWK UHOHYDQW NQRZOHGJH DQG H[SHULHQFH WR KHOS WKH
RUJDQL]DWLRQV¶LPSURYHWKHPVHOYHV
$Q LPSRUWDQW LPSOLFDWLRQ RI WKLV LQYHVWLJDWLRQ WKHUHIRUH LV WKH UHDOL]DWLRQ WKDW DFWLRQ
UHVHDUFKLVSDUWLFXODUO\ZHOOVXLWHGDVDQDSSURDFKWRV\QWKHVL]HULJRUDQGUHOHYDQFHDQGWR
DGYDQFH WKH PHWKRGRORJLFDO EDVLV IRU 63, 7KHUH DUH VHYHUDO UHDVRQV IRU WKLV DV ZH VDZ LQ
&KDSWHUEXWWKHPRVWLPSRUWDQWLVWKDWDFWLRQUHVHDUFKLVXQLTXHLQWKHZD\LWDVVRFLDWHVUH
VHDUFKDQGSUDFWLFHVRUHVHDUFKLQIRUPVSUDFWLFHDQGSUDFWLFHLQIRUPVUHVHDUFKV\QHUJLVWLFDOO\

 7KHFRQYHUJHQFH²GLYHUJHQFHQH[XV
$VZHVDZLQ&KDSWHUWKHUDWLRQDOHEHKLQGEHVWSUDFWLFHDSSURDFKHVWR63,LVWKH³FRQYHU
JHQFHK\SRWKHVLV´ 0LQW]EHUJ RIWKH³RQHEHVWZD\´6XFKFRQYHUJHQWWKLQNLQJLVDOVR
IRXQGLQWKHHQJLQHHULQJWUDGLWLRQVRIGHGXFWLYHUHDVRQLQJZKLFKLVSULPDULO\RFFXSLHGZLWK
ILQGLQJWKHVROXWLRQWRDFRQYHUJHQWSUREOHP+RZHYHULQGLYLGXDOVWHDPVDQGRUJDQL]DWLRQDO
FXOWXUHVDUHDOOGLIIHUHQW$QG DVZHKDYHDOUHDG\VHHQ VHH6HFWLRQ VPDOOVXFFHVVIXO

±±
&+$37(5

RUJDQL]DWLRQV KDYH FDSLWDOL]HG RQ WKLV GLYHUVLW\ DQG WXUQHG LW WR WKHLU DGYDQWDJH 7KHUHIRUH
ZKHQSURSHUO\XQGHUVWRRGDQGLPDJLQDWLYHO\DGGUHVVHGGLYHUVLW\RIIHUVRSSRUWXQLWLHVIRUGH
YHORSLQJEHWWHUVRIWZDUHSUDFWLFHVDQGLPSURYLQJWKHFRPSHWLWLYHHGJH,JQRULQJLWKRZHYHU
FDQUHVXOWLQFRQIOLFWGLVUXSWLRQDQG FRPSURPLVHGSHUIRUPDQFH7KXVRXUILQGLQJV VXJJHVW
WKDW WR EH VXFFHVVIXO LQ 63, ZH QHHG WR ORRN EH\RQG WKH FRQYHUJHQFH K\SRWKHVLV WR EUHDN
DZD\IURPROGURXWLQHVDQGVWDQGDUGVUDWKHUWKDQSHUIHFWLQJH[LVWLQJRQHV
&RQWUDU\ WR FRQYHUJHQW SUREOHPV GLYHUJHQW SUREOHPV KDYH QR ³FRUUHFW´ VROXWLRQ ± QR
PDWWHU KRZ PXFK ZH VWXG\ WKHP 6FKXPDFKHU   ,W LV LPSRUWDQW WR UHDOL]H WKLV VLQFH
GLYHUJHQWSUREOHPVDUHQRWFRQYHUJHQWSUREOHPVWKDWKDYHQRW \HWEHHQVROYHG 5DWKHU WKH\
DUH SUREOHPV IRU ZKLFK WKHUH LV QR VLQJOH EHVW VROXWLRQ ,Q RXU H[SHULHQFH PRVW LI QRW DOO
SUREOHPVLQ63, DUH GLYHUJHQW DV IRU H[DPSOH ³+RZ GR ZH EHVW LPSURYH RXU GHYHORSPHQW
SURFHVV"´ ³:KDW QHZ SURGXFWV VKRXOG ZH GHYHORS"´ ³+RZ FDQ ZH EHVW VDWLVI\ RXU
FXVWRPHUV"´7RGHDOZLWKWKHVHSUREOHPVVRIWZDUHRUJDQL]DWLRQVDQG63,UHVHDUFKHUVQHHGWR
DFNQRZOHGJH WKDW D ³RQHVL]HILWVDOO´ DSSURDFK GRHVQ¶W ZRUN LQ VRIWZDUH GHYHORSPHQW DQG
WKDWZHVKRXOGSD\PRUHDWWHQWLRQVWRORFDOQHHGVDQGVSHFLILFVLWXDWLRQV
7KH GDQJHU RI FRQYHUJHQW WKLQNLQJ LV WKDW LW HDVLO\ PD\ WXUQ 63, PHWKRGV DQG ³EHVW
SUDFWLFHV´ LQWR D 3URFUXVWHDQ EHG ,Q *UHHN P\WK 3URFUXVWHV RIIHUHG KRVSLWDOLW\ WR SDVVLQJ
VWUDQJHUV ZKR ZHUH LQYLWHG LQ IRU D SOHDVDQW PHDO DQG D QLJKW¶V UHVW LQ KLV EHG 3URFUXVWHV
GHVFULEHGKLVEHGDVKDYLQJWKHXQLTXHSURSHUW\WKDWLWVOHQJWKH[DFWO\PDWFKHGZKRPVRHYHU
OD\GRZQXSRQLW:KDWKHGLGQ¶WYROXQWHHUZDVWKHPHWKRGE\ZKLFKWKLV³RQHVL]HILWVDOO´
ZDVDFKLHYHGDVKRUWJXHVWZDVUDFNHG DQGVWUHWFKHGE\3URFUXVWHVXQWLOKHILWDWDOO JXHVW
ZKRVHKHDGRUOLPEVGDQJOHGRIIWKHHQGRIWKHEHGKDGWKHRYHUODSFKRSSHGRII
7KLV GRHVQ¶W PHDQ WKDW ZH VKRXOG DEDQGRQ FRQYHUJHQW WKLQNLQJ ± ERWK FRQYHUJHQW DQG
GLYHUJHQWWKLQNLQJLVQHHGHG:KLOHGLYHUJHQWWKLQNLQJLVHVVHQWLDOIRUJHQHUDWLQJDZLGHUDQJH
RILGHDVDQGVHHLQJQHZSDWWHUQVLQVLWXDWLRQVFRQYHUJHQWWKLQNLQJLVQHFHVVDU\WRVHOHFWDQG
HYDOXDWH WKH PRVW XVHIXO RI WKH SRVVLEOH VROXWLRQV :KHQ GLYHUJHQW WKLQNHUV SUHIHU WR VSHQG
PRUHWLPHIRUPXODWLQJWKHSUREOHPDQGH[SORULQJFUHDWLYHLGHDVFRQYHUJHQWWKLQNHUVDUHPRUH
FRQFHUQHG DERXW JHWWLQJ D VROXWLRQ XQGHU ZD\ 7KXV WR EH DEOH WR WDNH SXUSRVHIXO DFWLRQV
VRIWZDUH RUJDQL]DWLRQV DQG 63, UHVHDUFKHUV DOLNH VKRXOG ILQG WKH ULJKW EDODQFH EHWZHHQ
GLYHUJHQWDQGFRQYHUJHQWWKLQNLQJLQWKHLULPSURYHPHQWPHWKRGV

)DFW 3UREOHP ,GHD 6ROXWLRQ $FFHSWDQFH


1
ILQGLQJ ILQGLQJ ILQGLQJ ILQGLQJ ILQGLQJ
(
:

$ &
3UREOHP &
+
2SSRUWXQLW\ 7 $
&KDOOHQJH ,
/
2
/
1 (
1
*
(

)LJXUH7KH2VERUQ3DUQHVILYHVWDJHFUHDWLYHSURFHVVPRGHO 3DUQHV 

±±
',6&866,21$1',03/,&$7,216

7KLVLVDFKDOOHQJHQRWRQO\IRUVRIWZDUHRUJDQL]DWLRQVEXWIRUDFDGHPLDDVZHOOVLQFHLQ
RXU H[SHULHQFH WKH VRIWZDUH HQJLQHHULQJ HGXFDWLRQ HPSKDVL]HV DQDO\WLFDO MXGJHPHQW DQG
FRQYHUJHQFH DW WKH H[SHQVH RI GLYHUJHQW WKLQNLQJ 7KHUHIRUH LI FUHDWLYLW\ LQ VRIWZDUH
GHYHORSPHQW DQG 63, LV WR EH IRVWHUHG PRUH HPSKDVLV RQ WKH GLYHUJHQW SURFHVV DQG WKH
LQWHUGHSHQGHQFHRIGLYHUJHQWDQGFRQYHUJHQWWKLQNLQJ LV QHHGHG 7KLV ZDV DOVR WKH PHVVDJH
EHKLQG WKH -XO\$XJXVW  VSHFLDO LVVXH RI ,((( 6RIWZDUH RQ GLYHUVLW\ DQG LQ +RZDUG¶V
 DQDO\VLVRIVRIWZDUHHQJLQHHULQJSURMHFWPDQDJHPHQW)XUWKHUPRUHLQV\VWHPVWKHRU\
WKHSULQFLSOHRIUHTXLVLWHYDULHW\ $VKE\ VXJJHVWVWKDWWKHLQWHUQDOFRQWUROPHFKDQLVPV
RIDVRFLDOV\VWHPPXVWEHDVYDULHGDVWKHHQYLURQPHQWLQZKLFKLWLVWU\LQJWRVXUYLYH7KLV
ZD\LWFDQGHDOZLWKWKHFRPSOH[LW\DQGFKDOOHQJHVRILWVHQYLURQPHQW
,Q &KDSWHU  ZH UHSRUWHG RQ WKH HIIHFWLYHQHVV RI FUHDWLYLW\ WHFKQLTXHV VXFK DV WKH .-
0HWKRG DQG 0LQG 0DSV LQ JHQHUDWLQJ QHZ RUJDQL]DWLRQDO NQRZOHGJH 7KHVH WHFKQLTXHV DV
PRVWSUREOHPVROYLQJWHFKQLTXHVDUHEDVHGRQWKHXQGHUO\LQJSKLORVRSK\RI2VERUQ¶V 
³EUDLQVWRUPLQJ´ WHFKQLTXH &RPPRQ WR WKHVH WHFKQLTXHV LV WKHLU IRFXV RQ WKH GLDOHFWLF
LQWHUSOD\ RI GLYHUJHQW DQG FRQYHUJHQW DFWLYLWLHV LQ WKH SUREOHPVROYLQJ SURFHVV $ SUREOHP
VROYLQJPRGHOWKDWLQFRUSRUDWHVERWKGLYHUJHQWDQGFRQYHUJHQWWKLQNLQJVKRXOGWKHUHIRUHEH
RI PHWKRGRORJLFDO LQWHUHVW IRU DQ\RQH SXUSRUWLQJ WR KHOS VRIWZDUH RUJDQL]DWLRQV WDNLQJ
SXUSRVHIXODFWLRQVWRZDUGLPSURYHPHQWVLQWKHLUGHYHORSPHQWSURFHVVHV )LJXUH 

 7KHSURFHVV²SUDFWLFHQH[XV
$ JHQHUDO REVHUYDWLRQ IURP WKLV VWXG\ KDV EHHQ WKDW PDQ\ VRIWZDUH RUJDQL]DWLRQV KDYH
GRFXPHQWHG WKHLU ³EHVW SUDFWLFHV´ DV IRUPDO SURFHGXUHV SURFHVV PRGHOV JXLGHOLQHV UXOHV
FKHFNOLVWVHWFLQRUGHUWRPDQDJHDQGLPSURYHWKHLUVRIWZDUHSURFHVVHV VHHHJ6HFWLRQ 
7KLV LV LQ DFFRUGDQFH ZLWK WKH SUHYDLOLQJ YLHZ WKDW IRUPDOO\ GHILQLQJ WKH VRIWZDUH SURFHVV
³FUHDWHV WKH GLVFLSOLQHG DQG VWUXFWXUHG HQYLURQPHQW UHTXLUHG IRU FRQWUROOLQJ DQG LPSURYLQJ
WKHSURFHVV´ )ORUDFDQG&DUOHWRQS 
+RZHYHULIZHVWHSEDFNORRNLQJDWWKHUXOHVXQGHUO\LQJDVRIWZDUHJURXS¶VDFWLRQVZH
ILQGWKDWWKHUHLVDQLPSRUWDQWDV\PPHWU\EHWZHHQWKHUXOHVDVUHSUHVHQWHGE\SURFHVVPRGHOV
DQGIRUPDOSURFHGXUHVDQGWKHUXOHVDVJXLGHVLQSUDFWLFH7KHODWWHUFDQEHYLHZHGLQWHUPVRI
WKH ODZ RI UHTXLVLWH YDULHW\ $VKE\   D SUDFWLFH LV DOZD\V ULFKHU WKDQ DQ\ IRUPDO
UHSUHVHQWDWLRQRILW$OVRWLPHUHODWHGDVSHFWVDGGWRWKLVULFKQHVVMXVWOLNHWKHH[SHULHQFHRI
GULYLQJWKURXJKDQDUHDFDQQRWEHFDSWXUHGE\DPDS7KLVULFKQHVVRIH[SHULHQFHDVVRFLDWHG
ZLWKWKHVRFLDOQDWXUHRIVRIWZDUHGHYHORSPHQWLVZK\ZHDWDQ\SRLQWLQWLPHFDQQRWRIIHUD
FRPSUHKHQVLYHGHVFULSWLRQRILWVSUDFWLFH:KDWVRIWZDUHGHYHORSPHQWLVDWDQ\SRLQWLQWLPH
GHSHQGV RQ KRZ WKH VRIWZDUH GHYHORSHUV PDNH VHQVH RI LW DQG LQWHUSUHWV LW WR EH 7KXV
VRIWZDUH GHYHORSPHQW LV LQKHUHQWO\ G\QDPLF LQGHWHUPLQDWH DQG FKDRWLF +\PDQ 
.HOVH\.UDXWDQG6WUHHWHU5D\PRQG 
6XFK LQGHWHUPLQDF\ RI VRFLDO SUDFWLFH KDV DOVR EHHQ ULFKO\ LOOXVWUDWHG E\ 2UU¶V 
HWKQRJUDSKLFVWXG\ RI SKRWRFRS\ UHSDLU WHFKQLFLDQV DW ;HUR[ +H VWXGLHG ZKDW UHSV DFWXDOO\
GLG QRW ZKDW WKH\ ZHUH DVVXPHG WR GR $QG DV LQ WKH FDVH RI WKH UHSV ZKDW VRIWZDUH
GHYHORSHUVDFWXDOO\GRWXUQVRXWWREHTXLWHGLIIHUHQWIURPWKHGHILQHGSURFHVV7KLVVXJJHVWV
WKDWRQHVL]HGRHVQRWILWDOOZKHQLWFRPHVWRVRIWZDUHWHDPVDQGWKHLUXQLTXHQHHGV
2XU UHVXOWV VXSSRUW %URZQ DQG 'XJXLG¶V   SHUVSHFWLYH RQ OHDUQLQJLQZRUNLQJ
ZKLFK VXJJHVWV WKDW VRIWZDUH SURFHVVHV DUH OLNHO\ WR EH LQHIIHFWLYH LI EDVHG RQ ³FDQRQLFDO´
UDWKHU WKDQ ³QRQFDQRQLFDO´ SUDFWLFH ,W LV QRW VXUSULVLQJ WKHUHIRUH WKDW ³VRFLDOL]DWLRQ´ DQG

±±
&+$37(5

³GLVFXVVLRQ JURXSV´ ZHUH DPRQJ WKH KLJKHVW UDQNHG DOWHUQDWLYHV WR IRUPDO URXWLQHV VHH
6HFWLRQ 7KLVLVDOVRLQDJUHHPHQWZLWK%URZQDQG'XJXLG¶V  ILQGLQJWKDW³VWRU\
WHOOLQJ´ LV RI XWPRVW LPSRUWDQFH IRU GHDOLQJ ZLWK WKH FRPSOH[LWLHV RI GD\WRGD\ SUDFWLFH
PXFK OLNH =XERII   GHVFULEHG VWRU\ WHOOLQJ DV D SUDFWLFH IRU GHDOLQJ ZLWK ³VPDUW´ PD
FKLQHV
7KXVFRQWUDU\WRWKHULJLGLWLHVRIIRUPDOSURFHVVHVVWRULHVDQGWKHWDFLWVRFLDO SUDFWLFHV
ZHUHVHHQDVPRUHIOH[LEOHDGDSWDEOHDQGUHOHYDQWE\WKHVRIWZDUHGHYHORSHUVLQRXUVWXG\
$FFRUGLQJO\ WKHUH LV DQ LQKHUHQW GLOHPPD RI EDODQFLQJ WKH WHQVLRQ EHWZHHQ IRUPDO SURFHVV
DQGWKHLQIRUPDOVRFLDOSUDFWLFHIRUDQ\RQHHQJDJHGLQ63,DQGLQGHYHORSLQJ63,PHWKRGV
7KLVWHQVLRQEHWZHHQWKHIRUPDODQGLQIRUPDOLQVRIWZDUHGHYHORSPHQWKDVDOVREHHQQRWHGE\
HJ)LW]JHUDOG*ODVV:DVWHOO 
:KLOHIRUPDOSURFHVVGHVFULSWLRQVDUHXVHIXOIRUVLPSOHURXWLQHZRUNWKH\RIWHQ IDLOLQ
WKH IDFH RI WXUEXOHQFH DQG XQFHUWDLQW\ ZKLFK W\SLILHV PRVW VRIWZDUH GHYHORSPHQW ,Q VXFK
VLWXDWLRQVZHFDQQRWXVHDIRUPDOSURFHVVVLPSO\EHFDXVHZHGRQ¶WNQRZZKDWWRGR,QGHHG
DVZHDUJXHGLQ &KDSWHU  ZH OHDUQ ZKDW WR GR DQG WKH ZD\V RI GHDOLQJ ZLWK LW GXULQJ WKH
DFWXDO FRXUVH RI WKH SURMHFW 7KLV VXJJHVWV WKDW LPSURYLVDWLRQ LV FHQWUDO LQ EULGJLQJ WKH JDS
EHWZHHQSURFHVVDQGSUDFWLFHDQGWKDWWKRVHZKRGRWKHZRUNVKRXOGEHFHQWUDOLQGHVLJQLQJ
WKHSURFHVV
7KXVWREHVXFFHVVIXORXUILQGLQJV HJ&DVH& VXJJHVWWKDWIRUPDOSURFHVVHVPXVWEH
VXSSOHPHQWHG ZLWK LQIRUPDO LQWHUSHUVRQDO FRRUGLQDWLRQ DERXW SUDFWLFH 7KLV LV FRQVLVWHQW
ZLWK .UDXW DQG 6WUHHWHU¶V   FRQFOXVLRQV RQ WKH VXEMHFW RI FRRUGLQDWLRQ LQ VRIWZDUH
GHYHORSPHQW ´3URFHVV DQG SUDFWLFH WKHQ GR QRW UHSUHVHQW ULYDO YLHZV RI WKH RUJDQL]DWLRQ
5DWKHUWKH\UHIOHFWWKHFUHDWLYHWHQVLRQDWWKHFHQWHURILQQRYDWLYHRUJDQL]DWLRQV´ %URZQDQG
'XJXLGDS $OVRDQGLQDFFRUGDQFHZLWK$GOHUDQG%RU\V¶V  GLVFXVVLRQRI
³HQDEOLQJ´ DQG ³FRHUFLYH´ EXUHDXFUDFLHV RXU ILQGLQJV VXJJHVW WKH LPSRUWDQFH RI VRIWZDUH
SURFHVVHVRIWKHHQDEOLQJW\SH VHH&RQUDGLDQG'\En'\EnE 
)XUWKHUPRUH WKH LQKHUHQW ODFN RI FRQIRUPDQFH EHWZHHQ IRUPDO SURFHVV DQG LQIRUPDO
SUDFWLFHLVDQHFHVVDU\IHDWXUHVRWKDWWKHVRIWZDUHRUJDQL]DWLRQPD\OHDUQIURPLWVWKHRULHVRI
DFWLRQ 'HHSHU VHFRQGRUGHU RU GRXEOHORRS OHDUQLQJ QRW RQO\ UHTXLUHV WKDW WKH VRIWZDUH
RUJDQL]DWLRQWDNHVDFWLRQVWRFRUUHFWHUURUVEXWDOVRWKDWLWFULWLFDOO\UHH[DPLQHVWKHYDOLGLW\RI
LWV EDVLF QRUPV DQG DVVXPSWLRQV DQG DV D UHVXOW LV SUHSDUHG WR PRGLI\ H[LVWLQJ VWUDWHJLHV
7KXVLQWKHH[WUHPHFDVHRIFRPSOHWHSURFHVVFRQIRUPDQFHOHDUQLQJDQGKHQFH63,ZRXOG
QRWEHSRVVLEOH VHH)LJXUH 
5DWKHUWKDQGHWDLOHGSURFHVVGHVFULSWLRQVWKLVVXJJHVWVWKDWVRIWZDUHSURFHVVHVVKRXOGEH
GHVFULEHGDFFRUGLQJWRWKH³UXOHRIELIXUFDWLRQ´ $UPRXU VXSSRUWLQJGLIIHUHQWGHJUHHV
RI IRUPDOLW\ ,H WKH\ FRXOG EH VWDWHG LQ WHUPV RI WZR OHYHOV D JHQHUDO GHVFULSWLRQ RI WKH
SURFHVV VXSSOHPHQWHG E\ VSHFLILF H[DPSOHV IURP SUDFWLFH /LNH WKH WDOH RI WKH VLWDU SOD\HU
DVNLQJ %XGGKDKRZ EHVW WR WXQH KLV LQVWUXPHQW WKHUHIRUH ZH ILQG WKH IDPRXV DQVZHU ³QRW
WRRWLJKWDQGQRWWRRORRVH´DVDJRRGJHQHUDOUXOHIRUEDODQFLQJIRUPDOSURFHVVZLWKLQIRUPDO
SUDFWLFH

±±
',6&866,21$1',03/,&$7,216

 ,PSOLFDWLRQVIRU3UDFWLFH
,Q WKLV VHFWLRQ ZH SUHVHQW D VHW RI HQDEOLQJ FRQGLWLRQV RU JXLGHOLQHV WKDW SUDFWLWLRQHUV FDQ
DGRSWWRLPSOHPHQWDVXFFHVVIXO63,SURJUDPLQWKHLURUJDQL]DWLRQV:HGRQRWSURPLVHWKDW
WKLVLQYROYHVDVWUDLJKWIRUZDUG DQG VLPSOLVWLF SURFHVV +RZHYHU WKH JXLGHOLQHV RIIHUHG KDYH
JURZQRXWRIRXU HPSLULFDO LQYHVWLJDWLRQV WKXV JXDUDQWHHLQJ WKDW WKH\ DUH JURXQGHG LQ WKH
³UHDO´ZRUOG)LUVW ZH RIIHU VRPH JXLGHOLQHV IRU EXLOGLQJ D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ
1H[WZHVXJJHVWDSHUIRUPDQFHPDQDJHPHQWPRGHOIRU63,)LQDOO\ZHRIIHUVRPHVSHFLILF
DGYLFHIRUPDQDJHUVDQGGHYHORSHUVLQVRIWZDUHRUJDQL]DWLRQVWKDWZDQWWKHLURUJDQL]DWLRQVWR
H[FHO

 %XLOGLQJDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ
$V RXU LQYHVWLJDWLRQV KDYH VKRZQ OHDUQLQJ LV QRW RQO\ FHQWUDO WR WKH DFWLYLWLHV RI VRIWZDUH
GHYHORSPHQW LW LV WKH VLQH TXD QRQ RI VRIWZDUH SURFHVV LPSURYHPHQW 7KXV D PDMRU
LPSOLFDWLRQ IRU SUDFWLFH LV WR XWLOL]H WKH LQVLJKWV JDLQHG IURP WKHVH LQYHVWLJDWLRQV WR EXLOG D
OHDUQLQJVRIWZDUHRUJDQL]DWLRQ%DVHGRQWKHUHVXOWVIURPWKLVVWXG\WKHUHIRUHZHVXJJHVWWKH
IROORZLQJVHYHQHVVHQWLDOJXLGHOLQHVIRUEXLOGLQJDOHDUQLQJVRIWZDUHRUJDQL]DWLRQ

 6KDUH NQRZOHGJH DQG H[SHULHQFH .QRZOHGJH DQG H[SHULHQFH DUH DPRQJ WKH SULPDU\
SUHFRQGLWLRQVIRUVXFFHVVIXO63,6RIWZDUHFRPSDQLHVWKDWZDQWWRVXFFHHGZLWK63,PXVW
OHDUQWRYDOXHWUXVWDQGUHO\RQWKHFROOHFWLYHLQVLJKWVRIWKHLUSHRSOHWRFUHDWHDOHDUQLQJ
VRIWZDUHRUJDQL]DWLRQ0RUHLPSRUWDQWO\WKHRUJDQL]DWLRQVKRXOGHQDEOH63,E\FUHDWLQJ
DFRQWH[WLQZKLFKWKHVKDULQJRINQRZOHGJHDQGH[SHULHQFHLVYDOXHG7KLVSUHVXSSRVHVD
V\VWHP RI RUJDQL]DWLRQZLGH VKDULQJ ± DQ RUJDQL]DWLRQDO PHPRU\ )XUWKHUPRUH LW SUH
VXSSRVHVDV\VWHPRILQFHQWLYHVVRWKDWWKHPHPEHUVRIWKHRUJDQL]DWLRQFDQEXLOGVRFLDO
FDSLWDOE\VKDULQJWKHLUNQRZOHGJHDQGH[SHULHQFH
8S XQWLO QRZ VRIWZDUH RUJDQL]DWLRQV KDYH EHHQ DGYLVHG WR SRSXODWH WKHLU H[SHULHQFH
EDVHV ZLWK ODUJH DPRXQWV RI H[SOLFLWO\ DYDLODEOH NQRZOHGJH VXFK DV TXDQWLILDEOH IDFWV
IRUPXODV URXWLQHV DQG SURFHGXUHV :KLOH WKLV LV VWLOO LPSRUWDQW WKH IXWXUH OHDUQLQJ
VRIWZDUH RUJDQL]DWLRQV PXVW FUHDWH HQYLURQPHQWV ZKHUH H[SHULHQWLDO NQRZOHGJH FDQ EH
VKDUHGWKURXJKGLDORJXHDQGLQWHUDFWLRQ7KHUHLVWKXVDQHHGWRDFNQRZOHGJHKRZWDFLW
NQRZOHGJHVXSSRUWVTXDQWLILDEOHGDWDWKHUHE\SURYLGLQJWKHVRIWZDUHRUJDQL]DWLRQZLWKD
PRUHFRPSOHWHVLWXDWHGOHDUQLQJV\VWHP
 6XSSRUWLQQRYDWLRQDQGFUHDWLYLW\$ORQJZLWKNQRZOHGJHDQGH[SHULHQFHVXFFHVVIXO63,
GHSHQGVRQLQQRYDWLRQDQGFUHDWLYLW\7KHVHFKDUDFWHULVWLFVUHTXLUHDQRUJDQL]DWLRQDOFXO
WXUHWKDWFRQWLQXDOO\TXHVWLRQVDQGWHVWVWKHRUJDQL]DWLRQVVKDUHGEHOLHIVDQGDVVXPSWLRQV
7KH\ FDOO IRU DQ HQYLURQPHQW WKDW DFWLYHO\ VXSSRUWV H[SHULPHQWDWLRQ ULVNWDNLQJ DQG
IDLOXUH
/LNH&VLNV]HQWPLKDO\L  IRXQGWKDWOXFNZDVWKHPRVWRIWHQPHQWLRQHGUHDVRQIRU
VXFFHVVIXO FUHDWLYLW\ VR WRR DUH VRIWZDUH RUJDQL]DWLRQV EHJLQQLQJ WR DFNQRZOHGJH WKDW
PDQ\ RI WKHLU VXFFHVVHV ZHUH WKH UHVXOW RI SURELQJ DQG OHDUQLQJ UDWKHU WKDQ EULOOLDQW
IRUHVLJKW7KHGHULYDWLRQRI0¶V3RVWLW1RWHVLVDFODVVLFWDOHRIVXFKDFFLGHQWDOVXFFHVV
DQGDJRRGLOOXVWUDWLRQRIKRZWKHLQQRYDWLYHFDSDFLW\RIDILUPGHSHQGVRQLWVPHPEHUV¶
HIIRUWVWRDOOHYLDWHWHQVLRQVEHWZHHQH[SORLWDWLRQRIH[LVWLQJNQRZOHGJHZLWKH[SORUDWLRQ
RIQHZNQRZOHGJH

±±
&+$37(5

 6LWXDWHOHDUQLQJLQUHDOZRUN0DQ\RUJDQL]DWLRQVYLHZOHDUQLQJDVDVWDQGDORQHDFWLYLW\
VHSDUDWHIURPGDLO\ZRUN(PSOR\HHVDUHWUDLQHGDZD\IURPWKHLUZRUNSODFHDQGWKHQDUH
DVVXPHG WR SHUIRUP WKHLU MREV DFFRUGLQJ WR WKH SURFHGXUHV OHDUQHG GXULQJ WUDLQLQJ
+RZHYHU VRIWZDUH GHYHORSPHQW LV WKH FRUH SURFHVV IRU NQRZOHGJH DQG H[SHULHQFH
VKDULQJLQQRYDWLRQDQGFUHDWLYLW\LQDVRIWZDUHRUJDQL]DWLRQ+RZZHOOWKHRUJDQL]DWLRQ
PDQDJHV LWV GHYHORSPHQW SURFHVV LV WKHUHIRUH D FULWLFDO IDFWRU LQ GHWHUPLQLQJ KRZ
VXFFHVVIXOLWVRUJDQL]DWLRQDOOHDUQLQJDQG63,DFWLYLWLHVFDQEHFDUULHGRXW
7KHRUJDQL]DWLRQ¶VFRUHFRPSHWHQFHLVPRUHWKDQWKHH[SOLFLW³NQRZZKDW´WKDWFDQEH
VKDUHGE\VHYHUDO$VRIWZDUHRUJDQL]DWLRQ¶VFRUHFRPSHWHQFHUHTXLUHVWKHPRUH HOXVLYH
³NQRZKRZ´ 5\OH ±WKHSDUWLFXODUDELOLW\WRSXWNQRZZKDWLQWRSUDFWLFH,WLVWKLV
NQRZKRZZKLFKLVHPEHGGHGLQWKHRUJDQL]DWLRQ¶VFROOHFWLYHZRUNSUDFWLFHVWKDWLVNH\
WRRUJDQL]DWLRQDOOHDUQLQJDQG63,7KXVGHYHORSHUVOHDUQDVWKH\ZRUNDQGWKHVRIWZDUH
RUJDQL]DWLRQOHDUQVIURPWKHFROOHFWLYHH[SHULHQFHRILWVGHYHORSHUV
 /DXQFK VHOIRUJDQL]LQJ WHDPV .QRZOHGJH DQG H[SHULHQFH VKDULQJ LQQRYDWLRQ DQG
FUHDWLYLW\WKULYHEHVWLQVPDOOJURXSVZKHUHSHRSOHFDQLQWHUDFWIUHHO\$IHZLQGLYLGXDOV
ZLWK QHZ LGHDV DQG FUHDWLYH WKRXJKWV DUH QRW HQRXJK IRU EXLOGLQJ D OHDUQLQJ VRIWZDUH
RUJDQL]DWLRQ7KXVWKHVRIWZDUHRUJDQL]DWLRQPXVWHQFRXUDJHFRPPXQLFDWLRQFRRUGLQD
WLRQDQGFROODERUDWLRQZLWKLQDQGEHWZHHQVRIWZDUHWHDPVHQVXULQJWKDWWKH\DUHIOH[LEOH
HQRXJKWRIRUPFKDQJHDQGGLVVROYHDVQHHGHG
6RIWZDUHWHDPVVKRXOGEHSURYLGHGZLWKHQRXJKDXWRQRP\WKDWWKH\FDQDFWRQZKDW
WKH\REVHUYH DQG OHDUQ ZLWK HQRXJK FRRUGLQDWLRQ WKDW WKHLU ORFDO DFWLRQV ZRUN WRJHWKHU
WRZDUG WKH RUJDQL]DWLRQ¶V FRUH YDOXHV UDWKHU WKDQ SURGXFLQJ VXERSWLPL]DWLRQV 7KH
FRRUGLQDWLRQ EHWZHHQ VXFK WHDPV LV DFKLHYHG WKURXJK WKH RUJDQL]DWLRQ¶V PHPRU\ E\
FROOHFWLYHO\JHQHUDWLQJDQGLQWHUSUHWLQJNQRZOHGJH
7KLV DXWRQRP\ FDQ EHVW EH DFKLHYHG WKURXJK D GHFHQWUDOL]HG VWUXFWXUH WKDW PDNHV
WHDPV RU VPDOO EXVLQHVV XQLWV VHOIRUJDQL]HG DQG VHOIPDQDJHG $OVR WHDP VL]H VKRXOG
QRWEHODUJHU WKDQ ZKDW LV SUDFWLFDO IRU FRRUGLQDWLRQ E\PXWXDO DGMXVWPHQW VLQFH WKLV LV
WKH RQO\ FRRUGLQDWLRQ PHFKDQLVP WKDW FDQ KDQGOH UHDOO\ FRPSOH[ ZRUN ZLWK D ORW RI
SUREOHP VROYLQJ 0LQW]EHUJ   7KURXJK VXFK DXWRQRP\ WKH RUJDQL]DWLRQ PD\
LQFUHDVH WKH FKDQFH RI LQWURGXFLQJ ³XQH[SHFWHG RSSRUWXQLWLHV´ 1RQDND DQG 7DNHXFKL
 
 0DQDJH GLYHUVLW\ $ NH\ LQJUHGLHQW LQ VXFFHVVIXO VRIWZDUH WHDPV LV GLYHUVLW\
+RPRJHQHRXVJURXSVDQGXQLIRUPSURFHVVHVSURPRWHGE\³EHVWSUDFWLFH´PRGHOVWHQGWR
SURGXFHVLQJOHORRSOHDUQLQJ7RIRVWHULQQRYDWLRQDQGFUHDWLYLW\LWLVQHFHVVDU\WREULQJ
WRJHWKHUGLYHUVHJURXSVRISHRSOHZLWKGLIIHUHQWOHYHOVRIH[SHUWLVHDQGDEURDGVSHFWUXP
RILGHDVWRWDLORUSURFHVVHVWRPHHWVSHFLILFORFDOQHHGV
'LYHUVLW\ RI SHUVSHFWLYHV LV HVVHQWLDO WR WKH FUHDWLRQ RI QHZ FROOHFWLYH NQRZOHGJH DV
ZHOO DV WR GHYHORSLQJ QHZ SHUVSHFWLYHV RQ H[LVWLQJ NQRZOHGJH )XUWKHUPRUH VLQFH
LQGLYLGXDOV WHDPV DQG RUJDQL]DWLRQDO FXOWXUHV DUH DOO GLIIHUHQW D ³RQHVL]HILWVDOO´
DSSURDFK GRHVQ¶W ZRUN LQ VRIWZDUH GHYHORSPHQW DQG 63, 7KHUHIRUH ZKHQ SURSHUO\
XQGHUVWRRG DQG LPDJLQDWLYHO\ DGGUHVVHG GLYHUVLW\ RIIHUV RSSRUWXQLWLHV IRU GHYHORSLQJ
EHWWHUVRIWZDUHSUDFWLFHVDQGLPSURYLQJWKHFRPSHWLWLYHHGJH
 (VWDEOLVK VWURQJ FRUH YDOXHV :KLOH DXWRQRP\ DQG GLYHUVLW\ DUH LPSRUWDQW HQDEOHUV IRU
WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ WKHUH PXVW EH VRPH JURXQGLQJ HQWLW\ WKDW XQLWHV WKH
GLYHUVH DQG LQGHSHQGHQW WHDPV DQG WKHLU HIIRUWV 7UDGLWLRQDOO\ WKLV HQWLW\ KDV EHHQ

±±
',6&866,21$1',03/,&$7,216

PDQDJHULDO FRQWURO ,Q WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ WKDW HQWLW\ LV ³EXVLQHVV
RULHQWDWLRQ´RUFRUHYDOXHV7KHVHYDOXHVDOORZIRUFRRUGLQDWLRQZLWKRXWFRQWURODQGIRU
H[SHULPHQWDWLRQDQGDGDSWDWLRQZLWKRXWDQDUFK\7KHRUJDQL]DWLRQ¶VFRUHYDOXHVFUHDWHD
VHQVH RI SXUSRVH ± WKH\ HQDEOH WKH VRIWZDUH RUJDQL]DWLRQ WR IRFXV LWV DWWHQWLRQ DQG
SURYLGHDGLUHFWLRQGHVSLWHDVHHPLQJO\UDQGRPEHKDYLRU
)XUWKHUPRUH FRUH YDOXHV SURYLGH WKH PRVW LPSRUWDQW FULWHULD IRU WKH MXVWLILFDWLRQ RI
QHZRUJDQL]DWLRQDONQRZOHGJH,QWKHDEVHQFHRIVXFKFRUHYDOXHVLWZRXOGEHLPSRVVLEOH
WR GHFLGH ZKHWKHU QHZ FRQFHSWV DQG EHOLHIV DUH ZRUWK\ RI IXUWKHU DWWHQWLRQ DQG
LQYHVWPHQW 7KHUHIRUH WKH FRPPLWPHQW RI RUJDQL]DWLRQDO PHPEHUV WR RUJDQL]DWLRQDO
OHDUQLQJDQG63,GHSHQGVFULWLFDOO\RQH[SOLFLWO\IRUPXODWHGVWUDWHJLHVDQGYDOXHV
 &ROOHFWLYHO\ UHIOHFW LQ DQG RQ SUDFWLFH &ULWLFDO UHIOHFWLRQ LV LPSRUWDQW LQ DQ\ IRUP RI
OHDUQLQJ .ROE6FK|Q $OVRWKHEHQHILWVRIWKH³FUHDWLYHFKDRV´LQGXFHGE\
GLYHUVLW\DQGORFDODXWRQRP\FDQRQO\EHUHDOL]HGWKURXJKUHIOHFWLRQXSRQRUJDQL]DWLRQDO
DFWLRQVZLWKRXW VXFK UHIOHFWLRQ DPELJXLW\ DQG IOXFWXDWLRQ WHQG WR OHDG WR ³GHVWUXFWLYH´
FKDRV 1RQDNDDQG7DNHXFKL 
6LPLODU WR WKH DQFLHQW 5RPDQ IRUXP ZKLFK ZDV D FHQWUDO JDWKHULQJ SODFH ZKHUH
FLWL]HQVGLVFXVVHGWKHJUHDWLVVXHVRIWKHGD\WKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQLVHTXDOO\
LQQHHGRIVHWWLQJVZKHUHLWFDQFROOHFWLYHO\UHIOHFWRQLWVSUDFWLFH6XFKOHDUQLQJIRUXPV
FDQWDNHPDQ\IRUPV7KH\LQFOXGHSURFHVVDVVHVVPHQWVVXUYH\IHHGEDFNLQWHUQDOEHQFK
PDUNLQJ SURMHFWV DQG SRVWPRUWHP UHYLHZV MXVW WR PHQWLRQ D IHZ &RPPRQ WR WKHVH
OHDUQLQJIRUXPVLVWKDWDVPDOOJURXSRISHRSOHLVDVVHPEOHGZLWKDZHOOGHILQHGOHDUQLQJ
DJHQGD DQG D FRPSUHVVHG OHDUQLQJ F\FOH LQ RUGHU WR LPSURYH WKHLU FROOHFWLYH XQGHU
VWDQGLQJRIWKHLVVXHVRILQWHUHVW$OVRZKHQRUJDQL]DWLRQDOPHPEHUVHQFRXQWHUDSURE
OHPWKHUHLVDQHHGIRUFROOHFWLYHUHIOHFWLRQLQSUDFWLFHIRUH[DPSOHE\FDOOLQJDPHHWLQJ
DQGJHWWLQJLPPHGLDWH IHHGEDFN7KLVLVLPSRUWDQWVLQFHZLWKRXWDFWLRQDQG VKRUW IHHG
EDFNF\FOHVRUJDQL]DWLRQDOPHPEHUV¶LQWHUHVWLQ63,ZLOOUDSLGO\GLVDSSHDU

 3HUIRUPDQFHPDQDJHPHQW
,Q&KDSWHUZHDUJXHGWKDWRUJDQL]DWLRQDOSHUIRUPDQFHLVWKHXOWLPDWHFULWHULRQIRUDQ\63,
DFWLYLW\7KDWLVZHPXVWHQVXUHWKDW JDLQV IURP 63, DFWLYLWLHV KDYH LQ IDFW EHHQ PDGH ZLWK
UHVSHFW WR RUJDQL]DWLRQDO EHKDYLRU DQG QRW PHUHO\ DW WKH FRJQLWLYH OHYHO &RQVHTXHQWO\ ZH
IRFXVHGRQRUJDQL]DWLRQDOSHUIRUPDQFHDVWKHGHSHQGHQWYDULDEOHLQWKLV+RZHYHUPHDVXULQJ
RUJDQL]DWLRQDO SHUIRUPDQFH LV QRW RQO\ LPSRUWDQW IRU WKH SUHVHQW LQYHVWLJDWLRQ SHUIRUPDQFH
PDQDJHPHQW VKRXOG EH DQ LQWHJUDO SDUW RI DQ\ LQGXVWULDO RUJDQL]DWLRQDO OHDUQLQJ DQG 63,
LQLWLDWLYH
7KHUHIRUHEDVHGRQWKHILQGLQJVIURPWKLVVWXG\DQGLQVSLUHGE\&XPPLQJVDQG:RUOH\
 ZHVXJJHVW D SHUIRUPDQFH PDQDJHPHQW PRGHO IRU 63, ZKLFK LQFOXGHV DFWLYLWLHV IRU
JRDOVHWWLQJGDWDFROOHFWLRQGDWDDQDO\VLVDQGIHHGEDFN VHH)LJXUH $OVREDVHGRQWKH
ILQGLQJWKDWIHHGEDFNLVWKHPRVWLPSRUWDQWSDUWRIDPHDVXUHPHQWEDVHG63,DSSURDFK HJ
&DVH$DQG'\EnH WKHVHDFWLYLWLHVMRLQWO\LQIOXHQFHWKHSHUIRUPDQFHRIVRIWZDUHWHDPV
DQG RUJDQL]DWLRQV $V ZH KDYH DOUHDG\ VHHQ WLPHO\ DQG DFFXUDWH IHHGEDFN LV HVVHQWLDO IRU
JXLGLQJ VXFFHVVIXO 63, DFWLRQV 7KXV WKH UHDO SD\RII IURP XVLQJ GDWDEDVHG PHWKRGV LQ WKH
RUJDQL]DWLRQDOOHDUQLQJF\FOHFRPHVZKHQWKHGDWDDUHIHGEDFNWRWKHORFDOWHDPVIURPZKLFK
LWZDVFROOHFWHGDQGSUREOHPVROYLQJEHJLQV

±±
&+$37(5

7LPH )HHGEDFN
*RDO
6\VWHP
6HWWLQJ

7HDP2UJ

3HUIRUPDQFH

&RVW 4XDOLW\

'DWD

&ROOHFWLRQDQG$QDO\VLV

)LJXUH63,SHUIRUPDQFHPDQDJHPHQWPRGHO

7KHXVHIXOQHVVRIWKHRUJDQL]DWLRQ¶VIHHGEDFNV\VWHPLQJXLGLQJSXUSRVHIXODFWLRQVLVODUJHO\
GHWHUPLQHGE\WKHSURFHVVHVXVHGWRFROOHFWWKHGDWDWKHWHFKQLTXHVXVHGWRDQDO\]HWKHGDWD
DQGWKHZD\LQZKLFKWKHIHHGEDFNGDWDDUHLQWHUSUHWHG,IWKHZURQJGDWDLVFROOHFWHGLIGDWD
LV LQDGHTXDWHO\ DQDO\]HG RU LI WKH SURFHVV RI GDWD FROOHFWLRQ FUHDWHV VXVSLFLRQ DQG DQ[LHW\
WKHQVXFFHVVIXOIHHGEDFNZLOOEHYHU\GLIILFXOWWRREWDLQ&RQYHUVHO\GDWDFROOHFWLRQPHWKRGV
DQG SUDFWLFHV WKDW JHQHUDWH LQWHUHVW DQG WKRXJKW DERXW LPSRUWDQW SUREOHPV FROOHFWLRQ
WHFKQLTXHV WKDW HQDEOH JDWKHULQJ RI XVHIXO DQG LPSRUWDQW GDWD DQG DQDO\VLV ZKLFK HQDEOHV
PHDQLQJIXOLQWHUSUHWDWLRQVRIWKRVHGDWDFDQJUHDWO\DLGIHHGEDFN 1DGOHU 
7KH RUJDQL]DWLRQ¶V VRIWZDUH SURFHVVHV DUH ERWK WKH VRXUFH DQG WKH WDUJHW IRU 63, ,W LV
GXULQJWKHH[HFXWLRQRIWKHVHSURFHVVHVWKDWNQRZOHGJHLVFUHDWHG$QGDVZLWKRUJDQL]DWLRQDO
OHDUQLQJDQG63,LQJHQHUDOWKHZD\LQZKLFKWKHVHSURFHVVHVDUHKDQGOHGLVDFULWLFDOIDFWRU
IRU HIIHFWLYH SHUIRUPDQFH PDQDJHPHQW ,W LV WKHUHIRUH SDUWLFXODUO\ LPSRUWDQW WKDW WKH
VRIWZDUHRUJDQL]DWLRQFRQVLGHUVLWVLQWHUQDOVRIWZDUHGHYHORSPHQWSURFHVVHVDVWKHIRXQGDWLRQ
IRU OHDUQLQJ +RZHYHU VLQFH H[SORLWDWLRQ JHQHUDOO\ JHQHUDWHV FOHDUHU HDUOLHU DQG FORVHU
IHHGEDFN WKDQ H[SORUDWLRQ LW LV LPSRUWDQW WKDW WKH RUJDQL]DWLRQ EDODQFHV OHDUQLQJ IURP
H[SHULHQFHZLWKLQQRYDWLRQDQGFUHDWLYLW\VRWKDWH[SORLWDWLRQGRHVQRWGULYHRXWH[SORUDWLRQ
GXULQJWKHPHDVXUHPHQWSURFHVV
7KHVRIWZDUHRUJDQL]DWLRQ¶VEXVLQHVVVWUDWHJ\VKRXOGJXLGHWKHGHILQLWLRQRIWKHJRDOVDQG
REMHFWLYHVWKDWDUHQHHGHGWRGHFLGHZKDWNLQGRIGDWDWRFROOHFWKRZWRFROOHFWLWKRZWRXVH
LW DQG KRZ WR HYDOXDWH LW $V D SUDFWLFDO DLG LQ VXFK JRDO VHWWLQJ ZH UHFRPPHQG XVLQJ WKH
WHPSODWHV GHYHORSHG VSHFLILFDOO\ IRU WKLV SXUSRVH LQ *40 VHH &KDSWHU   7RJHWKHU ZLWK
EXVLQHVVRULHQWDWLRQ HPSOR\HH SDUWLFLSDWLRQ LV DV ZH KDYH VHHQ WKH PRVW FULWLFDO IDFWRU IRU
VXFFHVVIXO 63, 7KHLU MRLQW FRQWULEXWLRQ H[SODLQV DERXW KDOI RI WKH YDULDQFH LQ 63, VXFFHVV
DGMXVWHG 5VTXDUH   )   S    VHH 7DEOH  DQG 7DEOH  7KLV
VXJJHVWVWKDWHPSOR\HHSDUWLFLSDWLRQDOVRLVDQHVVHQWLDOIDFWRULQGHWHUPLQLQJWKHQDWXUHRIWKH

±±
',6&866,21$1',03/,&$7,216

RUJDQL]DWLRQ¶VSHUIRUPDQFHPDQDJHPHQWSUDFWLFHV6RIWZDUHGHYHORSHUVDQGPDQDJHUVVKRXOG
WKHUHIRUH SDUWLFLSDWH LQ DOO WKH PDLQ DFWLYLWLHV RI WKH SHUIRUPDQFH PDQDJHPHQW PRGHO JRDO
VHWWLQJGDWDFROOHFWLRQDQGDQDO\VLVDQGIHHGEDFN
7R VXPPDUL]H SHUIRUPDQFH PDQDJHPHQW LV DQ LQWHJUDO SDUW RI WKH OHDUQLQJ VRIWZDUH
RUJDQL]DWLRQ,WVIRFXVVKRXOGWKHUHIRUHEHWRHQDEOHWKHVRIWZDUHRUJDQL]DWLRQ¶VSURFHVVHVRI
VHQVHPDNLQJNQRZOHGJHFUHDWLRQDQGSXUSRVHIXODFWLRQV2XUILQGLQJVWKXVVXJJHVWWKDWWKH
VRIWZDUH RUJDQL]DWLRQ¶V SHUIRUPDQFH PDQDJHPHQW PRGHO VKRXOG KDYH WKH IROORZLQJ SURSHU
WLHV

x $IRFXVRQDIHZPHWULFVWKDWDUHFULWLFDOWRRUJDQL]DWLRQDOVXFFHVVDQGLQVXSSRUWLQJWKH
RUJDQL]DWLRQ¶VEXVLQHVVVWUDWHJ\DQGFXOWXUH
x $EDODQFHEHWZHHQRXWFRPHPHDVXUHVWKDWDVVHVVSHUIRUPDQFHDQGSURFHVVPHDVXUHVWKDW
HQDEOHOHDUQLQJ
x $VWHDG\VWUHDPRIPHDVXUHPHQWVIURPDQRQJRLQJSURFHVVRIOHDUQLQJIURPH[SHULHQFH
DQGH[SHULPHQWDWLRQ
x $ FROOHFWLYH IHHGEDFN V\VWHP WKDW FORVHV WKH OHDUQLQJ F\FOH DQG KHOSV WXUQ NQRZOHGJH
DERXW63,LQWRRUJDQL]DWLRQDODFWLRQ

 /HDGLQJRUJDQL]DWLRQDOOHDUQLQJDQG63,
7KHIXQGDPHQWDOUROHRIPDQDJHUVDQGOHDGHUVLVWRVKDSHDQGFUHDWHRUJDQL]DWLRQDOFRQWH[WV
WKDWDUHVXSSRUWLYHRIDQGFRQGXFLYHWRRUJDQL]DWLRQDOOHDUQLQJDQG63,7RWKHH[WHQWWKDWWKH
VRIWZDUHRUJDQL]DWLRQUHPDLQVORFNHGLQWRWKHROGFRQWH[WQRVLJQLILFDQWFKDQJHRULPSURYH
PHQWLVSRVVLEOH7KLVPHDQVWKDWPDQDJHUVKDYHWREHFRPHVNLOOHGLQHQDEOLQJ WKH OHDUQLQJ
SURFHVVHVDQGNH\IDFWRUVIRUVXFFHVVLQRUGHUWRGHILQHQHZDQGDSSURSULDWHFRQWH[WVIRU63,
,Q WKLV ZD\ WKH\ FDQ KHOS WR VKDSH WKH HPHUJHQW SURFHVVHV RI VHOIRUJDQL]DWLRQ LQ VRIWZDUH
WHDPVE\SURYLGLQJ³PLQLPXPVSHFLILFDWLRQV´ZKLOHDYRLGLQJWKHWUDSRILPSRVLQJWRRPXFK
FRQWURO
7KHPDQDJHUFDQFUHDWHVXFKFRQWH[WVE\HQDEOLQJDEHOLHIGULYHQSURFHVVWKDWJHQHUDWHV
QHZ XQGHUVWDQGLQJV RI D VLWXDWLRQ RU E\ HQJDJLQJ LQ QHZ DFWLRQV WKURXJK DQ DFWLRQGULYHQ
SURFHVV7KHFRQYHQWLRQDOZD\RIWKLQNLQJDERXW63,SXWVWKHVHLQDVHTXHQWLDORUGHULHILUVW
XQGHUVWDQGLQJ WKHQ DFWLRQ )RU H[DPSOH LQ WKH HDUO\ -DSDQHVH VRIWZDUH IDFWRULHV D VWURQJ
HPSKDVLVZDVSXWRQJDWKHULQJGDWDRQH[LVWLQJSURFHVVHVEHIRUHFKDQJLQJRULPSURYLQJWKHP
&XVXPDQR /LNHZLVH%DVLOLHWDO E DQG%DVLOLDQG&DOGLHUD  DUJXHGWKDW
ZH VKRXOG ILUVW XQGHUVWDQG ZKDW ZH GR EHIRUH ZH DWWHPSW WR FKDQJH LW )URP D OHDUQLQJ
SHUVSHFWLYH KRZHYHU DFWLRQV DQG XQGHUVWDQGLQJV RIWHQ QHHG WR EH UHYHUVHG 7KHUHIRUH WKH
JHQHUDWLRQRIQHZXQGHUVWDQGLQJVDQGQHZDFWLRQVLQZKDWHYHURUGHUWKH\HYROYHDUHIXQGD
PHQWDOLQFUHDWLQJWKHFRQWH[WVWKDWHQDEOH63,
&RQJUXHQWZLWKWKHUHVXOWVRIRXULQYHVWLJDWLRQVZHVXJJHVWWKHIROORZLQJILYHJXLGHOLQHV
IRUOHDGLQJRUJDQL]DWLRQDOOHDUQLQJDQG63,

 &UHDWH D NQRZOHGJH YLVLRQ 7RS PDQDJHPHQW VKRXOG FUHDWH D NQRZOHGJH YLVLRQ DQG
FRPPXQLFDWHLWZLWKLQWKHRUJDQL]DWLRQ7KHYLVLRQVKRXOGGHILQHWKHFRQWH[WDQGSURYLGH
DJHQHUDOGLUHFWLRQ UHJDUGLQJ ZKDW NLQG RI NQRZOHGJH RUJDQL]DWLRQDO PHPEHUV RXJKW WR
VHHNDQGFUHDWH7KLVLVLPSRUWDQWLQRUGHUWRHQVXUHDZHOOIRXQGHGEXVLQHVVRULHQWDWLRQ

±±
&+$37(5

LQRUJDQL]DWLRQDOOHDUQLQJDQG63,7KHHVVHQFHLVWKXVWRHQDEOHWKHRUJDQL]DWLRQWRWDNH
FROOHFWLYHDFWLRQJHQHUDWHQHZXQGHUVWDQGLQJVDQGPDNHWKHPDYDLODEOHWRWKHUHVWRIWKH
RUJDQL]DWLRQ
 &UHDWH OHDUQLQJ RSSRUWXQLWLHV 7KH WLPH SUHVVXUH DQG ZRUNORDG LQ PRVW VRIWZDUH
RUJDQL]DWLRQVPDNHVWKHXUJHQWGULYHRXWWKHLPSRUWDQW2UJDQL]DWLRQDOOHDUQLQJDQG63,
LV HDVLO\ SRVWSRQHG LQ WKH IDFH RI PRUH LPPHGLDWH GHPDQGV )RU OHDUQLQJ WR RFFXU WKH
RUJDQL]DWLRQ¶V PDQDJHUV DQG OHDGHUV PXVW QHYHUWKHOHVV HQVXUH WKDW HQRXJK WLPH DQG
VSDFHDUHVHWDVLGHIRUUHIOHFWLRQDQGWKHVKDULQJRINQRZOHGJH$OVRDFULWLFDOWDVNRIWKH
PDQDJHU LV WR DVVXUH WKDW WKH RUJDQL]DWLRQ¶V IHHGEDFN SURFHVV LV RSHQ KHDOWK\ DQG
HIIHFWLYHVRWKDWHIIRUWVFDQEHGLUHFWHGWRZDUGSUREOHPVROYLQJQHZRSSRUWXQLWLHVDQG
FRQVWUXFWLYHFKDQJHUDWKHUWKDQGHQLDOGHIHQVLYHEHKDYLRURUPLVXVHRIGDWD
 ,QYROYHHYHU\RQH7RJHWKHUZLWKEXVLQHVVRULHQWDWLRQHPSOR\HHSDUWLFLSDWLRQLVWKHPRVW
FULWLFDOIDFWRUIRUVXFFHVVLQ63,7KHUHIRUHVRIWZDUHRUJDQL]DWLRQV VKRXOG FDSLWDOL]H RQ
WKH GLYHUVH WDOHQWV RI WKHLU PHPEHUV DQG WXUQ LW WR WKHLU DGYDQWDJH 7KLV PHDQV WKDW
HYHU\RQH VKRXOG EH LQYROYHG LQ WKH RUJDQL]DWLRQ¶V OHDUQLQJ SURFHVV 7KXV DVN \RXU
HPSOR\HHVKRZ \RXEHVWFDQKHOSWKHP±OLVWHQDQGUHVSRQG ,JQRULQJWKLVPLJKWHDVLO\
UHVXOWLQFRQIOLFWGLVUXSWLRQDQGFRPSURPLVHGSHUIRUPDQFH5HPHPEHUSHRSOHWHQGWR
VXSSRUWZKDWWKH\KDYHSDUWLFLSDWHGLQFUHDWLQJ
 6WDUWZLWKWKHREYLRXV'RQ¶WVHDUFKRXWVLGHWKHRUJDQL]DWLRQIRUDVLOYHUEXOOHW63,LVQRW
DERXW VHHNLQJ H[SHUW DQVZHUV IURP RXWVLGH WKH RUJDQL]DWLRQ $V 'RURWK\ GLVFRYHUHG LQ
7KH:L]DUGRI2] %DXP WKHUH¶VQRSODFHOLNHKRPH5DWKHUWKDQVHDUFKLQJIRUWKH
ODWHVWIDGVWDUWZLWKWKHREYLRXV³KRWVSRWV´ZLWKLQ \RXURZQRUJDQL]DWLRQ5HPHPEHU
WKDW WKH PRVW SRZHUIXO OHDUQLQJ FRPHV IURP ILUVWKDQG H[SHULHQFH 7KHUHIRUH XVH WKH
RUJDQL]DWLRQ¶V VRIWZDUH SURMHFWV DV WKH OHDUQLQJ ODE DQG VLWXDWH RUJDQL]DWLRQDO OHDUQLQJ
DQG63,LQWKHVHSURMHFWV
 7ROHUDWH IDLOXUH ,I H[SHULPHQWDWLRQ ULVNWDNLQJ DQG WULDODQGHUURU PRGHV RI SUREOHP
VROYLQJDUHWREHYDOXHGWKHQWKHRUJDQL]DWLRQ¶VFXOWXUHPXVWWROHUDWHIDLOXUHDQGUHIUDLQ
IURP SODFLQJ EODPH 5DWKHU WKDQ WUHDW IDLOXUH DV XQDFFHSWDEOH DQG VWLJPDWL]LQJ WKH
RUJDQL]DWLRQVKRXOGGLVWLQJXLVKEHWZHHQIDLOXUHVWKDWUHVXOWIURPFDUHOHVVQHVVDQGIDLOXUHV
WKDW DUH D UHVXOW RI LQWHOOLJHQW HIIRUWV WR H[SHULPHQW RXWVLGH H[LVWLQJ SDWWHUQV %DUUHWW
  ,QWKLV ZD\ WKH PDQDJHU FDQ GUDZ DWWHQWLRQ WR SRWHQWLDO SUREOHPV DQG VWLPXODWH
WKH VHDUFK IRU FUHDWLYH DQG LQQRYDWLYH VROXWLRQV ZKHQ WKH HQYLURQPHQWDO IDFWRUV DUH
FKDQJLQJ7KHSDUDGR[LVWKDW\RXKDYHWRH[SHULHQFHIDLOXUHLQRUGHUWRKDYHVXFFHVV
7KH IROORZLQJ VWRU\ DERXW 7KRPDV :DWVRQ 6U ,%0¶V IRXQGHU DQG &(2 IRU PDQ\
GHFDGHVLOOXVWUDWHVWKLV %HQQLVDQG1DQXV 

$ SURPLVLQJ MXQLRU H[HFXWLYH RI ,%0 ZDV LQYROYHG LQ D ULVN\ YHQWXUH IRU WKH FRPSDQ\ DQG
PDQDJHGWRORVHRYHUPLOOLRQLQWKHJDPEOH,WZDVDGLVDVWHU:KHQ:DWVRQFDOOHGWKH
QHUYRXV H[HFXWLYH LQWR KLV RIILFH WKH \RXQJ PDQ EOXUWHG RXW ³, JXHVV \RX ZDQW P\
UHVLJQDWLRQ"´:DWVRQVDLG³<RXFDQ¶WEHVHULRXV:HMXVWVSHQWPLOOLRQGROODUVHGXFDWLQJ
\RX´ LELGS 

±±
',6&866,21$1',03/,&$7,216

 7KHUHVSRQVLELOLWLHVRIRUJDQL]DWLRQDOPHPEHUV
2UJDQL]DWLRQDO NQRZOHGJH LV FUHDWHG E\ WKH RQJRLQJ H[SHULHQFH DQG H[SHULPHQWDWLRQ RI
RUJDQL]DWLRQDO PHPEHUV 7KHUHIRUH DOO PHPEHUV RI WKH RUJDQL]DWLRQ VKRXOG FRQVLGHU WKHLU
UHVSRQVLELOLWLHV DQG UROHV LQ EXLOGLQJ D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ :LWKRXW LQGLYLGXDOV
ZKR OHDUQ WKHUH FDQ EH QR RUJDQL]DWLRQDO OHDUQLQJ 6RIWZDUH GHYHORSHUV IRU H[DPSOH
JHQHUDWHDFFXPXODWHDQGLQWHUSUHWERWKWDFLWDQGH[SOLFLWNQRZOHGJHDVSDUWRIWKHLUDFWLRQVWR
GHYHORS TXDOLW\ VRIWZDUH 0DQ\ RI WKHP ZRUN LQ GLUHFW FRQWDFW ZLWK WKH FXVWRPHU ZKLFK
PHDQV WKDW WKH\ DUH WKH VRIWZDUH RUJDQL]DWLRQ¶V IURQW OLQH RI EXVLQHVV 7KXV EHLQJ DW WKH
³JHPED´ =XOWQHU   WKH\ DUH LQ D SRVLWLRQ WR REWDLQ WKH ODWHVW LQIRUPDWLRQ RQ WKH
GHYHORSPHQWVLQWKHPDUNHWWHFKQRORJ\RUFRPSHWLWLRQ
7KXV ZH RIIHU WKH IROORZLQJ ILYH UHVSRQVLELOLWLHV WKDW PHPEHUV RI D IXWXUH  OHDUQLQJ
VRIWZDUHRUJDQL]DWLRQVKRXOGFRQVLGHU

 5HIOHFWLQDQGRQSUDFWLFH(QJDJLQJLQDSURFHVVRIDFWLRQDQGUHIOHFWLRQLVDQLPSRUWDQW
SDUW RI LQGLYLGXDO OHDUQLQJ 7KHUHIRUH RUJDQL]DWLRQDO PHPEHUV VKRXOG SXUVXH D
³UHIOHFWLYH´ DWWLWXGH DERXW WKHLU RZQ LQGLYLGXDO ZRUN SUDFWLFHV 5HIOHFWLRQ LV D ZD\ RI
EULQJLQJFRQFUHWHH[SHULHQFHLQWRDEVWUDFWFRQFHSWXDOL]DWLRQ,WLVDZD\RILQYHVWLJDWLQJ
WKHSRVVLEOHLQWHUSUHWDWLRQVRIZKDWLVRUZKDWZDVH[SHULHQFHG7KHUHIRUHLWLVLPSRUWDQW
WR OHDUQ PRUH DERXW RQHV SURIHVVLRQDO SUDFWLFH E\ UHIOHFWLQJ LQ WKH RQJRLQJ SUDFWLFH DV
ZHOO DV RQ WKH SUDFWLFH DIWHU VRPH DFWLRQ KDV EHHQ WDNHQ 5HIOHFWLRQ RQ SUDFWLFH FDQ EH
FRQVLGHUHG DV RUGLQDU\ H[SHULHQWLDO OHDUQLQJ ZKLOH UHIOHFWLRQ LQ SUDFWLFH LV D NQRZLQJ
SURFHVV LH WKH VLPXOWDQHRXV SURFHVV RI DFWLQJ DQG UHIOHFWLQJ 7KXV E\ UHIOHFWLRQ
RUJDQL]DWLRQDOPHPEHUVFDQWDNHUHVSRQVLELOLW\IRUWU\LQJQHZZD\VRIGRLQJWKLQJVDQG
WROHDUQLQDQGIURPWKHLUDFWLRQV
 $FWLYHO\HQJDJHLQGLDORJXH6XFFHVVIXO63,LVFORVHO\FRQQHFWHGWRERWKRUJDQL]DWLRQDO
PHDQV DQG RUJDQL]DWLRQDO HQGV $FWLYHO\ HQJDJLQJ LQ D SXEOLF GLDORJXH DERXW RUJDQL]D
WLRQDOPHDQVDQGHQGVDQGWKHLUUHODWLRQVKLSVLVLPSRUWDQWIRUDQ\OHDUQLQJLQLWLDWLYHWR
VXFFHHG2UJDQL]DWLRQDOPHPEHUVVKRXOGWKHUHIRUHWDNHUHVSRQVLELOLW\WRPDNHLQGLYLG
XDOUHIOHFWLRQVDFFHVVLEOHWRRWKHURUJDQL]DWLRQDOPHPEHUVDQGRSHQO\TXHVWLRQRUFKDO
OHQJHWKHRUJDQL]DWLRQ¶VXQGHUO\LQJVWUDWHJLHVDQGDVVXPSWLRQV$ZD\RIGRLQJWKLVLVE\
WDNLQJWKHLQLWLDWLYHWRFUHDWHOHDUQLQJIRUXPV
 %HRSHQWRQHZSHUVSHFWLYHV+LVWRU\KDVWDXJKWXVWKDWHYHQWKHPRVWHVWDEOLVKHGWUXWKV
PXVW HYHQWXDOO\ EH UHYLVHG RU UHSODFHG )RU LQGLYLGXDOV JURXSV DQG RUJDQL]DWLRQV WR
OHDUQWKLVUHTXLUHVDQRSHQQHVVWKDW DFFHSWV WKH SURYLVLRQDO QDWXUH RI NQRZOHGJH *RRG
LQGLFDWRUV RI VXFK RSHQQHVV DUH RQH¶V DWWLWXGH WRZDUG FKDOOHQJLQJ TXHVWLRQV RQH¶V
ZLOOLQJQHVV WR UHILQH RQH¶V WKHRULHVLQXVH DQG DVVXPSWLRQV DERXW WKH ZD\ WKH ZRUOG
ZRUNV DQG RQH¶V ZLOOLQJQHVV WR VHHN IHHGEDFN IURP RWKHUV 5HPHPEHU %UHDNWKURXJKV
RFFXUZKHQWKHRULHVDUHRYHUWXUQHGXSGDWHGRUUHSODFHG
 7DNH UHVSRQVLELOLW\ IRU VKDULQJ NQRZOHGJH $OO PHPEHUV RI WKH RUJDQL]DWLRQ PXVW WDNH
UHVSRQVLELOLW\WRPDNHZKDWWKH\KDYHOHDUQHGDYDLODEOHWRRWKHUV7KHWUDGLWLRQDOSUDFWLFH
RIKRDUGLQJNQRZOHGJHLQRUGHUWRHQKDQFHRQH¶VSHUVRQDOSRZHULVQRWRQO\XQDFFHSWDEOH
± LW ZLOO EDFNILUH ,Q WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ SRZHU DFFUXHV WR WKRVH ZKR
EHFRPHDVRXUFHRINQRZOHGJHE\VKDULQJZKDWWKH\NQRZ

±±
&+$37(5

 +HOS FROOHDJXHV VXFFHHG 6LQFH VRIWZDUH GHYHORSPHQW LV D WHDP HIIRUW RUJDQL]DWLRQDO
PHPEHUV VXFFHHG RQO\ DV WKHLU FROOHDJXHV VXFFHHG ,Q PDQ\ ZD\V WKH UROH RI WKH
GHYHORSHUUHVHPEOHVWKDWRIDVRFFHUSOD\HU:KLOHHDFKSOD\HUKDV DIL[HGSRVLWLRQWKH
ZKROHWHDPPRYHVWRJHWKHUZKLOHLQGLYLGXDOPHPEHUVUHWDLQWKHLUUHODWLYHSRVLWLRQV-XVW
OLNH D VRFFHU WHDP PRYHV ZLWK WKH EDOO WKH VRIWZDUH WHDP PRYHV ZLWK WKH WDVN 7KLV
VXJJHVWV WKDW UDWKHU WKDQ LQWHUQDO FRPSHWLWLRQ RUJDQL]DWLRQDO PHPEHUV VKRXOG WDNH
UHVSRQVLELOLW\WRIRVWHUDQDWPRVSKHUHRIFROODERUDWLYHDQGFRRSHUDWLYHZRUNHIIRUWV

 &KDSWHU6XPPDU\
,Q WKLV FKDSWHU ZH KDYH GLVFXVVHG WKH DQVZHUV WR WKH WKUHH UHVHDUFK TXHVWLRQV SRVHG LQ
&KDSWHU)LUVWZLWKUHVSHFWWRWKHOHDUQLQJSURFHVVHVLQ63,ZHGLVFXVVHGWKHLPSOLFDWLRQV
RIWKHILQGLQJWKDWVRIWZDUHGHYHORSHUVDFWLYHO\FRQVWUXFWNQRZOHGJHLQWKHLUDWWHPSWVWRPDNH
VHQVHRIWKHLUZRUOG7KLVOHGWRDIRFXVRQWKHGLDOHFWLFEHWZHHQORFDOFRPPXQLWLHVRISUDF
WLFH DQG OLYLQJ RUJDQL]DWLRQDO PHPRULHV 1H[W ZH GLVFXVVHG WKH ILQGLQJV UHJDUGLQJ WKH
LPSRUWDQFHRIHDFKRIWKHVL[NH\IDFWRUVRIVXFFHVVLQ63,LGHQWLILHGLQRXUPRGHO7KHQZH
GLVFXVVHGWKHHIIHFWVRIRUJDQL]DWLRQDOFRQWH[WRQRUJDQL]DWLRQDOOHDUQLQJLQVRIWZDUHRUJDQL
]DWLRQVSDUWLFXODUO\WKHGLIIHUHQFHVIRXQGEHWZHHQVPDOODQGODUJHVRIWZDUHRUJDQL]DWLRQVLQ
XQVWDEOHDQGFKDQJLQJVLWXDWLRQV
)XUWKHUPRUH WKH LPSOLFDWLRQV IRU WKHRU\ DQG PHWKRGRORJ\ ZHUH GLVFXVVHG XVLQJ D
GLDOHFWLFDSSURDFK:LWKUHVSHFWWRWKHRU\IRXUUHODWLRQVKLSVZHUHGLVFXVVHGWKHWDFLWH[SOLFLW
QH[XV WKH ORFDOJOREDO QH[XV WKH NQRZOHGJHDFWLRQ QH[XV DQG WKH H[SORUDWLRQH[SORLWDWLRQ
QH[XV:LWKUHVSHFWWRPHWKRGRORJ\ZHGLVFXVVHGWKHSRVLWLYLVWLQWHUSUHWLYLVWQH[XVWKHULJRU
UHOHYDQFHQH[XVWKHFRQYHUJHQFHGLYHUJHQFHQH[XVDQGWKHSURFHVVSUDFWLFH QH[XV )LQDOO\
WKH LPSOLFDWLRQV IRU SUDFWLFH ZHUH GLVFXVVHG LQ WHUPV RI SUDFWLFDO UHFRPPHQGDWLRQV IRU
VXFFHVVIXO 63, LQ WHUPV RI JXLGHOLQHV IRU EXLOGLQJ D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ IRU
SHUIRUPDQFHPDQDJHPHQWDQGIRUWKHUROHVDQGUHVSRQVLELOLWLHVRIPDQDJHUVDQGGHYHORSHUV
,Q WKH QH[W DQG ILQDO FKDSWHU ZH SUHVHQW RXU FRQFOXVLRQV RQ WKH UHVHDUFK SUREOHP DQG
TXHVWLRQV DQG VWDWH WKH FODLPHG FRQWULEXWLRQV RI WKH WKHVLV )XUWKHUPRUH ZH PDNH DQ
HYDOXDWLRQ RI WKH WKHVLV ZLWK UHVSHFW WR ERWK ULJRU DQG UHOHYDQFH )LQDOO\ ZH GHVFULEH WKH
OLPLWDWLRQVWRWKHVWXG\DORQJZLWKUHFRPPHQGDWLRQVIRUIXWXUHUHVHDUFK

±±
&+$37(5 
&RQFOXVLRQV

³$OLFHµ:RXOG\RXWHOOPHSOHDVHZKLFKZD\,RXJKWWRJRIURPKHUH"¶
µ7KDWGHSHQGVDJRRGGHDORQZKHUH\RXZDQWWRJHWWR¶VDLGWKH&DW´
±/HZLV&DUUROO

,Q WKH SUHYLRXV FKDSWHU ZH GLVFXVVHG WKH DQVZHUV WR WKH WKUHH UHVHDUFK TXHVWLRQV SRVHG LQ
&KDSWHU)LUVWZLWKUHVSHFWWRWKHOHDUQLQJSURFHVVHVLQ63,ZHGLVFXVVHGWKHLPSOLFDWLRQV
RIWKHILQGLQJWKDWVRIWZDUHGHYHORSHUVDFWLYHO\FRQVWUXFWNQRZOHGJHLQWKHLUDWWHPSWVWRPDNH
VHQVHRIWKHLUZRUOG1H[WZHGLVFXVVHGWKHILQGLQJVUHJDUGLQJWKHLPSRUWDQFHRIHDFKRIWKH
VL[ NH\ IDFWRUV RI VXFFHVV LQ 63, LGHQWLILHG LQ RXU PRGHO 7KHQ ZH GLVFXVVHG WKH HIIHFWV RI
RUJDQL]DWLRQDOFRQWH[WRQRUJDQL]DWLRQDOOHDUQLQJLQVRIWZDUHRUJDQL]DWLRQV)XUWKHUPRUHWKH
LPSOLFDWLRQVIRUWKHRU\DQGPHWKRGRORJ\ZHUHGLVFXVVHGXVLQJDGLDOHFWLFDSSURDFKZKLOHWKH
LPSOLFDWLRQVIRUSUDFWLFHZHUHGLVFXVVHGLQWHUPVRISUDFWLFDOUHFRPPHQGDWLRQVIRUVXFFHVVIXO
63,
,QWKLVILQDOFKDSWHUZHSUHVHQWRXUFRQFOXVLRQVRQWKHUHVHDUFKSUREOHPDQGTXHVWLRQV
DQGVWDWHWKHFODLPHGFRQWULEXWLRQVRIWKHWKHVLV)XUWKHUPRUHZHPDNHDQHYDOXDWLRQRIWKH
WKHVLV ZLWK UHVSHFW WR ERWK ULJRU DQG UHOHYDQFH )LQDOO\ ZH GHVFULEH WKH OLPLWDWLRQV WR WKLV
VWXG\DORQJZLWKUHFRPPHQGDWLRQVIRUIXUWKHUUHVHDUFK

 &RQFOXVLRQVRQWKH5HVHDUFK3UREOHPDQG4XHVWLRQV
7KH IXQGDPHQWDO DVVXPSWLRQ EHKLQG WKH LQYHVWLJDWLRQ SUHVHQWHG LQ WKLV WKHVLV ZDV WKDW
VRIWZDUH SURFHVV LPSURYHPHQW LV D VRFLDOO\ FRQVWUXFWHG OHDUQLQJ SURFHVV DQG FRQVHTXHQWO\
WKDWDFRPPLWPHQWWROHDUQLQJUDWKHUWKDQWR³EHVWSUDFWLFH´PRGHOVLVQHHGHGWRDFFRPSOLVK
LPSURYHPHQWVLQVRIWZDUHGHYHORSPHQW
7KH SRVLWLRQ WDNHQ UHJDUGLQJ RUJDQL]DWLRQDO LVVXHV ZDV VWURQJO\ LQIOXHQFHG E\ VRFLR
WHFKQLFDO WKHRU\ DQG LWV FHQWUDO FRQFHSWLRQ WKDW RUJDQL]DWLRQV DUH ERWK VRFLDO DQG WHFKQLFDO

±±
&+$37(5

V\VWHPV DQG WKDW WKH FRUH RI WKH VRIWZDUH RUJDQL]DWLRQ LV UHSUHVHQWHG WKURXJK WKH LQWHUIDFH
EHWZHHQ WKH WHFKQLFDO DQG KXPDQ VRFLDO  V\VWHP $FFRUGLQJO\ ZH GHILQHG RUJDQL]DWLRQDO
LVVXHV ZLWKLQ WKH FRQWH[W RI 63, DV DQ\ GLVWLQFW DUHD RQ WKH LQWHUIDFH EHWZHHQ WKH WHFKQLFDO
V\VWHPDQGWKHVRFLDOV\VWHPZKLFKFDQHQDEOHVRIWZDUHSURFHVVLPSURYHPHQWV
0RUHRYHUGHVSLWHWKHLQFUHDVLQJO\UHFRJQL]HGLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVZLWKLQ
WKH 63, FRPPXQLW\ IHZ HPSLULFDO VWXGLHV KDYH EHHQ UHSRUWHG 7R KHOS ILOO WKLV JDS WKH
GRFWRUDO VWXG\ UHSRUWHG LQ WKLV WKHVLV ZDV LQLWLDWHG WR H[SORUH WKH UHODWLYH LPSRUWDQFH RI
RUJDQL]DWLRQDO LVVXHV E\ LQYHVWLJDWLQJ WKH OHDUQLQJ SURFHVVHV DQG NH\ IDFWRUV IRU VXFFHVV LQ
63,7KXVWKHUHVHDUFKSUREOHPDGGUHVVHGLQWKLVWKHVLVZDV

+RZFDQVRIWZDUHRUJDQL]DWLRQVHQDEOHVRIWZDUHSURFHVVLPSURYHPHQW"

7R QDUURZ WKH IRFXV RI WKH LQYHVWLJDWLRQ WKH UHVHDUFK SUREOHP ZDV DGGUHVVHG E\ VWXG\LQJ
WKUHHUHVHDUFKTXHVWLRQV6RLQRUGHUWRSURYLGHDQDQVZHUWRWKHUHVHDUFKSUREOHPZHILUVW
SUHVHQWWKHFRQFOXVLRQVWRHDFKRIWKHVHTXHVWLRQV

4 :KDWDUHWKHNH\OHDUQLQJSURFHVVHVLQVXFFHVVIXOVRIWZDUHRUJDQL]DWLRQV"

7KH ILUVW TXHVWLRQ IRFXVHG RQ LGHQWLI\LQJ WKH NH\ SURFHVVHV WKDW DUH SDUW RI D VXFFHVVIXO
VRIWZDUHRUJDQL]DWLRQ¶VOHDUQLQJF\FOH,QDGGLWLRQWRRXURZQSUDFWLFDOH[SHULHQFHRIVRIWZDUH
GHYHORSPHQWDWKHRUHWLFDOLQYHVWLJDWLRQDQGDVHWRITXDOLWDWLYHFDVHVWXGLHVZHUHFRQGXFWHG
WRDQVZHUWKHTXHVWLRQ
,QDGGLWLRQWRLGHQWLI\LQJ63,DVDVRFLDOFROODERUDWLYHDFWLYLW\WKHVHLQYHVWLJDWLRQVDOVR
OHGXVWRWKHLGHQWLILFDWLRQRIVHQVHPDNLQJNQRZOHGJHFUHDWLRQDQGSXUSRVHIXODFWLRQVDVWKH
IRXQGDWLRQV RI WKH OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ 7KHUHIRUH WR H[SODLQ ZK\ VRPH 63,
LQLWLDWLYHVDUHPRUHVXFFHVVIXOWKDQRWKHUVDUHZHFRQVWUXFWHG DG\QDPLFPRGHORI63,WKDW
LQFRUSRUDWHGWKHVHIRXQGDWLRQV
7KHNH\WRRXUG\QDPLFPRGHORI63,ZDVDQXQGHUVWDQGLQJRIWKHGLDOHFWLFQDWXUHRIWKH
OHDUQLQJSURFHVVHVDQGWKHLUHQDEOLQJFRQGLWLRQV0RVWLPSRUWDQWO\ZDVWKHUHFRJQLWLRQRIWKH
GLDOHFWLFDO SURFHVV EHWZHHQ JHQHUDWLRQ RI QHZ NQRZOHGJH WKURXJK DFWLRQ UHVXOWLQJ LQ
RUJDQL]DWLRQDO NQRZOHGJH DQG WKH LQWHUSUHWDWLRQ RI WKLV RUJDQL]DWLRQDO NQRZOHGJH WKURXJK
VHQVHPDNLQJLQWRORFDONQRZLQJ
7KHPDLQFRQFOXVLRQRQWKHILUVWUHVHDUFKTXHVWLRQLVWKDWWKHNH\WRVXFFHVVIXOOHDUQLQJLV
DFRQWLQXRXVDQGVLPXOWDQHRXVGLDOHFWLFLQWHUSOD\EHWZHHQWKHNQRZOHGJHWKDWWKHRUJDQL]D
WLRQ KDV HVWDEOLVKHG RYHU WLPH DQG WKH NQRZLQJ RI WKH RUJDQL]DWLRQ¶V PHPEHUV LQ WKHLU
UHVSHFWLYH FRQWH[WV 7KXV UHFRJQL]LQJ WKH IXQGDPHQWDO SULQFLSOH RI WKH KHUPHQHXWLF FLUFOH
VXFFHVVIXOOHDUQLQJUHTXLUHVWKHMRLQWFUHDWLRQRIORFDODQGRUJDQL]DWLRQDONQRZOHGJH

±±
&21&/86,216

4 :KDWDUHWKHNH\IDFWRUVRIVXFFHVVLQVRIWZDUHSURFHVVLPSURYHPHQW"

7KHVHFRQGTXHVWLRQIRFXVHGRQLGHQWLI\LQJWKHNH\IDFWRUVIRUVXFFHVVLQ63,,QDGGUHVVLQJ
WKLVTXHVWLRQZHSHUIRUPHGDWKHRUHWLFDOVWXG\DQGDTXDQWLWDWLYHVXUYH\WRLQYHVWLJDWHWKHNH\
IDFWRUVRIVXFFHVVLQ63,
7KH UHVXOWV RI WKH ELYDULDWH FRUUHODWLRQDO DQG PXOWLSOH UHJUHVVLRQ DQDO\VHV LQGLFDWHG
VXSSRUW IRU DOO RI WKH K\SRWKHVHV LQ WKH SURSRVHG WKHRU\ DQG GHPRQVWUDWHG WKH H[LVWHQFH RI
LPSRUWDQW IDFWRUV IRU 63, VXFFHVV 7KHVH ILQGLQJV DGG DQ LPSRUWDQW QHZ GLPHQVLRQ WR (6(
UHVHDUFK LQ WKDW WKH\ YHULI\ WKH LPSRUWDQFH RI RUJDQL]DWLRQDO IDFWRUV IRU 63, VXFFHVV 7KLV
VXJJHVWVWKDWUDWKHUWKDQWU\LQJWRLPLWDWHWHFKQLFDOSURFHGXUHVVRIWZDUHRUJDQL]DWLRQVVKRXOG
IRFXVWKHLU63,HIIRUWVRQFUHDWLQJDQRUJDQL]DWLRQDOFXOWXUHZLWKLQZKLFKWKHVHSURFHGXUHVFDQ
WKULYH7KLVGLIIHUVVXEVWDQWLDOO\IURPWKDWIRXQGLQPRVWRIWKHH[LVWLQJ63,OLWHUDWXUHZKLFK
IRFXVHVDOPRVWHQWLUHO\RQVRIWZDUHHQJLQHHULQJWRROVDQGWHFKQLTXHV
7KH PDLQ FRQFOXVLRQ RQ WKH VHFRQG UHVHDUFK TXHVWLRQ LV WKDW 63, VXFFHVV GHSHQGV
FULWLFDOO\ RQ VL[ RUJDQL]DWLRQDO IDFWRUV EXVLQHVV RULHQWDWLRQ LQYROYHG OHDGHUVKLS HPSOR\HH
SDUWLFLSDWLRQFRQFHUQIRUPHDVXUHPHQWH[SORLWDWLRQRIH[LVWLQJNQRZOHGJH DQG H[SORUDWLRQ
RIQHZNQRZOHGJH7RJHWKHUWKHVHIDFWRUVH[SODLQHGSHUFHQWRIWKHYDULDQFHLQ63,VXFFHVV
DGMXVWHG 5VTXDUH   )   S    )XUWKHUPRUH WKH UHVXOWV RI WKH PXOWLSOH
UHJUHVVLRQDQDO\VLVVKRZHGWKDWHPSOR\HHSDUWLFLSDWLRQ E W S DQG
EXVLQHVV RULHQWDWLRQ E   W   S    ZHUH WKH PRVW LPSRUWDQW IDFWRUV LQ
SUHGLFWLQJ63,VXFFHVV,QIDFWWKHVHWZRIDFWRUVH[SODLQHGSHUFHQWRIWKHYDULDQFHLQ63,
VXFFHVV DGMXVWHG5VTXDUH ) S 

4 :KDWDUHWKHUHODWLRQVKLSVEHWZHHQRUJDQL]DWLRQDOFRQWH[WDQGPRGHVRI
OHDUQLQJLQVRIWZDUHRUJDQL]DWLRQV"

7KH WKLUG TXHVWLRQ IRFXVHG RQ ILQGLQJ WKH UHODWLRQVKLSV EHWZHHQ RUJDQL]DWLRQDO FRQWH[W DQG
PRGHV RI OHDUQLQJ LQ VRIWZDUH RUJDQL]DWLRQV 7ZR PRGHV RI OHDUQLQJ ZHUH LGHQWLILHG LQ WKLV
VWXG\ H[SORLWDWLRQ RI H[LVWLQJ NQRZOHGJH DQG H[SORUDWLRQ RI QHZ NQRZOHGJH )XUWKHUPRUH
ZH LGHQWLILHG WZR FRQWH[WXDO YDULDEOHV WR FDSWXUH WKH PRVW LQIOXHQWLDO VRXUFHV RI YDULDWLRQ
HQYLURQPHQWDOWXUEXOHQFHDQGRUJDQL]DWLRQDOVL]H7KXVWRDQVZHUWKHWKLUGUHVHDUFKTXHVWLRQ
ZHH[DPLQHGWKHHIIHFWVRIRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDOFRQGLWLRQVRQWKHOHDUQLQJ
PRGHVE\FRPSDULQJWKHHVWLPDWHGPDUJLQDOPHDQVRIH[SORLWDWLRQRIH[LVWLQJNQRZOHGJHDQG
H[SORUDWLRQ RI QHZ NQRZOHGJH XVLQJ WZRZD\ $129$ ZLWK RUJDQL]DWLRQDO VL]H DQG
HQYLURQPHQWDVWKHWZRFODVVLILFDWLRQYDULDEOHV
7ZRLPSRUWDQWUHVXOWVHPHUJHGIURPWKHLQYHVWLJDWLRQRIWKLVUHVHDUFKTXHVWLRQ)LUVWWKH
UHVXOWV VKRZHG WKDW HQYLURQPHQWDO WXUEXOHQFH KDG QR LQIOXHQFH RQ WKH OHYHO RI 63, VXFFHVV
:KDW¶VPRUHLPSRUWDQWKRZHYHULVWKDWODUJHVXFFHVVIXODQGVPDOOVXFFHVVIXORUJDQL]DWLRQV
GLIIHUHG IXQGDPHQWDOO\ LQ WKHLU UHVSHFWLYH DSSURDFK WR 63, 7KH UHVXOWV VKRZHG WKDW VPDOO
VRIWZDUH RUJDQL]DWLRQV HQJDJHG LQ VLJQLILFDQWO\ S    PRUH H[SORUDWLRQ LQ WXUEXOHQW
HQYLURQPHQWV WKDQ ODUJH VRIWZDUH RUJDQL]DWLRQ ZKLFK VXJJHVWV WKDW WKH PDLQ GLIIHUHQFH

±±
&+$37(5

EHWZHHQVPDOODQG ODUJH VRIWZDUH RUJDQL]DWLRQV LV WKH ZD\V LQ ZKLFK WKH\ UHDFW WR XQVWDEOH
DQGFKDQJLQJVWLPXOXVVLWXDWLRQV
7KH PRVW LPSRUWDQW FRQFOXVLRQ RQ WKH WKLUG UHVHDUFK TXHVWLRQ LV WKDW VPDOO VRIWZDUH
RUJDQL]DWLRQVLQ WXUEXOHQW HQYLURQPHQWV UHTXLUH OHDUQLQJ VWUDWHJLHV WKDW DUH FORVHO\ DOLJQHG
ZLWK H[SORUDWLYH EHKDYLRU ZKLOH DW WKH VDPH WLPH SURPRWLQJ WKH H[SORLWDWLRQ RI SDVW
H[SHULHQFHV 5DWKHU WKDQ ³EHVW SUDFWLFH´ DSSURDFKHV VXFK DV WKH &00 ZKLFK UHO\ RQ D
SUHGLFWDEOHVHTXHQFHRIHYHQWVWKLVVXJJHVWVDQ63,VWUDWHJ\EDVHGRQLPSURYLVDWLRQLQZKLFK
RUJDQL]DWLRQDOPHPEHUVSUHSDUHWKHLURUJDQL]DWLRQVWROHDUQZKLOHLQWKHSURFHVVRIDFWLQJ

7DNHQWRJHWKHUWKHDQVZHUVWRWKHVHWKUHHUHVHDUFKTXHVWLRQVFRQVWLWXWHWKHPDLQFRQWULEXWLRQV
RIWKLVWKHVLV6RUHWXUQLQJWRWKHRULJLQDOTXHVWLRQRQKRZVRIWZDUHRUJDQL]DWLRQVFDQHQDEOH
63,ZHIRXQGWKDWWHFKQRORJ\LVQRWHQRXJKWRVROYHWKHGLIILFXOWSUREOHPVIDFLQJPRVWVRIW
ZDUH RUJDQL]DWLRQV .QRZLQJ LV D KXPDQ DFW 7KHUHIRUH LQ DGGLWLRQ WR QHZ WHFKQRORJLHV
VRIWZDUHRUJDQL]DWLRQVPXVWDOVRVXSSRUWVRFLDOLQWHUDFWLRQDPRQJDQGZLWKLQORFDOWHDPVLQ
RUGHUWRFUHDWHHQDEOLQJFRQWH[WVIRU63,,QRWKHUZRUGVVRIWZDUHRUJDQL]DWLRQVWKDWZDQWWR
SURVSHULQWKHVWFHQWXU\VKRXOGV\QHUJLVWLFDOO\FRPELQHWHFKQRORJ\ZLWKVRFLDOFROODERUD
WLRQWREHFRPHOHDUQLQJVRIWZDUHRUJDQL]DWLRQV
7RFUHDWHVXFKOHDUQLQJVRIWZDUHRUJDQL]DWLRQVZHKDYHSURSRVHGDQXPEHURIGLDOHFWLF
UHODWLRQVKLSV$IXQGDPHQWDOXQGHUVWDQGLQJRIWKHVHUHODWLRQVKLSVDUHQHFHVVDU\WRFUHDWHWKH
FRQWH[WV QHHGHG WR HQDEOH 63, +RZHYHU LQVWHDG RI WKLQNLQJ RI HJ NQRZOHGJH YV DFWLRQ
H[SORUDWLRQ YV H[SORLWDWLRQ ULJRU YV UHOHYDQFH RU SURFHVV YV SUDFWLFH LW ZRXOG EH PRUH
XVHIXOWRWKLQNRIKRZWKHWZRVLGHVRIWKHGLDOHFWLFDUHLQWHUODFHG)URPWKLVSHUVSHFWLYHLW
ZLOO EH PRUH LPSRUWDQW WR WKLQN LQ WHUPV RI FRPPXQLWLHV RI SUDFWLFH LPSURYLVDWLRQ OLYLQJ
RUJDQL]DWLRQDOPHPRULHVDQGDFWLRQUHVHDUFKWRHQDEOH63,7KHQDJDLQVRPHRIWKHGLDOHFWLF
UHODWLRQVKLSVDUHREYLRXVO\PRUHGLIILFXOWWRV\QWKHVL]HWKDQRWKHUV,QVRPHFDVHVDG\QDPLF
V\QWKHVLV PD\ EH LPSRVVLEOH WR REWDLQ 1HYHUWKHOHVV LW LV SUHFLVHO\ LQ WKH GLDORJXHV DQG
LQWHUDFWLRQVRIVHDUFKLQJIRUVXFKV\QWKHVHVWKDWHQDEOLQJFRQWH[WVDUHFUHDWHG
7KXVWRFUHDWHDOHDUQLQJVRIWZDUHRUJDQL]DWLRQDGLIIHUHQWFRQWH[WWKDQWKDWSURFODLPHG
E\ FXUUHQW ³EHVW SUDFWLFH´ 63, DSSURDFKHV PXVW EH FUHDWHG 7KH FRQFOXVLRQ RQ WKH UHVHDUFK
SUREOHP LV WKDW 63, FDQQRW EH PDQDJHG EXW RQO\ HQDEOHG WKURXJK WKH VSDFH LQ ZKLFK WKH
VRIWZDUH RUJDQL]DWLRQ FUHDWHV WKH SRVVLELOLWLHV IRU VHQVHPDNLQJ NQRZOHGJH FUHDWLRQ DQG
SXUSRVHIXODFWLRQ

 &RQWULEXWLRQV
7KHREMHFWLYHRIWKHWKHVLVZDVWRLQYHVWLJDWHWKHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,
%DVHG RQ WKLV REMHFWLYH DQG WKH DQVZHUV SURYLGHG WR WKH WKUHH UHVHDUFK TXHVWLRQV SRVHG LQ
&KDSWHUWKHWKHVLVFRQWULEXWHVZLWKXQLTXHWKHRUHWLFDOPHWKRGRORJLFDODQGSUDFWLFDONQRZ
OHGJH
)RU WKH PRVW SDUW 63, KDV EHHQ SUHRFFXSLHG ZLWK WHFKQLFDO LVVXHV DW WKH H[SHQVH RI
RUJDQL]DWLRQDO LVVXHV 7KHUHIRUH WKH SULQFLSDO FRQWULEXWLRQ RI WKH WKHVLV LV WR LQFUHDVH WKH
XQGHUVWDQGLQJ RI WKH LQIOXHQFH RI RUJDQL]DWLRQDO LVVXHV LQ 63, E\ HPSLULFDOO\ VKRZLQJ WKDW
WKH\DUHDWOHDVWDVLPSRUWDQWDVWHFKQRORJ\IRUVXFFHHGLQJZLWK63,

±±
&21&/86,216

 7KHRUHWLFDOFRQWULEXWLRQV
:HKDYHPDGHVHYHUDOWKHRUHWLFDOFRQWULEXWLRQVWKURXJKRXWWKHWKHVLV7KHPRVWLPSRUWDQWDUH

x )RXQGDWLRQVRIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ2QHRIWKHNH\DVVXPSWLRQVLQWKH
WKHVLVZDVWKDWVXFFHVVIXO63,SUHVXSSRVHVDQRULHQWDWLRQWRZDUGRUJDQL]DWLRQDOOHDUQLQJ
%DVHGRQWKLVDVVXPSWLRQZHPDGHDWKHRUHWLFDOFRQWULEXWLRQE\GHILQLQJWKHIRXQGDWLRQV
RIWKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ VHH&KDSWHU 
x $ G\QDPLF PRGHO RI 63, %DVHG RQ SHUVRQDO H[SHULHQFH DQG REVHUYDWLRQV DQG WKH
H[WHQVLYHOLWHUDWXUHUHYLHZZHFRQWULEXWHGWRWKHWKHRU\RI63,E\GHYHORSLQJDG\QDPLF
PRGHORI63,7KHPRGHOLVLQVSLUHGE\VRFLDOFRQVWUXFWLYLVPDQGRSHQV\VWHPVWKHRU\,W
FRQVLVWV RI WKH IROORZLQJ IRXU PDMRU HOHPHQWV RUJDQL]DWLRQDO FRQWH[W OHDUQLQJ F\FOH
IDFLOLWDWLQJIDFWRUVDQGRUJDQL]DWLRQDORXWFRPH7KHPRGHOZDVSUHVHQWHGLQ&KDSWHU
DQGSURYLGHGWKHDQVZHUWRUHVHDUFKTXHVWLRQ4
x .H\IDFWRUVIRUVXFFHVVLQ63,$VDQLPSRUWDQWSDUWRIWKHG\QDPLFPRGHORI63,ZH
FRQWULEXWHG WR WKH WKHRU\ RI 63, E\ GHILQLQJ D VHW RI NH\ IDFWRUV IRU VXFFHVV 7KH
LPSRUWDQFH RI WKHVH IDFWRUV ZDV YDOLGDWHG WKURXJK WKH TXDQWLWDWLYH VXUYH\ 7KH IDFWRUV
ZHUH GHILQHG LQ &KDSWHU  DQG YDOLGDWHG LQ &KDSWHU  DQG SURYLGHG WKH DQVZHU WR
UHVHDUFKTXHVWLRQ4
x $Q LPSURYLVDWLRQDO DSSURDFK WR 63, 7KH UHVXOWV RI WKH LQYHVWLJDWLRQV VKRZHG WKDW
WKHUH DUH LPSRUWDQW GLIIHUHQFHV LQ WKH ZD\ ODUJH VXFFHVVIXO DQG VPDOO VXFFHVVIXO
RUJDQL]DWLRQV UHDFW WR HQYLURQPHQWDO FRQGLWLRQV DQG KRZ WKH\ GHDO ZLWK 63,
&RQVHTXHQWO\ ZH SURSRVHG DQ DSSURDFK WR 63, LQ VPDOO RUJDQL]DWLRQV EDVHG RQ
LPSURYLVDWLRQ7KLVFRQWULEXWLRQZDVGHVFULEHGLQ&KDSWHUDQGSURYLGHGWKHDQVZHUWR
UHVHDUFKTXHVWLRQ4

 0HWKRGRORJLFDOFRQWULEXWLRQV
7KHPDLQPHWKRGRORJLFDOFRQWULEXWLRQVRIWKHWKHVLVDUH

x $ SUDJPDWLF DSSURDFK WR (6( UHVHDUFK )RU WKH PRVW SDUW (6( UHVHDUFK KDV EHHQ
FRQFHUQHG ZLWK H[SHULPHQWDO DQG TXDQWLWDWLYH PHWKRGV :H FODLP WKDW DOO UHVHDUFK LV D
VRFLDOFRQVWUXFWLRQ&RQVHTXHQWO\ZHGHILQHGDSUDJPDWLFUHVHDUFKDSSURDFKLQWHJUDWLQJ
SRVLWLYLVW DQG LQWHUSUHWDWLYH DSSURDFKHV ZKLFK ZH EHOLHYH DUH JHQHUDOO\ DSSOLFDEOH WR
(6(UHVHDUFK7KHIRXQGDWLRQVIRUWKLVDSSURDFKZHUHGHVFULEHGLQ&KDSWHU
x $QLQVWUXPHQWIRUPHDVXULQJWKHNH\IDFWRUVRIVXFFHVVLQ63,,QVWUXPHQWYDOLGDWLRQ
DQG UHOLDELOLW\ LVVXHV KDYH EHHQ LQDGHTXDWHO\ DGGUHVVHG LQ (6( UHVHDUFK %\ DSSO\LQJ
SV\FKRPHWULF WKHRU\ ZH GHYHORSHG DQ LQVWUXPHQW IRU PHDVXULQJ WKH NH\ IDFWRUV RI
VXFFHVVLQ63,7KHLQVWUXPHQWZDVVKRZQWRKDYHGHVLUDEOHSV\FKRPHWULFSURSHUWLHV7KH
SURFHVV RI GHYHORSLQJ WKH LQVWUXPHQW ZDV GHVFULEHG LQ &KDSWHU  ZKLOH WKH LQVWUXPHQW
LWVHOILVLQFOXGHGLQ$SSHQGL[(

±±
&+$37(5

 3UDFWLFDOFRQWULEXWLRQV
%DVHGRQWKHUHVXOWVRIWKHLQYHVWLJDWLRQVLQWKLVWKHVLVZHKDYHPDGHVHYHUDOFRQWULEXWLRQV
IRUSUDFWLFH7KHPDLQFRQWULEXWLRQVDUH VHH&KDSWHU 

x *XLGHOLQHV IRU EXLOGLQJ D OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ 2XU LQYHVWLJDWLRQV KDYH


VKRZQ WKDW OHDUQLQJ LV WKH VLQH TXD QRQ RI 63, %DVHG RQ WKH LQVLJKWV JDLQHG ZH
FRQWULEXWHG ZLWK D VHW RI HVVHQWLDO JXLGHOLQHV IRU EXLOGLQJ D OHDUQLQJ VRIWZDUH
RUJDQL]DWLRQ
x $ SHUIRUPDQFH PDQDJHPHQW PRGHO IRU 63, 7KURXJKRXW WKH WKHVLV ZH DUJXHG WKDW
RUJDQL]DWLRQDO SHUIRUPDQFH LV WKH XOWLPDWH FULWHULRQ IRU DQ\ 63, DFWLYLW\ %DVHG RQ RXU
ILQGLQJV WKHUHIRUH ZH PDGH D FRQWULEXWLRQ WR SUDFWLFH E\ SURSRVLQJ D SHUIRUPDQFH
PDQDJHPHQW PRGHO ZKLFK LQFOXGHV DFWLYLWLHV IRU JRDO VHWWLQJ GDWD FROOHFWLRQ GDWD
DQDO\VLVDQGIHHGEDFN
x *XLGHOLQHV IRU OHDGLQJ 63, &RQJUXHQW ZLWK RXU ILQGLQJV DQG WKH IRXQGDWLRQV RI WKH
OHDUQLQJ VRIWZDUH RUJDQL]DWLRQ ZH VXJJHVWHG D VHW RI JXLGHOLQHV IRU FUHDWLQJ WKH
DSSURSULDWHFRQWH[WVIRURUJDQL]DWLRQDOOHDUQLQJDQG63,LQDQLQGXVWULDOVHWWLQJ
x 5HVSRQVLELOLWLHVRIRUJDQL]DWLRQDOPHPEHUV)RURUJDQL]DWLRQDOOHDUQLQJWRWDNHSODFH
LQGLYLGXDO PHPEHUV RI WKH RUJDQL]DWLRQ PXVW WDNH RQ FHUWDLQ UHVSRQVLELOLWLHV
&RQVHTXHQWO\ ZH SURSRVHG D VHW RI UROHV DQG UHVSRQVLELOLWLHV LQ EXLOGLQJ D OHDUQLQJ
VRIWZDUHRUJDQL]DWLRQWKDWRUJDQL]DWLRQDOPHPEHUVVKRXOGFRQVLGHU

 (YDOXDWLRQ
7KURXJKRXW WKH WKHVLV ZH KDYH DUJXHG WKDW 63, UHVHDUFK VKRXOG EHFRPH PRUH ULJRURXV DQG
PRUHUHOHYDQW:HKDYHDUJXHGWKDWPHWKRGRORJLFDOULJRULVDQLPSRUWDQWDQGQHFHVVDU\EDVLV
LQDQ\UHVHDUFKWKDWSXUSRUWVWREHUHOHYDQW,QDGGLWLRQIRU63,UHVHDUFKWREHUHOHYDQWLWPXVW
DOVR EH JURXQGHG LQ UHDO LQGXVWULDO QHHGV LQ RUGHU WR QDUURZ WKH JXOI EHWZHHQ UHVHDUFK DQG
SUDFWLFH
&RQVHTXHQWO\ZHWDNHRXURZQPHGLFLQHDQGHYDOXDWHWKHPDLQTXDQWLWDWLYHSDUWRIWKH
SUHVHQWLQYHVWLJDWLRQDFFRUGLQJWRERWKULJRUDQGUHOHYDQFH0HWKRGRORJLFDOULJRULVHYDOXDWHG
DFFRUGLQJ WR WKH JXLGHOLQHV SURSRVHG E\ .LWFKHQKDP HW DO IRUWKFRPLQJ  VHH 7DEOH  
5HOHYDQFH LV HYDOXDWHG DFFRUGLQJ WR %HQEDVDW DQG =PXG¶V   UHFRPPHQGDWLRQV IRU
LQFUHDVLQJWKHUHOHYDQFHRI,6UHVHDUFK VHH7DEOH 

7DEOH(YDOXDWLRQRIULJRUDFFRUGLQJWR.LWFKHQKDPHWDO¶V IRUWKFRPLQJ JXLGHOLQHVIRU


HPSLULFDOUHVHDUFKLQVRIWZDUHHQJLQHHULQJ

&ULWHULRQ &RPSOLDQFH

([SHULPHQWDOFRQWH[W
 %HVXUHWRVSHFLI\DVPXFKRIWKHLQGXVWULDO <HVFRQWH[WLQIRUPDWLRQZDVGHVFULEHGLQ
FRQWH[WDVSRVVLEOH,QSDUWLFXODUFOHDUO\GH 6HFWLRQVDQG7KHVSHFLILFPHDVXUHV
ILQHWKHHQWLWLHVDWWULEXWHVDQGPHDVXUHVWKDW XVHGWRH[SORUHWKHHIIHFWVRIFRQWH[WXDOYDULDEOHV
DUHFDSWXULQJWKHFRQWH[WXDOLQIRUPDWLRQ ZHUHVSHFLILHGLQ7DEOH

±±
&21&/86,216

&ULWHULRQ &RPSOLDQFH

 ,IDVSHFLILFK\SRWKHVLVLVEHLQJWHVWHGVWDWH <HV6HFWLRQZDVIXOO\GHGLFDWHGWRWKH
LWFOHDUO\SULRUWRSHUIRUPLQJWKHVWXG\DQG GLVFXVVLRQRIWKHWKHRU\IURPZKLFKWKHVHYHQ
GLVFXVVWKHWKHRU\IURPZKLFKLWLVGHULYHG K\SRWKHVHVLQWKHVWXG\ZHUHGHULYHG
VRWKDWLWLPSOLFDWLRQVDUHDSSDUHQW

 ,IWKHUHVHDUFKLVH[SORUDWRU\VWDWHFOHDUO\ <HVLQ6HFWLRQZHVWDWHGWKHUHVHDUFK
DQGSULRUWRGDWDDQDO\VLVZKDWTXHVWLRQVWKH SUREOHPDQGTXHVWLRQVDQGKRZWKH\ZRXOGEH
LQYHVWLJDWLRQLVLQWHQGHGWRDGGUHVVDQGKRZ DGGUHVVHGLQWKLVVWXG\
LWZLOODGGUHVVWKHP

 'HVFULEHUHVHDUFKWKDWLVVLPLODUWRRUKDVD <HVWKHH[WHQVLYHOLWHUDWXUHUHYLHZSUHVHQWHG
EHDULQJRQWKHFXUUHQWUHVHDUFKDQGKRZ WKURXJKRXWWKHWKHVLVGHVFULEHVVLPLODUZRUN
FXUUHQWZRUNUHODWHVWRLW $OVRWKHILQDOGLVFXVVLRQUHODWHVWKLVVWXG\WR
RWKHUZRUN6HH&KDSWHUVDQG

([SHULPHQWDOGHVLJQ
 ,GHQWLI\WKHSRSXODWLRQIURPZKLFKWKHVXEMHFWV <HVWKHSRSXODWLRQIURPZKLFKWKHVXEMHFWVZHUH
DQGREMHFWVDUHGUDZQ GUDZQZDVLGHQWLILHGLQ6HFWLRQ

 'HILQHWKHSURFHVVE\ZKLFKWKHVXEMHFWVDQG <HVWKHVDPSOHVHOHFWLRQSURFHVVZDVGHVFULEHG
REMHFWVZHUHVHOHFWHG LQ6HFWLRQ

 'HILQHWKHSURFHVVE\ZKLFKVXEMHFWVDQG 1RWDSSOLFDEOH
REMHFWVDUHDVVLJQHGWRWUHDWPHQWV

 5HVWULFW\RXUVHOIWRVLPSOHVWXG\GHVLJQVRUDW <HVZHXVHGDsequential, mixed method design


OHDVWWRGHVLJQVWKDWDUHIXOO\DQDO\]HGLQWKH that was justified by reference to the research
OLWHUDWXUH literature. See Section 6.2.

 'HILQHWKHH[SHULPHQWDOXQLW <HVWKHXQLWRIDQDO\VLVZDVGHILQHGLQ6HFWLRQ
DQGDOVRLQ6HFWLRQ

)RUIRUPDOH[SHULPHQWVSHUIRUPDSUH <HVSRZHUDQDO\VLVDQGFDOFXODWLRQRIWKH
H[SHULPHQWRUSUHFDOFXODWLRQWRLGHQWLI\RU PLQLPXPUHTXLUHGVDPSOHVL]HZHUHGRQHLQ
HVWLPDWHWKHPLQLPXPUHTXLUHGVDPSOHVL]H 6HFWLRQ1%7KLVLVMXVWDVLPSRUWDQWIRUD
VXUYH\DVLWLVIRUDIRUPDOH[SHULPHQW

8VHDSSURSULDWHOHYHOVRIEOLQGLQJ 1RWDSSOLFDEOH

,I\RXFDQQRWDYRLGHYDOXDWLQJ\RXURZQZRUN <HV,QWKHTXDOLWDWLYHSDUWRIWKHVWXG\ZHDF
WKHQPDNHH[SOLFLWDQ\YHVWHGLQWHUHVWV WLYHO\SDUWLFLSDWHGLQWKHLPSURYHPHQWSURFHVVHV
LQFOXGLQJ\RXUVRXUFHVRIVXSSRUW DQGUHSRUW 7KHLQIOXHQFHRIWKLVSDUWLFLSDWLRQIRUWKHFROOHFWHG
ZKDW\RXKDYHGRQHWRPLQLPL]HELDV GDWDZDVGHVFULEHGLQ6HFWLRQVDQG

$YRLGWKHXVHRIFRQWUROVXQOHVV\RXDUHVXUH <HVRUJDQL]DWLRQDOVL]HDQGHQYLURQPHQWDOFRQ
WKHFRQWUROVLWXDWLRQFDQEHXQDPELJXRXVO\ GLWLRQVZHUHXQDPELJXRXVO\GHILQHGDQGLQFOXGHG
GHILQHG IRUTXDVLH[SHULPHQWDOFRQWURO6HH6HFWLRQ

)XOO\GHILQHDOOWUHDWPHQWV LQWHUYHQWLRQV  1RWDSSOLFDEOH

-XVWLI\WKHFKRLFHRIRXWFRPHPHDVXUHVLQ <HVWKHRXWFRPHPHDVXUH63,VXFFHVVZDV
WHUPVRIWKHLUUHOHYDQFHWRWKHREMHFWLYHVRI GHILQHGDQGMXVWLILHGLQ6HFWLRQDQGRSHUD
WKHHPSLULFDOVWXG\ WLRQDOL]HGLQ6HFWLRQ$OVRVHH$SSHQGL[(

±±
&+$37(5

&ULWHULRQ &RPSOLDQFH

&RQGXFWLQJWKHH[SHULPHQWDQGGDWDFROOHFWLRQ
'HILQHDOOVRIWZDUHPHDVXUHPHQWVIXOO\ <HVDOODVSHFWVRIWKHLQVWUXPHQWGHYHORSHGIRU
LQFOXGLQJWKHHQWLW\DWWULEXWHXQLWDQG GDWDFROOHFWLRQZDVGHVFULEHGDQGMXVWLILHGLQ
FRXQWLQJUXOHV &KDSWHU

)RUVXEMHFWLYHPHDVXUHVSUHVHQWDPHDVXUH <HVUHOLDELOLW\DQGYDOLGLW\PHDVXUHVZHUH
RILQWHUUDWHUDJUHHPHQWVXFKDVWKHNDSSD UHSRUWHGLQ6HFWLRQVDFFRUGLQJWR
VWDWLVWLFRUWKHLQWUDFODVVFRUUHODWLRQ VWDQGDUGSV\FKRPHWULFSULQFLSOHVDQGFULWHULD
FRHIILFLHQWIRUFRQWLQXRXVPHDVXUHV

'HVFULEHDQ\TXDOLW\FRQWUROPHWKRGXVHGWR <HVFRPSOHWHQHVVDQGDFFXUDF\RIWKHGDWD
HQVXUHFRPSOHWHQHVVDQGDFFXUDF\RIGDWD ZHUHFKHFNHGFRQWLQXRXVO\DVTXHVWLRQQDLUHV
FROOHFWLRQ DUULYHGGXULQJWKHGDWDFROOHFWLRQSHULRG

)RUVXUYH\VPRQLWRUDQGUHSRUWWKHUHVSRQVH <HVWKHUHVSRQVHUDWHZDVUHSRUWHGDQG
UDWHDQGGLVFXVVWKHUHSUHVHQWDWLYHQHVVRI GLVFXVVHGWRJHWKHUZLWKWKHUHSUHVHQWDWLYHQHVV
WKHUHVSRQVHVDQGWKHLPSDFWRIQRQ RIWKHUHVSRQVHV6HH6HFWLRQ
UHVSRQVH

)RUREVHUYDWLRQDOVWXGLHVDQGH[SHULPHQWV 1RWDSSOLFDEOHGiven the high response rate in


UHFRUGGDWDDERXWVXEMHFWVZKRGURSRXWIURP this study, no further analysis was done on the
WKHVWXGLHV differences between respondents and non-
respondents. See Section 6.3.

)RUREVHUYDWLRQDOVWXGLHVDQGH[SHULPHQWV <HVDEDODQFHGVHWRISHUIRUPDQFHPHDVXUHV
UHFRUGGDWDDERXWRWKHUSHUIRUPDQFHPHDV DQGSHUFHLYHGOHYHOVRIVXFFHVVZDVLQFOXGHGLQ
XUHVWKDWPD\EHDGYHUVHO\DIIHFWHGE\WKH WKHVWXG\6HH6HFWLRQVDQG$OVRVHH
WUHDWPHQWHYHQLIWKH\DUHQRWWKHPDLQIRFXV $SSHQGL[(
RIWKHVWXG\

$QDO\VLV
6SHFLI\DQ\SURFHGXUHVXVHGWRFRQWUROIRU 1RWDSSOLFDEOH
PXOWLSOHWHVWLQJ

&RQVLGHUXVLQJEOLQGDQDO\VLV 1RWDSSOLFDEOH

3HUIRUPVHQVLWLYLW\DQDO\VHV <HVVHQVLWLYLW\DQDO\VHVIRUDOOYDULDEOHVZHUH
SHUIRUPHGDQGUHSRUWHGLQ6HFWLRQ

(QVXUHWKDWWKHGDWDGRQRWYLRODWHWKHDV <HVDOODVVXPSWLRQVRIWKHWHVWVXVHGRQWKH
VXPSWLRQVRIWKHWHVWVXVHGRQWKHP GDWDZHUHHYDOXDWHGLQ6HFWLRQ

$SSO\DSSURSULDWHTXDOLW\FRQWUROSURFHGXUHV <HVJUDSKLFDOH[DPLQDWLRQVDQGH[SORUDWRU\GDWD
WRYHULI\\RXUUHVXOWV DQDO\VLVZHUHGRQHSULRUWRGHWDLOHGDQDO\VLV

3UHVHQWDWLRQRIUHVXOWV
'HVFULEHRUFLWHDUHIHUHQFHIRUDOOVWDWLVWLFDO <HVWKHSURFHGXUHIRUK\SRWKHVLVWHVWLQJZDV
SURFHGXUHVXVHG GHVFULEHGLQ6HFWLRQ)XUWKHUPRUHDOOEXWWKH
PRVWEDVLFWHVWVZHUHH[SOLFLWO\UHIHUHQFHG

5HSRUWWKHVWDWLVWLFDOSDFNDJHXVHG <HVWKHGDWDDQDO\VLVWHFKQLTXHVDQGVWDWLVWLFDO
SDFNDJHXVHGZDVUHSRUWHGLQ6HFWLRQ

±±
&21&/86,216

&ULWHULRQ &RPSOLDQFH

3UHVHQWTXDQWLWDWLYHUHVXOWVDVZHOODVVLJ <HVTXDQWLWDWLYHUHVXOWVDQGVLJQLILFDQFHOHYHOV
QLILFDQFHOHYHOV4XDQWLWDWLYHUHVXOWVVKRXOG ZHUHUHSRUWHGIRUDOOVWDWLVWLFDOWHVWV6HH&KDSWHU
VKRZWKHPDJQLWXGHRIHIIHFWVDQGWKHFRQ 
ILGHQFHOLPLWV

3UHVHQWWKHUDZGDWDZKHQHYHUSRVVLEOH <HVWKHUDZGDWDRIWKHVXUYH\LVLQFOXGHGLQ
2WKHUZLVHFRQILUPWKDWWKH\DUHDYDLODEOHIRU $SSHQGL[*
FRQILGHQWLDOUHYLHZE\WKHUHYLHZHUVDQG
LQGHSHQGHQWDXGLWRUV

0DNHDSSURSULDWHXVHRIJUDSKLFV <HVUHVXOWVIURPWZRZD\$129$WHVWVZHUH
SUHVHQWHGJUDSKLFDOO\IRUWKHRWKHUWHVWVVLPSOH
WDEOHVZHUHXVHGWRUHSRUWUHVXOWV

,QWHUSUHWDWLRQRIUHVXOWV
'HILQHWKHSRSXODWLRQWRZKLFKLQIHUHQWLDO <HVWKHSRSXODWLRQZDVGHILQHGLQ6HFWLRQ
VWDWLVWLFVDQGSUHGLFWLYHPRGHOVDSSO\

'LIIHUHQWLDWHEHWZHHQVWDWLVWLFDOVLJQLILFDQFH <HVWKHUHODWLRQVKLSVEHWZHHQVWDWLVWLFDO
DQGSUDFWLFDOLPSRUWDQFH VLJQLILFDQFHDQGSUDFWLFDOLPSRUWDQFHZHUH
GLVFXVVHGLQ6HFWLRQ

'HILQHWKHW\SHRIVWXG\ <HVWKHW\SHRIVWXG\ZDVGHILQHGLQ6HFWLRQ

6SHFLI\DQ\OLPLWDWLRQVRIWKHVWXG\ <HVWKHOLPLWDWLRQVRIWKHVWXG\DUHVSHFLILHGLQ
6HFWLRQ

7DEOH(YDOXDWLRQRIUHOHYDQFHDFFRUGLQJWR%HQEDVDWDQG=PXG¶V 
UHFRPPHQGDWLRQVIRULQFUHDVLQJWKHUHOHYDQFHRILQIRUPDWLRQV\VWHPVUHVHDUFK

&ULWHULRQ &RPSOLDQFH

7RSLF6HOHFWLRQ
 )RFXVRQIXWXUHLQWHUHVWVRINH\VWDNHKROGHUV <HVWKHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ
63,LVJHWWLQJLQFUHDVLQJO\PRUHDWWHQWLRQDPRQJ
FROOHDJXHVDQGSUDFWLWLRQHUVDQGDOVRLQSUDFWLFH
RULHQWHGPDJD]LQHVVXFKDV,(((6RIWZDUHDQG
&RPPXQLFDWLRQVRIWKH$&0

 ,GHQWLI\WRSLFVIURPVRIWZDUHGHYHORSPHQW <HVRXULQGXVWULDOEDFNJURXQGDQGFRQWLQXRXV
SUDFWLFH FROODERUDWLRQZLWKSUDFWLWLRQHUVGXULQJWKHODVW
\HDUVKDYHUHYHDOHGWKDWRUJDQL]DWLRQDOLVVXHV
DUHFRQVLGHUHGLPSRUWDQWIRULQGXVWULDO63,SUR
JUDPV

 ,GHQWLI\DVDQDFDGHPLFFRPPXQLW\WKHFRUH <HVWKHFXUUHQWLQYHVWLJDWLRQLVSDUWRIDQHIIRUW
UHVHDUFKLVVXHVWKDWFDQLQIOXHQFHSUDFWLFHLQ WRUHDFKVRPHGHJUHHRIFRQVHQVXVDVDFRP
WKHIXWXUH PXQLW\UHJDUGLQJWKHFRUHSKHQRPHQDDVVRFLDWHG
ZLWKUHOHYDQW63,UHVHDUFK

±±
&+$37(5

&ULWHULRQ &RPSOLDQFH

3XUSRVH
 )RFXVRQWKHOLNHO\RXWFRPH WKDWFDQLQ <HVLQ6HFWLRQZHSRLQWHGRXWWKDWWKHIRFXV
IOXHQFHSUDFWLFH UDWKHUWKDQRQLQSXWV DFD RIWKHVWXG\ZDVRQKRZWRVXFFHHGZLWKWKH
GHPLFDQGLQWHOOHFWXDOFKDOOHQJHV ZKHQ SUDFWLFHRI63,7KLVLVDOVRVHHQLQWKHLPSOLFD
FKRRVLQJDUHVHDUFKSURMHFW WLRQVIRUSUDFWLFHLQ6HFWLRQ

 'HYHORSFXPXODWLYHWKHRU\EDVHGFRQWH[W <HVWKHIRXQGDWLRQVRIWKHOHDUQLQJVRIWZDUH
ULFKERGLHVRIUHVHDUFKWREHDEOHWRPDNH RUJDQL]DWLRQ &KDSWHU DQGWKHG\QDPLFPRGHO
SUHVFULSWLRQVDQGEHSURDFWLYH RI63, &KDSWHU DUHVXFKWKHRULHV$OVRWKH
PHDVXUHPHQWLQVWUXPHQW $SSHQGL[( GHYHO
RSHGLQ&KDSWHUSURYLGHVUHOLDEOHDQGYDOLG
PHDVXUHVRIWKHNH\IDFWRUVIRUVXFFHVVLQ63,

 'HYHORSIUDPHVRIUHIHUHQFHWRRUJDQL]HSKH <HVWKHOHDUQLQJF\FOHDQGWKHNH\IDFWRUVIRU
QRPHQDDQGSURYLGHFRQWLQJHQF\DSSURDFKHV VXFFHVVLQ63, &KDSWHU DUHWKHWZRPRVW
WRPDQDJHULDODFWLRQ LPSRUWDQWIUDPHVRIUHIHUHQFHGHYHORSHGLQWKLV
VWXG\$OVRWKHLPSOLFDWLRQVRIEOLQGO\IROORZLQJ
³EHVWSUDFWLFH´DSSURDFKHVWR63,LVVXFKD
IUDPHRIUHIHUHQFH6HH6HFWLRQDQG'\En
E 

 3RUWUD\UHVHDUFKRXWSXWVLQZD\VSUDFWLWLRQHUV <HVLQ6HFWLRQZHoffered guidelines for


FDQXWLOL]HWRMXVWLI\DQGUDWLRQDOL]H63,UHODWHG building a learning software organization. Also,
GHFLVLRQV we suggested a performance management
model for SPI along with specific advice for man-
agers and developers in software organizations
that want their organization to excel.

5HDGDELOLW\
 8VHFOHDUVLPSOHDQGFRQFLVHVW\OHLQWKH 3DUWLDO6LQFHDGRFWRUDOGLVVHUWDWLRQLVPDLQO\
ZULWHXS UHDGE\WKHUHVHDUFKFRPPXQLW\WKHFKRVHQ
VW\OHLVGHOLEHUDWHO\DFDGHPLF+RZHYHUWKH
GLVFXVVLRQRIUHVXOWVDQGSDUWLFXODUO\WKHLP
SOLFDWLRQVIRUSUDFWLFH 6HFWLRQ LVPRUH
³PDQDJHULDO´LQQDWXUHIROORZLQJPDJD]LQHVW\OH
UDWKHUWKDQMRXUQDOVW\OH

(GLWRULDOSURFHVV
 6HWWKHJRDORISXEOLVKLQJPDQXVFULSWVDV <HVWKLVKDVEHHQFOHDUO\VWDWHGWKURXJKRXWWKH
EHLQJERWKULJRURXVDQGUHOHYDQW WKHVLVDQGLQWKHSUHVHQWHYDOXDWLRQ

7KXV EDVHG RQ WKH HYDOXDWLRQ RI PHWKRGRORJLFDO ULJRU SUHVHQWHG LQ 7DEOH  DQG WKH
HYDOXDWLRQ RI UHOHYDQFH WR SUDFWLFH SUHVHQWHG LQ 7DEOH  ZH FRQFOXGH WKDW WKH SUHVHQW
LQYHVWLJDWLRQFDQEHFRQVLGHUHGERWKULJRURXVDQGUHOHYDQW

 /LPLWDWLRQV
$OWKRXJKZHKDYHGLVFXVVHGVHYHUDOLPSOLFDWLRQVRIRXUUHVXOWVIRUWKHWKHRU\PHWKRGRORJ\
DQGSUDFWLFHRI63,WKHUHVHDUFKUHSRUWHGKHUHLVQRWZLWKRXWLWVOLPLWDWLRQV)LUVWWKHPRGHO
EXLOGLQJSDUWRIWKHLQYHVWLJDWLRQUHVWVLQWKHLQWHUSUHWLYHUHVHDUFKWUDGLWLRQZKLFKKROGVWKDW

±±
&21&/86,216

UHDOLW\LVDVXEMHFWLYHFRQVWUXFWLRQRIWKHPLQGDQGWKDWLWVIRUPDQGFRQWHQWGHSHQGVRQWKH
LQGLYLGXDO KROGLQJ WKH FRQVWUXFWLRQ (YHQ WKRXJK ZH DSSOLHG JURXQGHG WKHRU\ DQG WKH
IXQGDPHQWDO SULQFLSOH RI WKH KHUPHQHXWLF FLUFOH .OHLQ DQG 0\HUV   ZKLFK ZDV
H[SOLFLWO\EXLOWLQWRWKHG\QDPLFPRGHORI63,WKURXJKWKHORFDODQGRUJDQL]DWLRQDOOHYHOVWKH
PRGHO LV VWLOO D VXEMHFWLYH FRQVWUXFWLRQ %HVLGHV WKH SURFHVV RI LQWHUSUHWDWLRQ LV LWHUDWLYH
ZKLFK PHDQV WKDW WKH VXEMHFWLYH FRQVWUXFWLRQV DQG WKHLU DVVRFLDWHG ³UHDOLWLHV´ DUH DOWHUDEOH
7KHUHIRUH ZH FDQQRW FODLP WKDW WKH PRGHO UHIOHFWV REMHFWLYH NQRZOHGJH EXW WKHQ DJDLQ
ZKLFKPRGHOFDQ" 7KHTXHVWLRQWKHUHIRUHLVQRWZKHWKHUWKHPRGHOLVPRUHRUOHVV³WUXH´
LQDQ\DEVROXWHVHQVHEXWVLPSO\LILWLVPRUHRUOHVVLQIRUPHGDQGRUVRSKLVWLFDWHG *XEDDQG
/LQFROQ 
6HFRQGWKHUHVXOWVRIWKHK\SRWKHVLVWHVWLQJSDUWRIWKLVUHVHDUFKKDYHEHHQGLVFXVVHGDV
WKRXJKWKHIDFLOLWDWLQJIDFWRUVFDXVHG63,VXFFHVV7KLVSDUWRIWKHLQYHVWLJDWLRQZDVKRZHYHU
FURVVVHFWLRQDODQGWKHVHDVVXPSWLRQVRIFDXVDOLW\DUHQRWWHFKQLFDOO\MXVWLILHG,WLVSRVVLEOH
IRUH[DPSOHWKDWWKHUHDUHFRPSOH[IHHGEDFNPHFKDQLVPVE\ZKLFKSHUIRUPDQFHLQRQHWLPH
SHULRGLVDIIHFWHGE\SHUIRUPDQFHLQSUHYLRXVSHULRGV 0DUFKDQG6XWWRQ %RWKVXFFHVV
DQGODFNRIVXFFHVVPLJKWYHU\ZHOOEHVHOIUHLQIRUFLQJ2QWKHRWKHUKDQGWKHUHFRXOGDOVREH
QHJDWLYH IHHGEDFN PHFKDQLVPV E\ ZKLFK 63, VXFFHVV RU IDLOXUH FUHDWHV FRXQWHUYDLOLQJ
WHQGHQFLHV,WLVSRVVLEOHWKHUHIRUHWKDWSHUIRUPDQFHEHORZWDUJHWOHYHOVLQFUHDVHVRUJDQL]D
WLRQDOHIIRUWVDQGWKXVWKHOLNHOLKRRGRIVXEVHTXHQWVXFFHVV$FFRUGLQJO\VXFFHVVFDQDOVREH
VHHQ DV D WULJJHU IRU DGMXVWPHQWV LQ WKH RSSRVLWH GLUHFWLRQ WKURXJK GHFUHDVHG LQQRYDWLRQ RU
LQFUHDVHGVODFN7KHUHIRUHPDQ\RIWKHIDFLOLWDWLQJIDFWRUVWKDWVHHPOLNHO\WRLQIOXHQFH63,
VXFFHVVFDQWKHPVHOYHVEHLQIOXHQFHGE\SULRUVXFFHVVRUODFNRIVXFFHVV)LQGLQJWKH³WUXH´
FDXVDO VWUXFWXUH RI 63, VXFFHVV EDVHG RQ LQFRPSOHWH LQIRUPDWLRQ JHQHUDWHG E\ SULRU
H[SHULHQFHLVWKHUHIRUHSUREOHPDWLF
7KLUG DOWKRXJK JHQHUDOO\ DFFHSWHG SV\FKRPHWULF SULQFLSOHV ZHUH XVHG WR GHYHORS WKH
PHDVXUHPHQW LQVWUXPHQW WKH YDULDEOHV ZHUH VWLOO PHDVXUHG RQ WKH EDVLV RI VXEMHFWLYH
SHUIRUPDQFHGHILQLWLRQV3HUIRUPDQFHPHDVXUHVVXFKDVWKHUHWXUQRQLQYHVWPHQWQHWSUHVHQW
YDOXH DQG SD\EDFN SHULRGV DUH RIWHQ UHJDUGHG DV REMHFWLYH PHDVXUHV +RZHYHU DWWHPSWV WR
SURYLGH REMHFWLYH GHILQLWLRQV RI VXFK PHDVXUHV PD\ EH DV RSHQ WR FULWLFLVP DV VXEMHFWLYH
GHILQLWLRQV %HUU\ DQG -HIIHU\  6DDULQHQ   7KLV SRLQWV WR D JHQHUDO SUREOHP RI
GHILQLQJDQGPHDVXULQJVXFFHVVLQVWXGLHVRI63,7KHTXHVWLRQWKHUHIRUHLVQRWZKHWKHUVXFK
PHDVXUHVDUHVXEMHFWLYHRUQRWEXWZKDWSXUSRVHWKH\VHUYH
)LQDOO\ D IXUWKHU FRPSOLFDWLRQ LV WKDW WKH LQGHSHQGHQW YDULDEOHV ZHUH DVVHVVHG XVLQJ
UHWURVSHFWLYHUHFDOO7KLVLQYROYHVDULVNIRUWKHLQWURGXFWLRQRIUHWURVSHFWLYHELDV )LVFKKRII
 ,WLVSRVVLEOHWKHUHIRUHWKDWSHUIRUPDQFHLQIRUPDWLRQLWVHOIFRORUVVXEMHFWLYHPHPRULHV
DQG SHUFHSWLRQV RI SRVVLEOH FDXVHV RI 63, VXFFHVV RU IDLOXUH 6RIWZDUH RUJDQL]DWLRQV DUH
FRQVWDQWO\ ZRUULHG DERXW WKHLU SHUIRUPDQFH DQG ³FRPPRQ ZLVGRP´ KDV PDQ\ H[SODQDWLRQV
IRU JRRG DQG SRRU SHUIRUPDQFH $V D UHVXOW UHWURVSHFWLYH UHSRUWV RI LQGHSHQGHQW YDULDEOHV
PD\EHOHVVLQIOXHQFHGE\PHPRU\WKDQE\ DUHFRQVWUXFWLRQWKDWFRQQHFWVFRPPRQZLVGRP
ZLWKWKHDZDUHQHVVRISHUIRUPDQFHUHVXOWV 0DUFKDQG6XWWRQ 
'HVSLWHWKHVHOLPLWDWLRQVWKLVVWXG\FRQWULEXWHVWRWKHJURZLQJOLWHUDWXUHRQ(6(UHVHDUFK
DQGSURYLGHVHPSLULFDOVXSSRUWIRUWKHLPSRUWDQFHRIRUJDQL]DWLRQDOLVVXHVLQ63,

±±
&+$37(5

 )XUWKHU5HVHDUFK
7KH UHVXOWV RI WKLV WKHVLV LWV FRQWULEXWLRQV DQG OLPLWDWLRQV SRLQW WR VHYHUDO SRVVLELOLWLHV IRU
IXUWKHUUHVHDUFKZLWKUHOHYDQFHIRUWKHRU\PHWKRGRORJ\DQGSUDFWLFH

x 7KHRU\ RI RUJDQL]DWLRQDO OHDUQLQJ DQG FKDQJH LQ VRIWZDUH RUJDQL]DWLRQV $ PRUH
GHWDLOHGWKHRU\RIRUJDQL]DWLRQDOOHDUQLQJDQGFKDQJHLQVRIWZDUHRUJDQL]DWLRQVVKRXOGEH
GHYHORSHGWRHQKDQFHWKHG\QDPLFPRGHORI63,DQGWREHWWHUXQGHUVWDQGWKHFRQFHSWRI
WKHOHDUQLQJVRIWZDUHRUJDQL]DWLRQ6XFKDWKHRU\VKRXOGEHEXLOWRQWKHEDVLVRILQ VLWX
ILHOGZRUN7KDWLVWKHUHVHDUFKHUVKRXOGDFWLYHO\SDUWLFLSDWHLQVLWXDWLRQVSHFLILFSUDFWLFHV
LQ D IHZ RUJDQL]DWLRQV LQ RUGHU WR JHW ³ULFK´ GDWD DQG DQ LQGHSWK XQGHUVWDQGLQJ RI WKH
FHQWUDOHOHPHQWVLQWKHWKHRU\2QWKHEDVLVRIVXFKFDVHVDSRVVLEOHDSSURDFKZRXOGEH
WR XVH TXDOLWDWLYH WHFKQLTXHV VXFK DV JURXQGHG WKHRU\ LQ WKH DFWXDO WKHRU\ EXLOGLQJ
SURFHVV
x 63,VXFFHVV PHDVXUHPHQW63,VXFFHVVPHDVXUHPHQWLV D FRQWURYHUVLDO LVVXH DQG PRUH
UHVHDUFK LV QHHGHG WR VWXG\ LW 6HYHUDO OHYHOV RI DQDO\VLV DUH SRVVLEOH ± HJ LQGLYLGXDO
JURXSSURFHVVDQGRUJDQL]DWLRQ±HDFKZLWKFRPSOH[LQWHUDFWLRQVZLWKWKHRWKHUV$OVR
VHYHUDO DQG SRVVLEO\ FRQIOLFWLQJ GLPHQVLRQV HJ IDVWHU EHWWHU DQG FKHDSHU  DQG
YLHZSRLQWV HJHFRQRPLFHQJLQHHULQJRUJDQL]DWLRQDODQGVRFLRWHFKQLFDO DUHUHOHYDQW
5HVHDUFKVKRXOGEHUHODWHGWRWKHVWXG\ RI QHZ DQG LPSURYHG PHDVXUHV RI 63, VXFFHVV
FRPSDULVRQRIPHDVXUHPHQWLQVWUXPHQWVDQGYDOLGDWLRQRI63,VXFFHVV PHDVXUHV XVLQJ
ERWKSRVLWLYLVWDQGLQWHUSUHWLYHDSSURDFKHV
x 7KHUROHRIFRQWH[WYDULDEOHVLQ63,&RQWH[WYDULDEOHVVXFKDVRUJDQL]DWLRQDOVL]HDQG
HQYLURQPHQWDOWXUEXOHQFHGLGQRWSOD\DQLPSRUWDQWUROHLQSUHGLFWLQJ63,VXFFHVVLQWKLV
VWXG\+RZHYHUWKH\SOD\HGDQLPSRUWDQWUROHLQGHWHUPLQLQJWKHDSSURDFKWDNHQWR63,
$OVRXQGHURWKHUFLUFXPVWDQFHVWKHLQGHSHQGHQWYDULDEOHVRIWKHSUHVHQWVWXG\FRXOGDFW
DVPRGHUDWLQJRUPHGLDWLQJYDULDEOHVLQRWKHUVWXGLHV5HVHDUFKLVQHHGHGWRLQYHVWLJDWH
WKH LPSRUWDQFH RI VXFK YDULDEOHV WR VHYHUDO W\SHV RI 63, SUREOHPV DQG WR YDOLGDWH WKH
DSSURDFKHVSURSRVHGIRUVROYLQJWKHP6XFKVWXGLHVVKRXOGFRPELQHIDFWRUUHVHDUFKZLWK
SURFHVVUHVHDUFKLQRUGHUWRSURYLGHVDWLVIDFWRU\OHYHOVRIH[WHUQDOYDOLGLW\
x 7KH QDWXUH RI FDXVDOLW\ LQ 63, VWXGLHV /DERUDWRU\ H[SHULPHQWV UHJDUGLQJ WKH UROH RI
UHWURVSHFWLYHELDVLQDVVHVVLQJLQGHSHQGHQWYDULDEOHVEDVHGRQUHWURVSHFWLYHUHFDOOVKRXOG
EH XQGHUWDNHQ WR VWXG\ WKH QDWXUH RI FDXVDOLW\ LQ 63, 6XFK H[SHULPHQWV VKRXOG
VXEVHTXHQWO\ EH H[WHQGHG WR ILHOG VLWXDWLRQV LQ RUGHU WR VWXG\ WKH ³WUXH´ QDWXUH RI VXFK
FDXVDOLW\ 7KH UHVHDUFK GHVLJQ IRU VXFK VWXGLHV VKRXOG EH EDVHG RQ D SUHWHVWSRVWWHVW
FRQWUROJURXSGHVLJQSUHIHUDEO\ZLWKSURIHVVLRQDOVRIWZDUHGHYHORSHUVDQGPDQDJHUVLQ
ERWKODERUDWRU\DQGILHOGVHWWLQJV
x 'LYHUVLW\RI(6(UHVHDUFKDSSURDFKHV(IIRUWVVKRXOGEHPDGHWRGHYHORSDGLYHUVLW\RI
(6(UHVHDUFKDSSURDFKHVVXLWHGIRUGLIIHUHQWSXUSRVHV2IVSHFLILFFRQFHUQKRZHYHUDUH
UHVHDUFK DSSURDFKHV WKDW DUH DEOH WR VXSSRUW WKH GHYHORSPHQW DQG WHVWLQJ RI WKHRULHV WR
LPSURYHRXUXQGHUVWDQGLQJRISUDFWLFHZKLOHVLPXOWDQHRXVO\VXSSRUWLQJWKHGHYHORSPHQW
DQG WHVWLQJ RI FRQFHSWV WR VXSSRUW LQGXVWULDO SUDFWLFH 5HVHDUFK LV QHHGHG WR GHYHORS
DFWLRQUHVHDUFKDVDQDSSURDFKWR(6(UHVHDUFKWKDWVDWLVILHVWKHUHTXLUHPHQWVRIVFLHQWLILF
ULJRUZKLOHDWWKHVDPHWLPHIRFXVLQJRQUHOHYDQFHIRUSUDFWLFH6XFKDSSURDFKHVZRXOG
PDNHLWHDVLHUWRFRPELQHWKHUROHRIWKHUHVHDUFKHUZLWKWKHUROHRIWKHFRQVXOWDQWLQ63,

±±
&21&/86,216

x *XLGHOLQHV IRU 63, LQ VPDOO RUJDQL]DWLRQV 3UDFWLFDO JXLGHOLQHV IRU SURFHVV GHILQLWLRQ
DVVHVVPHQW LPSURYHPHQW DQG LQQRYDWLRQ LQ VPDOO RUJDQL]DWLRQV VKRXOG EH GHYHORSHG
6XFKDSSURDFKHVVKRXOGFRPELQHNQRZOHGJHFUHDWLRQDQGVRFLRWHFKQLFDOFRQFHSWVVXFK
DV³FRGHWHUPLQDWLRQ´³PLQLPXPFULWLFDOVSHFLILFDWLRQ´DQG³DXWRQRPRXVZRUNJURXSV´
ZLWKLPSURYLVDWLRQDQGOLYLQJRUJDQL]DWLRQDOPHPRULHV2ISDUWLFXODULPSRUWDQFHKHUHLV
ZRUNWKDWLVEHLQJGRQHWRVWXG\WKHUHOHYDQFHRILPSURYLVDWLRQLQMD]]DQGWHDPJDPHVWR
RUJDQL]DWLRQ GHYHORSPHQW LQ RUGHU WR HJ UHGXFH WKH WLPH EHWZHHQ SODQQLQJ DQG DFWLRQ
VHH'\EnE (YHQWXDOO\WKHJXLGHOLQHVVKRXOGEHHYDOXDWHGLQDQLQGXVWULDOFRQWH[W
WKURXJKWKHXVHRIILHOGH[SHULPHQWVVXUYH\VFDVHVWXGLHVRUDFWLRQUHVHDUFK

7KHUHDUHFHUWDLQO\RWKHUGLUHFWLRQVIRUIXUWKHUUHVHDUFK+RZHYHUWKHYDOXHRIDQ\VXFKIXWXUH
ZRUNGHSHQGVRQWKHVSHFLILFJRDOVRIHDFKSDUWLFXODULQYHVWLJDWLRQ

 )LQDO5HPDUNV
7KH UHVXOWV RI WKH HPSLULFDO LQYHVWLJDWLRQV SUHVHQWHG LQ WKLV WKHVLV VXSSRUW RXU FODLP WKDW
RUJDQL]DWLRQDO LVVXHV DUH DV LPSRUWDQW LQ 63, DV WHFKQRORJ\ LI QRW PRUH VR 7KHUHIRUH OLNH
.UDXWDQG6WUHHWHU  ZKRVWXGLHGFRRUGLQDWLRQLQVRIWZDUHGHYHORSPHQWZHEHOLHYHWKDW
WKH ODUJH OLWHUDWXUH RQ RUJDQL]DWLRQDO WKHRU\ GHYHORSHG LQ QRQVRIWZDUH VHWWLQJV KDV PRUH
UHOHYDQFHWRVRIWZDUHGHYHORSPHQWWKDQKDVSUHYLRXVO\EHHQUHFRJQL]HGLQVRIWZDUHHQJLQHHU
LQJ
)LQDOO\DQGLQDFFRUGDQFHZLWKRXUFRQVWUXFWLYLVW VWDQGSRLQW ZH FRXOG QRW VD\ ³+HUH¶V
KRZWRGRLW´5DWKHUZHEHOLHYHWKDWHDFKVRIWZDUHRUJDQL]DWLRQPXVW XVH LWV RZQ OHDUQLQJ
FDSDFLW\ WR LQYHQW WKH VSHFLILF SURFHVVHV DQG HQDEOLQJ IDFWRUV WKDW LW QHHGV WR VXFFHHG ZLWK
RUJDQL]DWLRQDOOHDUQLQJDQG63,1HYHUWKHOHVVZHEHOLHYHWKDWWKHUHVXOWVRIWKLVLQYHVWLJDWLRQ
FDQ SURYLGH YDOXDEOH LQSXWV WR VXFK RUJDQL]DWLRQ VSHFLILF SURFHVVHV DQG WKDW OHDUQLQJ IURP
RWKHUVFDQEHDYDOXDEOHUHVRXUFH

±±
$SSHQGL[$7HUPLQRORJ\

$ $EEUHYLDWLRQV
$&0 $VVRFLDWLRQIRU&RPSXWLQJ0DFKLQHU\
DPL DSSOLFDWLRQRIPHWULFVLQLQGXVWU\
%35 %XVLQHVV3URFHVV5HHQJLQHHULQJ
%6& %DODQFHG6FRUHFDUG
&%$,3, &00%DVHG$SSUDLVDOIRU,QWHUQDO3URFHVV,PSURYHPHQW
&(2 &KLHI([HFXWLYH2IILFHU
&00 &DSDELOLW\0DWXULW\0RGHO
&00, &00,QWHJUDWLRQ
($6( (PSLULFDO$VVHVVPHQWLQ6RIWZDUH(QJLQHHULQJ
() ([SHULHQFH)DFWRU\
()40 (XURSHDQ)RXQGDWLRQIRU4XDOLW\0DQDJHPHQW
(6( (PSLULFDO6RIWZDUH(QJLQHHULQJ
(66, (XURSHDQ6\VWHPVDQG6RIWZDUH,QLWLDWLYH
*40 *RDO4XHVWLRQ0HWULF
*6)& *RGGDUG6SDFH)OLJKW&HQWHU
,'($/ ,QLWLDWLQJ'LDJQRVLQJ(VWDEOLVKLQJ$FWLQJ/HDUQLQJ PRGHO
,(& ,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,((( ,QVWLWXWHRI(OHFWULFDODQG(OHFWURQLFV(QJLQHHUV
,6 ,QIRUPDWLRQ6\VWHPV
,6(51 ,QWHUQDWLRQDO6RIWZDUH(QJLQHHULQJ5HVHDUFK1HWZRUN
,62 ,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQ
.3$ .H\3URFHVV$UHD
/2 /HDUQLQJ2UJDQL]DWLRQ
/62 /HDUQLQJ6RIWZDUH2UJDQL]DWLRQ

±±
$33(1',;$

0,6 0DQDJHPHQW,QIRUPDWLRQ6\VWHPV
1$6$ 1DWLRQDO$HURQDXWLFVDQG6SDFH$GPLQLVWUDWLRQ
1718 7KH1RUZHJLDQ8QLYHUVLW\RI6FLHQFHDQG7HFKQRORJ\
2' 2UJDQL]DWLRQ'HYHORSPHQW
2/ 2UJDQL]DWLRQDO/HDUQLQJ
20,6 2UJDQL]DWLRQDO0HPRU\,QIRUPDWLRQ6\VWHP
3'&$ 3ODQ'R&KHFN$FW F\FOH
3,( 3URFHVV,PSURYHPHQW([SHULPHQW
352),7 3URFHVV,PSURYHPHQWIRU,7,QGXVWU\ SURMHFW
4,3 4XDOLW\,PSURYHPHQW3DUDGLJP
5 ' 5HVHDUFKDQG'HYHORSPHQW
52, 5HWXUQRQ,QYHVWPHQW
6&$03, 6WDQGDUG&00,$VVHVVPHQW0HWKRGIRU3URFHVV,PSURYHPHQW
6'  6RIWZDUH'HYHORSPHQW  6WDQGDUG'HYLDWLRQ
6(, 6RIWZDUH(QJLQHHULQJ,QVWLWXWH
6(/ 6RIWZDUH(QJLQHHULQJ/DERUDWRU\
6(3* 6RIWZDUH(QJLQHHULQJ3URFHVV*URXS
6,17() 7KH )RXQGDWLRQ IRU 6FLHQWLILF DQG ,QGXVWULDO 5HVHDUFK DW WKH 1RUZHJLDQ
,QVWLWXWHRI7HFKQRORJ\
60( 6PDOODQG0HGLXPVL]HG(QWHUSULVHV
63$ 6RIWZDUH3URFHVV$VVHVVPHQW
63& 6WDWLVWLFDO3URFHVV&RQWURO
63, 6RIWZDUH3URFHVV,PSURYHPHQW
63,&( 6RIWZDUH3URFHVV,PSURYHPHQWDQG&DSDELOLW\G(WHUPLQDWLRQ
63,4 6RIWZDUH3URFHVV,PSURYHPHQWIRUEHWWHU4XDOLW\ SURMHFW
676 6RFLR7HFKQLFDO6\VWHP
6: 6RIWZDUH
6:&00 &DSDELOLW\0DWXULW\0RGHOIRU6RIWZDUH
7(/0(7 7HOHFRPPXQLFDWLRQ0HWULFV$SSURDFK SURMHFW
740 7RWDO4XDOLW\0DQDJHPHQW
8L2 8QLYHUVLW\RI2VOR

±±
7(50,12/2*<

$ 'HILQLWLRQV
$FWLRQ5HVHDUFK$QLWHUDWLYHSURFHVVLQYROYLQJUHVHDUFKHUVDQGSUDFWLWLRQHUVDFWLQJWRJHWKHU
RQDSDUWLFXODU F\FOH RI DFWLYLWLHV LQFOXGLQJ SUREOHP GLDJQRVLV DFWLRQ LQWHUYHQWLRQ DQG
UHIOHFWLYHOHDUQLQJ $YLVRQHWDO 
%HQFKPDUNLQJ $Q RQJRLQJ LQYHVWLJDWLRQ DQG OHDUQLQJ H[SHULHQFH WKDW HQVXUHV WKDW EHVW
SUDFWLFHVDUHXQFRYHUHGDQDO\]HGDGRSWHGDQGLPSOHPHQWHG
%XVLQHVVRULHQWDWLRQ7KHH[WHQWWRZKLFK63,JRDOVDQGDFWLRQVDUHDOLJQHGZLWKH[SOLFLWDQG
LPSOLFLWEXVLQHVVJRDOVDQGVWUDWHJLHV
&DVH VWXG\ $Q HPSLULFDO LQTXLU\ WKDW LQYHVWLJDWHV D FRQWHPSRUDU\ SKHQRPHQRQ ZLWKLQ LWV
UHDOOLIH FRQWH[W HVSHFLDOO\ ZKHQ WKH ERXQGDULHV EHWZHHQ SKHQRPHQRQ DQG FRQWH[W DUH
QRWFOHDUO\HYLGHQW <LQ 
&RQFHSWXDOL]DWLRQ7KHSURFHVVRIWDNLQJ DQ DEVWUDFW FRQVWUXFW DQG UHILQLQJ LW E\ JLYLQJ LW D
FRQFHSWXDORUWKHRUHWLFDOGHILQLWLRQ 1HXPDQ 
&RQFHUQIRUPHDVXUHPHQW7KHH[WHQWWRZKLFKWKHVRIWZDUHRUJDQL]DWLRQFROOHFWVDQGXWLOL]HV
TXDOLW\GDWDWRJXLGHDQGDVVHVVWKHHIIHFWVRI63,DFWLYLWLHV
&RQVWUXFWYDOLGLW\7KHGHJUHHWRZKLFKDPHDVXUHPHQWLQVWUXPHQWUHSUHVHQWVDQGDFWVOLNHWKH
SURFHVVHVEHLQJPHDVXUHG &URQEDFK 
&RQWHQW YDOLGLW\ 7KH GHJUHH WR ZKLFK WKH LWHPV LQ D PHDVXUHPHQW LQVWUXPHQW UHSUHVHQW WKH
GRPDLQRUXQLYHUVHRIWKHSURFHVVHVXQGHUVWXG\ &URQEDFK 
&UHGLELOLW\ 7KH DUJXPHQWV DQG WKH SURFHVVHV QHFHVVDU\ IRU KDYLQJ VRPHRQH WUXVW UHVHDUFK
UHVXOWV *UHHQZRRG /HYLQ 
&ULWHULRQYDOLGLW\7KHGHJUHHWRZKLFKDPHDVXUHPHQWLQVWUXPHQWLVDEOHWRSUHGLFWDYDULDEOH
WKDWLVGHVLJQDWHGDFULWHULRQ $QDVWDVL 8UELQD 
&URVVVHFWLRQDOUHVHDUFK5HVHDUFKLQZKLFKWKHPHDVXUHPHQWVRQWKHYDULDEOHVRILQWHUHVWDUH
WDNHQDWRQHSRLQWLQWLPH
&XVWRPHU VDWLVIDFWLRQ 7KH GLIIHUHQFH EHWZHHQ WKH FXVWRPHUV¶ SHUFHLYHG SHUIRUPDQFH DQG
WKHLUQHHGVDQGH[SHFWDWLRQV /\QFK &URVV 
'DWD6\PEROVHJQXPEHUVRUOHWWHUV
'HGXFWLYH UHVHDUFK 5HVHDUFK WKDW EHJLQV ZLWK DQ DEVWUDFW ORJLFDO UHODWLRQVKLS DPRQJ
FRQFHSWVIRUPXODWHGDVDK\SRWKHVLVDQGWKHQPRYHVWRZDUGFRQFUHWHHPSLULFDOHYLGHQFH
E\WHVWLQJWKHK\SRWKHVLV
'HSHQGHQWYDULDEOH7KHYDULDEOHLQDVWXG\WKDWLVWKHHIIHFWRURXWFRPHRIWKHLQGHSHQGHQW
YDULDEOH,W³GHSHQGVRQ´WKHFDXVH 'DYLV 
'HXWHUROHDUQLQJ/HDUQLQJKRZWROHDUQ %DWHVRQ 
'RXEOHORRSOHDUQLQJ/HDUQLQJWKDWUHVXOWVLQDFKDQJHLQWKHYDOXHVRIWKHRU\LQXVHDVZHOO
DVLQLWVVWUDWHJLHVDQGDVVXPSWLRQV $UJ\ULV 6FK|Q 
(PSOR\HHSDUWLFLSDWLRQ7KHH[WHQWWRZKLFKHPSOR\HHVXVHWKHLUNQRZOHGJHDQGH[SHULHQFH
WRGHFLGHDFWDQGWDNHUHVSRQVLELOLW\IRU63,

±±
$33(1',;$

(SLVWHPRORJ\4XHVWLRQVUHJDUGLQJWKHQDWXUHRIWKHUHODWLRQVKLSEHWZHHQWKHUHVHDUFKHUDQG
ZKDWFDQEHNQRZQ *XED /LQFROQ 
(6( UHVHDUFK $QDO\VLV EDVHG RQ WKH LQYHVWLJDWLRQ RI DFWXDO SUDFWLFH IRU WKH SXUSRVH RI
GLVFRYHULQJWKHXQNQRZQRUWHVWLQJDK\SRWKHVLV
(VSRXVHGWKHRU\7KHWKHRU\RIDFWLRQZKLFKLVDGYDQFHGWRH[SODLQRUMXVWLI\DJLYHQSDWWHUQ
RIDFWLYLW\ $UJ\ULV 6FK|Q 
([SHULHQFH  'LUHFWREVHUYDWLRQRIRUSDUWLFLSDWLRQLQHYHQWVDVDEDVLVRINQRZOHGJH 
7KH IDFW RU VWDWH RI KDYLQJ EHHQ DIIHFWHG E\ RU JDLQHG NQRZOHGJH WKURXJK GLUHFW
REVHUYDWLRQRUSDUWLFLSDWLRQ 0HUULDP:HEVWHU 
([SHULHQFHEDVH$QLQWHJUDWHGFROOHFWLRQRIH[SHULHQFHSDFNDJHV
([SHULHQFH)DFWRU\$QRUJDQL]DWLRQWKDWVXSSRUWVUHXVHRIH[SHULHQFHDQGFROOHFWLYHOHDUQLQJ
ZLWKLQDVRIWZDUHRUJDQL]DWLRQ %DVLOLHWDOD 
([SHULHQFHSDFNDJH([WHUQDOL]HGH[SHULHQFHSDFNDJHGLQDIRUPWKDWPDNHVLWDYDLODEOHIRU
IXWXUHXVH
([SHULPHQW$QHPSLULFDOLQTXLU\WKDWLQYHVWLJDWHVH[SODQDWRU\UHODWLRQV,WLVHVSHFLDOO\ZHOO
VXLWHGIRUDQVZHULQJTXHVWLRQVDERXWKRZDQGZK\ <LQ 
([WHUQDOL]DWLRQ 7KH HQDFWPHQW RI ORFDO UHDOLW\ WKH SURFHVV RI FUHDWLQJ RUJDQL]DWLRQDO
LQVWLWXWLRQVV\VWHPVDQGURXWLQHVE\WDNLQJDFWLRQDQGXVLQJODQJXDJHWRH[SUHVVRQHVHOI
WRWKHH[WHUQDOZRUOG %HUJHU /XFNPDQQ 
)DFLOLWDWLQJIDFWRUV7KHFRQGLWLRQVWKDWIDFLOLWDWHRUHQDEOHNQRZOHGJHFUHDWLRQDQG63,7KH\
DUHWKHNH\IDFWRUVIRUVXFFHVVWKDWWKHVRIWZDUHRUJDQL]DWLRQPXVWSXWLQSODFHLQRUGHUWR
IDFLOLWDWHWKHRUJDQL]DWLRQ¶VOHDUQLQJF\FOHDQGLPSURYHLWVGHYHORSPHQWSURFHVVHV
)DFW7KRVHWKLQJVRUSKHQRPHQDWKDWZHEHOLHYHDUHWUXH
)HHGEDFNVHVVLRQ$OHDUQLQJIRUXPWKDWLVUHJXODUO\KHOGGXULQJDPHDVXUHPHQWSURJUDP
*RDO4XHVWLRQ0HWULF $Q DSSURDFK WR JRDORULHQWHG PHDVXUHPHQW LQ VRIWZDUH SURMHFWV
%DVLOLHWDOE 
+\SRWKHVLV $ FRQMHFWXUDO VWDWHPHQW RI WKH UHODWLRQVKLS EHWZHHQ WZR RU PRUH YDULDEOHV WKDW
FDUU\FOHDULPSOLFDWLRQVIRUWHVWLQJWKHVWDWHGUHODWLRQ .HUOLQJHU 
,PSURYLVDWLRQ 7KH UHZRUNLQJ RI SUHFRPSRVHG PDWHULDO DQG GHVLJQV LQ UHODWLRQ WR XQDQ
WLFLSDWHG LGHDV FRQFHLYHG VKDSHG DQG WUDQVIRUPHG XQGHU WKH VSHFLDO FRQGLWLRQV RI SHU
IRUPDQFHWKHUHE\DGGLQJXQLTXHIHDWXUHVWRHYHU\FUHDWLRQ %HUOLQHU 
,QGHSHQGHQW YDULDEOH 7KH YDULDEOH LQ D VWXG\ WKDW LV WKH SUHVXPHG FDXVH RI WKH SUHVXPHG
HIIHFW,WLV³LQGHSHQGHQWRI´SULRUFDXVHVWKDWDFWRQLW 'DYLV 
,QGXFWLYH UHVHDUFK 5HVHDUFK WKDW EHJLQV ZLWK GHWDLOHG REVHUYDWLRQV RI WKH ZRUOG PRYLQJ
WRZDUG DEVWUDFW JHQHUDOL]DWLRQV DQG WKHRULHV DQG HYHQWXDOO\ WR WKH IRUPXODWLRQ RI
K\SRWKHVHV
,QIRUPDWLRQ  ([WHUQDOL]HGNQRZOHGJH  $UHGXFWLRQLQXQFHUWDLQW\ 6KDQQRQ :HDYHU
 RUWKHGLIIHUHQFHVWKDWPDNHDGLIIHUHQFH %DWHVRQ 

±±
7(50,12/2*<

,QVWUXPHQW FRQVWUXFWLRQ 7KH SURFHVV RI GHYHORSLQJ WKH GDWD FROOHFWLRQ GHYLFH LQ RUGHU WR
GHILQHDQGREWDLQUHOHYDQWGDWDIRUDJLYHQUHVHDUFKTXHVWLRQ
,QWHUQDOL]DWLRQ 7KH SURFHVV E\ ZKLFK LQGLYLGXDOV RU JURXSV RI LQGLYLGXDOV JLYH PHDQLQJ WR
RUJDQL]DWLRQDO UHDOLW\ PDNLQJ LW SDUW RI WKHLU RZQ ORFDO UHDOLW\ %HUJHU  /XFNPDQQ
 
,QWHUSUHWLYLVP $ SKLORVRSK\ WKDW PDLQWDLQV WKDW UHDOLW\ LV D VXEMHFWLYH FRQVWUXFWLRQ RI WKH
PLQG DQG WKDW LWV IRUP DQG FRQWHQW GHSHQGV RQ WKH LQGLYLGXDO KROGLQJ WKH FRQVWUXFWLRQ
/HH 
,QWHUYHQLQJ YDULDEOH $ YDULDEOH WKDW HPHUJHV DV D IXQFWLRQ RI WKH LQGHSHQGHQW YDULDEOH
RSHUDWLQJLQDVLWXDWLRQDQGKHOSVWRH[SODLQWKHLQIOXHQFHRIWKHLQGHSHQGHQWYDULDEOHRQ
WKHGHSHQGHQWYDULDEOH 'DYLV 
,QYROYHGOHDGHUVKLS7KHH[WHQWWRZKLFKOHDGHUVDWDOOOHYHOVLQWKHRUJDQL]DWLRQDUHJHQXLQHO\
FRPPLWWHGWRDQGDFWLYHO\SDUWLFLSDWHLQ63,
.QRZLQJ7KHHSLVWHPRORJLFDOGLPHQVLRQRIDFWLRQ &RRN %URZQ 
.QRZOHGJH  7KHIDFWRUFRQGLWLRQRINQRZLQJVRPHWKLQJZLWKIDPLOLDULW\JDLQHGWKURXJK
H[SHULHQFHRUDVVRFLDWLRQ 0HUULDP:HEVWHU   -XVWLILHGWUXHEHOLHI
.QRZOHGJH FUHDWLRQ $ FRQWLQXRXV DQG G\QDPLF LQWHUDFWLRQ EHWZHHQ WDFLW DQG H[SOLFLW
NQRZOHGJH 1RQDND 7DNHXFKL 
/HDGHUVKLS6HHµ,QYROYHGOHDGHUVKLS¶
/HDUQLQJ 7KH SURFHVV ZKHUHE\ NQRZOHGJH LV FUHDWHG WKURXJK WKH WUDQVIRUPDWLRQ RI
H[SHULHQFH .ROE 
/HDUQLQJ F\FOH $ GLDOHFWLF SURFHVV WKDW LQWHJUDWHV ORFDO H[SHULHQFH DQG RUJDQL]DWLRQDO
FRQFHSWV
/HDUQLQJ VRIWZDUH RUJDQL]DWLRQ $ VRIWZDUH RUJDQL]DWLRQ WKDW SURPRWHV LPSURYHG DFWLRQV
WKURXJKEHWWHUNQRZOHGJHDQGXQGHUVWDQGLQJ
/HDUQLQJVWUDWHJ\7KHH[WHQWWRZKLFKDVRIWZDUHRUJDQL]DWLRQLVHQJDJHGLQWKHH[SORLWDWLRQ
RIH[LVWLQJNQRZOHGJHDQGLQWKHH[SORUDWLRQRIQHZNQRZOHGJH
/HVVRQV OHDUQHG &RQFLVH DQG LQVLJKWIXO H[SHULHQFHV WKDW FDQ EH IUXLWIXOO\ DSSOLHG LQ IXWXUH
HQGHDYRUV
/RFDO UHDOLW\ 7KH ZD\ DQ LQGLYLGXDO RU D JURXS RI LQGLYLGXDOV SHUFHLYH WKH ZRUOG LQ ZKLFK
WKH\OLYH %HUJHU /XFNPDQQ 
/RQJLWXGLQDO UHVHDUFK 5HVHDUFK LQ ZKLFK PHDVXUHV RI WKH VDPH VDPSOH RU SRSXODWLRQ DUH
WDNHQUHSHDWHGO\ DWOHDVWWZLFH WKURXJKWLPH
0HDVXUH'DWDDVVLJQHGWRDQHQWLW\LQRUGHUWRFKDUDFWHUL]HDQDWWULEXWH )HQWRQ 3IOHHJHU
 
0HDVXUHPHQW7KHSURFHVVE\ZKLFKGDWDLVDVVLJQHGWRDWWULEXWHVRIHQWLWLHVLQWKHUHDOZRUOG
LQVXFKDZD\DVWRGHVFULEHWKHPDFFRUGLQJWRFOHDUO\GHILQHGUXOHV )HQWRQ 3IOHHJHU
 
0HDVXUHPHQWLQVWUXPHQW$GDWDFROOHFWLRQGHYLFH LQWKLVVWXG\DTXHVWLRQQDLUH 

±±
$33(1',;$

0HDVXUHPHQWVFDOH$GHYLFHWKDWLVXVHGWRDVVLJQQXPEHUVWRDVSHFWVRIREMHFWVDQGHYHQWV
0HWKRG$SURFHGXUHRUSURFHVVIRUDWWDLQLQJDQREMHFW 0HUULDP:HEVWHU 
0HWKRGRORJ\ 4XHVWLRQV UHJDUGLQJ KRZ WKH UHVHDUFKHU JDLQV NQRZOHGJH DERXW WKH
SKHQRPHQRQXQGHUVWXG\ *XED /LQFROQ 
0HWULF$SURSHUW\RIDSURFHVVSURGXFWRUUHVRXUFH
0RGHO$EVWUDFWLRQVRIUHDOLW\DOORZLQJXVWRVWULSDZD\GHWDLODQGYLHZDQHQWLW\RUFRQFHSW
IURPDSDUWLFXODUSHUVSHFWLYH )HQWRQ 3IOHHJHU 
0RGHUDWLQJ YDULDEOH $ YDULDEOH WKDW KDV D VWURQJ HIIHFW RQ DQ LQGHSHQGHQWGHSHQGHQW
UHODWLRQVKLS 'DYLV 
2EVHUYDWLRQ 3HUFHSWLRQ RI UHDOLW\ E\ QRWLQJ VRPH REMHFW RU WKH RFFXUUHQFH RI VRPH
SKHQRPHQRQLQWKHLPPHGLDWHHQYLURQPHQW 'DYLV 
2QWRORJ\4XHVWLRQVUHJDUGLQJWKHIRUPDQGQDWXUHRIUHDOLW\DQGWKHUHIRUHDERXWZKDWWKHUH
LVWKDWFDQEHNQRZQDERXWLW *XED /LQFROQ 
2SHUDWLRQDOL]DWLRQ 7KH SURFHVV RI OLQNLQJ D FRQFHSWXDO GHILQLWLRQ WR D VSHFLILF VHW RI
PHDVXUHPHQWWHFKQLTXHVRUSURFHGXUHV 1HXPDQ 
2UJDQL]DWLRQDOFRQWH[W7KH JHQHUDOHQYLURQPHQWWKDWLPSRVHVFRQVWUDLQWV DQG RSSRUWXQLWLHV
DERXWZKDWWKHRUJDQL]DWLRQFDQDQGFDQQRWGRZLWKUHVSHFWWRRUJDQL]DWLRQDOOHDUQLQJDQG
63,
2UJDQL]DWLRQDOLVVXHV$Q\GLVWLQFWDUHDRQWKHLQWHUIDFHEHWZHHQWKHWHFKQLFDOV\VWHPDQGWKH
VRFLDO V\VWHP ZKLFK FDQ HQDEOH VRIWZDUH SURFHVV LPSURYHPHQWV 7KH WKHVLV IRFXVHV RQ
WZRFODVVHVRIVXFKLVVXHV  WKHVRFLDOO\FRQVWUXFWHGOHDUQLQJSURFHVVHVDQG  WKHNH\
IDFWRUVWKDWIDFLOLWDWHLPSURYHPHQWVLQRUJDQL]DWLRQDOSHUIRUPDQFH
2UJDQL]DWLRQDO OHDUQLQJ 7KH SURFHVV RI LPSURYLQJ DFWLRQV WKURXJK EHWWHU NQRZOHGJH DQG
XQGHUVWDQGLQJ )LRO /\OHV )RUDOWHUQDWLYHGHILQLWLRQVVHH)LJXUH
2UJDQL]DWLRQDOPHPRU\7KHPHDQVE\ZKLFKDVRIWZDUHRUJDQL]DWLRQ¶VNQRZOHGJHIURPWKH
SDVWLVEURXJKWWREHDURQSUHVHQWDFWLYLWLHV
2UJDQL]DWLRQDOUHDOLW\7KHVRFLDORUGHURULQVWLWXWLRQWKDWH[LVWVEHFDXVHHYHU\ERG\UHODWHWRLW
LQWKHLUDFWLRQV %HUJHU /XFNPDQQ 
3DUDGLJP $ FRPPRQDOLW\ RI SHUVSHFWLYH ZKLFK ELQGV WKH ZRUN RI D JURXS RI WKHRULVWV
WRJHWKHU %XUUHOODQG0RUJDQ 
3RSXODWLRQ7KHFRPSOHWHVHWRIXQLWVRIDQDO\VLVWKDWDUHXQGHULQYHVWLJDWLRQ 'DYLV 
3RVLWLYLVP$SKLORVRSK\WKDWDUJXHVIRUWKHDSSOLFDWLRQRIWKHPHWKRGVRIWKHQDWXUDOVFLHQFHV
WRWKHVRFLDOVFLHQFHVDQGWKHUHE\SUHVXSSRVHVWKHXQLW\RIVFLHQFH 'HODQW\ 
3UDJPDWLVP $ SKLORVRSK\ EDVHG RQ WKH SURSRVLWLRQ WKDW UHVHDUFKHUV VKRXOG XVH ZKDWHYHU
SKLORVRSKLFDO DQGRU PHWKRGRORJLFDO DSSURDFK WKDW ZRUNV IRU WKH SDUWLFXODU UHVHDUFK
SUREOHPXQGHUVWXG\ 7DVKDNNRUL 7HGGOLH 
3URFHVV$SDUWLDOO\RUGHUHGVHWRIDFWLYLWLHVWRSURGXFHDVSHFLILFRXWSXW

±±
7(50,12/2*<

3URFHVVDVVHVVPHQW$QDSSUDLVDORUUHYLHZRID VRIWZDUH RUJDQL]DWLRQDQGLWVSURFHVVHVWR


DGYLFH LWV PDQDJHPHQW DQG SURIHVVLRQDOV RQ KRZ WKH\ FDQ LPSURYH WKHLU RSHUDWLRQ
+XPSKUH\ 
3URFHVVFDSDELOLW\7KHDELOLW\RIDSURFHVVWRDFKLHYHDUHTXLUHGJRDO ,62,(&75
 
3URFHVV FRQIRUPDQFH 7KH GHJUHH RI DJUHHPHQW EHWZHHQ D SURFHVV H[HFXWLRQ DQG D SURFHVV
PRGHO 6¡UXPJnUG 
3URFHVV LPSURYHPHQW $Q LQWHUYHQWLRQ VWUDWHJ\ WKDW LQYROYHV FRQWLQXRXV RU LQFUHPHQWDO
FKDQJHWRWKHRUJDQL]DWLRQDQGLWVSURFHVVHV
3URFHVVLQQRYDWLRQ$QLQWHUYHQWLRQVWUDWHJ\WKDWLQYROYHVUDGLFDOFKDQJHWRWKHRUJDQL]DWLRQ
ZLWKUHSODFHPHQWRILWVSURFHVVHV
3URFHVVPRGHO$QDEVWUDFWGHVFULSWLRQRID VRIWZDUH SURFHVV
4XDOLW\  7KHWRWDOLW\RIIHDWXUHVDQGFKDUDFWHULVWLFVRIDSURGXFWRUVHUYLFHWKDWEHDURQLWV
DELOLW\WRVDWLVI\VWDWHGRULPSOLHGQHHGV ,62   $ELOLW\RIDVHWRILQKHUHQW
FKDUDFWHULVWLFVRIDSURGXFWV\VWHPRUSURFHVVWRIXOILOOUHTXLUHPHQWVRIFXVWRPHUVDQG
RWKHULQWHUHVWHGSDUWLHV ,62 
4XDOLW\DVVXUDQFH3DUWRITXDOLW\PDQDJHPHQWIRFXVHGRQSURYLGLQJFRQILGHQFHWKDWTXDOLW\
UHTXLUHPHQWVDUHIXOILOOHG ,62 
4XDOLW\ ,PSURYHPHQW 3DUDGLJP $ JRDOGULYHQ IUDPHZRUN IRU FRQWLQXRXV LPSURYHPHQW RI
VRIWZDUHGHYHORSPHQWDQGPDLQWHQDQFH %DVLOLHWDOD 
4XDOLW\PDQDJHPHQW&RRUGLQDWHGDFWLYLWLHVWRGLUHFWDQGFRQWURODQRUJDQL]DWLRQZLWKUHJDUG
WRTXDOLW\ ,62 
4XDOLW\PDQDJHPHQWV\VWHP6\VWHPWRHVWDEOLVKDTXDOLW\SROLF\DQGTXDOLW\REMHFWLYHVDQGWR
DFKLHYHWKRVHREMHFWLYHV ,62 
4XHVWLRQQDLUHLWHP$TXHVWLRQDQGLWVDVVRFLDWHGPHDVXUHPHQWVFDOH
5HOLDELOLW\ 7KH FRQVLVWHQF\ DQG VWDELOLW\ RI D VFRUH IURP D PHDVXUHPHQW VFDOH $QDVWDVL
8UELQD 
5HVHDUFKGHVLJQ$JXLGHXVHGE\UHVHDUFKHUVLQWKHLUTXHVWWRDQVZHUWKHUHVHDUFKTXHVWLRQ
DQGVROYHWKHSUREOHPVXQGHUVWXG\D³EOXHSULQW´RIUHVHDUFK <LQ 
6DPSOH7KHVXEVHWRIXQLWVRIDQDO\VLVFKRVHQIRUVWXG\IURPDSRSXODWLRQ 'DYLV 
6DPSOLQJIUDPH$SK\VLFDOUHSUHVHQWDWLRQRIREMHFWVLQGLYLGXDOVJURXSVHWFLPSRUWDQWWR
WKHGHYHORSPHQWRIWKHILQDOVWXG\VDPSOH 'DYLV 
6LQJOHORRS OHDUQLQJ ,QVWUXPHQWDO OHDUQLQJ WKDW FKDQJHV VWUDWHJLHV RI DFWLRQ RU DVVXPSWLRQV
XQGHUO\LQJ VWUDWHJLHV LQ ZD\V WKDW OHDYH WKH YDOXHV RI D WKHRU\ RI DFWLRQ XQFKDQJHG
$UJ\ULV 6FK|Q 



,QWKLVFRQWH[WUHTXLUHPHQWLVGHILQHGDV³QHHGRUH[SHFWDWLRQWKDWLVVWDWHGFXVWRPDULO\LPSOLHGRU
REOLJDWRU\´ ,62 

±±
$33(1',;$

6RFLDOFRQVWUXFWLYLVP$SKLORVRSK\WKDWPDLQWDLQVWKDWVRFLDOUHDOLW\LVFRQVWUXFWHGWKURXJKD
GLDOHFWLFDO SURFHVV EHWZHHQ H[WHUQDOL]DWLRQ RI LQGLYLGXDO VXEMHFWLYH UHDOLWLHV WKURXJK
DFWLRQ UHVXOWLQJ LQ REMHFWLYH UHDOLW\ DQG WKH LQWHUQDOL]DWLRQ RI WKLV REMHFWLYH UHDOLW\
WKURXJKVHQVHPDNLQJLQWRVXEMHFWLYHUHDOLW\ %HUJHU /XFNPDQQ 
6RIWZDUH &RPSXWHU SURJUDPV SURFHGXUHV DQG SRVVLEO\ DVVRFLDWHG GRFXPHQWDWLRQ DQG GDWD
SHUWDLQLQJWRWKHRSHUDWLRQRIDFRPSXWHUV\VWHP ,(((6WG 
6RIWZDUHGHYHORSPHQWSURFHVV7KHSURFHVVE\ZKLFKXVHUQHHGVDUHWUDQVODWHGLQWRDVRIWZDUH
SURGXFW ,(((6WG 
6RIWZDUHHQJLQHHULQJ  7KHDSSOLFDWLRQRIDV\VWHPDWLFGLVFLSOLQHGTXDQWLILDEOHDSSURDFK
WR WKH GHYHORSPHQW RSHUDWLRQ DQG PDLQWHQDQFH RI VRIWZDUH WKDW LV WKH DSSOLFDWLRQ RI
HQJLQHHULQJWRVRIWZDUH  7KHVWXG\RIDSSURDFKHVDVLQ   ,(((6WG 
6RIWZDUH RUJDQL]DWLRQ $ ZKROH FRPSDQ\ RU DQ LQGHSHQGHQW EXVLQHVV XQLW LQVLGH D ODUJHU
FRPSDQ\WKDWKDVVRIWZDUHGHYHORSPHQWDVLWVSULPDU\EXVLQHVV
6RIWZDUH SURFHVV $ FRKHUHQW VHW RI SROLFLHV RUJDQL]DWLRQDO VWUXFWXUHV WHFKQRORJLHV
SURFHGXUHV DQG DUWLIDFWV WKDW DUH QHHGHG WR FRQFHLYH GHYHORS GHSOR\ DQG PDLQWDLQ D
VRIWZDUHSURGXFW )XJJHWWD 
6RIWZDUHSURFHVVLPSURYHPHQW$FWLYLWLHVWR  GHILQHDQGPRGHODVRIWZDUHSURFHVV  WR
DVVHVVWKHSURFHVV  WRUHILQHWKHSURFHVVDQG  WRLQQRYDWHDQHZSURFHVV
6RIWZDUH SURGXFW   7KH FRPSOHWH VHW RI FRPSXWHU SURJUDPV SURFHGXUHV DQG SRVVLEO\
DVVRFLDWHG GRFXPHQWDWLRQ DQG GDWD GHVLJQDWHG IRU GHOLYHU\ WR D XVHU   $Q\ RI WKH
LQGLYLGXDOLWHPVLQ   ,(((6WG 
63, VXFFHVV 7KH SHUIRUPDQFH RU UHVXOWV RI WKH RUJDQL]DWLRQ¶V 63, DFWLYLWLHV 7KLV LV WKH
GHSHQGHQWYDULDEOHWKDWLVXVHGWRPHDVXUHWKDWJDLQVKDYHLQIDFWEHHQPDGHZLWKUHVSHFW
WRRUJDQL]DWLRQDOEHKDYLRUDQGSHUIRUPDQFH
6XUYH\$UHWURVSHFWLYHVWXG\RIDVLWXDWLRQWKDWLQYHVWLJDWHVUHODWLRQVKLSVDQGRXWFRPHV,WLV
HVSHFLDOO\ZHOOVXLWHGIRUDQVZHULQJTXHVWLRQVDERXWZKDWKRZPXFKDQGKRZPDQ\DV
ZHOODVTXHVWLRQVDERXWKRZDQGZK\ 3LQVRQQHDXOW .UDHPHU 
7HFKQLTXHV7HFKQLFDODQGPDQDJHULDOSURFHGXUHVWKDWDLGLQWKHHYDOXDWLRQDQGLPSURYHPHQW
RIWKHVRIWZDUHGHYHORSPHQWSURFHVV ,(((6WG 
7HFKQRORJ\  3K\VLFDOREMHFWVRUDUWLIDFWV  DFWLYLWLHVRUSURFHVVHVDQG  NQRZOHGJHRU
SRWHQWLDODFWLRQV 0DF.HQ]LH :DMFPDQ 
7KHRU\ $Q LQWHUUHODWHG VHW RI VWDWHPHQWV RI UHODWLRQVKLSV ZKRVH SXUSRVH LV WR H[SODLQ DQG
SUHGLFW 'DYLV 
7KHRU\LQXVH 7KH WKHRU\ RI DFWLRQ ZKLFK LV LPSOLFLW LQ WKH SHUIRUPDQFH RI D SDWWHUQ RI
DFWLYLW\ $UJ\ULV 6FK|Q 
9DOLGLW\   7KH EHVW DYDLODEOH DSSUR[LPDWLRQ WR WKH WUXWK RI SURSRVLWLRQV LQFOXGLQJ
SURSRVLWLRQVDERXWFDXVH &RRN &DPSEHOO   $PHDVXUHPHQWVFDOHLVYDOLGLILW
GRHVZKDWLWLVVXSSRVHGWRGRDQGPHDVXUHVZKDWLWLVVXSSRVHGWRPHDVXUH &URQEDFK
 
9DULDEOH$V\PERORUDFRQFHSWWKDWFDQDVVXPHDQ\RQHRIDVHWRIYDOXHV 'DYLV 

±±
$SSHQGL[%,QWHUYLHZ*XLGH

4 .QRZOHGJHRIURXWLQHV
4'HVFULEHWKH SRVVLEOH FRQWHQWVLQURXWLQHVEHLQJXVHGIRUVRIWZDUHGHYHORSPHQW
4+RZZHUHWKHVHURXWLQHVLQWURGXFHGLQWKHFRPSDQ\"
4:KDWZDVWKHSXUSRVHRIWKHVHURXWLQHV"
4:KDWLV\RXSHUVRQDOLPSUHVVLRQRIWKHURXWLQHV"

4 8VHRIURXWLQHV
4:KDWVWDWXVGRHVDJLYHQURXWLQHKDYHDPRQJGHYHORSHUV"
47RZKDWGHJUHHDUHWKHURXWLQHVDFWXDOO\EHLQJXVHG"
4:KRDUHWKHPRVWDFWLYHSDVVLYHXVHUV"
4:KDWLVWKHDYDLODELOLW\RIWKHURXWLQHV"
4+RZLVIROORZXSDQGFRQWURORIXVDJHGRQH"

4 8SGDWLQJRIURXWLQHV
4:KDWSURFHGXUHVDUHXVHGWRXSGDWHWKHURXWLQHV"
4:KRSDUWLFLSDWHVLQWKHXSGDWHDFWLYLWLHV"

4 5RXWLQHVDVDPHGLXPIRUWUDQVIHURINQRZOHGJHDQGH[SHULHQFH
4'R\RXUHJDUGZULWWHQURXWLQHVDVDQHIILFLHQWPHGLXPIRUWUDQVIHURINQRZOHGJH
DQGH[SHULHQFH"
4:KDW DOWHUQDWLYHV WR ZULWWHQ URXWLQHV GR \RX WKLQN DUH XVHIXO RU LQ XVH LQ WKH
FRPSDQ\"
4:KDWEDUULHUVDJDLQVWWUDQVIHURIH[SHULHQFHVGR\RXWKLQNDUHPRVWLPSRUWDQW"

±±
$SSHQGL[&([DPSOHRI5HVXOWV
IURPDQ([SORUDWRU\6WXG\LQ&;

,Q WKLV DSSHQGL[ ZH LQFOXGH WKH UHVXOWV IURP DQ H[SORUDWRU\ VWXG\ WKDW ZDV FRQGXFWHG LQ
&RPSDQ\;WRYDOLGDWHWKHOLWHUDWXUHGHULYHGIDFWRUVHQDEOLQJ63,VXFFHVV7KHGDWDFROOHFWLRQ
PHWKRGXVHGWRGHULYHNH\IDFWRUVIRUVXFFHVVZDVWKUHHTXHVWLRQQDLUHLWHPVDQGDIROORZXS
JURXSLQWHUYLHZ IHHGEDFN VHVVLRQ  )RU WKH SXUSRVH RI WKH UHVXOWV SUHVHQWHG LQ WKLV FKDSWHU
GDWDFROOHFWLRQIRFXVHGRQDQVZHULQJRQHTXHVWLRQ

x ,Q\RXURSLQLRQZKDWDUHWKHWKUHHPRVWLPSRUWDQWIDFWRUVHQDEOLQJ63,VXFFHVVLQ\RXU
RUJDQL]DWLRQ"

,QRUGHUWRJDLQPRUHEDFNJURXQGLQIRUPDWLRQDERXWWKHHQDEOLQJIDFWRUVRI63,VXFFHVVRXU
TXHVWLRQLQJVWUDWHJ\LQFOXGHGWZRDGGLWLRQDOTXHVWLRQV)LUVWZHDVNHGWKHVXEMHFWVDERXWWKHLU
PRVWLPSRUWDQWDUJXPHQWLQIDYRURI63,LQWKHLURUJDQL]DWLRQ6HFRQGZHDVNHGWKHVXEMHFWV
DERXWWKHLUPRVWLPSRUWDQWDUJXPHQWDJDLQVW63,LQWKHLURUJDQL]DWLRQ7KHDQVZHUVWRWKHVH
TXHVWLRQVJDYHXVYDOXDEOHLQIRUPDWLRQIRULQWHUSUHWLQJWKHHQDEOLQJIDFWRUV
7HQ SURFHVV PDQDJHUV DQVZHUHG WKH WKUHH TXHVWLRQV DQG SDUWLFLSDWHG LQ WKH VXEVHTXHQW
IHHGEDFNVHVVLRQ7KHUHVXOWRIFRGLQJWKHILHOGGDWDLQWRWKHRUHWLFDOFRQFHSWVZDVWKHVHWRI
ILYH HQDEOLQJ IDFWRUV IRU 63, VXFFHVV VKRZQ LQ 7DEOH & (DFK IDFWRU ZDV PHQWLRQHG E\ DW
OHDVWWKUHHVXEMHFWV

$QVZHUVWRWKHTXHVWLRQV

 :KDWLVWKHPRVWLPSRUWDQWDUJXPHQWLQIDYRURI63,LQ\RXURUJDQL]DWLRQ"
x %HGUHPXOLJKHWHUIRU´EHGUH´SURVMHNWHUGYVGHVRPRSSIDWWHVVRP¡QVNHOLJHSURVMHNWHU
VRP´YL´KDUO\VWWLOnMREEHPHG
x ‘NHSURIHVMRQDOLWHWHQLQQDGRJK¡\QHSRVLVMRQHQPKWNYDOLWHWRJHIIHNWLYLWHWXWDG
x ,QYHVWHULQJLPHUHIIHNWLYSURGXNVMRQ%HGUHLQQWMHQLQJK¡\HUHVDOJ0HUWLOIUHGVVWLOOHQGH
DUEHLGVVLWXDVMRQ
x $YJM¡UHQGHIRUIUHPWLGLJNRQNXUUDQVHG\NWLJKHW



7KLVVWXG\ZDVRQHRIIRXUVXFKVWXGLHVSHUIRUPHGLQIRXUGLIIHUHQWFRPSDQLHVZLWKDWRWDORI
PDQDJHUVGHYHORSHUVDQGFXVWRPHUUHSUHVHQWDWLYHVWRYDOLGDWHWKHOLWHUDWXUHGHULYHGIDFWRUV

±±
$33(1',;&

x )OHUHInUQ\WWHWLOVDPPHNRVWQDGYHGYHNVWLDQWDOODQVDWWH
x 9LPnIRUEHGUHSURVHVVHQHIRUnEHYDUHRJ¡NHYnUNRQNXUUDQVHNUDIW
x *MHQQRPSURVHVVIRUEHGULQJYLOYLNXQQHOHYHUHSURGXNWHUPHGK¡\HUHNYDOLWHWRJWLO
ODYHUHNRVWQDG'HWWHYLONXQQHSnYLUNHDUEHLGVWLOIUHGVKHWHQLSRVLWLYUHWQLQJ
x 7LOSDVQLQJWLOVWDGLJIRUEHGUHWIRUVWnHOVHDYHJHQRUJDQLVDVMRQ7LOSDVQLQJWLOHNVWHUQH
UDPPHEHWLQJHOVHU1\WHNQRORJLQ\HOHYHUDQVHNDQDOHUQ\HOHYHUDQVHPXOLJKHWHU
x .RQWLQXHUOLJWLOSDVQLQJWLOHNVWHUQIRUDQGULQJ'\QDPLVNRJXWIRUGUHQGHDUEHLGVSODVV
x 'HWHURJYLODOOWLGY UHP\HVRPNDQRJE¡UIRUEHGUHV

 :KDWLVWKHPRVWLPSRUWDQWDUJXPHQWDJDLQVWRI63,LQ\RXURUJDQL]DWLRQ"
x 9LOVNDSH´NXOWXU´NRQIOLNWHULRUJDQLVDVMRQHQ
x )DUHIRUnGHPSHGHQHQNHOWHVNUHDWLYLWHWRJDQVYDUOLJKHWRYHUIRUVLQHRSSJDYHUYHGn
LQQI¡UHIRUULJLGHV\VWHPHUUXQGWGHQHQNHOWHVDUEHLGVRSSJDYHU
x 9DQVNHOLJnJMHQQRPI¡UHSJDOLWHQWUDGLVMRQLVW\ULQJE\UnNUDWLVHULQJ(QNHOWHNDQY UH
OLWHYLOOLJHWLOn´VHVHJVHOYLVSHLOHW´6W¡UUHDUEHLGVEHODVWQLQJSnKYHUPHGDUEHLGHU
x ,QQHE UHUP\HLQQVDWVVRPNDQVNMHLNNHEHWDOHUVHJWLOEDNHIHNVLIRUPDYnRSSQn
IRUVWnHOVHIRUGHWWHLKHOHRUJDQLVDVMRQHQ
x .RVWHUP\HRYHUEHYLVQLQJVNUDIW
x ,QJHQJRGHDUJXPHQWHUPRWSURVHVVIRUEHGULQJ
x 'HUVRPSURVHVVIRUEHGULQJEDUHEHW\UIRUPDOLVHULQJDYUXWLQHUYLOGHWWHIRUYLWUHGHQ
HQNHOWHVDQVYDUOLJKHW
x 'HWHUWURVVDOWUHVVXUVNUHYHQGH
x 'HWWDUWLGUHVVXUVHURJIRNXVYHNNIUDSURVMHNWHUVRPSDUDGRNVDOWQRNHOOHUVNXQQHOHYHUH
HWEHGUHSURGXNWWLONXQGHQ SnNRUWVLNW" 
x 9LNWLJKHOHWLGHQnSDVVHSnDWLNNHVHOYHDUEHLGHWPHGSURVHVVIRUEHGULQJVWMHOHUIRNXVIUD
GHWVRPVNDOIRUEHGUHV

 ,Q\RXURSLQLRQZKDWDUHWKHWKUHHPRVWLPSRUWDQWIDFWRUVHQDEOLQJ63,VXFFHVVLQ
\RXURUJDQL]DWLRQ"
x /HGHOVHVSULRULWHULQJ2SSO ULQJDYPHGDUEHLGHUH+HQVLNWVPHVVLJHIRUDQGULQJHU
x (QNOHRYHUVLNWOLJHUXWLQHUIUDEDVLVWULQQHQHLWLOEXGVRJSURVMHNWDUEHLG%HGUH
SURVMHNWSODQOHJJLQJRJ±VW\ULQJ.ODUHUHWQLQJVOLQMHUIRU4$JMHQQRPJDQJ
x 2SSO ULQJRJPRWLYDVMRQ)HOOHVIRUVWnHOVHDYPnO0nNXQQHVHJHYLQVWHU
x )RUPDOLVHULQJDYHVWLPHULQJLQVSHNVMRQRJPnOLQJVOLNDWGHWWHVW¡WWHURSSRP
RYHURUGQHGHPnO3URVMHNWJMHQQRPI¡ULQJVVW¡WWHLQNOIRUEHGULQJVPRPHQWHU,QQI¡ULQJDY
REOLJDWRULVNHVWDQGDUGHU
x ,KHUGLJKHWRJNRQWLQXLWHWEODQWGHVRPVNDOI¡OJHRSSIRUEHGULQJVDUEHLGHWRJUXWLQHQH
UXQGWGHWWH$NVHSWEODQWGHVRPSULRULWHUHUSHUVRQHOOUHVVXUVHU$QHUNMHQQHOVHDYHYW
HNVWUDWLGVEUXNWLOSURVHVVIRUEHGULQJSnNRUWVLNWIRUnInIRUGHOHUSnODQJVLNW

±±
(;$03/(2)5(68/76)520$1(;3/25$725<678'<,1&;

x .UDIWLJHUHPHUHQHUJLVNLPSOHPHQWHULQJDYDOOHUHGHHWDEOHUWHSURVHVVHU%HGUH
V\QOLJJM¡ULQJRJEHGUHRSSI¡OJLQJDYVHOYHIRUEHGULQJVDUEHLGHW%HGUHYHUNW¡\IRUnPnOH
RJHWWHUSU¡YHHIIHNWHQDYIRUEHGULQJVWLOWDN
x 8WI¡UHVLNRQNUHWHSURVMHNWHU7DVLQQVRPHQGHODYSURVMHNWSODQHQH2SSI¡OJLQJL
RUJDQLVDVMRQHQSnKYDVRPRSSQnV
x 2PIRUHQWVLWXDVMRQVIRUVWnHOVH LQWHUQRJHNVWHUQ 0HGYLUNQLQJ3ULRULWHULQJ
x 9LOOLJKHWWLOnSU¡YHRJIHLOH.XQQVNDSVGHOLQJ2YHUVLNWRYHUIDNWLVNHIRUKROG
x 7RSSOHGHOVHIRUDQNULQJ2SSOHYHVPHQLQJVI\OWQ\WWLJDYGHDQVDWWH)RUEHGUHERWWRPOLQH
UHVXOWDW

7DEOH&)DFWRUVHQDEOLQJ63,VXFFHVVLQ&RPSDQ\;

(QDEOLQJ)DFWRUV ([SODQDWLRQRI(QDEOLQJ)DFWRUV

/HDGHUVKLS,QYROYHPHQW /HGHOVHVSULRULWHULQJ7RSSOHGHOVHIRUDQNULQJ$NVHSWEODQWGH
VRPSULRULWHUHUSHUVRQHOOUHVVXUVHU3ULRULWHULQJ$QHUNMHQQHOVHDY
WLGVEUXNWLOSURVHVVIRUEHGULQJSnNRUWVLNWIRUnInIRUGHOHUSnODQJ
VLNW

(PSOR\HH3DUWLFLSDWLRQ 0HGYLUNQLQJ2SSO ULQJDYPHGDUEHLGHUH2SSO ULQJRJ
PRWLYDVMRQ2SSOHYHVPHQLQJVI\OWQ\WWLJDYGHDQVDWWH

/HDUQLQJIURP([SHULHQFH .XQQVNDSVGHOLQJ+HQVLNWVPHVVLJHIRUDQGULQJHU(QNOH
RYHUVLNWOLJHUXWLQHU)RUPDOLVHULQJ,QQI¡ULQJDYVWDQGDUGHU

&RQFHUQIRU0HDVXUHPHQW 0nOHRJHWWHUSU¡YHHIIHNWHQDYIRUEHGULQJVWLOWDN6\QOLJJM¡ULQJRJ
RSSI¡OJLQJDYIRUEHGULQJVDUEHLGHW2YHUVLNWRYHUIDNWLVNHIRUKROG
0nNXQQHVHJHYLQVWHU2SSI¡OJLQJLRUJDQLVDVMRQHQSnKYDVRP
RSSQnV

%XVLQHVV2ULHQWDWLRQ )RUEHGUHERWWRPOLQHUHVXOWDW2PIRUHQWVLWXDVMRQVIRUVWnHOVH
LQWHUQRJHNVWHUQ )HOOHVIRUVWnHOVHDYPnO8WI¡UHVLNRQNUHWH
SURVMHNWHU7DVLQQVRPHQGHODYSURVMHNWSODQHQH3URVMHNW
JMHQQRPI¡ULQJVVW¡WWH



±±
$SSHQGL['2ULJLQDO/LVWRI
)DFLOLWDWLQJ)DFWRUVDQG,QGLFDWRUV

7KHLWHPVPDUNHGE\DQDVWHULVN ZHUHGURSSHGDIWHUWKHH[SHUWUHYLHZ ,WHPVPDUNHGE\


WZR DVWHULVNV  ZHUH HYHQWXDOO\ GHOHWHG LQ RUGHU WR LPSURYH WKH UHOLDELOLW\ RI WKH ILQDO
LQVWUXPHQW

.H\)DFWRUV 3RWHQWLDO,QGLFDWRUV

%XVLQHVV2ULHQWDWLRQ xDPRXQWRIVSHFLILFJRDOVIRU63,ZLWKLQWKHFRPSDQ\
xH[WHQWRIJRDORULHQWDWLRQLQ63,DFWLYLWLHV
xH[WHQWRIORQJWHUPSODQQLQJRI63,DFWLYLWLHV
xH[WHQWWRZKLFK63,JRDOVDQGSROLF\DUHXQGHUVWRRG
xGHJUHHRILQWHJUDWLQJ63,DFWLRQVZLWK³UHDO´ZRUN
xH[WHQWWRZKLFK63,JRDOVDUHDOLJQHGZLWKEXVLQHVVJRDOV
xWKRURXJKQHVVLQWKHSULRULW\RILPSURYHPHQWDFWLRQV
xGHJUHHRIEDODQFHEHWZHHQVKRUWWHUPDQGORQJWHUPJRDOV
/HDGHUVKLS,QYROYHPHQW xGHJUHHRISDUWLFLSDWLRQE\PDQDJHPHQWLQWKH63,SURFHVV
xDFFHSWDQFHRIUHVSRQVLELOLW\IRU63,E\PDQDJHPHQW
xH[WHQWWRZKLFKWRSPDQDJHPHQWKDVREMHFWLYHVIRUVRIWZDUH
SHUIRUPDQFH
xGHJUHHWRZKLFKWRSPDQDJHPHQWLVHYDOXDWHGIRUVRIWZDUH
SHUIRUPDQFH
xGHJUHHWRZKLFKPDQDJHPHQWFRQVLGHUV63,DVDZD\WRLQFUHDVH
FRPSHWLWLYHDGYDQWDJH
xDPRXQWRIUHYLHZRI63,LVVXHVLQWRSPDQDJHPHQWPHHWLQJV

&RQFHUQIRU0HDVXUHPHQW xLPSRUWDQFHRIPHDVXULQJSHUIRUPDQFH
xDYDLODELOLW\RITXDOLW\GDWD GHIHFWVWLPHOLQHVVHWF
xH[WHQWWRZKLFKTXDOLW\GDWDDUHDYDLODEOHWRGHYHORSHUV
xH[WHQWWRZKLFKTXDOLW\GDWDDUHDYDLODEOHWRPDQDJHUV
xH[WHQWWRZKLFKTXDOLW\GDWDFKDUWVHWFDUHGLVSOD\HGLQFRUULGRUV
HWF
xH[WHQWWRZKLFKVLPSOHVWDWLVWLFDOWRROVDUHXVHG
xDPRXQWRIIHHGEDFNSURYLGHGWRGHYHORSHUVRQWKHLUSHUIRUPDQFH

±±
$33(1',;'

.H\)DFWRUV 3RWHQWLDO,QGLFDWRUV

(PSOR\HH3DUWLFLSDWLRQ xH[WHQWRIHPSOR\HHLQYROYHPHQWLQGHFLVLRQVDERXWZKDWVKRXOGEHVW
EHGRQHDWWKHLURZQOHYHO FRGHWHUPLQDWLRQ
xH[WHQWRIHPSOR\HHSDUWLFLSDWLRQLQGHYHORSPHQWSODQQLQJ
xH[WHQWRIGHYHORSHUSDUWLFLSDWLRQLQWKHIRUPDOL]DWLRQRIURXWLQHV
xH[WHQWWRZKLFKHPSOR\HHVFRQWULEXWHZLWKLPSURYHPHQWSURSRVDOV
xH[WHQWRIHPSOR\HHLQWHUDFWLRQZLWKFXVWRPHUVDQGVXSSOLHUV
xH[WHQWWRZKLFKHPSOR\HHVKDYHUHVSRQVLELOLW\IRU63,
xDPRXQWRIWUDLQLQJLQ63,FRQFHSWV
xH[WHQWRIGHYHORSHUSDUWLFLSDWLRQLQJRDOVHWWLQJGDWDDQDO\VLVDQG
LQWHUSUHWDWLRQ
xH[WHQWRISDUWLFLSDWRU\PDQDJHPHQW
xH[WHQWRIRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXWVRIWZDUH
GHYHORSPHQW
xH[WHQWRIRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXW63,
([SORLWDWLRQRIH[LVWLQJNQRZOHGJH xH[WHQWWRZKLFKH[LVWLQJNQRZOHGJHLVH[SORLWHG
xH[WHQWRIOHDUQLQJIURPSDVWH[SHULHQFH
xGHJUHHRIHODERUDWLRQRIH[LVWLQJLGHDVVWUDWHJLHVDQGWHFKQRORJLHV
xGHJUHHRIV\VWHPL]DWLRQRISDVWH[SHULHQFH
xLPSRUWDQFHRIIRUPXODWLQJH[SHULHQFHLQWRH[SOLFLWFRQFHSWV
xGHJUHHWRZKLFKIRUPDOURXWLQHVDUHEDVHGRQSDVWH[SHULHQFH
xH[WHQWWRZKLFKFRPSXWHUL]HGRUJDQL]DWLRQDOPHPRU\DUHXVHG
xLPSRUWDQFHRIQDUURZ VSHFLDOL]HG VNLOOV
xLPSRUWDQFHRIPD[LPXPEUHDNGRZQRIWDVN
xH[WHQWRIVHDUFKLQJIRUVWDELOLW\
xGHJUHHRILQWHUQDOH[SHULHQFHWUDQVIHU
xH[WHQWRIULVNDYHUVLRQ
([SHULPHQWDWLRQ xH[WHQWRIH[SORUDWLRQRIQHZNQRZOHGJH
xGHJUHHRIH[SHULPHQWDWLRQZLWKQHZLGHDVVWUDWHJLHVDQG
WHFKQRORJLHV
xLPSRUWDQFHRIH[SORULQJRSSRUWXQLWLHV
xH[WHQWWRZKLFKLQQRYDWLRQFKDQJHLVHQFRXUDJHG
xGHJUHHRIOHDUQLQJIURPRWKHURUJDQL]DWLRQV
xH[WHQWWRZKLFKULVNWDNLQJLVHQFRXUDJHG
xLPSRUWDQFHRIPXOWLSOHEURDGVNLOOV
xGHJUHHRIDGDSWDELOLW\WRUDSLGFKDQJHLQFUHDVLQJFRPSOH[LW\DQG
HQYLURQPHQWDOXQFHUWDLQW\
xDELOLW\WRTXHVWLRQXQGHUO\LQJYDOXHV

2SHUDWLRQDOYDULHW\ xLPSRUWDQFHRIPDWFKLQJWKHYDULHW\DQGFRPSOH[LW\RIWKH
RUJDQL]DWLRQ¶VHQYLURQPHQW
xH[WHQWRIYDULHW\LQWKHXVHRIPHWKRGVWHFKQLTXHVDQGWRROV
xH[WHQWWRZKLFKGLYHUVLW\LVDSSUHFLDWHG
xGHJUHHRIGHWDLOLQWDVNVSHFLILFDWLRQV PLQLPXPFULWLFDOVSHFLILFDWLRQ
xGHJUHHRIIOH[LELOLW\LQWDVNH[HFXWLRQ
xLPSRUWDQFHRIRSWLPXPYDULHW\LQWDVNSHUIRUPDQFH
xLPSRUWDQFHRIRSWLPXPJURXSLQJRIWDVNV

±±
$SSHQGL[(
0HDVXUHPHQW,QVWUXPHQW

3DUWLFLSDQWVLQWKHVWXG\ZHUHDVNHGWRPDUNRUFLUFOHWKHEHVWUHVSRQVHWRHDFKVWDWHPHQWRQ
WKH IROORZLQJ SRLQW VFDOH ³6WURQJO\ GLVDJUHH´ ³'LVDJUHH´ ³1HLWKHU DJUHH QRU GLVDJUHH´
³$JUHH´DQG³6WURQJO\DJUHH´IRUHDFKRIWKHIROORZLQJIDFWRUV

%XVLQHVV2ULHQWDWLRQ
 :HKDYHHVWDEOLVKHGXQDPELJXRXVJRDOVIRUWKHRUJDQL]DWLRQ¶V63,DFWLYLWLHV
 7KHUHLVDEURDGXQGHUVWDQGLQJRI63,JRDOVDQGSROLF\ZLWKLQRXURUJDQL]DWLRQ
 2XU63,DFWLYLWLHVDUHFORVHO\LQWHJUDWHGZLWKVRIWZDUHGHYHORSPHQWDFWLYLWLHV
 2XU63,JRDOVDUHFORVHO\DOLJQHGZLWKWKHRUJDQL]DWLRQ¶VEXVLQHVVJRDOV
 :HKDYHDILQHEDODQFHEHWZHHQVKRUWWHUPDQGORQJWHUP63,JRDOV

/HDGHUVKLS,QYROYHPHQW
 0DQDJHPHQWLVDFWLYHO\VXSSRUWLQJ63,DFWLYLWLHV
 0DQDJHPHQWDFFHSWVUHVSRQVLELOLW\IRU63,
 0DQDJHPHQWFRQVLGHUV63,DVDZD\WRLQFUHDVHFRPSHWLWLYHDGYDQWDJH
 0DQDJHPHQWLVDFWLYHO\SDUWLFLSDWLQJLQ63,DFWLYLWLHV
63,LVVXHVDUHRIWHQGLVFXVVHGLQWRSPDQDJHPHQWPHHWLQJV

(PSOR\HH3DUWLFLSDWLRQ
6RIWZDUHGHYHORSHUVDUHLQYROYHGWRDJUHDWH[WHQWLQGHFLVLRQVDERXWWKHLPSOHPHQWDWLRQ
RIWKHLURZQZRUN
6RIWZDUHGHYHORSHUVDUHDFWLYHO\FRQWULEXWLQJZLWK63,SURSRVDOV
6RIWZDUHGHYHORSHUVDUHDFWLYHO\LQYROYHGLQFUHDWLQJURXWLQHVDQGSURFHGXUHVIRUVRIWZDUH
GHYHORSPHQW
:HKDYHDQRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXWVRIWZDUHGHYHORSPHQW
6RIWZDUHGHYHORSHUVKDYHUHVSRQVLELOLW\UHODWHGWRWKHRUJDQL]DWLRQ¶V63,DFWLYLWLHV



6WDUUHGLWHPVZHUHUHPRYHGIURPWKHILQDOYHUVLRQRIWKHLQVWUXPHQWDQGVKRXOGQRWEHXVHG

±±
$33(1',;(

6RIWZDUHGHYHORSHUVDUHDFWLYHO\LQYROYHGLQVHWWLQJJRDOVIRURXU63,DFWLYLWLHV
:HKDYHDQRQJRLQJGLDORJXHDQGGLVFXVVLRQDERXW63,

&RQFHUQIRU0HDVXUHPHQW
:HFRQVLGHULWDVLPSRUWDQWWRPHDVXUHRUJDQL]DWLRQDOSHUIRUPDQFH
:HUHJXODUO\FROOHFWTXDOLW\GDWD HJGHIHFWVWLPHOLQHVV IURPRXUSURMHFWV
,QIRUPDWLRQRQTXDOLW\GDWDLVUHDGLO\DYDLODEOHWRVRIWZDUHGHYHORSHUV
,QIRUPDWLRQRQTXDOLW\GDWDLVUHDGLO\DYDLODEOHWRPDQDJHPHQW
:HXVHTXDOLW\GDWDDVDEDVLVIRU63,
2XUVRIWZDUHSURMHFWVJHWUHJXODUIHHGEDFNRQWKHLUSHUIRUPDQFH

([SORLWDWLRQRI([LVWLQJ.QRZOHGJH
:HH[SORLWWKHH[LVWLQJRUJDQL]DWLRQDONQRZOHGJHWRWKHXWPRVWH[WHQW
:HDUHV\VWHPDWLFDOO\OHDUQLQJIURPWKHH[SHULHQFHRISULRUSURMHFWV
2XUURXWLQHVIRUVRIWZDUHGHYHORSPHQWDUHEDVHGRQH[SHULHQFHIURPSULRUSURMHFWV
:HFROOHFWDQGFODVVLI\H[SHULHQFHIURPSULRUSURMHFWV
:HSXWJUHDWHPSKDVLVRQLQWHUQDOWUDQVIHURISRVLWLYHDQGQHJDWLYHH[SHULHQFH
7RWKHH[WHQWZHFDQDYRLGLWZHGRQRWWDNHULVNVE\H[SHULPHQWLQJ ZLWKQHZZD\VRI
ZRUNLQJ

([SORUDWLRQRI1HZ.QRZOHGJH
:HDUHYHU\FDSDEOHDWPDQDJLQJXQFHUWDLQW\LQWKHRUJDQL]DWLRQ¶VHQYLURQPHQW
,QRXURUJDQL]DWLRQZHHQFRXUDJHLQQRYDWLRQDQGFUHDWLYLW\
:HRIWHQFDUU\RXWWULDOVZLWKQHZVRIWZDUHHQJLQHHULQJPHWKRGVDQGWRROV
:HRIWHQFRQGXFWH[SHULPHQWVZLWKQHZZD\VRIZRUNLQJZLWKVRIWZDUHGHYHORSPHQW
:HKDYHWKHDELOLW\WRTXHVWLRQ³HVWDEOLVKHG´WUXWKV
:HDUHYHU\IOH[LEOHLQWKHZD\ZHFDUU\RXWRXUZRUN
:HGRQRWVSHFLI\ZRUNSURFHVVHVPRUHWKDQZKDWLVDEVROXWHO\QHFHVVDU\
:H PDNH WKH PRVW RI WKH GLYHUVLW\ LQ WKH GHYHORSHU¶V VNLOOV DQG LQWHUHVWV WR PDQDJH WKH
YDULHW\DQGFRPSOH[LW\RIWKHRUJDQL]DWLRQ¶VHQYLURQPHQW

2UJDQL]DWLRQDO3HUIRUPDQFH
 2XU63,ZRUNKDVVXEVWDQWLDOO\LQFUHDVHGRXUVRIWZDUHHQJLQHHULQJFRPSHWHQFH
 2XU63,ZRUNKDVVXEVWDQWLDOO\LPSURYHGRXURYHUDOOSHUIRUPDQFH
 2YHUWKHSDVW\HDUVZHKDYHJUHDWO\UHGXFHGWKHFRVWRIVRIWZDUHGHYHORSPHQW
 2YHUWKHSDVW\HDUVZHKDYHJUHDWO\UHGXFHGWKHF\FOHWLPHRIVRIWZDUHGHYHORSPHQW
 2YHUWKHSDVW\HDUVZHKDYHJUHDWO\LQFUHDVHGRXUFXVWRPHU¶VVDWLVIDFWLRQ

±±
$SSHQGL[)4XHVWLRQQDLUH

6S¡UUHXQGHUV¡NHOVHRP
3526(66)25%('5,1*,352*5$09$5(879,./,1*

,QQOHGQLQJ
,VDPDUEHLGPHG1RUJHVIRUVNQLQJVUnGJMHQQRPI¡UHU1RUJHVWHNQLVNQDWXUYLWHQVNDSOLJHXQLYHUVLWHW 1718
RJ6,17()HQVS¡UUHXQGHUV¡NHOVHRPIRUEHGULQJVDUEHLGNQ\WWHWWLOXWYLNOLQJDYSURJUDPYDUH'HQQHXQGHU
V¡NHOVHQHUGHODYHQVW¡UUHQDVMRQDOVDWVLQJSnNXQQVNDSVIRUPLGOLQJRJIRUEHGULQJLQRUVNHSURJUDPYDUH
PLOM¡HU5HVXOWDWHQHIUDVS¡UUHXQGHUV¡NHOVHQLQQJnURJVnVRPHQGHODYHWGRNWRUJUDGVDUEHLGYHG1718

+HQVLNWHQPHGXQGHUV¡NHOVHQHUnVWXGHUHGHRUJDQLVDVMRQVPHVVLJHIRUKROGHQHVRPRIWHOHJJHUI¡ULQJHUIRU
HQGULQJVRJIRUEHGULQJVDUEHLGLWHNQRORJLEHGULIWHU,VS¡UUHVNMHPDHWHUIRUEHGULQJVDUEHLGGHILQHUWVRPDOW
RUJDQLVDVMRQVPHVVLJRJWHNQLVNUHWWHWDUEHLGIRUnIRUEHGUHHNVLVWHUHQGHPnWHUnXWYLNOHSURJUDPYDUHSn
+RYHGGHOHQDYVS¡UUHVNMHPDHWEHVWnUDYHQUHNNHXWVDJQVRPNDUDNWHULVHUHUHQRUJDQLVDVMRQ9LEHURPDW
GXIRUKYHUWXWVDJQDQJLULKYRUVWRUJUDGGXHUHQLJXHQLJLDWGHWWHXWVDJQHWNDUDNWHULVHUHUGLQRUJDQLVDVMRQ
+YLVGHWHUIOHUHHQKHWHULRUJDQLVDVMRQHQVRPXWYLNOHUSURJUDPYDUHEHUYLRPDWGXVYDUHUIRUGHQHQKHWHQ
GXNMHQQHUEHVW

'LQGHOWDNHOVHLXQGHUV¡NHOVHQHUYLNWLJIRUGLGXKDUHQVHQWUDOSRVLVMRQLHQEHGULIWVRPXWYLNOHU
SURJUDPYDUHRJIRUGLGXKDUYLNWLJHHUIDULQJHULIRUKROGWLOKYDVRPVNDOWLOIRUnO\NNHVPHGIRUEHGULQJV
DUEHLGLHQNXQQVNDSVEHGULIW8WI\OOLQJDYGHWYHGODJWHVS¡UUHVNMHPDHWWDUFDPLQXWWHU

$OOHRSSO\VQLQJHUYLOEOLEHKDQGOHWIRUWUROLJ+YHUNHQQDYQSnSHUVRQHUHOOHUEHGULIWHUYLOEOLQHYQWL
IRUVNQLQJVUDSSRUWHU+YLVGX¡QVNHUnInWLOVHQGWUDSSRUWHQIUDGHQQHXQGHUV¡NHOVHQYHQQOLJVWVNULYQDYQRJ
DGUHVVHQHGHUVWSnGHQQHVLGHQHOOHUVHQGRVVHWYLVLWWNRUW(YHQWXHOOHVS¡UVPnORPXQGHUV¡NHOVHQNDQUHWWHV
WLOXQGHUWHJQHGHYLDHSRVW7RUH'\ED#LQIRUPDWLFVVLQWHIQRHOOHUSnWHOHIRQ

-HJYLOVHWWHVWRUSULVSnRPGXNDQWDGHJWLGWLOnI\OOHXWVS¡UUHVNMHPDHWRJUHWXUQHUHGHWLYHGODJWH
VYDUNRQYROXWWLO¡SHWDYWRXNHU3nIRUKnQGWXVHQWDNNIRUKMHOSHQ

0HGYHQQOLJKLOVHQ

7RUH'\En
6,17()7HOHRJGDWD
7URQGKHLP

±±
$33(1',;)

9HQQOLJVWPDUNHUKYRUJRGWGXPHQHUI¡OJHQGHXWVDJQEHVNULYHUIRUEHGULQJVDUEHLGLGLQRUJDQLVDVMRQ
6WHUNW +YHUNHQHQLJ 6WHUNW
/ ULQJIUDHJQHHUIDULQJHU XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 9LXWQ\WWHUGHQHNVLVWHUHQGHNXQQVNDSHQLEHGULIWHQPDNVLPDOW … … … … …
 9LO UHUV\VWHPDWLVNIUDHJQHSURVMHNWHUIDULQJHU … … … … …
 8WYLNOLQJVUXWLQHQHYnUHHUEDVHUWSnHUIDULQJHUIUDWLGOLJHUH … … … … …
SURVMHNWHU
 9LWDUYDUHSnRJV\VWHPDWLVHUHUHUIDULQJHUIUDJMHQQRPI¡UWH … … … … …
SURVMHNWHU
 9LOHJJHUVWRUYHNWSnLQWHUQVSUHGQLQJDYSRVLWLYHRJQHJDWLYH … … … … …
HUIDULQJHU
 ,GHQJUDGYLNDQXQQJnGHWWDUYLLNNHULVLNRYHGnSU¡YHXW … … … … …
DUEHLGVPHWRGHUVRPYLLNNHKDUHUIDULQJPHG

6WHUNW +YHUNHQHQLJ 6WHUNW


/HGHOVHVHQJDVMHPHQW XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 /HGHOVHQJLUDNWLYVW¡WWHWLOIRUEHGULQJVDUEHLG … … … … …
 /HGHOVHQWDUDQVYDUIRUIRUEHGULQJVDUEHLG … … … … …
 /HGHOVHQLQQVHUDWIRUEHGULQJVDUEHLGNDQELGUDWLO¡NW … … … … …
NRQNXUUDQVHNUDIW
 /HGHOVHQGHOWDUDNWLYWLEHGULIWHQVIRUEHGULQJVDUEHLG … … … … …
 )RUEHGULQJVDUEHLGEOLURIWHGLVNXWHUWLOHGHUP¡WHU … … … … …

6WHUNW +YHUNHQHQLJ 6WHUNW


)RUUHWQLQJVRULHQWHULQJ XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 9LKDUHWDEOHUWNODUHPnOIRUEHGULIWHQVIRUEHGULQJVDUEHLG … … … … …
 'HWHUEUHGIRUVWnHOVHIRUIRUEHGULQJVPnORJ±SROLF\LEHGULIWHQ … … … … …
 )RUEHGULQJVDUEHLGHWHUWHWWLQWHJUHUWPHGXWYLNOLQJVDUEHLG … … … … …
 )RUEHGULQJVDUEHLGHWE\JJHURSSXQGHUEHGULIWHQVRYHURUGQHGH … … … … …
IRUUHWQLQJVPHVVLJHPnO
 9LKDUHQJRGEDODQVHPHOORPNRUWVLNWLJHRJODQJVLNWLJH … … … … …
IRUEHGULQJVPnO

6WHUNW +YHUNHQHQLJ 6WHUNW


0nOLQJ XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 9LDQVHUGHWVRPYLNWLJnPnOHEHGULIWHQVSUHVWDVMRQHU … … … … …
 9LVDPOHUUHJHOPHVVLJLQQNYDOLWHWVGDWD IHLOIRUVLQNHOVHU … … … … …
HQGULQJHUHWF IUDSURVMHNWHQHYnUH
 .YDOLWHWVGDWDHUOHWWWLOJMHQJHOLJIRUXWYLNOHUH … … … … …
 .YDOLWHWVGDWDHUOHWWWLOJMHQJHOLJIRUOHGHOVHQ … … … … …
 .YDOLWHWVGDWDEHQ\WWHVVRPJUXQQODJIRUIRUEHGULQJ … … … … …
 8WYLNOLQJVSURVMHNWHQHInUUHJHOPHVVLJWLOEDNHPHOGLQJ … … … … …
IHHGEDFN SnGHWDUEHLGHWGHXWI¡UHU

±±
48(67,211$,5(

9HQQOLJVWPDUNHUKYRUJRGWGXPHQHUI¡OJHQGHXWVDJQEHVNULYHUIRUEHGULQJVDUEHLGLGLQRUJDQLVDVMRQ
6WHUNW +YHUNHQHQLJ 6WHUNW
8WSU¡YLQJRJIOHNVLELOLWHW XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 9LHUVY UWG\NWLJHWLOnKnQGWHUHXVLNNHUKHWLEHGULIWHQV … … … … …
RPJLYHOVHU
 ,YnUEHGULIWRSSIRUGUHVGHWWLOQ\WHQNLQJRJNUHDWLYLWHW … … … … …
 9LSU¡YHURIWHXWQ\HPHWRGHURJYHUNW¡\ … … … … …
 9LHNVSHULPHQWHUHURIWHPHGQ\HPnWHUnDUEHLGHSn … … … … …
 9LKDUHYQHWLOnVWLOOHVS¡UVPnOYHG´YHGWDWWH´VDQQKHWHU … … … … …
 9LHUVY UWIOHNVLEOHLIRUKROGWLOKYRUGDQDUEHLGVRSSJDYHQH … … … … …
XWI¡UHV
 9LVSHVLILVHUHULNNHDUEHLGVRSSJDYHUPHUGHWDOMHUWHQQGHWVRP … … … … …
HUDEVROXWWQ¡GYHQGLJ
 9LXWQ\WWHUDNWLYWYDULDVMRQHQLGHDQVDWWHVNRPSHWDQVHRJ … … … … …
LQWHUHVVHUWLOnKnQGWHUHYDULDVMRQHQRJNRPSOHNVLWHWHQWLO
EHGULIWHQVRPJLYHOVHU

6WHUNW +YHUNHQHQLJ 6WHUNW


0HGYLUNQLQJIUDXWYLNOHUQH XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 8WYLNOHUQHKDUVWRULQQIO\WHOVHSnRUJDQLVHULQJHQDYGHWDUEHLGHW … … … … …
GHVHOYXWI¡UHU
 8WYLNOHUQHGHOWDUDNWLYWPHGIRUVODJWLOIRUEHGULQJDY … … … … …
XWYLNOLQJVDUEHLGHW
 8WYLNOHUQHGHOWDUDNWLYWLXWIRUPLQJDYUXWLQHURJSURVHG\UHUIRU … … … … …
XWYLNOLQJ
 3ULQVLSSHUIRUXWYLNOLQJDYSURJUDPYDUHEOLUMHYQOLJGLVNXWHUW … … … … …
EODQWXWYLNOHUQH
 8WYLNOHUQHKDUDQVYDUVRSSJDYHUNQ\WWHWWLOEHGULIWHQV … … … … …
IRUEHGULQJVDUEHLG
 8WYLNOHUQHGHOWDUDNWLYWLnVHWWHNRQNUHWHPnOIRU … … … … …
IRUEHGULQJVDUEHLGHW
 )RUEHGULQJDYXWYLNOLQJVSURVHVVHUEOLUMHYQOLJGLVNXWHUWEODQW … … … … …
XWYLNOHUQH
 8WYLNOHUQHGHOWDUDNWLYWLDUEHLGHWPHGnSODQOHJJHQ\H … … … … …
SURVMHNWHU

9HQQOLJVWPDUNHUKYRUJRGWGXPHQHUI¡OJHQGHXWVDJQEHVNULYHURSSQnGGHUHVXOWDWHUDYIRUEHGULQJV
DUEHLGLGLQRUJDQLVDVMRQ
6WHUNW +YHUNHQHQLJ 6WHUNW
5HVXOWDWHU XHQLJ 8HQLJ HOOHUXHQLJ (QLJ (QLJ

 )RUEHGULQJVDUEHLGHWYnUWKDUJLWWHQEHW\GHOLJ¡NQLQJLJHQHUHOO … … … … …
XWYLNOLQJVNRPSHWDQVH
 )RUEHGULQJVDUEHLGHWYnUWKDUI¡UWWLODWYLJM¡UHQYHVHQWOLJEHGUH … … … … …
MREE
 ,O¡SHWDYGHVLVWHWUHnUHQHKDUYLRSSQnGGYHVHQWOLJH … … … … …
NRVWQDGVUHGXNVMRQHULXWYLNOLQJDYSURJUDPYDUH
 ,O¡SHWDYGHVLVWHWUHnUHQHKDUYLRSSQnGGYHVHQWOLJH … … … … …
UHGXNVMRQHULXWYLNOLQJVWLGIRUSURJUDPYDUH
 ,O¡SHWDYGHVLVWHWUHnUHQHKDUYLRSSQnGGYHVHQWOLJ¡NQLQJL … … … … …
NXQGHWLOIUHGVKHW

±±
$33(1',;)

*HQHUHOOLQIRUPDVMRQ

+YRUPDQJHDQVDWWHHUGHWLGLQEHGULIW" BBBBBBBBB
+YRUPDQJHDYGLVVHMREEHUPHGSURJUDPYDUHXWYLNOLQJ" BBBBBBBBB

+YDHUGHWSULP UHPDUNHGVVHJPHQWWLOEHGULIWHQ" PDUNHUHWWYDOJ
…%DQNILQDQVIRUVLNULQJ …2IIHQWOLJVHNWRU …,QGXVWUL …(OHNWURQLNNWHOHNRP

…$QQHW BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB

+YLONHQUROOHKDUSURJUDPYDUHSURVMHNWHULGLQEHGULIW" PDUNHUHWWYDOJ
…8WYLNOLQJVDOJDYK\OOHYDUH …8WYLNOLQJIRUHNVWHUQHNXQGHU …8WYLNOLQJIRULQWHUQWEUXN

3nHQVNDODIUDWLOKYRUGDQYLOGXNDUDNWHULVHUHEHGULIWHQVRPJLYHOVHU"
6WDELO! 8VWDELO
      
… … … … … … …

8IRUXWVLJEDU! )RUXWVLJEDU
      
… … … … … … …

+DUEHGULIWHQHWDNWLYWIRUEHGULQJVHOOHUNYDOLWHWVSURJUDP" …-D …1HL


+YLV-$KYRUPDQJHnUHUGHWVLGHQRSSVWDUWDYGHWWHSURJUDPPHW" BBBBBBBBBBB

0RGHOOHURJVWDQGDUGHUVRPHULDNWLYEUXNLEHGULIWHQ" PDUNHUDOOHVRPHULEUXN
…,6263,&( …6(,&00,'($/ …%RRWVWUDS

…,62  …()40 740 …(66,63,4

…$QQHW BBBBBBBBBBBBBBBBBBBBBBBBBBBBB

+YDHUGLQMREEWLWWHO" BBBBBBBBBBBBBBBBBBBBBBBBBBBBB
+YDHUGLQK¡\HVWHIXOOI¡UWHXWGDQQLQJ"
…,QJK¡\VNROHFDQGPDJHOOHUWLOVYDUHQGH …6LYLOLQJHQL¡UKRYHGIDJHOOHUWLOVYDUHQGH

…'RNWRUJUDG …$QQHWBBBBBBBBBBBBBBBBBBBBBBBBB

+YRUPDQJHnUVHUIDULQJKDUGXPHGSURJUDPYDUHXWYLNOLQJ"BBBBBBBBBBBBBB
+YRUPDQJHnUKDUGXDUEHLGHWLGHQQHEHGULIWHQ" BBBBBBBBBBBBBB

7XVHQWDNNIRUDWGXWRNGHJWLGWLOnVYDUHSnGLVVHVS¡UVPnOHQH

±±
$SSHQGL[*6XUYH\'DWD

,G ([SORUDWLRQ /HDGHUVKLS %XVLQHVV 0HDVXUHPHQW ([SORUDWLRQ 3DUWLFLSDWLRQ


0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     

±±
$33(1',;*

,G ([SORUDWLRQ /HDGHUVKLS %XVLQHVV 0HDVXUHPHQW ([SORUDWLRQ 3DUWLFLSDWLRQ


0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     

±±
6859(<'$7$

,G ([SORUDWLRQ /HDGHUVKLS %XVLQHVV 0HDVXUHPHQW ([SORUDWLRQ 3DUWLFLSDWLRQ


0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
0                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     
3                                     

±±
$33(1',;*

,G 3HUIRUPDQFH 6L]H ,QGXVWU\ 3URGXFW (QYLURQP 4$ -RE (GX 6ZH[S 2UJH[S


EXVLQHVV IXQFWLRQ
0               
0               
0               
0               
0               
0               
0               
0              "" 
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               

±±
6859(<'$7$

,G 3HUIRUPDQFH 6L]H ,QGXVWU\ 3URGXFW (QYLURQP 4$ -RE (GX 6ZH[S 2UJH[S


EXVLQHVV IXQFWLRQ
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               

±±
$33(1',;*

,G 3HUIRUPDQFH 6L]H ,QGXVWU\ 3URGXFW (QYLURQP 4$ -RE (GX 6ZH[S 2UJH[S


EXVLQHVV IXQFWLRQ
0               
0               
0              "" 
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
0               
3               
3               
3               
3               
3               
3               
3               
3               
3               
3               
3               
3               

±±
5HIHUHQFHV

$%'(/+$0,'7.  7KH6OLSSHU\3DWKWR3URGXFWLYLW\,PSURYHPHQW,(((6RIWZDUH


9RO1RSS
$%'(/+$0,'7. $1' 0$'1,&.6(  7KH(OXVLYH6LOYHU/LQLQJ+RZ:H)DLOWR
/HDUQIURP6RIWZDUH'HYHORSPHQW)DLOXUHV6ORDQ0DQDJHPHQW5HYLHZ9RO1R
)DOOSS
$&.(50$1 06 $1' +$/9(5621 &$   5HH[DPLQLQJ 2UJDQL]DWLRQDO 0HPRU\
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
$'/(5 36 $1' %25<6 %   7ZR 7\SHV RI %XUHDXFUDF\ (QDEOLQJ DQG &RHUFLYH
$GPLQLVWUDWLYH6FLHQFH4XDUWHUO\9RO1RSS
$'/(536 $1' :,12*5$'7$ (GV   8VDELOLW\7XUQLQJ7HFKQRORJLHVLQWR7RROV
1HZ<RUN2[IRUG8QLYHUVLW\3UHVV
$+,5( 6/ $1' *2/+$5 '<   4XDOLW\ 0DQDJHPHQW LQ /DUJH YV 6PDOO )LUPV $Q
(PSLULFDO,QYHVWLJDWLRQ-RXUQDORI6PDOO%XVLQHVV0DQDJHPHQW9RO1RSS
$+,5(6/*2/+$5'<$1':$//(50$  'HYHORSPHQWDQG9DOLGDWLRQRI740
,PSOHPHQWDWLRQ&RQVWUXFWV'HFLVLRQ6FLHQFHV9RO1RSS
$1$67$6,$ $1' 85%,1$6  3V\FKRORJLFDO7HVWLQJ6HYHQWK(GLWLRQ8SSHU6DGGOH
5LYHU1HZ-HUVH\3UHQWLFH+DOO
$5',6 0$ $1' 0$5&2/,1 %/ (GV    'LIIXVLQJ 6RIWZDUH 3URGXFW DQG 3URFHVV
,QQRYDWLRQV ,),3 7& :* )RXUWK :RUNLQJ &RQIHUHQFH RQ 'LIIXVLQJ 6RIWZDUH
3URGXFWDQG3URFHVV,QQRYDWLRQV$SULO%DQII&DQDGD%RVWRQ.OXZHU
$5*<5,6&  +RZ /HDUQLQJ DQG 5HDVRQLQJ 3URFHVVHV $IIHFW 2UJDQL]DWLRQDO &KDQJH
LQ36*RRGPDQDQG$VVRFLDWHV (GV &KDQJHLQ2UJDQL]DWLRQV1HZ3HUVSHFWLYHVRQ
7KHRU\5HVHDUFKDQG3UDFWLFH6DQ)UDQFLVFR-RVVH\%DVV
$5*<5,6 &   2Q 2UJDQL]DWLRQDO /HDUQLQJ 6HFRQG (GLWLRQ 2[IRUG %ODFNZHOO
%XVLQHVV
$5*<5,6 & $1' 6&+g1 '$   2UJDQL]DWLRQDO /HDUQLQJ $ 7KHRU\ RI $FWLRQ
3HUVSHFWLYH5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
$5*<5,6 & $1' 6&+g1 '$   2UJDQL]DWLRQDO /HDUQLQJ ,, 7KHRU\ 0HWKRG DQG
3UDFWLFH5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
$5,6+2/0(6.$1'6(1-6$*/,.$1'6-‘%(5*'  ,PSURYLQJDQ(YROXWLRQDU\
'HYHORSPHQW 3URFHVV ± $ &DVH 6WXG\ 3URFHHGLQJV RI WKH (XURSHDQ 6RIWZDUH 3URFHVV
,PSURYHPHQW&RQIHUHQFH (XUR63,¶ 3RUL)LQODQG2FWREHU

±±
5()(5(1&(6

$50285 3*  7KH/DZVRI6RIWZDUH3URFHVV&RPPXQLFDWLRQVRIWKH$&09RO


1RSS
$6+%<:5  $Q,QWURGXFWLRQWR&\EHUQHWLFV/RQGRQ8.&KDSPDQ +DOO
$81( $   .YDOLWHWVVLUNOHU 3UREOHPO¡VQLQJVJUXSSHU IRU SHUVRQOLJ YHNVW NYDOLWHW RJ
SURGXNWXWYLNOLQJ 4XDOLW\&LUFOHV3UREOHP6ROYLQJ*URXSVIRU3HUVRQDO*URZWK4XDOLW\
DQG3URGXFW'HYHORSPHQW 2VOR8QLYHUVLWHWVIRUODJHW LQ1RUZHJLDQ 
$9,621 ' /$8 ) 0<(56 0 $1' 1,(/6(1 3$   $FWLRQ 5HVHDUFK
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
%$(7-(5 + -5   6RIWZDUH DV &DSLWDO $Q (FRQRPLF 3HUVSHFWLYH RQ 6RIWZDUH
(QJLQHHULQJ/RV$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVV
%$*2==,53  0HDVXUHPHQWLQ0DUNHWLQJ5HVHDUFK%DVLF3ULQFLSOHVRI4XHVWLRQQDLUH
'HVLJQ LQ 53 %DJR]]L (G  3ULQFLSOHV RI 0DUNHWLQJ 5HVHDUFK &DPEULGJH
0DVVDFKXVHWWV%ODFNZHOOSS
%$/=(5 5   7UDQVIRUPDWLRQDO ,PSOHPHQWDWLRQ $Q ([DPSOH ,((( 7UDQVDFWLRQV RQ
6RIWZDUH(QJLQHHULQJ9RO1RSS
%$528',-$1'25/,.2:6.,:  7KH3UREOHPRI6WDWLVWLFDO3RZHULQ0,65HVHDUFK
0,64XDUWHUO\9RO1RSS
%$55(77 )-   &UHDWLYLW\ DQG ,PSURYLVDWLRQ LQ -D]] DQG 2UJDQL]DWLRQV ,PSOLFDWLRQV
IRU2UJDQL]DWLRQDO/HDUQLQJ2UJDQL]DWLRQ6FLHQFH9RO1RSS
%$58&+ <   5HVSRQVH 5DWH LQ $FDGHPLF 6WXGLHV  $ &RPSDUDWLYH $QDO\VLV +XPDQ
5HODWLRQV9RO1RSS
%$6,/, 95   6RIWZDUH 'HYHORSPHQW $ 3DUDGLJP IRU WKH )XWXUH 3URFHHGLQJV RI WKH
WK$QQXDO,QWHUQDWLRQDO&RPSXWHU6RIWZDUH $SSOLFDWLRQV&RQIHUHQFH &2036$& 
.H\QRWH$GGUHVV2UODQGR)/6HSWHPEHU
%$6,/,95  7KH([SHULPHQWDO3DUDGLJPLQ6RIWZDUH(QJLQHHULQJLQ+'5RPEDFK
95 %DVLOL DQG 5 6HOE\ (GV  ([SHULPHQWDO 6RIWZDUH (QJLQHHULQJ ,VVXHV &ULWLFDO
$VVHVVPHQW DQG )XWXUH 'LUHFWLYHV 3URFHHGLQJV RI WKH 'DJVWXKO:RUNVKRS *HUPDQ\
/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH1R%HUOLQ6SULQJHU9HUODJSS
%$6,/,95  7KH5ROHRI([SHULPHQWDWLRQLQ6RIWZDUH(QJLQHHULQJ3DVW&XUUHQWDQG
)XWXUH 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO &RQIHUHQFH RQ 6RIWZDUH (QJLQHHULQJ
,&6( %HUOLQ*HUPDQ\0DUFKSS
%$6,/,95$1'&$/',(5$*  ,PSURYH6RIWZDUH4XDOLW\E\5HXVLQJ.QRZOHGJHDQG
([SHULHQFH6ORDQ0DQDJHPHQW5HYLHZ9RO1R$XWXPQSS
%$6,/,95$1'520%$&++'  7KH7$0(SURMHFW7RZDUGVLPSURYHPHQWRULHQWHG
VRIWZDUHHQYLURQPHQWV,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS

%$6,/,95 $1' 520%$&++'  6XSSRUWIRU&RPSUHKHQVLYH5HXVH,(((6RIWZDUH
(QJLQHHULQJ-RXUQDO9RO1RSS
%$6,/,95 $1' 6(/%<5:  3DUDGLJPVIRU([SHULPHQWDWLRQDQG(PSLULFDO6WXGLHV
LQ 6RIWZDUH (QJLQHHULQJ 5HOLDELOLW\ (QJLQHHULQJ DQG 6\VWHP 6DIHW\ 9RO  1RV 
SS

±±
REFERENCES

%$6,/, 95 $1' 7851(5 $-   ,WHUDWLYH (QKDQFHPHQW $ 3UDFWLFDO 7HFKQLTXH IRU
6RIWZDUH'HYHORSPHQW,((( 7UDQVDFWLRQV RQ 6RIWZDUH (QJLQHHULQJ 9RO  1R  SS

%$6,/,95 $1' :(,66'  $PHWKRGRORJ\IRUFROOHFWLQJYDOLGVRIWZDUHHQJLQHHULQJ
GDWD,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
%$6,/, 95 &$/',(5$ * $1' 520%$&+ +' D  ([SHULHQFH )DFWRU\ LQ --
0DUFLQLDN (G (QF\FORSHGLDRI6RIWZDUH(QJLQHHULQJ9RO-RKQ:LOH\ 6RQVSS

%$6,/, 95 &$/',(5$ * $1' 520%$&+ +' E  7KH *RDO 4XHVWLRQ 0HWULF
$SSURDFK LQ -- 0DUFLQLDN (G  (QF\FORSHGLD RI 6RIWZDUH (QJLQHHULQJ 9RO  -RKQ
:LOH\ 6RQVSS
%$6,/, 95 &21'21 6( (/ (0$0 . +(1'5,&. 5% $1' 0(/2 : 
&KDUDFWHUL]LQJ DQG 0RGHOLQJ WKH &RVW RI 5HZRUN LQ D /LEUDU\ RI 5HXVDEOH 6RIWZDUH
&RPSRQHQWV3URFHHGLQJVRIWKHWK,QWHUQDWLRQDO&RQIHUHQFHRQ6RIWZDUH(QJLQHHULQJ
SS
%$6,/, 95 6(/%< 5: $1' +87&+(16 '+   ([SHULPHQWDWLRQ LQ 6RIWZDUH
(QJLQHHULQJ,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
%$6.(59,//(5$1':22'+$53(5$7  $&ULWLFDO3HUVSHFWLYHRQ$FWLRQ5HVHDUFK
DVD0HWKRGIRU,QIRUPDWLRQ6\VWHPV5HVHDUFK-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO
1RSS
%$6.(59,//(5 $1' :22'+$53(5$7  'LYHUVLW\LQ,QIRUPDWLRQ6\VWHPV$FWLRQ
5HVHDUFK0HWKRGV(XURSHDQ-RXUQDORI,QIRUPDWLRQ6\VWHPV9RO1RSS
%$660$11 0- 0&*$55< ) $1' 3$-(56., 5   7KH 6RIWZDUH 0HDVXUHPHQW
*XLGHERRN5HYLVLRQ6RIWZDUH(QJLQHHULQJ/DERUDWRU\6HULHV6(/*UHHQEHOW
0DU\ODQG*RGGDUG6SDFH)OLJKW&HQWHU
%$7( 5 (G    $ 6\VWHPV (QJLQHHULQJ &DSDELOLW\ 0DWXULW\ 0RGHO 9HUVLRQ 
7HFKQLFDO 5HSRUW &086(,00 3LWWVEXUJK 3$ &DUQHJLH 0HOORQ 8QLYHUVLW\
6RIWZDUH(QJLQHHULQJ,QVWLWXWH
%$7(621*  6WHSVWRDQ(FRORJ\RI0LQG1HZ<RUN%DOODQWLQH%RRNV
%$7(621*  0LQGDQG1DWXUH$1HFHVVDU\8QLW\1HZ<RUN%DQWDP%RRNV
%$7,67$- $1''( ),*8(,5('2$'  63,LQD9HU\6PDOO7HDPD&DVHZLWK&00
6RIWZDUH3URFHVV±,PSURYHPHQWDQG3UDFWLFH9RO1RSS
%$80 /)   7KH :L]DUG RI 2] /RQGRQ 3HQJXLQ %RRNV RULJLQDOO\ SXEOLVKHG DV 7KH
:RQGHUIXO:L]DUGRI2]*HRUJH0+LOO&RPSDQ\ 
%$80*$57(/ +   8VLQJ (PSOR\HH 4XHVWLRQQDLUH 5HVXOWV IRU ,PSURYLQJ
2UJDQL]DWLRQV7KH6XUYH\µ)HHGEDFN¶([SHULPHQW.DQVDV%XVLQHVV5HYLHZ9ROSS
'HFHPEHU
%(&+72/' 57   ,PSURYLQJ WKH 6RIWZDUH 3URFHVV WKURXJK 3URFHVV 'HILQLWLRQ DQG
0RGHOLQJ/RQGRQ,QWHUQDWLRQDO7KRPVRQ&RPSXWHU3UHVV
%(&. .   ([WUHPH 3URJUDPPLQJ ([SODLQHG (PEUDFH &KDQJH 5HDGLQJ
0DVVDFKXVHWWV$GGLVRQ:HVO\
%((50(,6(167$75$ $1' 63(&725 %   :K\ &KDQJH 3URJUDPV 'RQ¶W 3URGXFH
&KDQJH+DUYDUG%XVLQHVV5HYLHZ9RO1RSS

±±
5()(5(1&(6

%(1%$6$7 , $1' =08' 5:   (PSLULFDO 5HVHDUFK LQ ,QIRUPDWLRQ 6\VWHPV 7KH
3UDFWLFHRI5HOHYDQFH0,64XDUWHUO\9RO1RSS
%(1%$6$7 , *2/'67(,1 '. $1' 0($' 0   7KH &DVH 5HVHDUFK 6WUDWHJ\ LQ
6WXGLHVRI,QIRUPDWLRQ6\VWHPV0,64XDUWHUO\9RO1RSS
%(1-$0,1 5 $1' /(9,1621 (   $ )UDPHZRUN IRU 0DQDJLQJ ,7(QDEOHG &KDQJH
6ORDQ0DQDJHPHQW5HYLHZ9RO1RSS
%(11(776 3'& :22'+$53(5 $7 $1' 0,//6 6   7KH 6RIW 6\VWHP
0HWKRGRORJ\DV D)UDPHZRUNIRU6RIWZDUH3URFHVV ,PSURYHPHQWLQ( 0F*XLUH (G 
6RIWZDUH3URFHVV,PSURYHPHQW&RQFHSWVDQG3UDFWLFHV/RQGRQ,GHD*URXS3XEOLVKLQJ
SS
%(11,6:* $1' 1$186%  /HDGHUV6WUDWHJLHVIRU7DNLQJ&KDUJH6HFRQG(GLWLRQ
1HZ<RUN+DUSHU%XVLQHVV
%(1621-.  $'LDOHFWLF0HWKRGIRUWKH6WXG\RI2UJDQL]DWLRQVLQ*0RUJDQ (G 
%H\RQG 0HWKRG 6WUDWHJLHV IRU 6RFLDO 5HVHDUFK 1HZEXU\ 3DUN &DOLIRUQLD 6DJH SS

%(1621 3* 6$5$3+ -9 $1' 6&+52('(5 5*   7KH (IIHFWV RI 2UJDQL]DWLRQDO
&RQWH[WRQ4XDOLW\0DQDJHPHQW$Q(PSLULFDO,QYHVWLJDWLRQ0DQDJHPHQW6FLHQFH9RO
1RSS
%(5*(5 3/$1' /8&.0$117  7KH6RFLDO&RQVWUXFWLRQRI5HDOLW\$7UHDWLVHLQWKH
6RFLRORJ\RI.QRZOHGJH+DUPRQGVZRUWK3HQJXLQ%RRNV
%(5/,1(5 3)   7KLQNLQJ LQ -D]] 7KH ,QILQLWH $UW RI ,PSURYLVDWLRQ &KLFDJR ,/
8QLYHUVLW\RI&KLFDJR3UHVV
%(55(0$1 *   $QHPLF DQG (PHWLF $QDO\VHV LQ 6RFLDO $QWKURSRORJ\ $PHULFDQ
$QWKURSRORJLVW9ROSS
%(55< 0 $1' -())(5< 5   $Q ,QVWUXPHQW IRU $VVHVVLQJ 6RIWZDUH 0HDVXUHPHQW
3URJUDPV(PSLULFDO6RIWZDUH(QJLQHHULQJ9RO1R1RYHPEHUSS
%,-.(5:(+8*+(673$1'3,1&+7-  7KH6RFLDO&RQVWUXFWLRQRI7HFKQRORJLFDO
6\VWHPV&DPEULGJH0DVVDFKXVHWWV7KH0,73UHVV
%,5Ï0 $1' 78//<&  7KH6RIWZDUH3URFHVVLQWKH&RQWH[WRI%XVLQHVV*RDOVDQG
3HUIRUPDQFHLQ50HVVQDU]DQG&7XOO\ (GV %HWWHU6RIWZDUH3UDFWLFHIRU%XVLQHVV
%HQHILW 3ULQFLSOHV DQG ([SHULHQFH /RV $ODPLWRV &DOLIRUQLD ,((( &RPSXWHU 6RFLHW\
3UHVVSS
%-(5.1(6 *   'LDOHFWLFDO 5HIOHFWLRQ LQ ,QIRUPDWLRQ 6\VWHPV 'HYHORSPHQW
6FDQGLQDYLDQ-RXUQDORI,QIRUPDWLRQ6\VWHPV9ROSS
%-(5.1(6 * '$+/%20 % (7 $/   2UJDQL]DWLRQDO &RPSHWHQFH LQ 6\VWHP
'HYHORSPHQW$6FDQGLQDYLDQ&RQWULEXWLRQ/XQG6ZHGHQ6WXGHQWOLWWHUDWXU
%/$&.6$$1'3257(5/-  ,GHQWLILFDWLRQRIWKH&ULWLFDO)DFWRUVRI740'HFLVLRQ
6FLHQFHV9RO1RSS
%/$/2&. +0   7KHRU\ &RQVWUXFWLRQ )URP 9HUEDO WR 0DWKHPDWLFDO )RUPXODWLRQV
(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
%/$81(55  $OLHQDWLRQDQG)UHHGRP&KLFDJR7KH8QLYHUVLW\RI&KLFDJR3UHVV
%2(+0 %:   $ 6SLUDO 0RGHO RI 6RIWZDUH 'HYHORSPHQW DQG (QKDQFHPHQW ,(((
&RPSXWHU9RO1RSS

±±
REFERENCES

%2(+0 %: $1' 3$3$&&,2 31   8QGHUVWDQGLQJ DQG &RQWUROOLQJ 6RIWZDUH &RVWV
,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
%2+0 ' $1' 3($7 )'   6FLHQFH 2UGHU DQG &UHDWLYLW\ 6HFRQG (GLWLRQ /RQGRQ
5RXWOHGJH
%2//,1*(5 7 $1' 0&*2:$1 &   $ &ULWLFDO /RRN DW 6RIWZDUH &DSDELOLW\
(YDOXDWLRQV,(((6RIWZDUH9RO1RSS
%2; *(3 +817(5 :* $1' +817(5 -6   6WDWLVWLFV IRU ([SHULPHQWHUV $Q
,QWURGXFWLRQ WR 'HVLJQ 'DWD $QDO\VLV DQG 0RGHO %XLOGLQJ 1HZ <RUN -RKQ :LOH\
6RQV
%5('583 +   3HUIRUPDQFH 0HDVXUHPHQW LQ D &KDQJLQJ &RPSHWLWLYH ,QGXVWULDO
(QYLURQPHQW %UHDNLQJ WKH )LQDQFLDO 3DUDGLJP 'RFWRUDO 'LVVHUWDWLRQ 7URQGKHLP
1RUZD\1RUZHJLDQ8QLYHUVLW\RI6FLHQFHDQG7HFKQRORJ\
%5,$1' /& ',))(5',1* &0 $1' 520%$&+ +' D  3UDFWLFDO *XLGHOLQHV IRU
0HDVXUHPHQW%DVHG3URFHVV,PSURYHPHQW6RIWZDUH3URFHVV,PSURYHPHQWDQG3UDFWLFH
9ROSS
%5,$1' /& (/ (0$0 . $1' 0(/2 :/   $Q ,QGXFWLYH 0HWKRG IRU 6RIWZDUH
3URFHVV,PSURYHPHQW&RQFUHWH6WHSVDQG*XLGHOLQHVLQ.(O(PDPDQG1+0DGKDYML
(GV  (OHPHQWV RI 6RIWZDUH 3URFHVV $VVHVVPHQW DQG ,PSURYHPHQW /RV $ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
%5,$1'/&(/ (0$0. $1' 025$6&$6  7KHRUHWLFDODQG(PSLULFDO9DOLGDWLRQ
RI 6RIWZDUH 3URGXFW 0HDVXUHV 7HFKQLFDO 5HSRUW ,6(51 ,QWHUQDWLRQDO 6RIWZDUH
(QJLQHHULQJ5HVHDUFK1HWZRUN
%5,$1'/&(/ (0$0. $1' 025$6&$6 E 2QWKH$SSOLFDWLRQRI0HDVXUHPHQW
7KHRU\LQ6RIWZDUH(QJLQHHULQJ(PSLULFDO6RIWZDUH(QJLQHHULQJ9RO,VVXHSS

%52'0$1-* $1' -2+1621'/  :KDW6PDOO%XVLQHVVHVDQG6PDOO2UJDQL]DWLRQV
6D\$ERXWWKH&003URFHHGLQJVRIWKH6L[WHHQWK,QWHUQDWLRQDO&RQIHUHQFHRQ6RIWZDUH
(QJLQHHULQJ,(((&RPSXWHU6RFLHW\3UHVVSS
%52'0$1 -* $1' -2+1621 '/   5HWXUQ RQ ,QYHVWPHQW 52,  IURP 6RIWZDUH
3URFHVV ,PSURYHPHQW DV 0HDVXUHG E\ 86 ,QGXVWU\ 6RIWZDUH 3URFHVV ,PSURYHPHQW DQG
3UDFWLFH3LORW,VVXHSS
%522.6 )3   7KH 0\WKLFDO 0DQ0RQWK (VVD\V RQ 6RIWZDUH (QJLQHHULQJ 5HDGLQJ
0DVVDFKXVHWWV$GGLVRQ:HVOH\
%522.6)3  1R6LOYHU%XOOHW(VVHQFHDQG$FFLGHQWVRI6RIWZDUH(QJLQHHULQJ,(((
&RPSXWHU9RO1RSS
%522.6)3  7KH0\WKLFDO0DQ0RQWK(VVD\VRQ6RIWZDUH(QJLQHHULQJ$QQLYHUVDU\
(GLWLRQ5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
%52:1-6 $1' '8*8,' 3   2UJDQL]DWLRQDO /HDUQLQJ DQG &RPPXQLWLHV RI 3UDFWLFH
7RZDUG D 8QLILHG 9LHZ RI :RUNLQJ /HDUQLQJ DQG ,QQRYDWLRQ 2UJDQL]DWLRQ 6FLHQFH
9RO1RSS
%52:1 -6 $1' '8*8,' 3 D  %DODQFLQJ $FW +RZ WR &DSWXUH .QRZOHGJH :LWKRXW
.LOOLQJ,W+DUYDUG%XVLQHVV5HYLHZ9RO1RSS

±±
5()(5(1&(6

%52:1-6$1' '8*8,'3 E 7KH6RFLDO/LIHRI,QIRUPDWLRQ%RVWRQ0DVVDFKXVHWWV


+DUYDUG%XVLQHVV6FKRRO3UHVV
%5816621 1   7KH ,UUDWLRQDO 2UJDQL]DWLRQ ,UUDWLRQDOLW\ DV D %DVLV IRU
2UJDQL]DWLRQDO$FWLRQDQG&KDQJH&KLFKHVWHU8.:LOH\
%5816621 1   7KH 2UJDQL]DWLRQ RI +\SRFULV\ 7DON 'HFLVLRQV DQG $FWLRQV LQ
2UJDQL]DWLRQV1HZ<RUN-RKQ:LOH\ 6RQV
%5<0$1$ $1' &5$0(5'  4XDQWLWDWLYH'DWD$QDO\VLVZLWK6366IRU:LQGRZV$
*XLGHIRU6RFLDO6FLHQWLVWV/RQGRQ5RXWOHGJH
%6,  7KH7LFN,7*XLGH,VVXH%ULWLVK6WDQGDUGV,QVWLWXWLRQ%6,',6&
%8'/21* ) $1' 3(7(5621 -   6RIWZDUH 0HWULFV &DSDELOLW\ (YDOXDWLRQ *XLGH 7KH
6RIWZDUH7HFKQRORJ\6XSSRUW&HQWHU2JGHQ$LU/RJLVWLFV&HQWHU+LOO$LU)RUFH%DVH
%85.( ::   2UJDQL]DWLRQ 'HYHORSPHQW $ 3URFHVV RI /HDUQLQJ DQG &KDQJLQJ
6HFRQG(GLWLRQ5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
%85167(,1,+20<(1$68:$1$66$5776$;(1$*$1'*5205  $7HVWLQJ
0DWXULW\ 0RGHO IRU 6RIWZDUH 7HVW 3URFHVV $VVHVVPHQW DQG ,PSURYHPHQW 6RIWZDUH
4XDOLW\3URIHVVLRQDO9RO1RSS
%855(//* $1' 025*$1*  6RFLRORJLFDO3DUDGLJPVDQG2UJDQL]DWLRQDO$QDO\VLV
/RQGRQ+HLQHPDQQ%RRNV
%8=$1 7 $1' %8=$1 %   7KH 0LQG 0DS %RRN 0LOOHQLXP (GLWLRQ /RQGRQ %%&
%RRNV
&$03 5&   %HQFKPDUNLQJ 7KH 6HDUFK IRU ,QGXVWU\ %HVW 3UDFWLFHV 7KDW /HDG WR
6XSHULRU 3HUIRUPDQFH LQ :) &KULVWRSKHU DQG &* 7KRU (GV  +DQGERRN IRU
3URGXFWLYLW\0HDVXUHPHQWDQG,PSURYHPHQW3RUWODQG3URGXFWLYLW\3UHVV
&$03%(// '7 $1' ),6.( ':   &RQYHUJHQW DQG 'LVFULPLQDQW 9DOLGDWLRQ E\ WKH
0XOWLWUDLW0XOWLPHWKRG0DWUL[3V\FKRORJLFDO%XOOHWLQ9ROSS
&$03%(// '7 $1' 67$1/(< -&   ([SHULPHQWDO DQG 4XDVL([SHULPHQWDO 'HVLJQV
IRU5HVHDUFK%RVWRQ+RXJKWRQ0LIIOLQ&RPSDQ\
&$5''  8QGHUVWDQGLQJ3URFHVV,PSURYHPHQW,(((6RIWZDUH9RO1RSS

&$5(<$  7KH+DZWKRUQH6WXGLHV$PHULFDQ6RFLRORJLFDO5HYLHZ9RO-XQHSS

&$50,1(6 (* $1' =(//(5 5$   5HOLDELOLW\ DQG 9DOLGLW\ $VVHVVPHQW 6DJH
8QLYHUVLW\3DSHUVHULHVRQ4XDQWLWDWLYH$SSOLFDWLRQVLQWKH6RFLDO6FLHQFHVVHULHVQR
1HZEXU\3DUN&DOLIRUQLD6DJH
&$552///  $OLFH¶V$GYHQWXUHVLQ:RQGHUODQGDQG7KURXJKWKH/RRNLQJ*ODVVDQG
:KDW$OLFH)RXQG7KHUH2[IRUG2[IRUG8QLYHUVLW\3UHVV
&$66,'< $ $1' *8**(1%(5*(5 .   $ 3UDFWLFDO *XLGH WR ,QIRUPDWLRQ 6\VWHPV
3URFHVV,PSURYHPHQW&5&3UHVV
&$77(// 5%   7KH 6FUHH 7HVW IRU WKH 1XPEHU RI )DFWRUV 0XOWLYDULDWH %HKDYLRUDO
5HVHDUFK9ROSS
&+(&./$1' 3 $1' 6&+2/(6 -   6RIW 6\VWHPV 0HWKRGRORJ\ LQ 3UDFWLFH &KLFKHVWHU
:LOH\

±±
REFERENCES

&+(&./$1' 3 $1' 6&+2/(6 -   6RIW 6\VWHPV 0HWKRGRORJ\ LQ $FWLRQ &KLFKHVWHU
:LOH\
&+(&./$1'3  6\VWHPV7KLQNLQJ6\VWHPV3UDFWLFH&KLFKHVWHU:LOH\
&+(&./$1'3  6\VWHPV7KLQNLQJ6\VWHPV3UDFWLFH,QFOXGHVD\HDU5HWURVSHFWLYH
&KLFKHVWHU:LOH\
&+22 &:   7KH .QRZLQJ 2UJDQL]DWLRQ +RZ 2UJDQL]DWLRQV 8VH ,QIRUPDWLRQ WR
&RQVWUXFW 0HDQLQJ &UHDWH .QRZOHGJH DQG 0DNH 'HFLVLRQV 1HZ <RUN 2[IRUG
8QLYHUVLW\3UHVV
&,%255$ &8   7KHRU\ RI ,QIRUPDWLRQ 6\VWHPV %DVHG RQ ,PSURYLVDWLRQ LQ :/
&XUULHDQG5'*DOOLHUV (GV   5HWKLQNLQJ0DQDJHPHQW,QIRUPDWLRQ6\VWHPV$Q
,QWHUGLVFLSOLQDU\3HUVSHFWLYH2[IRUG2[IRUG8QLYHUVLW\3UHVVSS
&/,)) 15   7KH (LJHQYDOXHVJUHDWHUWKDQRQH 5XOH DQG WKH 5HOLDELOLW\ RI
&RPSRQHQWV3V\FKRORJLFDO%XOOHWLQ9ROSS
&2$//,(5 ) 0&.(1=,( 50 :,/621 -) $1' +$7= -   7ULOOLXP 0RGHO IRU
7HOHFRP 3URGXFW 'HYHORSPHQW DQG 6XSSRUW 3URFHVV &DSDELOLW\ 5HOHDVH  %HOO
&DQDGD
&2+(1+%  7KH3HUIRUPDQFH3DUDGR[$FDGHP\RI0DQDJHPHQW([HFXWLYH9RO
1RSS
&2+(1 -   6WDWLVWLFDO 3RZHU $QDO\VLV IRU WKH %HKDYLRUDO 6FLHQFHV 5HYLVHG (GLWLRQ
1HZ<RUN$FDGHPLF3UHVV
&2+(1 -   6WDWLVWLFDO 3RZHU $QDO\VLV IRU WKH %HKDYLRUDO 6FLHQFHV 6HFRQG (GLWLRQ
+LOOVGDOH1HZ-HUVH\/DXUHQFH(UOEDXP
&2+(1-  $3RZHU3ULPHU3V\FKRORJLFDO%XOOHWLQ9RO1RSS
&2+(1 0' $1' %$&'$<$1 3   2UJDQL]DWLRQDO 5RXWLQHV DUH 6WRUHG DV 3URFHGXUDO
0HPRU\ (YLGHQFH IRUP D /DERUDWRU\ 6WXG\ 2UJDQL]DWLRQ 6FLHQFH 9RO  1R  SS

&205(<$  $)LUVW&RXUVHRQ)DFWRU$QDO\VLV/RQGRQ$FDGHPLF3UHVV
&215$',5 $1' '<%c7  $Q(PSLULFDO6WXG\RQWKH8WLOLW\RI)RUPDO5RXWLQHVWR
7UDQVIHU .QRZOHGJH DQG ([SHULHQFH 3URFHHGLQJV RI WKH MRLQW WK (XURSHDQ 6RIWZDUH
(QJLQHHULQJ&RQIHUHQFH (6(& DQGWK$&06,*62)7,QWHUQDWLRQDO6\PSRVLXPRQWKH
)RXQGDWLRQVRI6RIWZDUH(QJLQHHULQJ )6( 9LHQQD$XVWULD6HSWHPEHU
&215$',5)(51675g0&$1' )8*(77$$  7RZDUGVD5HIHUHQFH)UDPHZRUNIRU
3URFHVV &RQFHSWV LQ -& 'HUQLDPH (G  3URFHHGLQJV RI WKH 6HFRQG (XURSHDQ
:RUNVKRSRQ6RIWZDUH3URFHVV7HFKQRORJ\ (:637¶ /1&66SULQJHU9HUODJSS

&2162/,1,/$1' )21$'(*  7KH(XURSHDQ6\VWHPVDQG6RIWZDUH,QLWLDWLYH±(66,
$ UHYLHZ RI &XUUHQW 5HVXOWV )LQDO 9HUVLRQ 7KH (XURSHDQ &RPPLVVLRQ¶V 'LUHFWRUDWH
*HQHUDO,,,,QGXVWU\
&2167$17,1( //   :RUN 2UJDQL]DWLRQ 3DUDGLJPV IRU 3URMHFW 0DQDJHPHQW DQG
2UJDQL]DWLRQ&RPPXQLFDWLRQVRIWKH$&09RO1RSS
&22. 6'1 $1' %52:1 -6   %ULGJLQJ (SLVWHPRORJLHV 7KH *HQHUDWLYH 'DQFH
%HWZHHQ2UJDQL]DWLRQDO.QRZOHGJHDQG2UJDQL]DWLRQDO.QRZLQJ2UJDQL]DWLRQ6FLHQFH
9RO1RSS

±±
5()(5(1&(6

&22.7' $1' &$03%(// '7   4XDVL([SHULPHQWDWLRQ 'HVLJQ  $QDO\VLV ,VVXHV


IRU)LHOG6HWWLQJV%RVWRQ+RXJKWRQ0LIIOLQ&RPSDQ\
&223(5 '5 $1' 6&+,1'/(5 36   %XVLQHVV 5HVHDUFK 0HWKRGV 6L[WK (GLWLRQ
%RVWRQ,UZLQ0F*UDZ+LOO
&223(5-),6+(50 $1' 6+(5(56:  6RIWZDUH$FTXLVLWLRQ&DSDELOLW\0DWXULW\
0RGHO 6$&00  9HUVLRQ  7HFKQLFDO 5HSRUW &086(,75 3LWWVEXUJK
3$&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
&25%(77-0   :RUN DW WKH ,QWHUIDFH $GYDQFHG 0DQXIDFWXULQJ 7HFKQRORJ\ DQG -RE
'HVLJQ LQ 36 $GOHU DQG 7$ :LQRJUDG (GV  8VDELOLW\  WXUQLQJ WHFKQRORJLHV LQWR
WRROV2[IRUG8QLYHUVLW\3UHVVSS
&5$6.05 $1' )2;5-  $Q([SORUDWLRQRIWKH,QWHUYDO3URSHUWLHVRI&RPPRQO\
8VHG 0DUNHWLQJ5HVHDUFK 6FDOHV $ 0DJQLWXGH (VWLPDWLRQ $SSURDFK -RXUQDO RI WKH
0DUNHW5HVHDUFK6RFLHW\9RO1RSS
&5(6:(// -:   5HVHDUFK 'HVLJQ 4XDOLWDWLYH DQG 4XDQWLWDWLYH $SSURDFKHV
7KRXVDQG2DNV&DOLIRUQLD6DJH
&521%$&+ /-   &RHIILFLHQW $OSKD DQG WKH ,QWHUQDO &RQVLVWHQF\ RI 7HVWV
3V\FKRPHWULFD9ROSS6HSWHPEHU
&521%$&+/-  7HVW9DOLGDWLRQLQ5/7KRUQGLNH (G (GXFDWLRQDO0HDVXUHPHQW
6HFRQG(GLWLRQ:DVKLQJWRQ$PHULFDQ&RXQFLORQ(GXFDWLRQSS
&526%< 3%   4XDOLW\ LV )UHH 7KH $UW RI 0DNLQJ 4XDOLW\ &HUWDLQ 1HZ <RUN
0F*UDZ+LOO
&526%<3%  4XDOLW\:LWKRXW7HDUV1HZ<RUN0F*UDZ+LOO
&526%<3%  4XDOLW\,V6WLOO)UHH0DNLQJ4XDOLW\&HUWDLQLQ8QFHUWDLQ7LPHV1HZ
<RUN0F*UDZ+LOO
&6,.6=(170,+$/<, 0   &UHDWLYLW\ )ORZ DQG WKH 3V\FKRORJ\ RI 'LVFRYHU\ DQG
,QYHQWLRQ1HZ<RUN+DUSHU&ROOLQV
&800,1*67*$1' :25/(<&*  2UJDQL]DWLRQ'HYHORSPHQWDQG&KDQJH6HYHQWK
(GLWLRQ&LQFLQQDWL2KLR6RXWK:HVWHUQ&ROOHJH3XEOLVKLQJ
&857,6 % +()/(< :( $1' 0,//(5 6$   3HRSOH &DSDELOLW\ 0DWXULW\ 0RGHO
9HUVLRQ7HFKQLFDO5HSRUW&086(,003LWWVEXUJK3$&DUQHJLH0HOORQ
8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
&857,6%.(//1(50, $1' 29(5-  3URFHVV0RGHOLQJ&RPPXQLFDWLRQVRIWKH
$&09RO1RSS
&857,6 % .5$61(5 + $1' ,6&2( 1   $ )LHOG 6WXG\ RI WKH 6RIWZDUH 'HVLJQ
3URFHVVIRU/DUJH6\VWHPV&RPPXQLFDWLRQVRIWKH$&09RO1RSS
&8680$120$  -DSDQ¶V6RIWZDUH)DFWRULHV$&KDOOHQJHWR860DQDJHPHQW1HZ
<RUN2[IRUG8QLYHUVLW\3UHVV
&<(57 50 $1' 0$5&+-*  $ %HKDYLRUDO 7KHRU\ RI WKH )LUP (QJOHZRRG &OLIIV
1HZ-HUVH\3UHQWLFH+DOO
&<(57 50 $1' 0$5&+ -*   $ %HKDYLRUDO 7KHRU\ RI WKH )LUP 6HFRQG (GLWLRQ
2[IRUG8.%ODFNZHOO

±±
REFERENCES

'$)7 5/ $1' :(,&. .(   7RZDUG D 0RGHO RI 2UJDQL]DWLRQV DV ,QWHUSUHWDWLRQ
6\VWHPV$FDGHP\RI0DQDJHPHQW5HYLHZ9RO1RSS
'$+/%20 % $1' 0$7+,$66(1 /   &RPSXWHUV LQ &RQWH[W 7KH 3KLORVRSK\ DQG
3UDFWLFHRI6\VWHPV'HVLJQ2[IRUG8.1&&%ODFNZHOO
'$+/%20%$1'0$7+,$66(1/  7KH)XWXUHRI2XU3URIHVVLRQ&RPPXQLFDWLRQVRI
WKH$&09RO1RSS
'$6.$/$1721$.,6 0.   $ 3UDFWLFDO 9LHZ RI 6RIWZDUH 0HDVXUHPHQW DQG
,PSOHPHQWDWLRQ ([SHULHQFHV ZLWKLQ 0RWRUROD ,((( 7UDQVDFWLRQV RQ 6RIWZDUH
(QJLQHHULQJ9RO1RSS
'$9(13257 7+   3URFHVV ,QQRYDWLRQ 5HHQJLQHHULQJ :RUN WKURXJK ,QIRUPDWLRQ
7HFKQRORJ\%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
'$9,6$0%(562))(+ $1' &20(5(5  $6WUDWHJ\IRU&RPSDULQJ$OWHUQDWLYH
6RIWZDUH'HYHORSPHQW/LIH&\FOH0RGHOV,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ
9RO1RSS
'$9,6 '   %XVLQHVV 5HVHDUFK IRU 'HFLVLRQ 0DNLQJ )RXUWK (GLWLRQ %HOPRQW
&DOLIRUQLD'X[EXU\3UHVV
'$9,6 /   (QKDQFLQJ WKH 4XDOLW\ RI :RUN /LIH 'HYHORSPHQWV LQ WKH 8QLWHG 6WDWHV
,QWHUQDWLRQDO/DERXU5HYLHZ9RO-XO\$XJXVWSS
'(%28&$1' .817=0$11&20%(//(6$  /LQNLQJ6RIWZDUH3URFHVV,PSURYHPHQW
WR %XVLQHVV 6WUDWHJLHV ([SHULHQFH IURP ,QGXVWU\ 6RIWZDUH 3URFHVV ,PSURYHPHQW DQG
3UDFWLFH9ROSS
'(%28 & &2857(/ ' /$0%(57 +% )8&+6 1 $1' +$8; 0   $OFDWHO¶V
([SHULHQFH ZLWK 3URFHVV ,PSURYHPHQW LQ 5 0HVVQDU] DQG & 7XOO\ (GV  %HWWHU
6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW 3ULQFLSOHV DQG ([SHULHQFH /RV $ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
'((3+286( & 08.+23$'+<$< 7 *2/'(1621 '5 $1' .(//1(5 0, 
6RIWZDUH 3URFHVVHV DQG 3URMHFW 3HUIRUPDQFH -RXUQDO RI 0DQDJHPHQW ,QIRUPDWLRQ
6\VWHPV9RO1RSS
'(/$17<*  6RFLDO6FLHQFH%H\RQG&RQVWUXFWLYLVPDQG5HDOLVP%XFNLQJKDP2SHQ
8QLYHUVLW\3UHVV
'(/21(:+ $1' 0&/($1 (5   ,QIRUPDWLRQ 6\VWHPV 6XFFHVV 7KH 4XHVW IRU WKH
'HSHQGHQW9DULDEOH,QIRUPDWLRQ6\VWHPV5HVHDUFK9RO1RSS
'(0$5&2 7   &RQWUROOLQJ 6RIWZDUH 3URMHFWV 0DQDJHPHQW 0HDVXUHPHQW DQG
(VWLPDWLRQ1HZ<RUN<RXUGRQ3UHVV
'(0$5&2 7 $1' /,67(5 7   3HRSOHZDUH 3URGXFWLYH 3URMHFWV DQG 7HDPV 6HFRQG
(GLWLRQ1HZ<RUN'RUVHW+RXVH3XEOLVKLQJ
'(0,1* :(   4XDOLW\ 3URGXFWLYLW\ DQG &RPSHWLWLYH 3RVLWLRQ &DPEULGJH
0DVVDFKXVHWWV0,7&HQWUHIRU$GYDQFHG(QJLQHHULQJ6WXG\
'(0,1*:(  2XWRIWKH&ULVLV&DPEULGJH0DVVDFKXVHWWV0,7&HQWHUIRU$GYDQFHG
(QJLQHHULQJ6WXG\
'(1,621 ' $1' 635(,7=(5 *   2UJDQL]DWLRQDO &XOWXUH DQG 2UJDQL]DWLRQDO
'HYHORSPHQW $ &RPSHWLQJ 9DOXHV $SSURDFK LQ 5 :RRGPDQ DQG : 3RVPRUH (GV 

±±
5()(5(1&(6

5HVHDUFKLQ 2UJDQL]DWLRQDO &KDQJH DQG 'HYHORSPHQW 9RO  *UHHQZLFK &RQQHFWLFXW


-$,3UHVVSS
'(1=,11.  6RFLRORJLFDO0HWKRGV$6RXUFHERRN1HZ<RUN0F*UDZ+LOO
'(1=,11. $1' /,1&2/1 <6 (GV    +DQGERRN RI 4XDOLWDWLYH 5HVHDUFK 6HFRQG
(GLWLRQ7KRXVDQG2DNV&DOLIRUQLD6DJH
'(51,$0(-&.$%$%$$1' :$67(//' (GV   6RIWZDUH3URFHVV3ULQFLSOHV
0HWKRGRORJ\ DQG 7HFKQRORJ\ /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH 9RO  %HUOLQ
6SULQJHU9HUODJ
'(9(//,6 5)   6FDOH 'HYHORSPHQW 7KHRU\ DQG $SSOLFDWLRQV 1HZEXU\ 3DUN
&DOLIRUQLD6DJH
'(:(<-  7KH4XHVWIRU&HUWDLQW\1HZ<RUN0LQWRQ%DOFK
'(:(<-  /RJLF7KH7KHRU\RI,QTXLU\1HZ<RUN+ROWDQG&RPSDQ\
',(5.(6 0 $17$/ $% &+,/' - $1' 121$.$ , (GV    +DQGERRN RI
2UJDQL]DWLRQDO/HDUQLQJDQG.QRZOHGJH2[IRUG2[IRUG8QLYHUVLW\3UHVV
',215  3URFHVV,PSURYHPHQWDQGWKH&RUSRUDWH%DODQFH6KHHW,(((6RIWZDUH9RO
1RSS
'2+(57<1)$1' .,1*0 D 7KH&RQVLGHUDWLRQRI2UJDQLVDWLRQDO,VVXHVGXULQJWKH
6\VWHPV 'HYHORSPHQW 3URFHVV $Q (PSLULFDO $QDO\VLV %HKDYLRXU DQG ,QIRUPDWLRQ
7HFKQRORJ\9RO1RSS
'2+(57<1) $1' .,1* 0 E  7KH ,PSRUWDQFH RI 2UJDQLVDWLRQDO ,VVXHV LQ 6\VWHPV
'HYHORSPHQW,QIRUPDWLRQ7HFKQRORJ\ 3HRSOH9RO1RSS
'2:621 0   6RIWZDUH 3URFHVV 7KHPHV DQG ,VVXHV 3URFHHGLQJV RI WKH 6HFRQG
,QWHUQDWLRQDO&RQIHUHQFHRQWKH6RIWZDUH3URFHVV,(((&RPSXWHU6RFLHW\3UHVVSS

'5(: '   7DLORULQJ WKH 6RIWZDUH (QJLQHHULQJ ,QVWLWXWH¶V 6(,  &DSDELOLW\ 0DWXULW\
0RGHO &00  WR D 6RIWZDUH 6XVWDLQLQJ (QJLQHHULQJ 2UJDQL]DWLRQ 3URFHHGLQJV RI WKH
,QWHUQDWLRQDO&RQIHUHQFHRQ6RIWZDUH0DLQWHQDQFHSS
'81$:$< '. $1' 0$67(56 6   &00%DVHG $SSUDLVDO IRU ,QWHUQDO 3URFHVV
,PSURYHPHQW &%$ ,3,  0HWKRG 'HVFULSWLRQ 7HFKQLFDO 5HSRUW &086(,75
&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
'<%c7  $VVHVVPHQWEDVHG6RIWZDUH3URFHVV,PSURYHPHQW7HOHNWURQLNN9RO1R
SS
'<%c 7 D  $Q ,QVWUXPHQW IRU 0HDVXULQJ WKH .H\ )DFWRUV RI 6XFFHVV LQ 6RIWZDUH
3URFHVV ,PSURYHPHQW (PSLULFDO 6RIWZDUH (QJLQHHULQJ 9RO  1R  'HFHPEHU SS

'<%c 7 E  ,PSURYLVDWLRQ LQ 6PDOO 6RIWZDUH 2UJDQL]DWLRQV ,((( 6RIWZDUH 9RO 
1R6HSWHPEHU2FWREHUSS
'<%c7 F 3ODQQLQJ2UJDQL]DWLRQDO,PSURYHPHQW3URJUDPVLQ7'\En (G 63,4±
6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\ 0HWKRGRORJ\ +DQGERRN LQ
1RUZHJLDQ  ,',5HSRUW7URQGKHLP1RUZD\1RUZHJLDQ8QLYHUVLW\ RI6FLHQFH
DQG7HFKQRORJ\)DFXOW\RI3K\VLFV,QIRUPDWLFVDQG0DWKHPDWLFV
'<%c 7 G  3ODQQLQJ 3URFHVV ,PSURYHPHQW ([SHULPHQWV LQ 7 '\En (G  63,4 ±
6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\ 0HWKRGRORJ\ +DQGERRN LQ

±±
REFERENCES

1RUZHJLDQ  ,',5HSRUW7URQGKHLP1RUZD\1RUZHJLDQ8QLYHUVLW\ RI6FLHQFH


DQG7HFKQRORJ\)DFXOW\RI3K\VLFV,QIRUPDWLFVDQG0DWKHPDWLFV
'<%c 7 (G  H  63,4 ± 6RIWZDUH 3URFHVV ,PSURYHPHQW IRU EHWWHU 4XDOLW\
0HWKRGRORJ\ +DQGERRN LQ 1RUZHJLDQ  ,', 5HSRUW  7URQGKHLP 1RUZD\
1RUZHJLDQ 8QLYHUVLW\ RI 6FLHQFH DQG 7HFKQRORJ\ )DFXOW\ RI 3K\VLFV ,QIRUPDWLFV DQG
0DWKHPDWLFV
'<%c 7 $1' 02( 1%   5HWKLQNLQJ WKH &RQFHSW RI 6RIWZDUH 3URFHVV $VVHVVPHQW
3URFHHGLQJV RI WKH (XURSHDQ 6RIWZDUH 3URFHVV ,PSURYHPHQW &RQIHUHQFH (XUR63,¶ 
3RUL)LQODQG2FWREHU
'<%c 7 $1' 6.2*67$' ‘   0HDVXUHPHQW%DVHG 6RIWZDUH 3URFHVV ,PSURYHPHQW
7HOHNWURQLNN9RO1RSS
'<%c 7 67c/+$1( 7 $1' 3$/0675‘0 5   ([SHULHQFH RI *RDO2ULHQWHG
0HDVXUHPHQW XVLQJ DPL DQG *40 3URFHHGLQJV RI WKH WK (XURSHDQ 6RIWZDUH &RQWURO
DQG0HWULFV&RQIHUHQFH (6&20¶ %HUOLQ*HUPDQ\0D\
($5/0-  %XVLQHVV3URFHVV5HHQJLQHHULQJ$3KHQRPHQRQRI2UJDQL]DWLRQLQ0-
(DUO (G ,QIRUPDWLRQ0DQDJHPHQW7KH2UJDQL]DWLRQDO'LPHQVLRQ1HZ<RUN2[IRUG
8QLYHUVLW\3UHVVSS
('021621 $ $1' 02,1*(21 %   )URP 2UJDQL]DWLRQDO /HDUQLQJ WR WKH /HDUQLQJ
2UJDQL]DWLRQ0DQDJHPHQW/HDUQLQJ9RO1RSS
()40   7KH ()40 ([FHOOHQFH 0RGHO %UXVVHOV (XURSHDQ )RXQGDWLRQ IRU 4XDOLW\
0DQDJHPHQW
(+1 3   6FDQGLQDYLDQ 'HVLJQ 2Q 3DUWLFLSDWLRQ DQG 6NLOO LQ 36 $GOHU DQG 7$
:LQRJUDG (GV  8VDELOLW\ ± 7XUQLQJ 7HFKQRORJLHV LQWR 7RROV 1HZ <RUN 2[IRUG
8QLYHUVLW\3UHVVSS
(,6(1+$5'7 .0   %XLOGLQJ 7KHRULHV IURP &DVH 6WXG\ 5HVHDUFK $FDGHP\ RI
0DQDJHPHQW5HYLHZ9RO1RSS
(,6(1+$5'7 .0 $1' 7$%5,=, %1   $FFHOHUDWLQJ $GDSWLYH 3URFHVVHV 3URGXFW
,QQRYDWLRQLQWKH*OREDO&RPSXWHU,QGXVWU\$GPLQLVWUDWLYH6FLHQFHV4XDUWHUO\9RO
0DUFKSS
(/ (0$0 .   7KH ,QWHUQDO &RQVLVWHQF\ RI WKH ,62,(&  6RIWZDUH 3URFHVV
&DSDELOLW\ 6FDOH 7HFKQLFDO 5HSRUW ,6(51 ,QWHUQDWLRQDO 6RIWZDUH (QJLQHHULQJ
5HVHDUFK1HWZRUN
(/ (0$0 . $1' %,5. $   9DOLGDWLQJ WKH ,62,(&  0HDVXUHV RI 6RIWZDUH
'HYHORSPHQW 3URFHVV &DSDELOLW\ -RXUQDO RI 6\VWHPV DQG 6RIWZDUH 9RO  1R  SS

(/ (0$0. $1' %5,$1'/  &RVWVDQG%HQHILWVRI6RIWZDUH3URFHVV,PSURYHPHQW
LQ 5 0HVVQDU] DQG & 7XOO\ (GV  %HWWHU 6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW
3ULQFLSOHVDQG([SHULHQFH/RV$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS

(/ (0$0 . $1' *2/'(1621 '5   $Q (PSLULFDO 5HYLHZ RI 6RIWZDUH 3URFHVV
$VVHVVPHQW$GYDQFHVLQ&RPSXWHUV9ROSS
(/ (0$0 . $1' 0$'+$9-, 1+   7KH 5HOLDELOLW\ RI 0HDVXULQJ 2UJDQL]DWLRQDO
0DWXULW\6RIWZDUH3URFHVV±,PSURYHPHQWDQG3UDFWLFH9RO1RSS

±±
5()(5(1&(6

(/ (0$0. $1' 0$'+$9-,1+  $Q ,QVWUXPHQW IRU0HDVXULQJWKH 6XFFHVV RI WKH
5HTXLUHPHQWV (QJLQHHULQJ 3URFHVV LQ ,QIRUPDWLRQ 6\VWHPV 'HYHORSPHQW (PSLULFDO
6RIWZDUH(QJLQHHULQJ9RO1RSS
(/ (0$0. $1' 0$'+$9-,1+ (GV   (OHPHQWV RI 6RIWZDUH 3URFHVV $VVHVVPHQW
DQG,PSURYHPHQW/RV$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVV
(/ (0$0.'528,1-1 $1' 0(/2: (GV   63,&(7KH7KHRU\DQG3UDFWLFH
RI 6RIWZDUH 3URFHVV ,PSURYHPHQW DQG &DSDELOLW\ 'HWHUPLQDWLRQ /RV $ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVV
(/ (0$0.)86$523 $1' 60,7+%  6XFFHVV)DFWRUVDQG %DUULHUV IRU6RIWZDUH
3URFHVV ,PSURYHPHQW LQ 5 0HVVQDU] DQG & 7XOO\ (GV  %HWWHU 6RIWZDUH 3UDFWLFH IRU
%XVLQHVV%HQHILW3ULQFLSOHVDQG([SHULHQFH /RV$ODPLWRV &DOLIRUQLD ,((( &RPSXWHU
6RFLHW\3UHVVSS
(/ (0$0 . *2/'(1621 '5 0&&85/(< - $1' +(5%6/(% -   0RGHOLQJ WKH
/LNHOLKRRGRI6RIWZDUH3URFHVV,PSURYHPHQW$Q([SORUDWRU\6WXG\(PSLULFDO6RIWZDUH
(QJLQHHULQJ9RO1RSS
(/'(10 $1' &+,6+2/05)  (PHUJLQJ9DULHWLHVRI$FWLRQ5HVHDUFK,QWURGXFWLRQ
WRWKH6SHFLDO,VVXH+XPDQ5HODWLRQV9RO1RSS
(0(5<0$1'3856(55(  7KH6HDUFK&RQIHUHQFH6DQ)UDQFLVFR-RVVH\%DVV
)$5$-6 $1' 63528///  &RRUGLQDWLQJ([SHUWLVHLQ6RIWZDUH'HYHORSPHQW7HDPV
0DQDJHPHQW6FLHQFH9RO1RSS
)$<$' 0( $1' /$,7,1(1 0   3URFHVV $VVHVVPHQW &RQVLGHUHG :DVWHIXO
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
)$<$' 0( /$,7,1(1 0 $1' :$5' 53   6RIWZDUH (QJLQHHULQJ LQ WKH 6PDOO
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
)(,*(1%$80 $9   7RWDO 4XDOLW\ &RQWURO )RUWLHWK $QQLYHUVDU\ (GLWLRQ 1HZ <RUN
0F*UDZ+LOO
)(,/(5 3+ $1' +803+5(< :6   6RIWZDUH 3URFHVV 'HYHORSPHQW DQG (QDFWPHQW
&RQFHSWV DQG 'HILQLWLRQV 3URFHHGLQJV RI WKH 6HFRQG ,QWHUQDWLRQDO &RQIHUHQFH RQ WKH
6RIWZDUH3URFHVV,(((&RPSXWHU6RFLHW\3UHVVSS
)(17211(  6RIWZDUH0HWULFV$5LJRURXV$SSURDFK/RQGRQ&KDSPDQ +DOO
)(1721 1(   6RIWZDUH 0HDVXUHPHQW $ 1HFHVVDU\ 6FLHQWLILF %DVLV ,(((
7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
)(17211(  &RQGXFWLQJDQG3UHVHQWLQJ(PSLULFDO6RIWZDUH(QJLQHHULQJ(PSLULFDO
6RIWZDUH(QJLQHHULQJ9RO1RSS
)(1721 1( $1' 1(,/ 0   6RIWZDUH 0HWULFV 6XFFHVVHV )DLOXUHV DQG 1HZ
'LUHFWLRQV-RXUQDORI6\VWHPVDQG6RIWZDUH9RO1RSS
)(1721 1( $1' 3)/((*(5 6+   6RIWZDUH 0HWULFV $ 5LJRURXV DQG 3UDFWLFDO
$SSURDFK/RQGRQ,QWHUQDWLRQDO7KRPVRQ&RPSXWHU3UHVV
)(17211(3)/((*(56+$1'*/$665/  6FLHQFHDQG6XEVWDQFH$&KDOOHQJH
WR6RIWZDUH(QJLQHHUV,(((6RIWZDUH9RO1RSS
),1.$ $1' .26(&2))-  +RZWR&RQGXFW6XUYH\V$6WHS%\6WHS*XLGH6HFRQG
(GLWLRQ7KRXVDQG2DNV&DOLIRUQLD6DJH3XEOLFDWLRQV

±±
REFERENCES

),1.(/67(,1 $ .5$0(5 - $1' 186(,%(+ %   6RIWZDUH 3URFHVV 0RGHOOLQJ DQG
7HFKQRORJ\7DXQWRQ6RPHUVHW8.5HVHDUFK6WXGLHV3UHVV
),2/ &0 $1' /</(6 0$   2UJDQL]DWLRQDO /HDUQLQJ $FDGHP\ RI 0DQDJHPHQW
5HYLHZ9RO1RSS
),6&+(5 * $1' 267:$/' -   .QRZOHGJH 0DQDJHPHQW 3UREOHPV 3URPLVHV
5HDOLWLHVDQG&KDOOHQJHV,(((,QWHOOLJHQW6\VWHPV9RO1RSS
),6&++2))%  +LQGVLJKW)RUHVLJKW7KH(IIHFWRI2XWFRPH.QRZOHGJHRQ-XGJPHQW
8QGHU 8QFHUWDLQW\ -RXUQDO RI ([SHULPHQWDO 3V\FKRORJ\ +XPDQ 3HUFHSWLRQ DQG
3HUIRUPDQFH9RO1RSS
),7=*(5$/' %   )RUPDOL]HG 6\VWHPV 'HYHORSPHQW 0HWKRGRORJLHV $ &ULWLFDO
3HUVSHFWLYH,QIRUPDWLRQ6\VWHPV-RXUQDO9RO1RSS
)/25$& :$ $1' &$5/(721 $'   0HDVXULQJ WKH 6RIWZDUH 3URFHVV 6WDWLVWLFDO
3URFHVV &RQWURO IRU 6RIWZDUH 3URFHVV ,PSURYHPHQW 5HDGLQJ 0DVVDFKXVHWWV $GGLVRQ
:HVOH\
)/25$& :$ 3$5. 5( $1' &$5/(721 $'   3UDFWLFDO 6RIWZDUH 0HDVXUHPHQW
0HDVXULQJ IRU 3URFHVV 0DQDJHPHQW DQG ,PSURYHPHQW *XLGHERRN &086(,+%
&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
)/2<'&   6RIWZDUH 'HYHORSPHQW DV 5HDOLW\ &RQVWUXFWLRQ LQ & )OR\G HW DO (GV 
6RIWZDUH'HYHORSPHQWDQG5HDOLW\&RQVWUXFWLRQ%HUOLQ6SULQJHU9HUODJSS
)/2<' & =h//,*+29(1 + %8''( 5 $1' .(,/6/$:,. 5 (GV    6RIWZDUH
'HYHORSPHQWDQG5HDOLW\&RQVWUXFWLRQ%HUOLQ6SULQJHU9HUODJ
)2:/(5 3 $1' 5,).,1 6   6RIWZDUH (QJLQHHULQJ 3URFHVV *URXS *XLGH 7HFKQLFDO
5HSRUW&086(,75&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
)5(1&+ :/   3URFHVVHV YLVjYLV 6\VWHPV 7RZDUG D 0RGHO RI WKH (QWHUSULVH DQG
$GPLQLVWUDWLRQ$FDGHP\RI0DQDJHPHQW-RXUQDO9RO0DUFKSS
)5(1&+ :/ $1' %(// &+ -5   2UJDQL]DWLRQ 'HYHORSPHQW %HKDYLRUDO 6FLHQFH
,QWHUYHQWLRQV IRU 2UJDQL]DWLRQ ,PSURYHPHQW 6L[WK (GLWLRQ 8SSHU 6DGGOH 5LYHU 1HZ
-HUVH\3UHQWLFH+DOO
)8**(77$$  5HWKLQNLQJWKH0RGHVRI6RIWZDUH(QJLQHHULQJ5HVHDUFK7KH-RXUQDO
RI6\VWHPVDQG6RIWZDUH9RO1RSS
)8**(77$$   6RIWZDUH 3URFHVV $ 5RDGPDS LQ $ )LQNHOVWHLQ (G 7KH )XWXUH RI
6RIWZDUH(QJLQHHULQJ1HZ<RUN$&03UHVVSS
)86$523(/ (0$0. $1' 60,7+ %   7KH ,QWHUQDO &RQVLVWHQF\ RI WKH  6(,
0DWXULW\ 4XHVWLRQQDLUH DQG WKH 63,&( &DSDELOLW\ 'LPHQVLRQ (PSLULFDO 6RIWZDUH
(QJLQHHULQJ9RO1RSS
*$%/( **   ,QWHJUDWLQJ &DVH 6WXG\ DQG 6XUYH\ 5HVHDUFK 0HWKRGV $Q ([DPSOH LQ
,QIRUPDWLRQ6\VWHPV(XURSHDQ-RXUQDORI,QIRUPDWLRQ6\VWHPV9RO1RSS

*$'$0(5+*  7UXWKDQG0HWKRG6HFRQG5HYLVHG(GLWLRQ/RQGRQ6KHHG :DUG
*$))1(< - &58,&.6+$1. 5 :(5/,1* 5 $1' )(/%(5 +   7KH 6RIWZDUH
0HDVXUHPHQW *XLGHERRN %RVWRQ 0DVVDFKXVHWWV ,QWHUQDWLRQDO 7KRPVRQ &RPSXWHU
3UHVV

±±
5()(5(1&(6

*$//,(565'  &KRRVLQJ,QIRUPDWLRQ6\VWHPV5HVHDUFK$SSURDFKHVLQ5'*DOOLHUV


(G  ,QIRUPDWLRQ 6\VWHPV 5HVHDUFK ,VVXHV 0HWKRGV DQG 3UDFWLFDO *XLGHOLQHV
,QIRUPDWLRQV\VWHPVVHULHV2[IRUG%ODFNZHOOSS
*$//,(565'$1' /$1'))  &KRRVLQJ$SSURSULDWH,QIRUPDWLRQ6\VWHPV5HVHDUFK
0HWKRGRORJLHV&RPPXQLFDWLRQVRIWKH$&09RO1RSS
*$59,1'$  4XDOLW\RQWKH/LQH+DUYDUG%XVLQHVV5HYLHZ9RO1RSS

*$59,1 '$   -DSDQHVH 4XDOLW\ 0DQDJHPHQW &ROXPELD -RXUQDO RI :RUOG %XVLQHVV
9RO1RSS
*$59,1'$   %XLOGLQJ D /HDUQLQJ 2UJDQL]DWLRQ+DUYDUG %XVLQHVV 5HYLHZ 9RO 
1RSS
*$59,1'$   /HDUQLQJ LQ $FWLRQ $ *XLGH WR 3XWWLQJ WKH /HDUQLQJ 2UJDQL]DWLRQ WR
:RUN%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
*,%%6::  6RIWZDUH¶V&KURQLF&ULVLV6FLHQWLILF$PHULFDQ9RO6HSWHPEHUSS

*,/%7  6RIWZDUHPHWULFV/XQG6ZHGHQ6WXGHQWOLWWHUDWXU
*,16%(5* 03 $1' 48,11 /+   3URFHVV 7DLORULQJ DQG WKH 6RIWZDUH &DSDELOLW\
0DWXULW\ 0RGHO 7HFKQLFDO 5HSRUW &086(,75 &DUQHJLH 0HOORQ 8QLYHUVLW\
6RIWZDUH(QJLQHHULQJ,QVWLWXWH
*,2,$' $1' 3,75((  0XOWLSDUDGLJP3HUVSHFWLYHVRQ7KHRU\%XLOGLQJ$FDGHP\RI
0DQDJHPHQW5HYLHZ9RO1RSS
*-(569,. 5   7KH &RQVWUXFWLRQ RI ,QIRUPDWLRQ 6\VWHPV LQ 2UJDQL]DWLRQV $Q $FWLRQ
5HVHDUFK 3URMHFW RQ 7HFKQRORJ\ 2UJDQL]DWLRQDO &ORVXUH 5HIOHFWLRQ DQG &KDQJH
'RFWRUDO 'LVVHUWDWLRQ 7URQGKHLP 1RUZD\ 1RUZHJLDQ 8QLYHUVLW\ RI 6FLHQFH DQG
7HFKQRORJ\
*/$665/  7KH6RIWZDUH5HVHDUFK&ULVLV,(((6RIWZDUH9RO1RSS
*/$665/  6RIWZDUH&UHDWLYLW\(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
*/$66 5/   3LORW 6WXGLHV :KDW :K\ DQG +RZ -RXUQDO RI 6\VWHPV DQG 6RIWZDUH
9RO1RSS
*/$66 5/   &RPSXWLQJ &DODPLWLHV /HVVRQV /HDUQHG IURP 3URGXFWV 3URMHFWV DQG
&RPSDQLHVWKDW)DLOHG8SSHU6DGGOH5LYHU1HZ-HUVH\3UHQWLFH+DOO
*2/'(1621 '5 $1' +(5%6/(% -'   $IWHU WKH $SSUDLVDO $ 6\VWHPDWLF 6XUYH\ RI
3URFHVV,PSURYHPHQWLWV%HQHILWVDQG)DFWRUVWKDW,QIOXHQFH6XFFHVV7HFKQLFDO5HSRUW
&086(,75&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
*2/'(1621 '5 (/ (0$0 . +(5%6/(% - $1' '((3+286( & D  (PSLULFDO
6WXGLHV RI 6RIWZDUH 3URFHVV $VVHVVPHQW 0HWKRGV LQ . (O (PDP DQG 1+ 0DGKDYML
(GV  (OHPHQWV RI 6RIWZDUH 3URFHVV $VVHVVPHQW DQG ,PSURYHPHQW /RV $ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
*2/'(1621'5*23$/$ $1' 08.+23$'+<$<7 E 'HWHUPLQDQWVRI6XFFHVVLQ
6RIWZDUH0HDVXUHPHQW3URJUDPV ,QLWLDO5HVXOWV3URFHHGLQJVRIWKH6L[WK,QWHUQDWLRQDO
6RIWZDUH0HWULFV6\PSRVLXP,(((&RPSXWHU6RFLHW\3UHVVSS

±±
REFERENCES

*2/(67$1'+,56&++(,05  7KH3DUDGLJPLV'HDGWKH3DUDGLJPLV'HDG«/RQJ


/LYH WKH 3DUDGLJP 7KH /HJDF\ RI %XUUHOO DQG 0RUJDQ 2PHJD 7KH ,QWHUQDWLRQDO
-RXUQDORI0DQDJHPHQW6FLHQFH9RO1RSS
*23$/$.5,6+1$1 6 $1' '$0$13285 )   $ 5HYLHZ RI ,QQRYDWLRQ 5HVHDUFK LQ
(FRQRPLFV 6RFLRORJ\ DQG 7HFKQRORJ\ 0DQDJHPHQW 2PHJD ,QWHUQDWLRQDO -RXUQDO RI
0DQDJHPHQW6FLHQFH9RO1RSS
*5$'< 5%   3UDFWLFDO 6RIWZDUH 0HWULFV IRU 3URMHFW 0DQDJHPHQW DQG 3URFHVV
,PSURYHPHQW(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
*5$'< 5%   6XFFHVVIXO 6RIWZDUH 3URFHVV ,PSURYHPHQW 8SSHU 6DGGOH 5LYHU 1HZ
-HUVH\3UHQWLFH+DOO
*5$'< 5% $1' &$6:(// '   6RIWZDUH 0HWULFV (VWDEOLVKLQJ D &RPSDQ\ZLGH
3URJUDP(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
*5$<(0$1'60,7+:/  2QWKH/LPLWDWLRQVRI6RIWZDUH3URFHVV$VVHVVPHQWDQG
WKH5HFRJQLWLRQRID5HTXLUHG5HRULHQWDWLRQIRU*OREDO3URFHVV,PSURYHPHQW6RIWZDUH
4XDOLW\-RXUQDO9RO1RSS
*5((1:22' '- $1' /(9,1 0   ,QWURGXFWLRQ WR $FWLRQ 5HVHDUFK 6RFLDO 5HVHDUFK
IRU6RFLDO&KDQJH7KRXVDQG2DNV&DOLIRUQLD6DJH
*5((1:22' '- $1' /(9,1 0   5HFRQVWUXFWLQJ WKH 5HODWLRQVKLSV %HWZHHQ
8QLYHUVLWLHV DQG 6RFLHW\ 7KURXJK $FWLRQ 5HVHDUFK LQ 1. 'HQ]LQ DQG <6 /LQFROQ
(GV  +DQGERRN RI 4XDOLWDWLYH 5HVHDUFK 6HFRQG (GLWLRQ 7KRXVDQG 2DNV &DOLIRUQLD
6DJHSS
*5(0%$- $1' 0<(56&  7KH,'($/0RGHO$3UDFWLFDO*XLGHIRU,PSURYHPHQW
&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH%ULGJH,VVXH
*5(66(&+2,6/% $1' :h67-  $SURFHVV0RGHOIRU*40%DVHG0HDVXUHPHQW
7HFKQLFDO 5HSRUW 677,( 6RIWZDUH 7HFKQRORJ\ 7UDQVIHU ,QLWLDWLYH
.DLVHUVODXWHUQ*HUPDQ\
*527+ /   )XWXUH 2UJDQL]DWLRQDO 'HVLJQ 7KH 6FRSH IRU WKH ,7%DVHG (QWHUSULVH
&KLFKHVWHU:LOH\
*529(59  )URP%XVLQHVV5HHQJLQHHULQJWR%XVLQHVV3URFHVV&KDQJH0DQDJHPHQW
$ /RQJLWXGLQDO 6WXG\ RI 7UHQGV DQG 3UDFWLFHV ,((( 7UDQVDFWLRQV RQ (QJLQHHULQJ
0DQDJHPHQW9RO1RSS
*8%$ (*   :KDW +DYH :H /HDUQHG $ERXW 1DWXUDOLVWLF (YDOXDWLRQ" (YDOXDWLRQ
3UDFWLFH9ROSS
*8%$(*$1'/,1&2/1<6  &RPSHWLQJ3DUDGLJPVLQ4XDOLWDWLYH5HVHDUFKLQ1.
'HQ]LQ DQG <6 /LQFROQ (GV  +DQGERRN RI 4XDOLWDWLYH 5HVHDUFK 7KRXVDQG 2DNV
&DOLIRUQLD6DJHSS
*8,/)25'-3  3V\FKRPHWULF0HWKRGV6HFRQG(GLWLRQ1HZ<RUN0F*UDZ+LOO
*8,1$13-&2235,'(5-* $1' )$5$-6  (QDEOLQJ6RIWZDUH'HYHORSPHQW7HDP
3HUIRUPDQFH'XULQJ5HTXLUHPHQWV'HILQLWLRQ$%HKDYLRUDO9HUVXV7HFKQLFDO$SSURDFK
,QIRUPDWLRQ6\VWHPV5HVHDUFK9RO1RSS
+$%(50$6 -   7KH 7KHRU\ RI &RPPXQLFDWLYH $FWLRQ 5HDVRQ DQG WKH 5DWLRQDOLW\ RI
6RFLHW\ 7UDQVODWHGE\70F&DUWK\ %RVWRQ%HDFRQ

±±
5()(5(1&(6

+$,5 -3 $1'(5621 5( 7$7+$0 5/ $1' %/$&. :&   0XOWLYDULDWH 'DWD
$QDO\VLV)LIWKHGLWLRQ8SSHU6DGGOH5LYHU1HZ-HUVH\3UHQWLFH+DOO
+$0%5,&. '& *(/(7.$1<&= 0$ $1' )5('5,&.621 -:   7RS ([HFXWLYH
&RPPLWPHQWWRWKH6WDWXV4XR6RPH7HVWVIRULWV'HWHUPLQDQWV6WUDWHJLF0DQDJHPHQW
-RXUQDO9RO1RSS
+$00(5 0   5HHQJLQHHULQJ :RUN 'RQ¶W $XWRPDWH ± 2EOLWHUDWH +DUYDUG %XVLQHVV
5HYLHZ9RO1RSS
+$00(5 0   %H\RQG 5HHQJLQHHULQJ +RZ WKH 3URFHVV&HQWHUHG 2UJDQL]DWLRQ LV
&KDQJLQJ2XU:RUNDQG2XU/LYHV/RQGRQ+DUSHU&ROOLQV
+$00(5 0 $1' &+$03< -   5HHQJLQHHULQJ WKH &RUSRUDWLRQ $ 0DQLIHVWR IRU
%XVLQHVV5HYROXWLRQ1HZ<RUN+DUSHU%XVLQHVV
+$1''-  6WDWLVWLFVDQGWKH7KHRU\RI0HDVXUHPHQW-RXUQDORIWKH5R\DO6WDWLVWLFV
6RFLHW\6HULHV$9RO3DUWSS
+$55,621 5 %$'22 1 %$55< ( %,))/ 6 3$55$ $ :,17(5 % $1' :8(67 -
  'LUHFWLRQV DQG 0HWKRGRORJLHV IRU (PSLULFDO 6RIWZDUH (QJLQHHULQJ 5HVHDUFK
(PSLULFDO6RIWZDUH(QJLQHHULQJ9RO1RSS
+$66$5' -   2YHUFRPLQJ +HUPHWLFLVP LQ 2UJDQL]DWLRQ 7KHRU\ $Q $OWHUQDWLYH WR
3DUDGLJP,QFRPPHQVXUDELOLW\+XPDQ5HODWLRQV9RO1RSS
+$<6:/  6WDWLVWLFV)LIWKHGLWLRQ1HZ<RUN+DUFRXUW%UDFH
+(03(/ &*   3KLORVRSK\ RI 1DWXUDO 6FLHQFH )RXQGDWLRQV RI 3KLORVRSK\ 6HULHV
(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
+(1'(5621 -& $1' /(( 6   0DQDJLQJ ,6 'HVLJQ 7HDPV $ &RQWURO 7KHRULHV
3HUVSHFWLYH0DQDJHPHQWVFLHQFH9RO1RSS
+(5%6/(% -'   +DUG 3UREOHPV DQG +DUG 6FLHQFH 2Q WKH 3UDFWLFDO /LPLWV RI
([SHULPHQWDWLRQ,(((7&6(6RIWZDUH3URFHVV1HZVOHWWHU1RSS
+(5%6/(%-'$1'*2/'(1621'5  $6\VWHPDWLF6XUYH\RI&00([SHULHQFHDQG
5HVXOWV 3URFHHGLQJV RI WKH (LJKWHHQWK ,QWHUQDWLRQDO &RQIHUHQFH RQ 6RIWZDUH
(QJLQHHULQJ,(((&RPSXWHU6RFLHW\3UHVVSS
+(66(/%(,1)*2/'60,7+0$1'%(&.+$5'5 (GV   7KH/HDGHURIWKH)XWXUH
1HZ9LVLRQV6WUDWHJLHVDQG3UDFWLFHVIRUWKH1H[W(UD6DQ)UDQFLVFR-RVVH\%DVV
+2$5(&$5  3URJUDPPLQJ6RUFHU\RU6FLHQFH",(((6RIWZDUH9RO1RSS

+2&+ '- 52(',1* &5 385.(57 * $1' /,1'1(5 6.   6HFUHWV RI 6RIWZDUH
6XFFHVV 0DQDJHPHQW ,QVLJKWV IURP  6RIWZDUH )LUPV DURXQG WKH :RUOG %RVWRQ
0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
+2+0$11 /   -RXUQH\ RI WKH 6RIWZDUH 3URIHVVLRQDO $ 6RFLRORJ\ RI 6RIWZDUH
'HYHORSPHQW8SSHU6DGGOH5LYHU1HZ-HUVH\3UHQWLFH+DOO
+2:$5' $   6RIWZDUH (QJLQHHULQJ 3URMHFW 0DQDJHPHQW &RPPXQLFDWLRQV RI WKH
$&09RO1RSS
+8%(5*3  2UJDQL]DWLRQDO/HDUQLQJWKH&RQWULEXWLQJ3URFHVVHVDQGWKH/LWHUDWXUHV
2UJDQL]DWLRQ6FLHQFH9RO1RSS

±±
REFERENCES

+803+5(<:6  0DQDJLQJWKH6RIWZDUH3URFHVV5HDGLQJ0DVVDFKXVHWWV$GGLVRQ


:HVOH\
+803+5(< :6   0DQDJLQJ 7HFKQLFDO 3HRSOH ,QQRYDWLRQ 7HDPZRUN DQG WKH
6RIWZDUH3URFHVV5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
+803+5(< :6 61<'(5 7 $1' :,//,6 5   6RIWZDUH 3URFHVV ,PSURYHPHQW DW
+XJKHV$LUFUDIW,(((6RIWZDUH9RO1RSS
+8175$1' %8=$17  &UHDWLQJD7KLQNLQJ2UJDQL]DWLRQ*URXQGUXOHVIRU6XFFHVV
+DPSVKLUH(QJODQG*RZHU
+817(5 -( $1' 6&+0,'7 )/   0HWKRGV RI 0HWD$QDO\VLV &RUUHFWLQJ (UURU DQG
%LDVLQ5HVHDUFK)LQGLQJV1HZEXU\3DUN&DOLIRUQLD6DJH3XEOLFDWLRQV
+817(55%$1'7+$<(55+ (GV   6RIWZDUH3URFHVV,PSURYHPHQW/RV$ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVV
+<0$1 5%   &UHDWLYH &KDRV LQ +LJK3HUIRUPDQFH 7HDPV $Q ([SHULHQFH 5HSRUW
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
,(((6WG,(((6WDQGDUG*ORVVDU\RI6RIWZDUH(QJLQHHULQJ7HUPLQRORJ\
,(((6WG,(((*XLGHIRU6RIWZDUH4XDOLW\$VVXUDQFH3ODQQLQJ
,/67$' 6   $ V\VWHP IRU $SSUDLVLQJ 4XHVWLRQQDLUHV LQ 1RUZHJLDQ  :RUNLQJ 3DSHU
1R1RUZHJLDQ8QLYHUVLW\RI6FLHQFHDQG7HFKQRORJ\
,0$,0  .DL]HQ7KH.H\WR-DSDQ¶V&RPSHWLWLYH6XFFHVV1HZ<RUN0F*UDZ+LOO
,6(1%(5*'-  +RZ6HQLRU0DQDJHUV7KLQN+DUYDUG%XVLQHVV5HYLHZ9RO1R
SS
,6+,.$:$ .   *XLGH WR 4XDOLW\ &RQWURO 6HFRQG (GLWLRQ 1HZ <RUN 4XDOLW\
5HVRXUFHV
,6+,.$:$.  ,QWURGXFWLRQWR4XDOLW\&RQWURO/RQGRQ&KDSPDQ +DOO
,62  4XDOLW\ 0DQDJHPHQW DQG 4XDOLW\ $VVXUDQFH ± 4XDOLW\ 9RFDEXODU\
,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQ
,624XDOLW\0DQDJHPHQW6\VWHPV±)XQGDPHQWDOVDQGYRFDEXODU\,QWHUQDWLRQDO
2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQ
,624XDOLW\0DQDJHPHQW6\VWHPV±5HTXLUHPHQWV,QWHUQDWLRQDO2UJDQL]DWLRQIRU
6WDQGDUGL]DWLRQ
,62,(&,QIRUPDWLRQWHFKQRORJ\±6RIWZDUH/LIH&\FOH3URFHVVHV,QWHUQDWLRQDO
2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQDQGWKH,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(& &'  6RIWZDUH (QJLQHHULQJ ± 3URFHVV $VVHVVPHQW 3DUWV  WR  
,QWHUQDWLRQDO 2UJDQL]DWLRQ IRU 6WDQGDUGL]DWLRQ DQG WKH ,QWHUQDWLRQDO (OHFWURWHFKQLFDO
&RPPLVVLRQ
,62,(&&'6RIWZDUH(QJLQHHULQJ±3URFHVV$VVHVVPHQW±3DUW3HUIRUPLQJ
DQ $VVHVVPHQW ,QWHUQDWLRQDO 2UJDQL]DWLRQ IRU 6WDQGDUGL]DWLRQ DQG WKH ,QWHUQDWLRQDO
(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(& &'  6RIWZDUH (QJLQHHULQJ ± 6RIWZDUH 0HDVXUHPHQW 3URFHVV )UDPH
ZRUN ,QWHUQDWLRQDO 2UJDQL]DWLRQ IRU 6WDQGDUGL]DWLRQ DQG WKH ,QWHUQDWLRQDO (OHFWUR
WHFKQLFDO&RPPLVVLRQ

±±
5()(5(1&(6

,62,(&75,QIRUPDWLRQ7HFKQRORJ\±6RIWZDUH3URFHVV$VVHVVPHQW±3DUW
&RQFHSWVDQG,QWURGXFWRU\*XLGH,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQDQGWKH
,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(&75,QIRUPDWLRQ7HFKQRORJ\±6RIWZDUH3URFHVV$VVHVVPHQW±3DUW
*XLGH IRU 8VH LQ 3URFHVV ,PSURYHPHQW ,QWHUQDWLRQDO 2UJDQL]DWLRQ IRU 6WDQGDUGL]DWLRQ
DQGWKH,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(&75,QIRUPDWLRQ7HFKQRORJ\±6RIWZDUH3URFHVV$VVHVVPHQW±3DUW
*XLGHIRU8VHLQ'HWHUPLQLQJ6XSSOLHU3URFHVV&DSDELOLW\,QWHUQDWLRQDO2UJDQL]DWLRQIRU
6WDQGDUGL]DWLRQDQGWKH,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(&75,QIRUPDWLRQ7HFKQRORJ\±6RIWZDUH3URFHVV$VVHVVPHQW±3DUW
9RFDEXODU\,QWHUQDWLRQDO2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQDQGWKH,QWHUQDWLRQDO(OHFWUR
WHFKQLFDO&RPPLVVLRQ
,62,(&:'6RIWZDUH(QJLQHHULQJ±3URFHVV$VVHVVPHQW±3DUW*XLGDQFH
RQ XVH IRU 3URFHVV ,PSURYHPHQW DQG 3URFHVV &DSDELOLW\ 'HWHUPLQDWLRQ ,QWHUQDWLRQDO
2UJDQL]DWLRQIRU6WDQGDUGL]DWLRQDQGWKH,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
,62,(&:'6RIWZDUHDQG6\VWHP(QJLQHHULQJ±*XLGHOLQHVIRUWKH$SSOLFDWLRQ
RI ,62  WR 6RIWZDUH ,QWHUQDWLRQDO 2UJDQL]DWLRQ IRU 6WDQGDUGL]DWLRQ DQG WKH
,QWHUQDWLRQDO(OHFWURWHFKQLFDO&RPPLVVLRQ
-$16(13 $1' 6$1'(56-  *XLGHOLQHVIRU3URFHVV,PSURYHPHQWLQ.(O(PDP-
1 'URXLQ DQG : 0HOR (GV  63,&( 7KH 7KHRU\ DQG 3UDFWLFH RI 6RIWZDUH 3URFHVV
,PSURYHPHQW DQG &DSDELOLW\ 'HWHUPLQDWLRQ /RV $ODPLWRV &DOLIRUQLD ,((( &RPSXWHU
6RFLHW\3UHVVSS
-())(5< '5 $1' 9277$ /*   *XHVW (GLWRU¶V 6SHFLDO 6HFWLRQ ,QWURGXFWLRQ ,(((
7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
-(/(7,&.3$-(56.,5$1'%52:1&  6RIWZDUH3URFHVV,PSURYHPHQW*XLGHERRN
5HYLVLRQ6RIWZDUH(QJLQHHULQJ/DERUDWRU\6HULHV6(/*UHHQEHOW0DU\ODQG
*RGGDUG6SDFH)OLJKW&HQWHU
-(/,1(. -- $1' 6&+221+29(1 &%   7KH ,QQRYDWLRQ 0DUDWKRQ &DPEULGJH 8.
%DVLO%ODFNZHOO
-,&. 7'   0L[LQJ 4XDOLWDWLYH DQG 4XDQWLWDWLYH 0HWKRGV 7ULDQJXODWLRQ LQ $FWLRQ
$GPLQLVWUDWLYH6FLHQFH4XDUWHUO\9RO1RSS
-2+1621'/ $1' %52'0$1-*  7DLORULQJWKH&00IRU6PDOO%XVLQHVVHV6PDOO
2UJDQL]DWLRQVDQG6PDOO3URMHFWVLQ.(O(PDPDQG1+0DGKDYML (GV (OHPHQWVRI
6RIWZDUH 3URFHVV $VVHVVPHQW DQG ,PSURYHPHQW /RV $ODPLWRV &DOLIRUQLD ,(((
&RPSXWHU6RFLHW\3UHVVSS
-2+1621/$,5' 31   0HQWDO 0RGHOV 7RZDUGV D &RJQLWLYH 6FLHQFH RI /DQJXDJH
,QIHUHQFHDQG&RQVFLRXVQHVV&DPEULGJH&DPEULGJH8QLYHUVLW\3UHVV
-21(6&  7KH(FRQRPLFVRI6RIWZDUH3URFHVV,PSURYHPHQWLQ.(O(PDPDQG1+
0DGKDYML (GV  (OHPHQWV RI 6RIWZDUH 3URFHVV $VVHVVPHQW DQG ,PSURYHPHQW /RV
$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
-2<% $1' .(11('<. (GV   ,QIRUPDWLRQ7HFKQRORJ\5HVHDUFK,QYHVWLQJLQ2XU
)XWXUH3UHVLGHQW¶V,QIRUPDWLRQ7HFKQRORJ\$GYLVRU\&RPPLWWHH 3,7$& 5HSRUWWRWKH

±±
REFERENCES

3UHVLGHQW $UOLQJWRQ 9$ 1DWLRQDO &RRUGLQDWLRQ 2IILFH IRU ,QIRUPDWLRQ 7HFKQRORJ\


5HVHDUFKDQG'HYHORSPHQW
-85$1-0   0DQDJHULDO %UHDNWKURXJK $ 1HZ &RQFHSW RI WKH 0DQDJHU¶V -RE 1HZ
<RUN0F*UDZ+LOO
-85$1 -0   -XUDQ RQ 4XDOLW\ E\ 'HVLJQ 7KH 1HZ 6WHSV IRU 3ODQQLQJ 4XDOLW\ LQWR
*RRGVDQG6HUYLFHV1HZ<RUN)UHH3UHVV
-85$1 -0 $1' *2')5(< $% (GV    -XUDQ¶V 4XDOLW\ +DQGERRN )LIWK (GLWLRQ
1HZ<RUN0F*UDZ+LOO
-‘5*(16(1 0 6-‘%(5* ' $1' &215$', 5   5HXVH RI 6RIWZDUH 'HYHORSPHQW
([SHULHQFHDW7HOHQRU7HOHFRP6RIWZDUH3URFHHGLQJVRIWKH(XURSHDQ6RIWZDUH3URFHVV
,PSURYHPHQW&RQIHUHQFH (XUR63,¶ *RWKHQEXUJ6ZHGHQ1RYHPEHU
.$,6(5 +)   7KH $SSOLFDWLRQ RI (OHFWURQLF &RPSXWHUV WR )DFWRU $QDO\VLV
(GXFDWLRQDODQG3V\FKRORJLFDO0HDVXUHPHQWV9ROSS
.$,6(5+)  $6HFRQG*HQHUDWLRQ/LWWOH-LII\3V\FKRPHWULND9ROSS
.$12112%8+,5267$.$+$6+,) $1' 768-,6  $WWUDFWLYH4XDOLW\DQG0XVW
%H4XDOLW\4XDOLW\0DJD]LQH9RO1RSS
.$18. / $1' %(5(1621 &   0DLO 6XUYH\V DQG 5HVSRQVH 5DWHV $ /LWHUDWXUH
5HYLHZ-RXUQDORI0DUNHWLQJ5HVHDUFK9ROSS
.$3/$1 $   7KH &RQGXFW RI ,QTXLU\ 0HWKRGRORJ\ IRU %HKDYLRUDO 6FLHQFH 6DQ
)UDQFLVFR&KDQGOHU
.$3/$1'   (YDOXDWLQJ DQG 0RGLI\LQJ &RYDULDQFH 6WUXFWXUH 0RGHOV $ 5HYLHZ DQG
5HFRPPHQGDWLRQ0XOWLYDULDWH%HKDYLRUDO5HVHDUFK9RO1RSS
.$3/$156 $1' 125721'3  7KH %DODQFHG 6FRUHFDUG 7UDQVODWLQJ 6WUDWHJ\ LQWR
$FWLRQ%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
.$3/$156 $1' 125721'3  7KH 6WUDWHJ\IRFXVHG 2UJDQL]DWLRQ +RZ %DODQFHG
6FRUHFDUG&RPSDQLHV7KULYHLQWKH1HZ%XVLQHVV(QYLURQPHQW %RVWRQ 0DVVDFKXVHWWV
+DUYDUG%XVLQHVV6FKRRO3UHVV
.$5/6621($ (G   6RIWZDUH5HXVH$+ROLVWLF$SSURDFK&KLFKHVWHU-RKQ:LOH\
6RQV
.$7= ' $1' .$+15/  7KH 6RFLDO 3V\FKRORJ\ RI 2UJDQL]DWLRQV 6HFRQG (GLWLRQ
1HZ<RUN:LOH\
.$87=. $1' /$56(1(c   'LIIXVLRQ7KHRU\DQG3UDFWLFH'LVVHPLQDWLQJ4XDOLW\
0DQDJHPHQWDQG6RIWZDUH3URFHVV,PSURYHPHQW,QQRYDWLRQV,QIRUPDWLRQ7HFKQRORJ\
3HRSOH9RO1RSS
.$:$/(. 3 $1' :$67(// '*   6RIWZDUH 'HYHORSPHQW DQG 2UJDQL]DWLRQDO
9LDELOLW\$Q$FFRXQWRIWKH,PSDFWRI2UJDQL]DWLRQDO,VVXHV8SRQ6RIWZDUH4XDOLW\LQ
(0F*XLUH (G 6RIWZDUH3URFHVV,PSURYHPHQW&RQFHSWVDQG3UDFWLFHV/RQGRQ,GHD
*URXS3XEOLVKLQJSS
.(/6(< 5%   &KDRV DQG &RPSOH[LW\ LQ 6RIWZDUH &KDOOHQJLQJ WKH ,QGXVWU\ DQG WKH
1HZ6FLHQFH1HZ<RUN1RYD6FLHQFH3XEOLVKHUV
.(5/,1*(5 )   )RXQGDWLRQV RI %HKDYLRUDO 5HVHDUFK 1HZ <RUN +ROW 5LQHKDUW DQG
:LQVWRQ

±±
5()(5(1&(6

.,0 '+   7KH /LQN EHWZHHQ ,QGLYLGXDO DQG 2UJDQL]DWLRQDO /HDUQLQJ 6ORDQ
0DQDJHPHQW5HYLHZ9RO1RSS
.,7&+(1+$0 %$   6RIWZDUH 0HWULFV 0HDVXUHPHQW IRU 6RIWZDUH 3URFHVV
,PSURYHPHQW2[IRUG8.1&&%ODFNZHOO
.,7&+(1+$0%$  (YDOXDWLQJ6RIWZDUH(QJLQHHULQJ0HWKRGVDQG7RROV3DUWV
WR6,*62)76RIWZDUH(QJLQHHULQJ1RWHV9ROV
.,7&+(1+$0%$3)/((*(56/3,&.$5'/0-21(63:+2$*/,1'&(/(0$0
. $1' 526(1%(5* - )RUWKFRPLQJ  3UHOLPLQDU\ JXLGHOLQHV IRU HPSLULFDO UHVHDUFK LQ
VRIWZDUHHQJLQHHULQJ,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ
.,7&+(1+$0 %$ 3,&.$5' /0 $1' 3)/((*(5 6/   &DVH 6WXGLHV IRU 0HWKRG
DQG7RRO(YDOXDWLRQ,(((6RIWZDUH9RO1RSS
./(,1 +. $1' 0<(56 0'   $ 6HW RI 3ULQFLSOHV IRU &RQGXFWLQJ DQG (YDOXDWLQJ
,QWHUSUHWLYH)LHOG6WXGLHVLQ,QIRUPDWLRQ6\VWHPV0,64XDUWHUO\9RO1RSS

./,1(6-  ,QQRYDWLRQ,V1RWD/LQHDU3URFHVV5HV3ROLF\9RO1RSS
.2/% '$   ([SHULHQWLDO /HDUQLQJ ([SHULHQFH DV WKH 6RXUFH RI /HDUQLQJ DQG
'HYHORSPHQW(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
.21,6+,6  1RUPDOL]LQJ7UDQVIRUPDWLRQVRIVRPH6WDWLVWLFVLQ0XOWLYDULDWH$QDO\VLV
%LRPHWULND9RO1RSS
.27/(53  0DUNHWLQJ0DQDJHPHQW$QDO\VLV3ODQQLQJ,PSOHPHQWDWLRQDQG&RQWURO
(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
.277(5-3  /HDGLQJ&KDQJH%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
.5$61(5+   7KH3D\RIIIRU6RIWZDUH3URFHVV ,PSURYHPHQW:KDWLW LV DQG +RZ WR
*HW LW LQ . (O (PDP DQG 1+ 0DGKDYML (GV  (OHPHQWV RI 6RIWZDUH 3URFHVV
$VVHVVPHQW DQG ,PSURYHPHQW /RV $ODPLWRV &DOLIRUQLD ,((( &RPSXWHU 6RFLHW\ 3UHVV
SS
.5$87 $, (G    2UJDQL]DWLRQDO 6XUYH\V 7RROV IRU $VVHVVPHQW DQG &KDQJH 6DQ
)UDQFLVFR-RVVH\%DVV
.5$87 5( $1' 675((7(5 /   &RRUGLQDWLRQ LQ 6RIWZDUH 'HYHORSPHQW
&RPPXQLFDWLRQVRIWKH$&09RO1RSS
.52*67,(-  &RQFHSWXDO0RGHOLQJIRU&RPSXWHUL]HG,QIRUPDWLRQ6\VWHPV6XSSRUWLQ
2UJDQL]DWLRQV 'RFWRUDO 'LVVHUWDWLRQ 7URQGKHLP 1RUZD\ 1RUZHJLDQ 8QLYHUVLW\ RI
6FLHQFHDQG7HFKQRORJ\
.52*67,( -   8VH RI 0HWKRGV DQG &$6(7RROV LQ 1RUZD\ 5HVXOWV IURP D 6XUYH\
$XWRPDWHG6RIWZDUH(QJLQHHULQJ9RO1RVSS
.5261,&.-$  6XUYH\5HVHDUFK$QQXDO5HYLHZRI3V\FKRORJ\9ROSS
.58&+7(1 3   7KH 5DWLRQDO 8QLILHG 3URFHVV $Q ,QWURGXFWLRQ 6HFRQG (GLWLRQ
5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
.8+1 76   7KH 6WUXFWXUH RI 6FLHQWLILF 5HYROXWLRQV 7KLUG (GLWLRQ &KLFDJR 7KH
8QLYHUVLW\RI&KLFDJR3UHVV
.81'$ *   (QJLQHHULQJ &XOWXUH &RQWURO DQG &RPPLWPHQW LQ D +LJK7HFK
&RUSRUDWLRQ3KLODGHOSKLD7HPSOH8QLYHUVLW\3UHVV

±±
REFERENCES

.89$-$ 3 6,0,/$ - .5=$1,. / %,&(*2 $ 628..21(1 6 $1' .2&+ * 
6RIWZDUH3URFHVV$VVHVVPHQWDQG,PSURYHPHQW7KH%227675$3$SSURDFK%ODFNZHOO
/$,7,1(1 0 )$<$' 0 $1' :$5' 5   6RIWZDUH (QJLQHHULQJ LQ WKH 6PDOO ,(((
6RIWZDUH9RO1RSS
/$177. $1' 0(=,$66-  $Q2UJDQL]DWLRQDO/HDUQLQJ0RGHORI&RQYHUJHQFHDQG
5HRULHQWDWLRQ2UJDQL]DWLRQ6FLHQFH9RO1RSS
/$56(1(c $1' .$87=.  4XDOLW\$VVXUDQFHDQG6RIWZDUH3URFHVV,PSURYHPHQW
LQ1RUZD\6RIWZDUH3URFHVV±,PSURYHPHQWDQG3UDFWLFH9RO1RSS
/$7285 %   6FLHQFH LQ $FWLRQ +RZ WR )ROORZ 6FLHQWLVWV DQG (QJLQHHUV WKURXJK
6RFLHW\&DPEULGJH0DVVDFKXVHWWV+DUYDUG8QLYHUVLW\3UHVV
/$8 )   7RZDUG D )UDPHZRUN IRU $FWLRQ 5HVHDUFK LQ ,QIRUPDWLRQ 6\VWHPV 6WXGLHV
,QIRUPDWLRQ7HFKQRORJ\ 3HRSOH9RO1RSS
/$9( - $1' :(1*(5 (   6LWXDWHG /HDUQLQJ /HJLWLPDWH 3HULSKHUDO 3DUWLFLSDWLRQ
&DPEULGJH&DPEULGJH8QLYHUVLW\3UHVV
/$:/(5 (( ,,,   5HWKLQNLQJ 2UJDQL]DWLRQ 6L]H 2UJDQL]DWLRQDO '\QDPLFV 9RO 
1RSS
/$:5(1&( 35 $1' /256&+ -:   2UJDQL]DWLRQ DQG (QYLURQPHQW 0DQDJLQJ
'LIIHUHQWLDWLRQDQG,QWHJUDWLRQ6HFRQG(GLWLRQ%RVWRQ+DUYDUG%XVLQHVV6FKRRO3UHVV
/(( $6   $ 6FLHQWLILF 0HWKRGRORJ\ IRU 0,6 &DVH 6WXGLHV 0,6 4XDUWHUO\ 9RO 
1RSS
/(( $6   ,QWHJUDWLQJ 3RVLWLYLVW DQG ,QWHUSUHWLYH $SSURDFKHV WR 2UJDQL]DWLRQDO
5HVHDUFK2UJDQL]DWLRQ6FLHQFH9RO1RSS
/(( $6 D  5HVHDUFKLQJ 0,6 LQ :/ &XUULH DQG 5' *DOOLHUV (GV  5HWKLQNLQJ
0DQDJHPHQW ,QIRUPDWLRQ 6\VWHPV $Q ,QWHUGLVFLSOLQDU\ 3HUVSHFWLYH 2[IRUG 2[IRUG
8QLYHUVLW\3UHVVSS
/((7: E  8VLQJ 4XDOLWDWLYH 0HWKRGV LQ 2UJDQL]DWLRQDO 5HVHDUFK 7KRXVDQG 2DNV
&DOLIRUQLD6DJH
/(+0$1 00   8QFHUWDLQW\ LQ &RPSXWHU $SSOLFDWLRQV DQG LWV &RQWURO WKURXJK WKH
(QJLQHHULQJ RI 6RIWZDUH 6RIWZDUH 0DLQWHQDQFH 5HVHDUFK DQG 3UDFWLFH 9RO  1R 
SS
/(,)(550&'(50277&02¶&21125*&3(7(56/65,&(03 $1' 9(5<=(5
5: -5   5DGLFDO ,QQRYDWLRQ +RZ 0DWXUH &RPSDQLHV &DQ 2XWVPDUW 8SVWDUWV
%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
/(21$5'%$5721'  :HOOVSULQJVRI.QRZOHGJH%XLOGLQJDQG6XVWDLQLQJWKH6RXUFHV
RI,QQRYDWLRQ%RVWRQ+DUYDUG%XVLQHVV6FKRRO3UHVV
/(9,10  7HFKQRORJ\7UDQVIHULV2UJDQL]DWLRQDO'HYHORSPHQW$Q,QYHVWLJDWLRQLQWR
WKH5HODWLRQVKLSEHWZHHQ7HFKQRORJ\7UDQVIHUDQG2UJDQL]DWLRQDO&KDQJH,QWHUQDWLRQDO
-RXUQDORI7HFKQRORJ\0DQDJHPHQW9RO1RVSS
/(9,17+$/'$ $1' 0$5&+-*  7KH0\RSLDRI /HDUQLQJ6WUDWHJLF0DQDJHPHQW
-RXUQDO9ROSS
/e9,675$866&  7KH6DYDJH0LQG&KLFDJR8QLYHUVLW\RI&KLFDJR3UHVV

±±
5()(5(1&(6

/(9,77 % $1' 0$5&+ -*   2UJDQL]DWLRQDO /HDUQLQJ $QQXDO 5HYLHZ RI 6RFLRORJ\
9ROSS
/(:,1.  )LHOG7KHRU\LQ6RFLDO6FLHQFHV1HZ<RUN+DUSHUDQG5RZ
/,(' +- $1' 67c/+$1( 7   ([SHULHQFH IURP 3URFHVV ,PSURYHPHQW LQ D 60(
3URFHHGLQJV RI WKH (XURSHDQ 6RIWZDUH 3URFHVV ,PSURYHPHQW &RQIHUHQFH (XUR63,¶ 
3RUL)LQODQG2FWREHU
/,.(57 5   $ 7HFKQLTXH IRU WKH 0HDVXUHPHQW RI $WWLWXGHV $UFKLYHV RI 3V\FKRORJ\
9RO1R
/,.(57 5   7KH +XPDQ 2UJDQL]DWLRQ ,WV 0DQDJHPHQW DQG 9DOXH 1HZ <RUN
0F*UDZ+LOO
/,.(57 5 $1' 526/2: 6   7KH (IIHFWV 8SRQ WKH 5HOLDELOLW\ RI $WWLWXGH 6FDOHV RI
8VLQJ7KUHH)LYHRU6HYHQ$OWHUQDWLYHV:RUNLQJ3DSHU1HZ<RUN8QLYHUVLW\
/,33,77 5 :$7621 - $1' :(67/< %   7KH '\QDPLFV RI 3ODQQHG &KDQJH 1HZ
<RUN+DUFRXUW%UDFHDQG:RUOG
/,66,7=5: $1' *5((16%  (IIHFWVRIWKH1XPEHURI6FDOH3RLQWVRQ5HOLDELOLW\
$0RQWH&DUOR$SSURDFK-RXUQDORI$SSOLHG3V\FKRORJ\9RO)HEUXDU\SS
/8&$6+&  :K\,QIRUPDWLRQ6\VWHPV)DLO1HZ<RUN&ROXPELD8QLYHUVLW\3UHVV
/<1&+5/ $1' &5266 .&   0HDVXUH 8S <DUGVWLFN IRU &RQWLQXRXV ,PSURYHPHQW
&DPEULGJH0DVVDFKXVHWWV%ODFNZHOO%XVLQHVV
/<11 *6 02521( -* $1' 3$8/621 $6   0DUNHWLQJ DQG 'LVFRQWLQXRXV
,QQRYDWLRQ7KH3UREHDQG/HDUQ3URFHVV&DOLIRUQLD0DQDJHPHQW5HYLHZ9RO1R
SS
/<6*$$5'6  $UEHLGHUNROOHNWLYHW 7KH:RUNHU&ROOHFWLYH 2VOR8QLYHUVLWHWVIRUODJHW
LQ1RUZHJLDQ 
0$&.(1=,(' $1' :$-&0$1- (GV   7KH 6RFLDO 6KDSLQJ RI 7HFKQRORJ\ 0LOWRQ
.H\QHV2SHQ8QLYHUVLW\3UHVV
0$'+$9-,1+  7KH3URFHVV&\FOH6RIWZDUH(QJLQHHULQJ-RXUQDO9RO1RSS

0$5&+ -*   ([SORUDWLRQ DQG ([SORLWDWLRQ LQ 2UJDQL]DWLRQDO /HDUQLQJ 2UJDQL]DWLRQ
6FLHQFH9RO1RSS
0$5&+ -*   7KH 3XUVXLW RI 2UJDQL]DWLRQDO ,QWHOOLJHQFH 0DOGHQ 0DVVDFKXVHWWV
%ODFNZHOO
0$5&+ -* $1' 2/6(1 -3   $PELJXLW\ DQG &KRLFH LQ 2UJDQL]DWLRQV %HUJHQ
1RUZD\8QLYHUVLWHWVIRUODJHW
0$5&+-*$1'6,021+$  2UJDQL]DWLRQV1HZ<RUN-RKQ:LOH\
0$5&+ -* $1' 6,021 +$   2UJDQL]DWLRQV 6HFRQG (GLWLRQ 2[IRUG 8. %ODFN
ZHOO
0$5&+-* $1' 6877215,  2UJDQL]DWLRQDO3HUIRUPDQFHDVD'HSHQGHQW9DULDEOH
2UJDQL]DWLRQ6FLHQFH9RO1RSS
0$548,6'*  7KH$QDWRP\RI6XFFHVVIXO,QQRYDWLRQVLQ0/7XVKPDQDQG:/
0RRUH (GV  5HDGLQJV LQ WKH 0DQDJHPHQW RI ,QQRYDWLRQ 6HFRQG (GLWLRQ 1HZ <RUN
+DUSHU%XVLQHVVSS

±±
REFERENCES

0$57,1 -   &XOWXUHV LQ 2UJDQL]DWLRQV 7KUHH 3HUVSHFWLYHV 1HZ <RUN 2[IRUG
8QLYHUVLW\3UHVV
0$7+,$66(1 /   5HIOHFWLYH 6\VWHPV 'HYHORSPHQW 'U 7HFKQ 7KHVLV $DOERUJ
8QLYHUVLW\'HQPDUN
0$7+,$66(1 / $1' 67$*( -   7KH 3ULQFLSOH RI /LPLWHG 5HGXFWLRQ LQ 6RIWZDUH
'HVLJQ,QIRUPDWLRQ7HFKQRORJ\ 3HRSOH9RO1RVSS
0$785$1$+5$1'9$5(/$)-  $XWRSRLHVLVDQG&RJQLWLRQ7KH5HDOL]DWLRQRIWKH
/LYLQJ/RQGRQ5HLGO
0$<2 (   7KH +XPDQ 3UREOHPV RI DQ ,QGXVWULDO &LYLOL]DWLRQ %RVWRQ +DUYDUG
8QLYHUVLW\3UHVV
0$<2 (   7KH 6RFLDO 3UREOHPV RI DQ ,QGXVWULDO &LYLOL]DWLRQ %RVWRQ +DUYDUG
8QLYHUVLW\3UHVV
0&)((/(<%  ,'($/$8VHU¶V*XLGHIRU6RIWZDUH3URFHVV,PSURYHPHQW+DQGERRN
&086(,+%&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
0&*$55< - (G    3UDFWLFDO 6RIWZDUH 0HDVXUHPHQW $ )RXQGDWLRQ IRU 2EMHFWLYH
3URMHFW 0DQDJHPHQW 9HUVLRQ D 2IILFH RI WKH 8QGHU 6HFUHWDU\ RI 'HIHQVH IRU
$FTXLVLWLRQ DQG 7HFKQRORJ\ -RLQW /RJLVWLFV &RPPDQGHUV -RLQW *URXS RQ 6\VWHPV
(QJLQHHULQJ
0&,9(5 -3 $1' &$50,1(6 (*   8QLGLPHQVLRQDO 6FDOLQJ %HYHUO\ +LOOV 6DJH
3XEOLFDWLRQV
0(+1(5 7   6LHPHQV 3URFHVV $VVHVVPHQW $SSURDFK LQ 5 0HVVQDU] DQG & 7XOO\
(GV  %HWWHU 6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW 3ULQFLSOHV DQG ([SHULHQFH /RV
$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
0(55,$0:(%67(5   0HUULDP:HEVWHU¶V &ROOHJLDWH 'LFWLRQDU\ WK (GLWLRQ
6SULQJILHOG0DVVDFKXVHWWV0HUULDP:HEVWHU
0(661$5= 5 D  6RIWZDUH 3URFHVV DQG $QDO\VLV &RQFHSWV DQG 'HILQLWLRQV LQ 5
0HVVQDU] DQG & 7XOO\ (GV  %HWWHU 6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW 3ULQFLSOHV
DQG([SHULHQFH/RV$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
0(661$5= 5 E  6XPPDU\ DQG 2XWORRN LQ 5 0HVVQDU] DQG & 7XOO\ (GV  %HWWHU
6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW 3ULQFLSOHV DQG ([SHULHQFH /RV $ODPLWRV
&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVVSS
0(661$5= 5 $1' 78//< & (GV    %HWWHU 6RIWZDUH 3UDFWLFH IRU %XVLQHVV %HQHILW
3ULQFLSOHVDQG([SHULHQFH/RV$ODPLWRV&DOLIRUQLD,(((&RPSXWHU6RFLHW\3UHVV
0,//(5*$  7KH0DJLFDO1XPEHU6HYHQ3OXVRU0LQXV7ZR6RPH/LPLWVRQ2XU
&DSDFLW\IRU3URFHVVLQJ,QIRUPDWLRQ3V\FKRORJLFDO5HYLHZ9ROSS
0,//(5-'$/<-:22'0523(50 $1' %522.6$  6WDWLVWLFDO3RZHU DQG
LWV 6XEFRPSRQHQWV ± 0LVVLQJ DQG 0LVXQGHUVWRRG &RQFHSWV LQ (PSLULFDO 6RIWZDUH
(QJLQHHULQJ 5HVHDUFK ,QIRUPDWLRQ DQG 6RIWZDUH 7HFKQRORJ\ 9RO  1R  SS 

0,17=%(5* +   $Q (PHUJLQJ 6WUDWHJ\ RI ³'LUHFW´ 5HVHDUFK $GPLQLVWUDWLYH 6FLHQFH
4XDUWHUO\9ROSS
0,17=%(5* +   6WUXFWXUH LQ )LYHV 'HVLJQLQJ (IIHFWLYH 2UJDQL]DWLRQV (QJOHZRRG
&OLIIV1HZ-HUVH\3UHQWLFH+DOO

±±
5()(5(1&(6

0,17=%(5* +   0LQW]EHUJ RQ 0DQDJHPHQW ,QVLGH 2XU 6WUDQJH :RUOG RI
2UJDQL]DWLRQV1HZ<RUN7KH)UHH3UHVV
0,1=7%(5* +   7KH )DOO DQG 5LVH RI 6WUDWHJLF 3ODQQLQJ +DUYDUG %XVLQHVV 5HYLHZ
9RO1RSS
0217$1*(52 &   7KH 6RIWZDUH 3URFHVV 0RGHOOLQJ DQG 7HFKQRORJ\ LQ -&
'HUQLDPH %$ .DED DQG '* :DVWHOO (GV  6RIWZDUH 3URFHVV 3ULQFLSOHV
0HWKRGRORJ\ DQG 7HFKQRORJ\ /HFWXUH 1RWHV LQ &RPSXWHU 6FLHQFH 9RO  %HUOLQ
6SULQJHU9HUODJSS
02250$1 & $1' 0,1(5 $6   7KH &RQYHUJHQFH RI 3ODQQLQJ DQG ([HFXWLRQ
,PSURYLVDWLRQLQ1HZ3URGXFW'HYHORSPHQW-RXUQDORI0DUNHWLQJ9RO1R-XO\
SS
025*$1*  ,PDJHVRI2UJDQL]DWLRQ1HZEXU\+LOO6DJH3XEOLFDWLRQV
080)25'(  'HVLJQLQJ+XPDQ6\VWHPVIRU1HZ7HFKQRORJ\7KH(7+,&60HWKRG
0DQFKHVWHU0DQFKHVWHU%XVLQHVV6FKRRO
0g//(5 .+ $1' 3$8/,6+ '-   6RIWZDUH 0HWULFV $ 3UDFWLWLRQHU¶V *XLGH WR
,PSURYHG 3URGXFW 'HYHORSPHQW /RV $ODPLWRV &DOLIRUQLD ,((( &RPSXWHU 6RFLHW\
3UHVV
1$'/(5'$  )HHGEDFNDQG2UJDQL]DWLRQ'HYHORSPHQW8VLQJ'DWDEDVHG0HWKRGV
5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
1$853  3URJUDP'HYHORSPHQW6WXGLHV%DVHGRQ'LDULHVLQ7*UHHQ63D\QHDQG
*YDQGHU9HHU (GV 3V\FKRORJ\RI&RPSXWHU8VH/RQGRQ$FDGHPLF3UHVVSS

1$85 3 $1' 5$1'(// % (GV    6RIWZDUH (QJLQHHULQJ 3URFHHGLQJV RI WKH 1$72
&RQIHUHQFH LQ *DUPLVFK3DUWHQNLUFKHQ 1$72 6FLHQFH &RPPLWWHH 6FLHQWLILF $IIDLUV
'LYLVLRQ1$72%UXVVHOV-DQXDU\
1()) ):   6XUYH\ 5HVHDUFK $ 7RRO IRU 3UREOHP 'LDJQRVLV DQG ,PSURYHPHQW LQ
2UJDQL]DWLRQVLQ$:*RXOGQHUDQG600LOOHU (GV $SSOLHG6RFLRORJ\1HZ<RUN
)UHH3UHVVSS
1(80$1 :/   6RFLDO 5HVHDUFK 0HWKRGV 4XDOLWDWLYH DQG 4XDQWLWDWLYH $SSURDFKHV
)RXUWK(GLWLRQ%RVWRQ$OO\QDQG%DFRQ
1(9,6 (& ',%(//$ $- $1' *28/' -0   8QGHUVWDQGLQJ 2UJDQL]DWLRQV DV
/HDUQLQJ6\VWHPV6ORDQ0DQDJHPHQW5HYLHZ9RO:LQWHUSS
1(:0$10 $1' 52%(<'  $6RFLDO3URFHVV0RGHORI8VHU$QDO\VW5HODWLRQVKLSV
0,64XDUWHUO\9RO1RSS
1,&2/,1,'$1'0(=1$50%  7KH6RFLDO&RQVWUXFWLRQRI2UJDQL]DWLRQDO/HDUQLQJ
&RQFHSWXDODQG 3UDFWLFDO ,VVXHV LQ WKH )LHOG +XPDQ 5HODWLRQV 9RO  1R SS 

12/$1$-  /HDUQLQJIURP6XFFHVV,(((6RIWZDUH9RO1RSS
121$.$ ,   7KH .QRZOHGJH&UHDWLQJ &RPSDQ\ +DUYDUG %XVLQHVV 5HYLHZ 9RO 
1R1RYHPEHU'HFHPEHUSS
121$.$,  $'\QDPLF7KHRU\RI2UJDQL]DWLRQDO.QRZOHGJH&UHDWLRQ2UJDQL]DWLRQ
6FLHQFH9RO1RSS

±±
REFERENCES

121$.$ , $1' .2112 1   7KH &RQFHSW RI ³%D´ %XLOGLQJ D )RXQGDWLRQ IRU
.QRZOHGJH&UHDWLRQ&DOLIRUQLD0DQDJHPHQW5HYLHZ9RO1RSS
121$.$ , $1' 7$.(8&+, +   7KH .QRZOHGJH&UHDWLQJ &RPSDQ\ +RZ -DSDQHVH
&RPSDQLHV&UHDWHWKH'\QDPLFVRI,QQRYDWLRQ1HZ<RUN2[IRUG8QLYHUVLW\3UHVV
129,&. 0 $1' /(:,6 *   &RHIILFLHQW $OSKD DQG WKH 5HOLDELOLW\ RI &RPSRVLWH
0HDVXUHPHQWV3V\FKRPHWULND9ROSS
1811$//<-&  3V\FKRPHWULF7KHRU\6HFRQG(GLWLRQ1HZ<RUN0F*UDZ+LOO
1811$//<-&$1'%(5167(,1,$  3V\FKRPHWULF7KHRU\7KLUG(GLWLRQ1HZ<RUN
0F*UDZ+LOO
2¶1(,//3 $1' 62+$/ $6   %XVLQHVV 3URFHVV 5HHQJLQHHULQJ $ 5HYLHZ RI 5HFHQW
/LWHUDWXUH7HFKQRYDWLRQ9RO1RSS
2/621 7 +803+5(< :6 $1' .,7621 '   &RQGXFWLQJ 6(,DVVLVWHG 6RIWZDUH
3URFHVV $VVHVVPHQWV 7HFKQLFDO 5HSRUW &086(,75 &DUQHJLH 0HOORQ
8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH
20$13 $1' 3)/((*(5 6/  $SSO\LQJ 6RIWZDUH 0HWULFV /RV $ODPLWRV &DOLIRUQLD
,(((&RPSXWHU6RFLHW\3UHVV
25/,.2:6., :- $1' +2)0$1 -'   $Q ,PSURYLVDWLRQDO 0RGHO IRU &KDQJH
0DQDJHPHQW7KH&DVHRI*URXSZDUH7HFKQRORJLHV6ORDQ0DQDJHPHQW5HYLHZ9RO
1RSS
255-(  6KDULQJ.QRZOHGJH&HOHEUDWLQJ,GHQWLW\&RPPXQLW\0HPRU\LQD6HUYLFH
&XOWXUHLQ'0LGGOHWRQDQG'(GZDUGV (GV &ROOHFWLYH5HPHPEHULQJ/RQGRQ6DJH
SS
255 -(   7DONLQJ DERXW 0DFKLQHV $Q (WKQRJUDSK\ RI D 0RGHUQ -RE ,WKDFD 1HZ
<RUN&RUQHOO8QLYHUVLW\3UHVV
26%251 $)   $SSOLHG ,PDJLQDWLRQ 3ULQFLSOHV DQG 3URFHGXUHV RI &UHDWLYH 3UREOHP
6ROYLQJ7KLUG(GLWLRQ1HZ<RUN6FULEQHUV
28/'0$  &00DQG,626RIWZDUH3URFHVV±,PSURYHPHQWDQG3UDFWLFH9RO
SS
3$5.5(*2(7+(57:%$1')/25$&:$  *RDO'ULYHQ6RIWZDUH0HDVXUHPHQW
±$*XLGHERRN+DQGERRN&086(,+%&DUQHJLH0HOORQ8QLYHUVLW\6RIWZDUH
(QJLQHHULQJ,QVWLWXWH
3$51$6'/$1'&/(0(1763&  $5DWLRQDO'HVLJQ3URFHVV+RZDQG:K\WR)DNH
,W,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
3$51(66-  &UHDWLYH%HKDYLRU*XLGHERRN1HZ<RUN6FULEQHUV
3$7721 04   4XDOLWDWLYH (YDOXDWLRQ DQG 5HVHDUFK 0HWKRGV 6HFRQG (GLWLRQ
1HZEXU\3DUN&DOLIRUQLD6DJH
3$8/. 0& $1' .215$' 0   0HDVXULQJ 3URFHVV &DSDELOLW\ YHUVXV 2UJDQL]DWLRQDO
3URFHVV0DWXULW\3URFHHGLQJVRIWKHWK,QWHUQDWLRQDO&RQIHUHQFH RQ 6RIWZDUH 4XDOLW\
2FWREHU
3$8/.0&:(%(5&9 $1' &+5,66,60%  7KH&DSDELOLW\0DWXULW\0RGHOIRU
6RIWZDUH LQ . (O (PDP DQG 1+ 0DGKDYML (GV  (OHPHQWV RI 6RIWZDUH 3URFHVV

±±
5()(5(1&(6

$VVHVVPHQWDQG ,PSURYHPHQW /RV $ODPLWRV &DOLIRUQLD ,((( &RPSXWHU 6RFLHW\ 3UHVV


SS
3$8/.0&:(%(5&9&857,6% $1' &+5,66,60%  7KH&DSDELOLW\0DWXULW\
0RGHO *XLGHOLQHV IRU ,PSURYLQJ WKH 6RIWZDUH 3URFHVV 5HDGLQJ 0DVVDFKXVHWWV
$GGLVRQ:HVOH\
3$<1(6  7KH$UWRI$VNLQJ4XHVWLRQV3ULQFHWRQ1HZ-HUVH\3ULQFHWRQ 8QLYHUVLW\
3UHVV
3(7(567-  7KULYLQJRQ&KDRV+DQGERRNIRUD0DQDJHPHQW5HYROXWLRQ1HZ<RUN
+DUSHU 5RZ
3(7(567-  /LEHUDWLRQ0DQDJHPHQW1HFHVVDU\'LVRUJDQL]DWLRQIRUWKH1DQRVHFRQG
1LQHWLHV1HZ<RUN$OIUHDG$.QRSI
3(7(567- $1' :$7(50$15+  ,Q6HDUFKRI([FHOOHQFH/HVVRQVIURP$PHULFD¶V
%HVW5XQ&RPSDQLHV1HZ<RUN+DUSHU 5RZ
3(7(5621 %   6RIWZDUH (QJLQHHULQJ ,QVWLWXWH 6RIWZDUH 3URFHVV ,PSURYHPHQW DQG
3UDFWLFH3LORW,VVXH-RKQ:LOH\ 6RQV/WG$XJXVW
3)())(5- $1' 6877215,  7KH.QRZLQJ'RLQJ*DS+RZ6PDUW&RPSDQLHV7XUQ
.QRZOHGJHLQWR$FWLRQ%RVWRQ0DVVDFKXVHWWV+DUYDUG%XVLQHVV6FKRRO3UHVV
3)/((*(5 6/   ([SHULPHQWDO 'HVLJQ DQG $QDO\VLV LQ 6RIWZDUH (QJLQHHULQJ
3DUWVWR6,*62)76RIWZDUH(QJLQHHULQJ1RWHV9ROV
3)/((*(5 6/   *XLGHOLQHV IRU $SSO\LQJ 5HVHDUFK 5HVXOWV ,((( 6RIWZDUH 9RO 
1RSS
3)/((*(5 6/ D  $OEHUW (LQVWHLQ DQG (PSLULFDO 6RIWZDUH (QJLQHHULQJ ,(((
&RPSXWHU9RO1RSS
3)/((*(5 6/ E  8QGHUVWDQGLQJ DQG ,PSURYLQJ 7HFKQRORJ\ 7UDQVIHU LQ 6RIWZDUH
(QJLQHHULQJ-RXUQDORI6\VWHPVDQG6RIWZDUH9RO1RSS
3)/((*(5 6/ $1' 0(1(=(6 :   0DUNHWLQJ 7HFKQRORJ\ WR 6RIWZDUH 3UDFWLWLRQHUV
,(((6RIWZDUH9RO1RSS
3,$*(7-  *HQHWLF(SLVWHPRORJ\1HZ<RUN&ROXPELD8QLYHUVLW\3UHVV
3,16211($8/7 $ $1' .5$(0(5 ./   6XUYH\ 5HVHDUFK 0HWKRGRORJ\ LQ
0DQDJHPHQW,QIRUPDWLRQ6\VWHPV$Q$VVHVVPHQW-RXUQDORI0DQDJHPHQW,QIRUPDWLRQ
6\VWHPV9RO1RSS
32/$1<,0  7KH7DFLW'LPHQVLRQ1HZ<RUN'RXEOHGD\
322/( 06 9$1 '( 9(1 $+ '22/(< . $1' +2/0(6 0(   2UJDQL]DWLRQDO
&KDQJH DQG ,QQRYDWLRQ 3URFHVVHV 7KHRU\ DQG 0HWKRGV IRU 5HVHDUFK 2[IRUG 2[IRUG
8QLYHUVLW\3UHVV
3233(5.5  7KH/RJLFRI6FLHQWLILF'LVFRYHU\/RQGRQ+XWFKLQVRQ
3233(5 .5   2EMHFWLYH .QRZOHGJH $Q (YROXWLRQDU\ $SSURDFK 5HYLVHG (GLWLRQ
2[IRUG&ODUHQGRQ3UHVV
32776&   6RIWZDUH(QJLQHHULQJ 5HVHDUFK 5HYLVLWHG,((( 6RIWZDUH 9RO  1R 
SS
32:(// 7&   7RWDO 4XDOLW\ 0DQDJHPHQW DV &RPSHWLWLYH $GYDQWDJH $ 5HYLHZ DQG
(PSLULFDO6WXG\6WUDWHJLF0DQDJHPHQW-RXUQDO9RO1RSS

±±
REFERENCES

35$+$/$' &. $1' +$0(/ *   7KH &RUH &RPSHWHQFH RI WKH &RUSRUDWLRQ
+DUYDUG%XVLQHVV5HYLHZ9RO1RSS
35(6/(<$6$5.,6- $1' /,/(6'+  $6RIW6\VWHPV0HWKRGRORJ\$SSURDFKIRU
3URGXFW DQG 3URFHVV ,QQRYDWLRQ ,((( 7UDQVDFWLRQV RQ (QJLQHHULQJ 0DQDJHPHQW 9RO
1RSS
35(660$1 56   0DNLQJ 6RIWZDUH (QJLQHHULQJ +DSSHQ $ *XLGH IRU ,QVWLWXWLQJ WKH
7HFKQRORJ\(QJOHZRRG&OLIIV1HZ-HUVH\3UHQWLFH+DOO
352)(6  352)(68VHU0DQXDO)LQDO9HUVLRQKWWSZZZLHVHIKJGH3URIHV
38/)25' . .817=0$11&20%(//(6 $ $1' 6+,5/$: 6   $ 4XDQWLWDWLYH
$SSURDFKWR6RIWZDUH0DQDJHPHQW7KHDPL+DQGERRN:RNLQJKDP(QJODQG$GGLVRQ
:HVOH\
48,11-%  0DQDJLQJ,QQRYDWLRQ&RQWUROOHG&KDRV+DUYDUG%XVLQHVV5HYLHZ9RO
1RSS
5$'(0$&+(5 5$   6WDWLVWLFDO 3RZHU LQ ,QIRUPDWLRQ 6\VWHPV 5HVHDUFK $SSOLFDWLRQ
DQG,PSDFWRQWKH'LVFLSOLQH-RXUQDORI&RPSXWHU,QIRUPDWLRQ6\VWHPV9RO1R
SS
5$*+$9$1 6$ $1' &+$1' '5   'LIIXVLQJ 6RIWZDUH(QJLQHHULQJ 0HWKRGV ,(((
6RIWZDUH9RO1RSS
5$<021'(6  7KH&DWKHGUDO WKH%D]DDU0XVLQJVRQ/LQX[DQG2SHQ6RXUFHE\
DQ$FFLGHQWDO5HYROXWLRQDU\6HEDVWRSRO&DOLIRUQLD2¶5HLOO\
5$<021' / %(5*(521 ) $1' 5,9$5' 6   'HWHUPLQDQWV RI %XVLQHVV 3URFHVV
5HHQJLQHHULQJ 6XFFHVV LQ 6PDOO DQG /DUJH (QWHUSULVHV $Q (PSLULFDO 6WXG\ LQ WKH
&DQDGLDQ&RQWH[W-RXUQDORI6PDOO%XVLQHVV0DQDJHPHQW9RO1RSS
5(,&+$5'7&6 $1' 5$//,66) (GV    7KH 4XDOLWDWLYH4XDQWLWDWLYH 'HEDWH 1HZ
3HUVSHFWLYHV6DQ)UDQFLVFR-RVVH\%DVV
5(77,*0 $1' 6,0216 *  $3URMHFW3ODQQLQJ DQG 'HYHORSPHQW 3URFHVV IRU 6PDOO
7HDPV&RPPXQLFDWLRQVRIWKH$&09RO1RSS
5,).,16  :KDW0DNHV0HDVXULQJ6RIWZDUH6R+DUG",(((6RIWZDUH9RO1R
SS
52%,1621 + +$// 3 +29(1'(1 ) $1' 5$&+(/ -   3RVWPRGHUQ 6RIWZDUH
'HYHORSPHQW7KH&RPSXWHU-RXUQDO9RO1RSS
52(7=+(,0:+  6WUXFWXUHG&RPSXWHU3URMHFW0DQDJHPHQW(QJOHZRRG&OLIIV1HZ
-HUVH\3UHQWLFH+DOO
52*(56(0  'LIIXVLRQRI,QQRYDWLRQV)RXUWK(GLWLRQ1HZ<RUN7KH)UHH3UHVV
522,-0$16-$(576+ $1' 9$1 *(18&+7(1 0   6RIWZDUH 4XDOLW\ LQ &RQVXPHU
(OHFWURQLFV3URGXFWV,(((6RIWZDUH9RO1RSS
526(1 60   6FLHQFH 3DUDGR[ DQG WKH 0RHELXV 3ULQFLSOH 7KH (YROXWLRQ RI D
³7UDQVFXOWXUDO´ $SSURDFK WR :KROHQHVV $OEDQ\ 1HZ <RUN 6WDWH 8QLYHUVLW\ RI 1HZ
<RUN3UHVV
52<&(::  0DQDJLQJWKH'HYHORSPHQWRI/DUJH6RIWZDUH6\VWHPV&RQFHSWVDQG
7HFKQLTXHV3URFHHGLQJVRI,(((:(6&21/RV$QJHOHVSS
5</(*  7KH&RQFHSWRI0LQG/RQGRQ+XWFKLQVRQ

±±
5()(5(1&(6

5</(*   ,PSURYLVDWLRQLQ*5\OH (G 2Q7KLQNLQJ /RQGRQ %ODFNZHOOSS



6$1'(56 0 (G    7KH 63,5( +DQGERRN %HWWHU )DVWHU &KHDSHU 6RIWZDUH
'HYHORSPHQWLQ6PDOO2UJDQLVDWLRQV'XEOLQ&HQWUHIRU6RIWZDUH(QJLQHHULQJ/WG
6$5$3+-9%(16213* $1' 6&+52('(55*  $Q,QVWUXPHQWIRU0HDVXULQJWKH
&ULWLFDO)DFWRUVRI4XDOLW\0DQDJHPHQW'HFLVLRQ6FLHQFHV9RO1RSS
6$8(5 - :$67(// '* $1' +2&.(< *5-   $ &RQFHSWXDO )UDPHZRUN IRU
'HVLJQLQJ 0LFURZRUOGV IRU &RPSOH[ :RUN 'RPDLQV $ &DVH 6WXG\ RI WKH &DELQ $LU
0DQDJHPHQW6\VWHP&RPSXWHUVLQ+XPDQ%HKDYLRU9RO1RSS
6$:<(5 6 $1' *8,1$1 3-   6RIWZDUH 'HYHORSPHQW 3URFHVVHV DQG 3HUIRUPDQFH
,%06\VWHPV-RXUQDO9RO1RSS
6&$&&+, :   0DQDJLQJ 6RIWZDUH (QJLQHHULQJ 3URMHFWV $ 6RFLDO $QDO\VLV ,(((
7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJ9RO1RSS
6&+(,1 (+   3URFHVV &RQVXOWDWLRQ 6HFRQG (GLWLRQ 5HDGLQJ 0DVVDFKXVHWWV
$GGLVRQ:HVOH\
6&+(,1(+  2UJDQL]DWLRQDO&XOWXUHDQG/HDGHUVKLS6HFRQG(GLWLRQ6DQ)UDQFLVFR
-RVVH\%DVV
6&+(,1(+ D &XOWXUH7KH0LVVLQJ&RQFHSWLQ2UJDQL]DWLRQ6WXGLHV$GPLQLVWUDWLYH
6FLHQFH4XDUWHUO\9ROSS
6&+(,1(+ E .XUW/HZLQ¶V&KDQJH7KHRU\LQWKH)LHOGDQGLQWKH&ODVVURRP1RWHV
7RZDUGVD0RGHORI0DQDJHG/HDUQLQJ6\VWHPV3UDFWLFH9RO1RSS
6&+(,1(+ F 7KUHH&XOWXUHVRI 0DQDJHPHQW 7KH .H\ WR 2UJDQL]DWLRQDO /HDUQLQJ
6ORDQ0DQDJHPHQW5HYLHZ9RO1R)DOOSS
6&+(57=(5 &% $1' .(51$1 -%   0RUH RQ WKH 5REXVWQHVV RI 5HVSRQVH 6FDOHV
-RXUQDORI0DUNHWLQJ5HVHDUFK6RFLHW\9RO1RSS
6&+8/7=0 $1' +$7&+0  /LYLQJZLWK0XOWLSOH3DUDGLJPV7KH&DVHRI3DUDGLJP
,QWHUSOD\ LQ 2UJDQL]DWLRQDO &XOWXUH 6WXGLHV $FDGHP\ RI 0DQDJHPHQW 5HYLHZ 9RO 
1RSS
6&+80$&+(5()  $*XLGHIRUWKH3HUSOH[HG1HZ<RUN+DUSHUDQG5RZ
6&+:$%(5 . $1' %(('/( 0 IRUWKFRPLQJ   6FUXP  $JLOH 6RIWZDUH 'HYHORSPHQW
3UHQWLFH+DOO
6&+:$1'7 7$   7KUHH (SLVWHPRORJLFDO 6WDQFHV IRU 4XDOLWDWLYH ,QTXLU\
,QWHUSUHWLYLVP +HUPHQHXWLFV DQG 6RFLDO &RQVWUXFWLRQLVP LQ 1. 'HQ]LQ DQG <6
/LQFROQ (GV  +DQGERRN RI 4XDOLWDWLYH 5HVHDUFK 6HFRQG (GLWLRQ 7KRXVDQG 2DNV
&DOLIRUQLD6DJHSS
6&+g1 '$   7KH 5HIOHFWLYH 3UDFWLWLRQHU +RZ 3URIHVVLRQDOV 7KLQN LQ $FWLRQ 1HZ
<RUN%DVLF%RRNV
6&83,15  7KH.-0HWKRG$7HFKQLTXHIRU$QDO\]LQJ'DWD'HULYHGIURP-DSDQHVH
(WKQRORJ\+XPDQ2UJDQL]DWLRQ9RO1RSS
6(, D 6&$03,6WDQGDUG&00,$VVHVVPHQW0HWKRGIRU3URFHVV,PSURYHPHQW0HWKRG
'HVFULSWLRQ 9HUVLRQ  7HFKQLFDO 5HSRUW &086(,75 &DUQHJLH 0HOORQ
8QLYHUVLW\6RIWZDUH(QJLQHHULQJ,QVWLWXWH

±±
REFERENCES

6(, E &00,6(6:&DSDELOLW\0DWXULW\0RGHO±,QWHJUDWHGIRU6\VWHPV(QJLQHHULQJ


6RIWZDUH(QJLQHHULQJ9HUVLRQ6WDJHG5HSUHVHQWDWLRQ7HFKQLFDO5HSRUW&086(,
756RIWZDUH(QJLQHHULQJ,QVWLWXWH&DUQHJLH0HOORQ8QLYHUVLW\
6(, F &00,6(6:&DSDELOLW\0DWXULW\0RGHO±,QWHJUDWHGIRU6\VWHPV(QJLQHHULQJ
6RIWZDUH (QJLQHHULQJ 9HUVLRQ  &RQWLQXRXV 5HSUHVHQWDWLRQ 7HFKQLFDO 5HSRUW
&086(,756RIWZDUH(QJLQHHULQJ,QVWLWXWH&DUQHJLH0HOORQ8QLYHUVLW\
6(.$5$18  5HVHDUFK0HWKRGVIRU%XVLQHVV$6NLOO%XLOGLQJ$SSURDFK1HZ<RUN
-RKQ:LOH\ 6RQV
6(1*(30  7KH)LIWK'LVFLSOLQH7KH$UWDQG3UDFWLFHRIWKH/HDUQLQJ2UJDQL]DWLRQ
1HZ<RUN'RXEOHGD\
6(1*( 30 ./(,1(5 $ 52%(576 & 5266 5 527+ * $1' 60,7+ %   7KH
'DQFHRI&KDQJH7KH&KDOOHQJHVRI6XVWDLQLQJ0RPHQWXPLQ/HDUQLQJ2UJDQL]DWLRQV
1HZ<RUN&XUUHQF\'RXEOHGD\
6+$1121 &( $1' :($9(5 :   7KH 0DWKHPDWLFDO 7KHRU\ RI &RPPXQLFDWLRQ
8UEDQD8QLYHUVLW\RI,OOLQRLV3UHVV
6,'',4, -   &KDOOHQJLQJ 8QLYHUVDO 7UXWKV RI 5HTXLUHPHQWV (QJLQHHULQJ ,(((
6RIWZDUH9RO1RSS
6,021+$  %RXQGHG5DWLRQDOLW\DQG2UJDQL]DWLRQDO/HDUQLQJ2UJDQL]DWLRQ6FLHQFH
9RO1RSS
6,021 -0 (/ (0$0 . 52866($8 6 -$&48(7 ( $1' %$%(< )   7KH
5HOLDELOLW\ RI ,62,(& 3'75  $VVHVVPHQWV 6RIWZDUH 3URFHVV ,PSURYHPHQW DQG
3UDFWLFH9ROSS
6,1*(5-  8VLQJWKH$PHULFDQ3V\FKRORJLFDO$VVRFLDWLRQ $3$ 6W\OH*XLGHOLQHVWR
5HSRUW([SHULPHQWDO5HVXOWV3URFHHGLQJVRI:RUNVKRSRQ(PSLULFDO6WXGLHVLQ6RIWZDUH
0DLQWHQDQFH 2[IRUG (QJODQG 6HSWHPEHU 15&  SS  1DWLRQDO 5HVHDUFK
&RXQFLO&DQDGD
6,7.,1 6%   /HDUQLQJ 7KURXJK )DLOXUH 7KH 6WUDWHJ\ RI 6PDOO /RVVHV 5HVHDUFK LQ
2UJDQL]DWLRQDO%HKDYLRU9ROSS
60,7+-.  4XDQWLWDWLYHYHUVXV4XDOLWDWLYH5HVHDUFK$Q$WWHPSWWR&ODULI\WKH,VVXH
(GXFDWLRQDO5HVHDUFKHU9ROSS
62'$1$&  <LQDQG<DQJLQ&RPSXWHU6FLHQFH&RPPXQLFDWLRQVRIWKH$&09RO
1RSS
6200(59,//(,$1'6$:<(53  5HTXLUHPHQWV(QJLQHHULQJ$*RRG3UDFWLFH*XLGH
&KLFKHVWHU-RKQ:LOH\ 6RQV
627,5296., '   +HXULVWLFV IRU ,WHUDWLYH 6RIWZDUH 'HYHORSPHQW ,((( 6RIWZDUH 9RO
1RSS
63(&7253   &KRRVLQJ 5HVSRQVH &DWHJRULHV IRU 6XPPDWHG 5DWLQJ 6FDOHV-RXUQDO RI
$SSOLHG3V\FKRORJ\9RO1RSS
63(&7253  5DWLQJVRI(TXDODQG8QHTXDO5HVSRQVH&KRLFH,QWHUYDOV7KH-RXUQDORI
6RFLDO3V\FKRORJ\1RSS
63(&7253   6XPPDWHG 5DWLQJ 6FDOH &RQVWUXFWLRQ $Q ,QWURGXFWLRQ 6DJH 8QLYHUVLW\
3DSHU VHULHV RQ 4XDQWLWDWLYH $SSOLFDWLRQV LQ WKH 6RFLDO 6FLHQFHV VHULHV QR 
1HZEXU\3DUN&DOLIRUQLD6DJH

±±
5()(5(1&(6

6366 D 6366%DVH8VHU¶V*XLGH&KLFDJR,/6366,QF


6366 E 6366%DVH$SSOLFDWLRQV*XLGH&KLFDJR,/6366,QF
67$.(5(  7KH$UWRI&DVH6WXG\5HVHDUFK7KRXVDQG2DNV&DOLIRUQLD6DJH
67$3/(721 -   '6'0 '\QDPLF 6\VWHPV 'HYHORSPHQW 0HWKRG +DUORZ (QJODQG
$GGLVRQ:HVOH\
67$5%8&. :+ $1' 0,//,.(1 )-   ([HFXWLYHV¶ 3HUFHSWXDO )LOWHUV :KDW 7KH\
1RWLFH DQG +RZ 7KH\ 0DNH 6HQVH LQ '& +DPEULFN (G  7KH ([HFXWLYH (IIHFW
&RQFHSWVDQG0HWKRGVIRU6WXG\LQJ7RS0DQDJHUV*UHHQZLFK&7-$,3UHVVSS
67$7$ 5$<   2UJDQL]DWLRQDO /HDUQLQJ ± 7KH .H\ WR 0DQDJHPHQW ,QQRYDWLRQ 6ORDQ
0DQDJHPHQW5HYLHZ9RO1RSS
67(/=(5' $1' 0(//,6:  6XFFHVV)DFWRUVRI 2UJDQL]DWLRQDO&KDQJHLQ6RIWZDUH
3URFHVV ,PSURYHPHQW 6RIWZDUH 3URFHVV ± ,PSURYHPHQW DQG 3UDFWLFH 9RO  1R 
SS
67(/=(5'0(//,6:$1'+(5=:850*  6RIWZDUH3URFHVV,PSURYHPHQWYLD,62
" 5HVXOWV RI 7ZR 6XUYH\V DPRQJ (XURSHDQ 6RIWZDUH +RXVHV 3URFHHGLQJV RI WKH
WK+DZDLL,QWHUQDWLRQDO&RQIHUHQFHRQ6\VWHPV6FLHQFHV-DQXDU\:DLOHD+DZDLL
86$
67(9(16 -  $SSOLHG0XOWLYDULDWH6WDWLVWLFVIRUWKH6RFLDO6FLHQFHV/RQGRQ/DZUHQFH
(UOEDXP
67(9(1666  2QWKH7KHRU\RI6FDOHVRI0HDVXUHPHQW6FLHQFH9ROSS

67(9(1666   0DWKHPDWLFV 0HDVXUHPHQW DQG 3V\FKRSK\VLFV LQ 66 6WHYHQV (G
+DQGERRNRI([SHULPHQWDO3V\FKRORJ\1HZ<RUN:LOH\
67(9(1666  3UREOHPVDQG0HWKRGVRI3V\FKRSK\VLFV3V\FKRORJLFDO%XOOHWLQ9RO
S
67(9(16 66   5DWLR 6FDOHV 3DUWLWLRQ 6FDOHV DQG &RQIXVLRQ 6FDOHV LQ + *XOOLNVHQ
DQG 6 0HVVLFN (GV  3V\FKRORJLFDO 6FDOLQJ 7KHRU\ DQG $SSOLFDWLRQV 1HZ <RUN
:LOH\
672..(+( $1' 3$/0675‘05  6RIWZDUH3URFHVV,PSURYHPHQWWKURXJK6RIWZDUH
0HWULFV±DQ(66,3URMHFW7HOHNWURQLNN9RO1RSS
675$8%':  9DOLGDWLQJ,QVWUXPHQWVLQ0,6UHVHDUFK0,64XDUWHUO\9RO1R
SS
675$866 $/ $1' &25%,1 -0   %DVLFV RI 4XDOLWDWLYH 5HVHDUFK 7HFKQLTXHV DQG
3URFHGXUHV IRU 'HYHORSLQJ *URXQGHG 7KHRU\ 6HFRQG (GLWLRQ 7KRXVDQG 2DNV
&DOLIRUQLD6DJH3XEOLFDWLRQV
67c/+$1( 7 %25*(56(1 3& $1' $51(6(1 . D  ,Q 6HDUFK RI WKH &XVWRPHU¶V
4XDOLW\9LHZ-RXUQDORI6\VWHPVDQG6RIWZDUH9RO1RSS
67c/+$1( 7 '<%c 7 $1' 3$/0675‘0 5 E  ([SHULHQFH RI ,QWURGXFLQJ *RDO
2ULHQWHG 0HDVXUHPHQW 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO :RUNVKRS RQ 6RIWZDUH
7HFKQRORJ\DQG(QJLQHHULQJ3UDFWLFH 67(3¶ /RQGRQ-XO\
67c/+$1( 7 :(''( .- $1' '<%c 7   'DWD 'ULYHQ ,PSURYHPHQW IRU 60(V
3URFHHGLQJV RI WKH (XURSHDQ 6RIWZDUH 3URFHVV ,PSURYHPHQW &RQIHUHQFH (XUR63,¶ 
*RWKHQEXUJ6ZHGHQ1RYHPEHU

±±
REFERENCES

68&+0$1 /$   3ODQV DQG 6LWXDWHG $FWLRQV 7KH 3UREOHP RI +XPDQ0DFKLQH
&RPPXQLFDWLRQ1HZ<RUN&DPEULGJH8QLYHUVLW\3UHVV
6860$1*,   $FWLRQ 5HVHDUFK $ 6RFLRWHFKQLFDO 6\VWHPV 3HUVSHFWLYH LQ * 0RUJDQ
(G %H\RQG0HWKRG6WUDWHJLHV IRU 6RFLDO 5HVHDUFK 1HZEXU\ 3DUN &DOLIRUQLD 6DJH
SS
6‘580*c5'6  9HULILFDWLRQRI3URFHVV&RQIRUPDQFHLQ(PSLULFDO6WXGLHVRI6RIWZDUH
'HYHORSPHQW 'RFWRUDO 'LVVHUWDWLRQ 7URQGKHLP 1RUZD\ 1RUZHJLDQ 8QLYHUVLW\ RI
6FLHQFHDQG7HFKQRORJ\
6$$5,1(1 7   $Q ([SDQGHG ,QVWUXPHQW IRU (YDOXDWLQJ ,QIRUPDWLRQ 6\VWHP 6XFFHVV
,QIRUPDWLRQ 0DQDJHPHQW9RO1RSS
7$*8&+, *   ,QWURGXFWLRQ WR 4XDOLW\ (QJLQHHULQJ 'HVLJQLQJ 4XDOLW\ LQWR 3URGXFWV
DQG3URFHVVHV7RN\R$VLDQ3URGXFWLYLW\2UJDQL]DWLRQ
7$*8&+, * (/6$<(' ($ $1' +6,$1* 7&   4XDOLW\ (QJLQHHULQJ LQ 3URGXFWLRQ
6\VWHPV1HZ<RUN0F*UDZ+LOO
7$6+$..25, $ $1' 7(''/,( &   0L[HG 0HWKRGRORJ\ &RPELQLQJ 4XDOLWDWLYH DQG
4XDQWLWDWLYH $SSURDFKHV $SSOLHG 6RFLDO 5HVHDUFK 0HWKRGV 6HULHV 9RO  7KRXVDQG
2DNV&DOLIRUQLD6DJH
7$</25 ):   7KH 3ULQFLSOHV RI 6FLHQWLILF 0DQDJHPHQW 1HZWRQ /LEUDU\ +DUSHU
5RZ
7(1* -7& -(21* 65 $1' *529(5 9   3URILOLQJ 6XFFHVVIXO 5HHQJLQHHULQJ
3URMHFWV&RPPXQLFDWLRQVRIWKH$&09RO1RSS
7(5=,296., 0 $1' 6$0621 '   7KH (IIHFW RI &RPSDQ\ 6L]H RQ WKH 5HODWLRQVKLS
EHWZHHQ 740 6WUDWHJ\ DQG 2UJDQL]DWLRQDO 3HUIRUPDQFH 7KH 740 0DJD]LQH 9RO 
1RSS
7(7(1%$80 7-   6KLIWLQJ 3DUDGLJPV )URP 1HZWRQ WR &KDRV 2UJDQL]DWLRQDO
'\QDPLFV9RO1RSS
7+20$6 -% &/$5. 60 $1' *,2,$ '$   6WUDWHJLF 6HQVHPDNLQJ DQG
2UJDQL]DWLRQDO 3HUIRUPDQFH /LQNDJHV DPRQJ 6FDQQLQJ ,QWHUSUHWDWLRQ $FWLRQ DQG
2XWFRPHV$FDGHP\RI0DQDJHPHQW-RXUQDO9RO1RSS
7+20$6 0 $1' 0&*$55< )   7RS'RZQ YV %RWWRP8S 3URFHVV ,PSURYHPHQW
,(((6RIWZDUH9RO1RSS
7+20$65-  :KDW0DFKLQHV&DQ¶W'R%HUNHOH\&DOLIRUQLD8QLYHUVLW\RI&DOLIRUQLD
3UHVV
7+25658'(  6RFLR7HFKQLFDO$SSURDFKWR-RE'HVLJQDQG2UJDQL]DWLRQDO'HYHORS
PHQW0DQDJHPHQW,QWHUQDWLRQDO5HYLHZ9ROSS
7+25658' ( 6‘5(16(1 % $1' *867$96(1 %   6RFLRWHFKQLFDO $SSURDFK WR
,QGXVWULDO'HPRFUDF\LQ1RUZD\LQ5'XELQ (G +DQGERRNRI:RUN2UJDQL]DWLRQDQG
6RFLHW\&KLFDJR5DQG0F1DOO\SS
7,&+<:)  6KRXOG&RPSXWHU6FLHQWLVWV([SHULPHQW0RUH",(((&RPSXWHU9RO
1RSS
7,&+<:)/8.2:,&=335(&+(/7/ $1' +(,1=($  ([SHULPHQWDO(YDOXDWLRQ
LQ &RPSXWHU 6FLHQFH $ 4XDQWLWDWLYH 6WXG\ -RXUQDO RI 6\VWHPV DQG 6RIWZDUH 9RO 
1RSS

±±
5()(5(1&(6

7,1*(< 02   &RPSDULQJ ,62  0DOFROP %DOGULGJH DQG WKH 6(, &00 IRU
6RIWZDUH$5HIHUHQFHDQG6HOHFWLRQ*XLGH3UHQWLFH+DOO
728/0,16   &RQFOXGLQJ 0HWKRGRORJLFDO 5HIOHFWLRQ (OLWLVP DQG 'HPRFUDF\ DPRQJ
WKH6FLHQFHVLQ67RXOPLQDQG%*XVWDYVHQ (GV %H\RQG7KHRU\$PVWHUGDP-RKQ
%HQMDPLQVSS
75,67(  7KH(YROXWLRQRI6RFLR7HFKQLFDO6\VWHPV$&RQFHSWXDO)UDPHZRUNDQGDQ
$FWLRQ5HVHDUFK3URJUDP2FFDVLRQDOSDSHUV1R7RURQWR2QWDULR2QWDULR4XDOLW\RI
:RUNLQJ/LIH&HQWHU
75,67 ( $1' %$0)257+   6RPH 6RFLDO DQG 3V\FKRORJLFDO &RQVHTXHQFHV RI WKH
/RQJZDOO0HWKRGRI&RDO*HWWLQJ+XPDQ5HODWLRQV9RO1RSS
78.(< -:   'DWD $QDO\VLV DQG %HKDYLRUDO 6FLHQFH RU /HDUQLQJ WR %HDU WKH
4XDQWLWDWLYH 0DQ¶V %XUGHQ E\ 6KXQQLQJ %DGPDQGPHQWV LQ /9 -RQHV (G  7KH
&ROOHFWHG:RUNVRI-RKQ:7XNH\9RO,,,3KLORVRSK\DQG3ULQFLSOHVRI'DWD$QDO\VLV
  0RQWHUH\&DOLIRUQLD:DGVZRUWK %URRNV&ROH$GYDQFHG%RRNV
6RIWZDUHSS
78.(<-:  7KH)XWXUHRI'DWD$QDO\VLVLQ/9-RQHV (G 7KH&ROOHFWHG:RUNVRI
-RKQ:7XNH\9RO,,,3KLORVRSK\DQG3ULQFLSOHVRI'DWD$QDO\VLV   
0RQWHUH\&DOLIRUQLD:DGVZRUWK %URRNV&ROH$GYDQFHG%RRNV 6RIWZDUHSS

786+0$1 0/ $1' 520$1(//, (   2UJDQL]DWLRQDO (YROXWLRQ $ 0HWDPRUSKRVLV
0RGHO RI &RQYHUJHQFH DQG 5HRULHQWDWLRQ LQ // &XPPLQJV DQG %0 6WDZ (GV 
5HVHDUFK LQ 2UJDQL]DWLRQDO %HKDYLRU 9RO  *UHHQZLFK &RQQHFWLFXW -$, 3UHVV SS

7<5( 0- $1' 921 +,33(/ (   7KH 6LWXDWHG 1DWXUH RI $GDSWLYH /HDUQLQJ LQ
2UJDQL]DWLRQV2UJDQL]DWLRQ6FLHQFH9RO1RSS
8&+,0$58.2.$0272 6 $1' .85$+$5$%  740IRU7HFKQLFDO*URXSV7RWDO
4XDOLW\3ULQFLSOHVIRU3URGXFW'HYHORSPHQW3RUWODQG2UHJRQ3URGXFWLYLW\3UHVV
9$1 '( 9(1$+  &HQWUDO3UREOHPVLQWKH0DQDJHPHQWRI ,QQRYDWLRQ0DQDJHPHQW
6FLHQFH9RO1RSS
9$1 '( 9(1 $+ $1' )(55< '/   0HDVXULQJ DQG $VVHVVLQJ 2UJDQL]DWLRQ 1HZ
<RUN-RKQ:LOH\ 6RQV
9$1 '( 9(1 $+ $1*/( +/ $1' 322/( 06 (GV    5HVHDUFK RQ WKH
0DQDJHPHQWRI,QQRYDWLRQ7KH0LQQHVRWD6WXGLHV2[IRUG2[IRUG8QLYHUVLW\3UHVV
9$1 '( 9(1 $+ 32//(< '( *$58' 5 $1' 9(1.$7$5$0$1 6   7KH
,QQRYDWLRQ-RXUQH\2[IRUG2[IRUG8QLYHUVLW\3UHVV
9$1 '(5 %(17 - 3$$8:( - $1' :,//,$06 5   2UJDQL]DWLRQDO /HDUQLQJ $Q
([SORUDWLRQRI2UJDQL]DWLRQDO0HPRU\DQGLWV5ROHLQ2UJDQL]DWLRQDO&KDQJH3URFHVVHV
-RXUQDORI2UJDQL]DWLRQDO&KDQJH0DQDJHPHQW9RO1RSS
9$162/,1*(15 $1' %(5*+287(  7KH*RDO4XHVWLRQ0HWULF0HWKRG$3UDFWLFDO
*XLGHIRU4XDOLW\,PSURYHPHQWRI6RIWZDUH'HYHORSPHQW/RQGRQ0F*UDZ+LOO
9(//(0$13)$1':,/.,1621/  1RPLQDO2UGLQDO,QWHUYDODQG5DWLR7\SRORJLHV
DUH0LVOHDGLQJ7KH$PHULFDQ6WDWLVWLFLDQ9RO1RSS

±±
REFERENCES

9(1.$75$0$1 1 $1' 5$0$18-$0 9   0HDVXUHPHQW RI %XVLQHVV (FRQRPLF
3HUIRUPDQFH ± $Q ([DPLQDWLRQ RI 0HWKRG &RQYHUJHQFH -RXUQDO RI 0DQDJHPHQW 9RO
1RSS
921 .52*+* $1' *5$1'6  -XVWLILFDWLRQLQ.QRZOHGJH&UHDWLRQ'RPLQDQW/RJLF
LQ 0DQDJHPHQW 'LVFRXUVHV LQ * YRQ .URJK , 1RQDND DQG 7 1LVKLJXFKL (GV 
.QRZOHGJH&UHDWLRQ$6RXUFHRI9DOXH/RQGRQ0DF0LOODQSS
921 .52*+*,&+,-2. $1' 121$.$,  (QDEOLQJ.QRZOHGJH&UHDWLRQ+RZWR
8QORFNWKH0\VWHU\RI7DFLW.QRZOHGJHDQG5HOHDVHWKH3RZHURI,QQRYDWLRQ1HZ<RUN
2[IRUG8QLYHUVLW\3UHVV
:$*1(55  7KH,QYHQWLRQRI&XOWXUH5HYLVHGDQG([SDQGHG(GLWLRQ&KLFDJR7KH
8QLYHUVLW\RI&KLFDJR3UHVV
:$/6+ -3 $1' 81*621 *'   2UJDQL]DWLRQDO 0HPRU\ $FDGHP\ RI 0DQDJHPHQW
5HYLHZ9RO1RSS
:$/='%(/$0-- $1' &857,6%  ,QVLGHD6RIWZDUH'HVLJQ7HDP.QRZOHGJH
$FTXLVLWLRQ6KDULQJDQG,QWHJUDWLRQ&RPPXQLFDWLRQVRIWKH$&09RO1RSS

:$67(// '*   7KH )HWLVK RI 7HFKQLTXH 0HWKRGRORJ\ DV D 6RFLDO 'HIHQFH
,QIRUPDWLRQ6\VWHPV-RXUQDO9RO1RSS
:$67(// '*   7KH +XPDQ 'LPHQVLRQ RI WKH 6RIWZDUH 3URFHVV LQ -& 'HUQLDPH
%$ .DED DQG '* :DVWHOO (GV  6RIWZDUH 3URFHVV 3ULQFLSOHV 0HWKRGRORJ\ DQG
7HFKQRORJ\/HFWXUH1RWHVLQ&RPSXWHU6FLHQFH9RO%HUOLQ6SULQJHU9HUODJSS

:(%(5 0   0DNW RJ E\UnNUDWL (VVD\V RP SROLWLNN RJ NODVVH VDPIXQQVIRUVNQLQJ RJ
YHUGLHU 3RZHUDQG%XUHDXFUDF\(VVD\VDERXWSROLWLFVFODVVVRFLDOVFLHQFHDQGYDOXHV 
7KLUG (GLWLRQ IURP ³:LUWVFKDIW XQG *HVHOOVFKDIW´   ³*HVDPPHOWH $XIVlW]H ]XU
:LVVHQVFKDIWVOHKUH´   DQG ³*HVDPPHOWH SROLWLVFKH 6FKULIWHQ´   2VOR
1RUZD\*\OGHQGDO LQ1RUZHJLDQ 
:(,&. .(   7KH 6RFLDO 3V\FKRORJ\ RI 2UJDQL]LQJ 6HFRQG (GLWLRQ 5HDGLQJ
0DVVDFKXVHWWV$GGLVRQ:HVOH\
:(,&. .(   6HQVHPDNLQJ LQ 2UJDQL]DWLRQV 7KRXVDQG 2DNV &DOLIRUQLD 6DJH
3XEOLFDWLRQV
:(,1%(5* *0   7KH 3V\FKRORJ\ RI &RPSXWHU 3URJUDPPLQJ 1HZ <RUN 9DQ
1RVWUDQG5HLQKROG
:(,1%(5* *0   7KH 3V\FKRORJ\ RI &RPSXWHU 3URJUDPPLQJ 6LOYHU $QQLYHUVDU\
(GLWLRQ1HZ<RUN'RUVHW+RXVH
:(1*(5(  &RPPXQLWLHVRI3UDFWLFH/HDUQLQJ0HDQLQJDQG,GHQWLW\ &DPEULGJH
&DPEULGJH8QLYHUVLW\3UHVV
:(67*$$5' 5+ $1' *867$' 6   $ 7RWDO ,PSURYHPHQW 6WUDWHJ\ DV D %DVLV IRU
6RIWZDUH 3URFHVV ,PSURYHPHQW 3URFHHGLQJV RI WKH (XURSHDQ 6RIWZDUH 3URFHVV
,PSURYHPHQW&RQIHUHQFH (XUR63,¶ 3RUL)LQODQG2FWREHU
:,&.6 $& $1' )5((0$1 5(   2UJDQL]DWLRQ 6WXGLHV DQG WKH 1HZ 3UDJPDWLVP
3RVLWLYLVP $QWLSRVLWLYLVP DQG WKH 6HDUFK IRU (WKLFV 2UJDQL]DWLRQ 6FLHQFH 9RO 
1RSS

±±
5()(5(1&(6

:,.675g0 6 $1' 1250$11 5   .QRZOHGJH DQG 9DOXH $ 1HZ 3HUVSHFWLYH RQ
&RUSRUDWH7UDQVIRUPDWLRQ/RQGRQ5RXWOHGJH
:,/.,1621/  'LVFXVVLRQRQWKH3DSHUE\+DQGLQ%DUWKRORPHZHWDO6WDWLVWLFVDQG
WKH 7KHRU\ RI 0HDVXUHPHQW ± 'LVFXVVLRQ RI WKH 3DSHU E\ +DQG   -RXUQDO RI WKH
5R\DO6WDWLVWLFV6RFLHW\6HULHV$9RO3DUWSS
:,12*5$' 7$ (G    %ULQJLQJ 'HVLJQ WR 6RIWZDUH ZLWK - %HQQHWW / 'H <RXQJ
DQG%+DUWILHOG$&03UHVV%RRNV5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
:,12*5$' 7$ $1' )/25(6 )   8QGHUVWDQGLQJ &RPSXWHUV DQG &RJQLWLRQ $ 1HZ
)RXQGDWLRQIRU'HVLJQ5HDGLQJ0DVVDFKXVHWWV$GGLVRQ:HVOH\
:2+/,1 & 581(621 3 +g67 0 2+/6621 0& 5(*1(// % $1' :(66/e1 $
  ([SHULPHQWDWLRQ LQ 6RIWZDUH (QJLQHHULQJ $Q ,QWURGXFWLRQ %RVWRQ .OXZHU
$FDGHPLF3XEOLVKHUV
<,15.  &DVH6WXG\5HVHDUFK'HVLJQDQG0HWKRGV6HFRQG(GLWLRQ$SSOLHG6RFLDO
5HVHDUFK0HWKRGV6HULHV9RO7KRXVDQG2DNV&DOLIRUQLD6DJH3XEOLFDWLRQV
<862) 60 $1' $63,1:$// (   &ULWLFDO 6XFFHVV )DFWRUV IRU 7RWDO 4XDOLW\
0DQDJHPHQW ,PSOHPHQWDWLRQ LQ 6PDOO DQG 0HGLXP (QWHUSULVHV 7RWDO 4XDOLW\
0DQDJHPHQW9RO1RV SS
=$+5$1 6   6RIWZDUH 3URFHVV ,PSURYHPHQW 3UDFWLFDO *XLGHOLQHV IRU %XVLQHVV
6XFFHVV+DUORZ(QJODQG$GGLVRQ:HVOH\
=$-$& * $1' %58+1 -*   7KH 0RUDO &RQWH[W RI 3DUWLFLSDWLRQ LQ 3ODQQHG
2UJDQL]DWLRQDO&KDQJHDQG/HDUQLQJ$GPLQLVWUDWLRQ 6RFLHW\9RO1RSS

=(/.2:,7= 09 $1' :$//$&( '5   ([SHULPHQWDO 0RGHOV IRU 9DOLGDWLQJ
7HFKQRORJ\,(((&RPSXWHU9RO1RSS
=(1'/(5 $   $ 3UHOLPLQDU\ 6RIWZDUH (QJLQHHULQJ 7KHRU\ DV ,QYHVWLJDWHG E\
3XEOLVKHG([SHULPHQWV(PSLULFDO6RIWZDUH(QJLQHHULQJ9RO1RSS
=,0$1-0 (G   7HFKQRORJLFDO,QQRYDWLRQDVDQ(YROXWLRQDU\3URFHVV&DPEULGJH
&DPEULGJH8QLYHUVLW\3UHVV
=8%2))6  ,QWKH$JHRIWKH6PDUW0DFKLQH1HZ<RUN%DVLF%RRNV
=8/71(55(  740IRU7HFKQLFDO7HDPV&RPPXQLFDWLRQVRIWKH$&09RO1R
SS
=:,&. :5 $1' 9(/,&(5 :)   &RPSDULVRQ RI )LYH 5XOHV IRU 'HWHUPLQLQJ WKH
1XPEHURI&RPSRQHQWVWR5HWDLQ3V\FKRORJLFDO%XOOHWLQ9ROSS
‘*5,0/  /HGHOVHDYV\VWHPXWYLNOLQJVSURVMHNWHU(QGLDOHNWLVNWLOQ UPLQJ 0DQDJH
PHQW RI 6\VWHPV 'HYHORSPHQW 3URMHFWV $ 'LDOHFWLF $SSURDFK  'RFWRUDO 'LVVHUWDWLRQ
2VOR1RUZD\8QLYHUVLW\RI2VOR LQ1RUZHJLDQ 

±±

You might also like