Download software engineering (testing) and more Lecture notes Software Engineering in PDF only on Docsity!
0RGXOH
&RGLQJDQG7HVWLQJ
/HVVRQ
'HEXJJLQJ,QWHJUDWLRQ
DQG6\VWHP7HVWLQJ
%DFNWUDFNLQJ
7KLV LV DOVR D IDLUO\ FRPPRQ DSSURDFK ,Q WKLV DSSURDFK EHJLQQLQJ IURP WKH
VWDWHPHQW DW ZKLFK DQ HUURU V\PSWRP KDV EHHQ REVHUYHG WKH VRXUFH FRGH LV
WUDFHG EDFNZDUGV XQWLO WKH HUURU LV GLVFRYHUHG 8QIRUWXQDWHO\ DV WKH QXPEHU RI
VRXUFHOLQHVWREHWUDFHGEDFNLQFUHDVHVWKHQXPEHURISRWHQWLDOEDFNZDUGSDWKV
LQFUHDVHV DQG PD\ EHFRPH XQPDQDJHDEO\ ODUJH WKXV OLPLWLQJ WKH XVH RI WKLV
DSSURDFK
&DXVH(OLPLQDWLRQ0HWKRG
,Q WKLV DSSURDFK D OLVW RI FDXVHV ZKLFK FRXOG SRVVLEO\ KDYH FRQWULEXWHG WR WKH
HUURUV\PSWRPLVGHYHORSHGDQGWHVWVDUHFRQGXFWHGWRHOLPLQDWHHDFK$UHODWHG
WHFKQLTXH RI LGHQWLILFDWLRQ RI WKH HUURU IURP WKH HUURU V\PSWRP LV WKH VRIWZDUH
IDXOWWUHHDQDO\VLV
3URJUDP6OLFLQJ
7KLVWHFKQLTXHLVVLPLODUWREDFNWUDFNLQJ+HUHWKHVHDUFKVSDFHLVUHGXFHGE\
GHILQLQJ VOLFHV $ VOLFH RI D SURJUDP IRU D SDUWLFXODU YDULDEOH DW D SDUWLFXODU
VWDWHPHQW LV WKH VHW RI VRXUFH OLQHV SUHFHGLQJ WKLV VWDWHPHQW WKDW FDQ LQIOXHQFH
WKHYDOXHRIWKDWYDULDEOH>0XQG@
'HEXJJLQJJXLGHOLQHV
'HEXJJLQJ LV RIWHQ FDUULHG RXW E\ SURJUDPPHUV EDVHG RQ WKHLU LQJHQXLW\ 7KH
IROORZLQJDUHVRPHJHQHUDOJXLGHOLQHVIRUHIIHFWLYHGHEXJJLQJ
0DQ\ WLPHV GHEXJJLQJ UHTXLUHV D WKRURXJK XQGHUVWDQGLQJ RI WKH
SURJUDPGHVLJQ7U\LQJWRGHEXJEDVHGRQDSDUWLDOXQGHUVWDQGLQJRI
WKH V\VWHP GHVLJQ DQG LPSOHPHQWDWLRQ PD\ UHTXLUH DQ LQRUGLQDWH
DPRXQWRIHIIRUWWREHSXWLQWRGHEXJJLQJHYHQVLPSOHSUREOHPV
'HEXJJLQJ PD\ VRPHWLPHV HYHQ UHTXLUH IXOO UHGHVLJQ RI WKH V\VWHP
,Q VXFK FDVHV D FRPPRQ PLVWDNHV WKDW QRYLFH SURJUDPPHUV RIWHQ
PDNHLVDWWHPSWLQJQRWWRIL[WKHHUURUEXWLWVV\PSWRPV
2QH PXVW EH EHZDUH RI WKH SRVVLELOLW\ WKDW DQ HUURU FRUUHFWLRQ PD\
LQWURGXFH QHZ HUURUV 7KHUHIRUH DIWHU HYHU\ URXQG RI HUURUIL[LQJ
UHJUHVVLRQWHVWLQJPXVWEHFDUULHGRXW
3URJUDPDQDO\VLVWRROV
$SURJUDPDQDO\VLVWRROPHDQVDQDXWRPDWHGWRROWKDWWDNHVWKHVRXUFHFRGHRU
WKH H[HFXWDEOH FRGH RI D SURJUDP DV LQSXW DQG SURGXFHV UHSRUWV UHJDUGLQJ
VHYHUDO LPSRUWDQW FKDUDFWHULVWLFV RI WKH SURJUDP VXFK DV LWV VL]H FRPSOH[LW\
DGHTXDF\ RI FRPPHQWLQJ DGKHUHQFH WR SURJUDPPLQJ VWDQGDUGV HWF :H FDQ
FODVVLI\WKHVHLQWRWZREURDGFDWHJRULHVRISURJUDPDQDO\VLVWRROV
6WDWLF$QDO\VLVWRROV
'\QDPLF$QDO\VLVWRROV
6WDWLFSURJUDPDQDO\VLVWRROV
6WDWLF DQDO\VLV WRRO LV DOVR D SURJUDP DQDO\VLV WRRO ,W DVVHVVHV DQG FRPSXWHV
YDULRXVFKDUDFWHULVWLFVRIDVRIWZDUHSURGXFWZLWKRXWH[HFXWLQJLW7\SLFDOO\VWDWLF
DQDO\VLV WRROV DQDO]H VRPH VWUXFWXUDO UHSUHVHQWDWLRQ RI D SURJUDP WR DUULYH DW
FHUWDLQ DQDO\WLFDO FRQFOXVLRQV HJ WKDW VRPH VWUXFWXUDO SURSHUWLHV KROG 7KH
VWUXFWXUDOSURSHUWLHVWKDWDUHXVXDOO\DQDO]HGDUH
:KHWKHUWKHFRGLQJVWDQGDUGVKDYHEHHQDGKHUHGWR"
&HUWDLQ SURJUDPPLQJ HUURUV VXFK DV XQLQLWLDOL]HG YDULDEOHV DQG
PLVPDWFK EHWZHHQ DFWXDO DQG IRUPDO SDUDPHWHUV YDULDEOHV WKDW DUH
GHFODUHGEXWQHYHUXVHGDUHDOVRFKHFNHG
&RGHZDONWKURXJKVDQGFRGHLQVSHFWLRQVPLJKWEHFRQVLGHUHGDVVWDWLFDQDO\VLV
PHWKRGV %XW WKH WHUP VWDWLF SURJUDP DQDO\VLV LV XVHG WR GHQRWH DXWRPDWHG
DQDO\VLVWRROV6RDFRPSLOHUFDQEHFRQVLGHUHGWREHDVWDWLFSURJUDPDQDO\VLV
WRRO
'\QDPLFSURJUDPDQDO\VLVWRROV
'\QDPLF SURJUDP DQDO\VLV WHFKQLTXHV UHTXLUH WKH SURJUDP WR EH H[HFXWHG DQG
LWV DFWXDO EHKDYLRU UHFRUGHG $ G\QDPLF DQDO]HU XVXDOO\ LQVWUXPHQWV WKH FRGH
LHDGGVDGGLWLRQDOVWDWHPHQWVLQWKHVRXUFHFRGHWRFROOHFWSURJUDPH[HFXWLRQ
WUDFHV 7KHLQVWUXPHQWHGFRGHZKHQH[HFXWHGDOORZVXVWRUHFRUGWKHEHKDYLRU
RIWKHVRIWZDUHIRUGLIIHUHQWWHVWFDVHV$IWHUWKHVRIWZDUHKDVEHHQWHVWHGZLWKLWV
IXOO WHVW VXLWH DQG LWV EHKDYLRU UHFRUGHG WKH G\QDPLF DQDO\VLV WRRO FDULHV RXW D
SRVW H[HFXWLRQ DQDO\VLV DQG SURGXFHV UHSRUWV ZKLFK GHVFULEH WKH VWUXFWXUDO
FRYHUDJHWKDWKDVEHHQDFKLHYHGE\WKHFRPSOHWHWHVWVXLWHIRUWKHSURJUDP)RU
H[DPSOH WKH SRVW H[HFXWLRQ G\QDPLF DQDO\VLV UHSRUW PLJKW SURYLGH GDWD RQ
H[WHQWVWDWHPHQWEUDQFKDQGSDWKFRYHUDJHDFKLHYHG
1RUPDOO\ WKH G\QDPLF DQDO\VLV UHVXOWV DUH UHSRUWHG LQ WKH IRUP RI D
KLVWRJUDPRUDSLHFKDUWWRGHVFULEHWKHVWUXFWXUDOFRYHUDJHDFKLHYHGIRUGLIIHUHQW
PRGXOHVRIWKHSURJUDP7KHRXWSXWRIDG\QDPLFDQDO\VLVWRROFDQEHVWRUHGDQG
SULQWHG HDVLO\ DQG SURYLGHV HYLGHQFH WKDW WKRURXJK WHVWLQJ KDV EHHQ GRQH 7KH
G\QDPLFDQDO\VLVUHVXOWVWKHH[WHQWRIWHVWLQJSHUIRUPHGLQZKLWHER[PRGH,IWKH
WHVWLQJFRYHUDJHLVQRWVDWLVIDFWRU\PRUHWHVWFDVHVFDQEHGHVLJQHGDQGDGGHG
WR WKH WHVW VXLWH )XUWKHU G\QDPLF DQDO\VLV UHVXOWV FDQ KHOS WR HOLPLQDWH
UHGXQGDQWWHVWFDVHVIURPWKHWHVWVXLWH
/DUJH VRIWZDUH V\VWHPV QRUPDOO\ UHTXLUH VHYHUDO OHYHOV RI VXEV\VWHP
WHVWLQJ ORZHUOHYHO VXEV\VWHPV DUH VXFFHVVLYHO\ FRPELQHG WR IRUP KLJKHUOHYHO
VXEV\VWHPV$SULQFLSDODGYDQWDJHRIERWWRPXSLQWHJUDWLRQWHVWLQJLVWKDWVHYHUDO
GLVMRLQWVXEV\VWHPVFDQEHWHVWHGVLPXOWDQHRXVO\,QDSXUHERWWRPXSWHVWLQJQR
VWXEV DUH UHTXLUHG RQO\ WHVWGULYHUV DUH UHTXLUHG $ GLVDGYDQWDJH RI ERWWRPXS
WHVWLQJ LV WKH FRPSOH[LW\ WKDW RFFXUV ZKHQ WKH V\VWHP LV PDGH XS RI D ODUJH
QXPEHU RI VPDOO VXEV\VWHPV 7KH H[WUHPH FDVH FRUUHVSRQGV WR WKH ELJEDQJ
DSSURDFK
7RS'RZQ,QWHJUDWLRQ7HVWLQJ
7RSGRZQ LQWHJUDWLRQ WHVWLQJ VWDUWV ZLWK WKH PDLQ URXWLQH DQG RQH RU WZR
VXERUGLQDWHURXWLQHVLQWKHV\VWHP$IWHUWKHWRSOHYHOμVNHOHWRQ¶KDVEHHQWHVWHG WKH LPPHGLDWHO\ VXEURXWLQHV RI WKH μVNHOHWRQ¶ DUH FRPELQHG ZLWK LW DQG WHVWHG 7RSGRZQ LQWHJUDWLRQ WHVWLQJ DSSURDFK UHTXLUHV WKH XVH RI SURJUDP VWXEV WR VLPXODWH WKH HIIHFW RI ORZHUOHYHO URXWLQHV WKDW DUH FDOOHG E\ WKH URXWLQHV XQGHU WHVW $ SXUH WRSGRZQ LQWHJUDWLRQ GRHV QRW UHTXLUH DQ\ GULYHU URXWLQHV $ GLVDGYDQWDJHRIWKHWRSGRZQLQWHJUDWLRQWHVWLQJDSSURDFKLVWKDWLQWKHDEVHQFH RI ORZHUOHYHO URXWLQHV PDQ\ WLPHV LW PD\ EHFRPH GLIILFXOW WR H[HUFLVH WKH WRS OHYHO URXWLQHV LQ WKH GHVLUHG PDQQHU VLQFH WKH ORZHUOHYHO URXWLQHV SHUIRUP VHYHUDOORZOHYHOIXQFWLRQVVXFKDV,2 0L[HG,QWHJUDWLRQ7HVWLQJ $PL[HG DOVRFDOOHGVDQGZLFKHG LQWHJUDWLRQWHVWLQJIROORZVDFRPELQDWLRQRIWRS GRZQDQGERWWRPXSWHVWLQJDSSURDFKHV,QWRSGRZQDSSURDFKWHVWLQJFDQVWDUW RQO\ DIWHU WKH WRSOHYHO PRGXOHV KDYH EHHQ FRGHG DQG XQLW WHVWHG 6LPLODUO\ ERWWRPXS WHVWLQJ FDQ VWDUW RQO\ DIWHU WKH ERWWRP OHYHO PRGXOHV DUH UHDG\ 7KH PL[HG DSSURDFK RYHUFRPHV WKLV VKRUWFRPLQJ RI WKH WRSGRZQ DQG ERWWRPXS DSSURDFKHV ,Q WKH PL[HG WHVWLQJ DSSURDFKHV WHVWLQJ FDQ VWDUW DV DQG ZKHQ PRGXOHV EHFRPH DYDLODEOH 7KHUHIRUH WKLV LV RQH RI WKH PRVW FRPPRQO\ XVHG LQWHJUDWLRQWHVWLQJDSSURDFKHV
3KDVHGYVLQFUHPHQWDOWHVWLQJ
7KH GLIIHUHQW LQWHJUDWLRQ WHVWLQJ VWUDWHJLHV DUH HLWKHU SKDVHG RU LQFUHPHQWDO $
FRPSDULVRQRIWKHVHWZRVWUDWHJLHVLVDVIROORZV
,QLQFUHPHQWDOLQWHJUDWLRQWHVWLQJRQO\RQHQHZPRGXOHLVDGGHGWRWKH
SDUWLDOV\VWHPHDFKWLPH
,Q SKDVHG LQWHJUDWLRQ D JURXS RI UHODWHG PRGXOHV DUH DGGHG WR WKH
SDUWLDOV\VWHPHDFKWLPH
3KDVHG LQWHJUDWLRQ UHTXLUHV OHVV QXPEHU RI LQWHJUDWLRQ VWHSV FRPSDUHG WR WKH
LQFUHPHQWDO LQWHJUDWLRQ DSSURDFK +RZHYHU ZKHQ IDLOXUHV DUH GHWHFWHG LW LV
HDVLHUWRGHEXJWKHV\VWHPLQWKHLQFUHPHQWDOWHVWLQJDSSURDFKVLQFHLWLVNQRZQ
WKDWWKHHUURULVFDXVHGE\DGGLWLRQRIDVLQJOHPRGXOH,QIDFWELJEDQJWHVWLQJLV
DGHJHQHUDWHFDVHRIWKHSKDVHGLQWHJUDWLRQWHVWLQJDSSURDFK
6\VWHPWHVWLQJ
6\VWHPWHVWVDUHGHVLJQHGWRYDOLGDWHDIXOO\GHYHORSHGV\VWHPWRDVVXUHWKDWLW
PHHWVLWVUHTXLUHPHQWV7KHUHDUHHVVHQWLDOO\WKUHHPDLQNLQGVRIV\VWHPWHVWLQJ
$OSKD7HVWLQJ $OSKDWHVWLQJUHIHUVWRWKHV\VWHPWHVWLQJFDUULHGRXW
E\WKHWHVWWHDPZLWKLQWKHGHYHORSLQJRUJDQL]DWLRQ
%HWDWHVWLQJ%HWDWHVWLQJLVWKHV\VWHPWHVWLQJSHUIRUPHGE\DVHOHFW
JURXSRIIULHQGO\FXVWRPHUV
$FFHSWDQFH 7HVWLQJ $FFHSWDQFH WHVWLQJ LV WKH V\VWHP WHVWLQJ
SHUIRUPHGE\WKHFXVWRPHUWRGHWHUPLQHZKHWKHUKHVKRXOGDFFHSWWKH
GHOLYHU\RIWKHV\VWHP
,QHDFKRIWKHDERYHW\SHVRIWHVWVYDULRXVNLQGVRIWHVWFDVHVDUHGHVLJQHGE\
UHIHUULQJ WR WKH 656 GRFXPHQW %URDGO\ WKHVH WHVWV FDQ EH FODVVLILHG LQWR
IXQFWLRQDOLW\DQGSHUIRUPDQFHWHVWV7KHIXQFWLRQDOLW\WHVWVWHVWWKHIXQFWLRQDOLW\RI
WKH VRIWZDUH WR FKHFN ZKHWKHU LW VDWLVILHV WKH IXQFWLRQDO UHTXLUHPHQWV DV
GRFXPHQWHGLQWKH656GRFXPHQW7KHSHUIRUPDQFHWHVWVWHVWWKHFRQIRUPDQFH
RIWKHV\VWHPZLWKWKHQRQIXQFWLRQDOUHTXLUHPHQWVRIWKHV\VWHP
3HUIRUPDQFHWHVWLQJ
3HUIRUPDQFHWHVWLQJLVFDUULHGRXWWRFKHFNZKHWKHUWKH V\VWHPQHHGVWKHQRQ
IXQFWLRQDOUHTXLUHPHQWVLGHQWLILHGLQWKH656GRFXPHQW7KHUHDUHVHYHUDOW\SHV
RI SHUIRUPDQFH WHVWLQJ $PRQJ RI WKHP QLQH W\SHV DUH GLVFXVVHG EHORZ 7KH
W\SHV RI SHUIRUPDQFH WHVWLQJ WR EH FDUULHG RXW RQ D V\VWHP GHSHQG RQ WKH
GLIIHUHQW QRQIXQFWLRQDO UHTXLUHPHQWV RI WKH V\VWHP GRFXPHQWHG LQ WKH 656
GRFXPHQW$OOSHUIRUPDQFHWHVWVFDQEHFRQVLGHUHGDVEODFNER[WHVWV
6WUHVVWHVWLQJ
9ROXPHWHVWLQJ
&RQILJXUDWLRQWHVWLQJ
&RPSDWLELOLW\WHVWLQJ
5HJUHVVLRQWHVWLQJ
5HFRYHU\WHVWLQJ
0DLQWHQDQFHWHVWLQJ
'RFXPHQWDWLRQWHVWLQJ
8VDELOLW\WHVWLQJ
5HJUHVVLRQ7HVWLQJ
7KLVW\SHRIWHVWLQJLVUHTXLUHGZKHQWKHV\VWHPEHLQJWHVWHGLVDQXSJUDGDWLRQRI
DQ DOUHDG\ H[LVWLQJ V\VWHP WR IL[ VRPH EXJV RU HQKDQFH IXQFWLRQDOLW\
SHUIRUPDQFH HWF 5HJUHVVLRQ WHVWLQJ LV WKH SUDFWLFH RI UXQQLQJ DQ ROG WHVW VXLWH
DIWHUHDFKFKDQJHWRWKHV\VWHPRUDIWHUHDFKEXJIL[WRHQVXUHWKDWQRQHZEXJ
KDV EHHQ LQWURGXFHG GXH WR WKH FKDQJH RU WKH EXJ IL[ +RZHYHU LI RQO\ D IHZ
VWDWHPHQWVDUHFKDQJHGWKHQWKHHQWLUHWHVWVXLWHQHHGQRWEHUXQRQO\WKRVH
WHVWFDVHVWKDWWHVWWKHIXQFWLRQVWKDWDUHOLNHO\WREHDIIHFWHGE\WKHFKDQJHQHHG
WREHUXQ
5HFRYHU\7HVWLQJ
5HFRYHU\ WHVWLQJ WHVWV WKH UHVSRQVH RI WKH V\VWHP WR WKH SUHVHQFH RI IDXOWV RU
ORVVRISRZHUGHYLFHVVHUYLFHVGDWDHWF7KHV\VWHPLVVXEMHFWHGWRWKHORVVRI
WKH PHQWLRQHG UHVRXUFHV DV DSSOLFDEOH DQG GLVFXVVHG LQ WKH 656 GRFXPHQW
DQG LW LV FKHFNHG LI WKH V\VWHP UHFRYHUV VDWLVIDFWRULO\ )RU H[DPSOH WKH SULQWHU
FDQ EH GLVFRQQHFWHG WR FKHFN LI WKH V\VWHP KDQJV 2U WKH SRZHU PD\ EH VKXW
GRZQWRFKHFNWKHH[WHQWRIGDWDORVVDQGFRUUXSWLRQ
0DLQWHQDQFH7HVWLQJ
7KLV WHVWLQJ DGGUHVVHV WKH GLDJQRVWLF SURJUDPV DQG RWKHU SURFHGXUHV WKDW DUH
UHTXLUHGWREHGHYHORSHGWRKHOSPDLQWHQDQFHRIWKHV\VWHP,WLVYHULILHGWKDWWKH
DUWLIDFWVH[LVWDQGWKH\SHUIRUPSURSHUO\
'RFXPHQWDWLRQ7HVWLQJ
,WLVFKHFNHGWKDWWKHUHTXLUHGXVHUPDQXDOPDLQWHQDQFHPDQXDOVDQGWHFKQLFDO
PDQXDOV H[LVW DQG DUH FRQVLVWHQW ,I WKH UHTXLUHPHQWV VSHFLI\ WKH W\SHV RI
DXGLHQFH IRU ZKLFK D VSHFLILF PDQXDO VKRXOG EH GHVLJQHG WKHQ WKH PDQXDO LV
FKHFNHGIRUFRPSOLDQFH
8VDELOLW\7HVWLQJ
8VDELOLW\ WHVWLQJ FRQFHUQV FKHFNLQJ WKH XVHU LQWHUIDFH WR VHH LI LW PHHWV DOO XVHU
UHTXLUHPHQWV FRQFHUQLQJ WKH XVHU LQWHUIDFH 'XULQJ XVDELOLW\ WHVWLQJ WKH GLVSOD\
VFUHHQV UHSRUW IRUPDWV DQG RWKHU DVSHFWV UHODWLQJ WR WKH XVHU LQWHUIDFH
UHTXLUHPHQWVDUHWHVWHG
(UURUVHHGLQJ
6RPHWLPHVWKHFXVWRPHUPLJKWVSHFLI\WKHPD[LPXPQXPEHURIDOORZDEOHHUURUV
WKDWPD\EHSUHVHQWLQWKHGHOLYHUHGV\VWHP7KHVHDUHRIWHQH[SUHVVHGLQWHUPV
RIPD[LPXPQXPEHURIDOORZDEOHHUURUVSHUOLQHRIVRXUFHFRGH(UURUVHHGFDQ
EHXVHGWRHVWLPDWHWKHQXPEHURIUHVLGXDOHUURUVLQDV\VWHP
(UURU VHHGLQJ DV WKH QDPH LPSOLHV VHHGV WKH FRGH ZLWK VRPH NQRZQ
HUURUV ,Q RWKHU ZRUGV VRPH DUWLILFLDO HUURUV DUH LQWURGXFHG LQWR WKH SURJUDP
DUWLILFLDOO\ 7KH QXPEHU RI WKHVH VHHGHG HUURUV GHWHFWHG LQ WKH FRXUVH RI WKH
VWDQGDUG WHVWLQJ SURFHGXUH LV GHWHUPLQHG 7KHVH YDOXHV LQ FRQMXQFWLRQ ZLWK WKH
QXPEHURIXQVHHGHGHUURUVGHWHFWHGFDQEHXVHGWRSUHGLFW
7KHQXPEHURIHUURUVUHPDLQLQJLQWKHSURGXFW
7KHHIIHFWLYHQHVVRIWKHWHVWLQJVWUDWHJ\
/HW1EHWKHWRWDOQXPEHURIGHIHFWVLQWKHV\VWHPDQGOHWQRIWKHVHGHIHFWVEH
IRXQGE\WHVWLQJ
/HW6EHWKHWRWDOQXPEHURIVHHGHGGHIHFWVDQGOHWVRIWKHVHGHIHFWVEHIRXQG
GXULQJWHVWLQJ
Q1 V6
RU
1 6 QV
'HIHFWVVWLOOUHPDLQLQJDIWHUWHVWLQJ 1±Q Q 6±V V
(UURU VHHGLQJ ZRUNV VDWLVIDFWRULO\ RQO\ LI WKH NLQG RI VHHGHG HUURUV PDWFKHV
FORVHO\ZLWKWKHNLQGRIGHIHFWVWKDWDFWXDOO\H[LVW+RZHYHULWLVGLIILFXOWWRSUHGLFW
WKH W\SHV RI HUURUV WKDW H[LVW LQ D VRIWZDUH 7R VRPH H[WHQW WKH GLIIHUHQW
FDWHJRULHV RI HUURUV WKDW UHPDLQ FDQ EH HVWLPDWHG WR D ILUVW DSSUR[LPDWLRQ E\
DQDO]LQJKLVWRULFDOGDWDRIVLPLODUSURMHFWV'XHWRWKHVKRUWFRPLQJWKDWWKHW\SHV
RIVHHGHGHUURUVVKRXOGPDWFKFORVHO\ZLWKWKHW\SHVRIHUURUVDFWXDOO\H[LVWLQJLQ
WKHFRGHHUURUVHHGLQJLVXVHIXORQO\WRDPRGHUDWHH[WHQW
5HJUHVVLRQWHVWLQJ
5HJUHVVLRQWHVWLQJGRHVQRWEHORQJWRHLWKHUXQLWWHVWLQWHJUDWLRQWHVWRUV\VWHP
WHVWLQJ ,QVWHDG LW LV D VHSDUDWH GLPHQVLRQ WR WKHVH WKUHH IRUPV RI WHVWLQJ 7KH
IXQFWLRQDOLW\RIUHJUHVVLRQWHVWLQJKDVEHHQGLVFXVVHGHDUOLHU
7KH IROORZLQJ TXHVWLRQV KDYH EHHQ GHVLJQHG WR WHVW WKH
REMHFWLYHVLGHQWLILHGIRUWKLVPRGXOH
:KDW DUH WKH GLIIHUHQW ZD\V RI GRFXPHQWLQJ SURJUDP FRGH" :KLFK RI
WKHVHLVXVXDOO\WKHPRVWXVHIXOZKLOHXQGHUVWDQGLQJDSLHFHRIFRGH"
:KDWLVDFRGLQJVWDQGDUG",GHQWLI\WKHSUREOHPVWKDWPLJKWRFFXULIWKH
HQJLQHHUVRIDQRUJDQL]DWLRQGRQRWDGKHUHWRDQ\FRGLQJVWDQGDUG
:KLFK LV VWURQJHVW VWUXFWXUDO WHVWLQJ WHFKQLTXH DPRQJ VWDWHPHQW
FRYHUDJHEDVHG WHVWLQJ EUDQFK FRYHUDJHEDVHG WHVWLQJ DQG FRQGLWLRQ
FRYHUDJHEDVHGWHVWLQJ":K"
'LVFXVV KRZ GRHV FRQWURO IORZ JUDSK &)* RI D SUREOHP KHOS LQ
XQGHUVWDQGLQJRISDWKFRYHUDJHEDVHGWHVWLQJVWUDWHJ\
'UDZ WKH FRQWURO IORZ JUDSK IRU WKH IROORZLQJ IXQFWLRQ QDPHG ILQG
PD[LPXP )URP WKH FRQWURO IORZ JUDSK GHWHUPLQHV LWV &\FORPDWLF
FRPSOH[LW\
LQWILQGPD[LPXP LQWLLQWMLQWN
^
LQWPD[
LI L!M WKHQ
LI L!N WKHQPD[ L
HOVHPD[ N
HOVHLI M!N PD[ M
HOVHPD[ N
UHWXUQ PD[
`
:KDW LV WKH GLIIHUHQFH EHWZHHQ SDWK DQG OLQHDUO\ LQGHSHQGHQW SDWK LQ
WHUPVRIFRQWUROIORZJUDSK &)* RIDSUREOHP"
'HILQH D PHWULF IRUP ZKLFK WKH XSSHU ERXQG IRU WKH QXPEHU RI OLQHDUO\
LQGHSHQGHQWSDWKVRIDSURJUDPFDQEHFRPSXWHG
&RQVLGHUWKHIROORZLQJ&IXQFWLRQQDPHGELQVHDUFK
QXPLVWKHQXPEHUWKHIXQFWLRQVHDUFKHVLQDSUHVRUWHG
LQWHJHUDUUD\DUU
LQWELQBVHDUFK LQWQXP
^
LQWPLQPD[
PLQ
PD[
ZKLOH PLQ PD[ ^
LI DUU> PLQPD[ @!QXP
PD[ PLQPD[
HOVHLI DUU> PLQPD[ @ QXP
PLQ PLQPD[
HOVHUHWXUQ PLQPD[ `
UHWXUQ
`
'HWHUPLQHWKHF\FORPDWLFFRPSOH[LW\RIWKHDERYHSUREOHP
:KDWLVPHDQWE\GDWDIORZEDVHGWHVWLQJDSSURDFK"
:KDWDUHWKHDGYDQWDJHVRISHUIRUPLQJPXWDWLRQWHVWLQJXSRQDVRIWZDUH
SURGXFW"
:ULWHGRZQWKUHHJHQHUDOJXLGHOLQHVIRUSHUIRUPLQJHIIHFWLYHGHEXJJLQJ
'LVWLQJXLVK EHWZHHQ WKH VWDWLF DQG G\QDPLF DQDO\VLV RI D SURJUDP +RZ
DUHVWDWLFDQGG\QDPLFSURJUDPDQDO\VLVUHVXOWVXVHIXO"
:KDW GR \RX XQGHUVWDQG E\ WKH WHUP LQWHJUDWLRQ WHVWLQJ" :KDW DUH WKH
GLIIHUHQW W\SHV RI LQWHJUDWLRQ WHVWLQJ PHWKRGV WKDW FDQ EH XVHG WR FDUU\
RXWLQWHJUDWLRQWHVWLQJRIDODUJHVRIWZDUHSURGXFW"
'R \RX DJUHH ZLWK WKH IROORZLQJ VWDWHPHQW ³6\VWHP WHVWLQJ FDQ EH
FRQVLGHUHGDVDSXUHEODFNER[WHVW´-XVWLI\\RXUDQVZHU
:KDWGR\RXXQGHUVWDQGE\SHUIRUPDQFHWHVWLQJ":ULWHGRZQWKHGLIIHUHQW
W\SHVRISHUIRUPDQFHWHVWLQJ
:KDWLVPHDQWE\HUURUVHHGLQJ"
([SODLQWKHQHFHVVLW\RISHUIRUPLQJUHJUHVVLRQWHVWLQJ
0DUNDOORSWLRQVZKLFKDUHWUXH
7KHVLGHHIIHFWVRIDIXQFWLRQFDOOLQFOXGH
PRGLILFDWLRQRISDUDPHWHUVSDVVHGE\UHIHUHQFH
PRGLILFDWLRQRIJOREDOYDULDEOHV
PRGLILFDWLRQRI,2RSHUDWLRQV
DOORIWKHDERYH
&RGHUHYLHZIRUDPRGXOHLVFDUULHGRXW
DVVRRQDVVNHOHWDOFRGHZULWWHQ
EHIRUHWKHPRGXOHLVVXFFHVVIXOO\FRPSLOHG
DIWHUWKHPRGXOHLVVXFFHVVIXOO\FRPSLOHGDQGDOOWKHV\QWD[HUURUVKDYH
EHHQHOLPLQDWHG
EHIRUH WKH PRGXOH LV VXFFHVVIXOO\ FRPSLOHG DQG DOO WKH V\QWD[ HUURUV
KDYHEHHQHOLPLQDWHG
$QLPSRUWDQWIDFWRUWKDWJXLGHVWKHLQWHJUDWLRQSODQIRULQWHJUDWLRQWHVWLQJLV
(5GLDJUDP
GDWDIORZGLDJUDP
VWUXFWXUHFKDUW
QRQHRIWKHDERYH
0DUN WKH IROORZLQJ DV HLWKHU 7UXH RU )DOVH -XVWLI\ \RXU
DQVZHU
&RGLQJVWDQGDUGVDUHV\QRQ\PVIRUFRGLQJJXLGHOLQHV
'XULQJ FRGH LQVSHFWLRQ \RX GHWHFW HUURUV ZKHUHDV GXULQJ FRGH WHVWLQJ
\RXGHWHFWIDLOXUHV
2XW RI DOO W\SHV RI LQWHUQDO GRFXPHQWDWLRQ LH SURYLGHG LQ WKH VRXUFH
FRGH FDUHIXOFRPPHQWLQJLVPRVWXVHIXO
(UURUDQGIDLOXUHDUHV\QRQ\PRXVLQVRIWZDUHWHVWLQJWHUPLQRORJ\
6RIWZDUHYHULILFDWLRQDQGYDOLGDWLRQDUHV\QRQ\PVWHUPV
7KHHIIHFWLYHQHVVRIDWHVWVXLWHLQ GHWHFWLQJHUURUVLQDV\VWHPFDQEH
GHWHUPLQHGE\FRXQWLQJWKHQXPEHURIWHVWFDVHVLQWKHVXLWH
7KHQXPEHURIWHVWFDVHVUHTXLUHGIRUVWDWHPHQWFRYHUDJHEDVHGWHVWLQJ
RI D SURJUDP FDQ EH JUHDWHU WKDQ WKRVH UHTXLUHG IRU SDWK FRYHUDJH
EDVHGWHVWLQJRIWKHVDPHSURJUDP
&RQGLWLRQ WHVWLQJ VWUDWHJ\ LV D VWURQJHU WHVWLQJ VWUDWHJ\ WKDQ EUDQFK
WHVWLQJVWUDWHJ\
$SURJUDPFDQKDYHPRUHWKDQRQHOLQHDUO\LQGHSHQGHQWSDWK
2QFH WKH 0F&DEH¶V &\FORPDWLF FRPSOH[LW\ RI D SURJUDP KDV EHHQ
GHWHUPLQHGLWLVYHU\HDV\WRLGHQWLI\DOOWKHOLQHDUO\LQGHSHQGHQWSDWKVRI
WKHSURJUDP
,QWURGXFWLRQ RI DGGLWLRQDO HGJHV DQG QRGHV LQ WKH &)* GXH WR
LQWURGXFWLRQ RI VHTXHQFH W\SHV RI VWDWHPHQWV LQ WKH SURJUDP FDQ
LQFUHDVHWKHF\FORPDWLFFRPSOH[LW\RIWKHSURJUDP
$SXUHWRSGRZQLQWHJUDWLRQWHVWLQJGRHVQRWUHTXLUHWKHXVHRIDQ\VWXE
PRGXOHV
$GKHUHQFH WR FRGLQJ VWDQGDUGV LV FKHFNHG GXULQJ WKH V\VWHP WHVWLQJ
VWDJH
'HYHORSPHQW RI VXLWDEOH GULYHU DQG VWXE IXQFWLRQV DUH HVVHQWLDO IRU
FDUU\LQJRXWHIIHFWLYHV\VWHPWHVWLQJRIDSURGXFW
6\VWHPWHVWLQJFDQEHFRQVLGHUHGDVDZKLWHER[WHVWLQJ
7KHPDLQSXUSRVHRILQWHJUDWLRQWHVWLQJLVWRILQGGHVLJQHUURUV
