A Fast and Simple Stemming Algorithm for German Words

A Fast and Simple Stemming Algorithm for
German Words 1
Jörg Caumanns
Free University of Berlin, CeDiS
caule@gmx.de
Abstract
,Q WKLV UHSRUW D VWHPPLQJ DOJRULWKP IRU PRUSKRORJLFDO FRPSOH[ ODQJXDJHV OLNH *HUPDQ
RU 'XWFK LV SUHVHQWHG 7KH PDLQ LGHD LV QRW WR XVH VWHPV DV FRPPRQ IRUPV LQ RUGHU WR
PDNH WKH DOJRULWKP VLPSOH DQG IDVW 7KH DOJRULWKP FRQVLVWV RI WZR VWHSV )LUVW FHUWDLQ
FKDUDFWHUV DQG RU FKDUDFWHU VHTXHQFHV DUH VXEVWLWXWHG 7KLV VWHS WDNHV OLQJXLVWLF UXOHV
DQG VWDWLVWLFDO KHXULVWLFV LQWR DFFRXQW ,Q D VHFRQG VWHS D YHU\ VLPSOH FRQWH[W IUHH
VXIIL[ VWULSSLQJ DOJRULWKP LV DSSOLHG 7KUHH YDULDWLRQV RI WKH DOJRULWKP DUH GHVFULEHG
7KH VLPSOHVW RQH FDQ HDVLO\ EH LPSOHPHQWHG ZLWK OLQHV RI & FRGH ZKLOH WKH PRVW
FRPSOH[ RQH UHTXLUHV DERXW OLQHV RI FRGH DQG D VPDOO ZRUGOLVW 6SHHG DQG TXDOLW\ RI
WKH DOJRULWKP FDQ EH VFDOHG E\ DSSO\LQJ IXUWKHU OLQJXLVWLF UXOHV DQG VWDWLVWLFDO KHXULVWLFV
1 Introduction
(YHQ LQ RXU WLPHV RI 0XOWL DQG +\SHUPHGLD ZULWWHQ WH[W VWLOO LV WKH SUHIHUUHG HQFRGLQJ RI
LQIRUPDWLRQ 0RUH WKDQ RI DOO GRFXPHQWV IRXQG LQ WKH :RUOG :LGH :HE DUH WH[WXDO >%UD\ @ 7KH
ODUJHVW VHDUFK HQJLQH RQ WKH :HE $OWDYLVWD FODLPV WR KDYH LQGH[HG RYHU PLOOLRQ GRFXPHQWV
7KHVH WZR QXPEHUV LPSO\ WKDW DQ\RQH ZLWK DFFHVV WR WKH LQWHUQHW DV ZHOO KDV IUHH DFFHVV WR PLOOLRQV RI
WH[WXDO GRFXPHQWV
$V QR RQH LV DEOH WR NHHS WUDFN RI WKLV PDVV RI LQIRUPDWLRQ WKHUH LV D VWURQJ GHPDQG IRU DXWRPDWLFDOO\
LQGH[LQJ VHDUFKLQJ H[WUDFWLQJ LQWHJUDWLQJ DQG UHVWUXFWXULQJ LQIRUPDWLRQ
1.1 Stemming
2QH RI WKH SUREOHPV IRU DQ\ NLQG RI DXWRPDWHG WH[W SURFHVVLQJ LV WKH GHWHFWLRQ RI GLIIHUHQW
PRUSKRORJLFDO YDULDWLRQV RI WKH VDPH ZRUG (VSHFLDOO\ IRU LQIRUPDWLRQ UHWULHYDO GDWD PLQLQJ DQG
DXWRPDWHG WH[W FRPSDULVRQ WKHVH YDULDWLRQV PXVW EH GHWHFWHG DQG PDSSHG WR D FRPPRQ IRUP 0RVW
DOJRULWKPV IRU WKLV FRQIODWLRQ RI WHUPV XVH ZRUG VWHPV DV FRPPRQ IRUPV 6WHP EDVHG FRQIODWLRQ LV
XVXDOO\ MXVW FDOOHG VWHPPLQJ
$ VWHPPHU VKRXOG FRQIODWH WRJHWKHU DOO DQG RQO\ WKRVH SDLUV RI ZRUGV ZKLFK DUH
VHPDQWLFDOO\ HTXLYDOHQW DQG VKDUH WKH VDPH VWHP >3DLFH @
� 7KH DOJRULWKP GHVFULEHG LQ WKLV UHSRUW ZDV GHYHORSHG DV SDUW RI D VHPLQDU DW WKH GHSDUWPHQW RI FRPSXWHU
VFLHQFH DW WKH )UHH 8QLYHUVLW\ RI %HUOLQ +LQ]H $ 6DELVFK $ 6FKZHSSH + Å*UXQGODJHQ 'LJLWDOHU
%LEOLRWKHNHQ´ :LQWHUVHPHVWHU

6WHPPLQJ FDQ EH HLWKHU ZHDN RU VWURQJ
$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
,Q WKH HDVLHVW FDVH RQO\ GLIIHUHQW GHFOHQVLRQV RI D ZRUG DUH GHWHFWHG DQG FRQIODWHG ( J
KRXVH DQG KRXVHV DUH VWHPPHG WR KRXVH DQG PRXVH DQG PLFH WR PRXVH 7KLV LV
FDOOHG ZHDN VWHPPLQJ
:LWK VWURQJ VWHPPLQJ DOO VXIIL[HV DQG VRPHWLPHV HYHQ DOO SUHIL[HV DUH UHPRYHG ( J HYHQ D
QRXQ OLNH LOOQHVV LV FRQIODWHG WR LV DGMHFWLYH VWHP LOO
)RU PRVW DSSOLFDWLRQV ZHDN VWHPPLQJ LV ERWK VXIILFLHQW DQG GHVLUHG DV LQ PDQ\ FDVHV SUHIL[HV DQG
VXIIL[HV FDUU\ OH[LFDO DQG VHPDQWLF PHDQLQJ
7KH PDLQ SUREOHPV WR EH VROYHG ZLWK ZHDN VWHPPLQJ DUH
• GHWHFWLQJ WKH ERXQGDU\ EHWZHHQ VWHP DQG HQGLQJ
• GHWHFWLQJ UHJXODU FKDQJHV RI WKH VWHP H J +DXV DQG +lXVHU LQ *HUPDQ
• GHWHFWLQJ JOXH FKDUDFWHUV H J VZLP DQG VZLPPLQJ LQ (QJOLVK RU HVVHQ DQG JHJHVVHQ
LQ *HUPDQ
• GHWHFWLQJ LUUHJXODU FKDQJHV RI WKH VWHP H J JR ZHQW JRQH LQ (QJOLVK RU QHKPHQ
QDKP JHQRPPHQ LQ *HUPDQ
)RU ODQJXDJHV ZLWK MXVW IHZ PRUSKRORJLFDO YDULDQWV H J (QJOLVK WKH PRVW FRPPRQ VWHPPLQJ
PHWKRG LV VXIIL[ VWULSSLQJ 7KH LGHD RI VXIIL[ VWULSSLQJ LV WR LWHUDWLYHO\ FXW RII DOO VXIIL[HV IURP D ZRUG
6XIIL[ VWULSSLQJ XVXDOO\ LV EDVHG RQ D GLFWLRQDU\ RI VXIIL[HV D ORQJHVW PDWFK DOJRULWKP DQG VRPH
VLPSOH PRUSKRORJLFDO UXOHV $Q H[DPSOHV IRU WKLV VWUDWHJ\ LV >3RUWHU @ ZKLFK LV XVHG E\ PRVW ZHE
EDVHG VHDUFK HQJLQHV
1.2 Stemming German Texts
6WHPPLQJ IRU PRUSKRORJLFDO PRUH FRPSOH[ ODQJXDJHV OLNH 'XWFK DQG *HUPDQ LV QRW WKDW HDV\ 7KH
UHDVRQV ZK\ WKH FRPELQDWLRQ RI ORQJHVW VXIIL[ PDWFKHV DQG VLPSOH OLQJXLVWLFV GRHVQ W ZRUN SURSHUO\
DUH
• &KDQJHV RI WKH VWHP XVXDOO\ GRQ W RFFXU DW WKH HQG RI WKH VWHP EXW LQ WKH PLGGOH H J +DXV
DQG +lXVHU
• $OO HYHQ LQFRPSOHWH UXOHV IRU GHFOHQVLRQV RI QRXQV DUH EDVHG RQ JHQGHU :LWKRXW OH[LFDO
DQDO\VLV RU GLFWLRQDU\ VHDUFK LW LV LPSRVVLEOH WR VD\ ZKHWKHU HU LV D VXIIL[ DV LQ %LOGHU RU
SDUW RI WKH VWHP DV LQ /HEHU
• 7KHUH DUH PDQ\ H[FHSWLRQV IRU ZKHQ WR H[FKDQJH D YRZHO IRU DQ 8PODXW WR EXLOG D SOXUDO IRUP
H J +XQG +XQGH EXW 0XQG 0 QGHU
• 7KH *HUPDQ ODQJXDJH PDNHV KHDY\ XVH RI FRPSRXQG QRXQV ( J WKH *HUPDQ WHUP IRU
QXFOHDU SRZHU SODQW LV $WRPNUDIWZHUN DQG WKH URRP WKH GLUHFWRU RI QXFOHDU SRZHU SODQW
ZRUNV LQ ZRXOG EH $WRPNUDIWZHUNVGLUHNWRUHQ]LPPHU
$V IDU DV ZH NQRZ WKHUH DUH FXUUHQWO\ QR IDVW DQG SRZHUIXO DOJRULWKPV DYDLODEOH IRU VWHPPLQJ
*HUPDQ WH[WV /LQJXLVWLF DSSURDFKHV KDYH GLIILFXOWLHV ZLWK FRPSRXQG ZRUGV ZKLFK PXVW EH
GHFRPSRVHG EHIRUH VWHPPLQJ 'LFWLRQDU\ EDVHG DSSURDFKHV DUH VORZ EHFDXVH RI WKHLU ODUJH ZRUG OLVWV

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
DERXW HQWULHV VHHP WR EH QHHGHG >6KHULGDQ 3LRWURZVNL @ 7KLV LV WKH UHDVRQ ZK\ *HUPDQ
VHDUFK HQJLQHV RQ WKH ZHE H J ILUHEDOO GR QR VWHPPLQJ DW DOO
1.3 Overview
,Q WKLV UHSRUW D VWHPPLQJ DOJRULWKP EDVHG RQ FRQWH[W IUHH VXIIL[ VWULSSLQJ LV LQWURGXFHG 7KH FRUH
DOJRULWKP LV YHU\ IDVW DQG YHU\ VLPSOH OHVV WKDQ OLQHV RI FRGH ,W FDQ KDQGOH DQ LQILQLWH QXPEHU RI
ZRUGV DQG JHWV HYHQ VWURQJHU WKH PRUH FRPSRXQGLQJ RFFXUV 7KH RQO\ UHTXLUHPHQW IRU WKH DOJRULWKP
LV WKDW DOO VWRS ZRUGV GHWHUPLQHUV DQG RWKHU IXQFWLRQ ZRUGV ² PXVW KDYH EHHQ UHPRYHG IURP WKH WH[W
WR EH VWHPPHG
7KH DOJRULWKP ZDV GHVLJQHG IRU VWHPPLQJ *HUPDQ ZRUGV EXW LW FDQ PRUH RU OHVV HDVLO\ EH DGDSWHG IRU
RWKHU ODQJXDJHV ,W KDV EHHQ LPSOHPHQWHG DV SDUW RI DQ H[SHULPHQWDO VHDUFK HQJLQH DQG LV FXUUHQWO\
XVHG IRU NH\ZRUG VHDUFK DQG WH[W FRPSDULVRQ ZLWKLQ DQ DSSOLFDWLRQ LQ WKH DUHD RI G\QDPLF GRFXPHQWV
>&DXPDQQV @
7KH QH[W FKDSWHU SURYLGHV D GHVFULSWLRQ RI WKH DOJRULWKP DQG WKH LGHDV LW LV EDVHG RQ 7KH DOJRULWKP
KDV EHHQ WHVWHG ZLWK D ZRUGOLVW FRQWDLQLQJ PRUH WKDQ WHUPV 6RPH RI WKH UHVXOWV RI WKHVH WHVWV
DUH JLYHQ LQ FKDSWHU
,W VKRXOG EH QRWLFHG WKDW WKH DOJRULWKP LV QRW EHWWHU WKDQ H[LVWLQJ DSSURDFKHV EXW LW LV PXFK VPDOOHU
DQG IDVWHU )XUWKHU RQ LW FDQ HDVLO\ EH H[WHQGHG E\ HLWKHU OLQJXLVWLF UXOHV VWDWLVWLFDO KHXULVWLFV RU
ZRUGOLVWV WR LPSURYH TXDOLW\ IRU WKH SULFH RI VSHHG
2 The Substitute-and-Strip Algorithm
$V PHQWLRQHG DERYH WKH SXUSRVH RI VWHPPLQJ LV WR UHGXFH GLIIHUHQW PRUSKRORJLFDO IRUPV RI D ZRUG
WR D FRPPRQ IRUP :LWKLQ WKLV UHSRUW WKH FRPPRQ IRUP RI GLIIHUHQW GHFOHQVLRQV RI WKH VDPH ZRUG LV
FDOOHG WKH GLVFULPLQDWRU RI WKH UHVSHFWLYH ZRUG 'LVFULPLQDWRUV VKRXOG EH XQLTXH LQ D ZD\ WKDW RQO\
HTXLYDOHQW ZRUGV WKDW ZHUH GHULYHG IURP WKH VDPH VWHP DUH PDSSHG RQWR WKH VDPH GLVFULPLQDWRU
:RUG VWHPV DUH YHU\ JRRG GLVFULPLQDWRUV DV WKH\ DUH XVXDOO\ XQLTXH LI KRPRQ\PV DUH LJQRUHG
,Q UHDO OLIH WKH UHTXLUHPHQW RI XQLTXHQHVV FDQ QHYHU EH PHW 0RUSKRORJLFDO KRPRQ\PV OLNH QXWV
3OXUDO RI QXW DQG V\QRQ\P IRU FUD]\ FDQQRW EH GHWHFWHG ZLWKRXW SHUIRUPLQJ D VHPDQWLF DQDO\VLV
RI WKH WH[W WR EH VWHPPHG 7KLV DGGV VRPH QRLVH WR DQ\ VWHPPLQJ DOJRULWKP DV WKHUH ZLOO DOZD\V EH D
FHUWDLQ QXPEHU RI ZRUGV QRW PDSSHG RQWR DQ XQLTXH GLVFULPLQDWRU
$QRWKHU SUREOHP IRU DQ\ VWHPPLQJ DOJRULWKP DUH LUUHJXODU GHFOHQVLRQV 9HUE IRUPV OLNH JR ZHQW
JRQH RU QRXQV OLNH YHUWH[ YHUWLFHV DUH YHU\ KDUG WR GHWHFW DV FRPPRQ (VSHFLDOO\ IRU ODQJXDJHV
OLNH 'XWFK RU *HUPDQ WKDW PDNH KHDY\ XVH RI FRPSRXQGLQJ WKHVH LUUHJXODU IRUP PLJKW JHW EXULHG
GHHS LQVLGH D ZRUG 6WHPPLQJ WKHVH ZRUGV FRUUHFWO\ QRW RQO\ UHTXLUHV D ZRUGOLVW RI DOO LUUHJXODU IRUPV
EXW HYHQ YHU\ VRSKLVWLFDWHG GHFRPSRVLQJ DQG UHFRPSRVLQJ DOJRULWKPV
7R VXP XS WKHVH FRQVLGHUDWLRQV LW FDQ EH VDLG WKDW DQ\ VWHPPLQJ DOJRULWKP WKDW LV QRW EDVHG RQ
VHPDQWLF WH[W DQDO\VLV SURGXFHV VRPH NLQG RI HUURUV (YHQ WKH EHVW DOJRULWKP ZLOO QHYHU EH DEOH WR
VWHP DOO ZRUGV FRUUHFWO\
7KH LGHD EHKLQG WKLV ZRUN LV YHU\ VLPSOH ,I RQH NQRZV WKDW VWHPPLQJ LV QHYHU SHUIHFW ZK\ VKRXOG
RQH WU\" )RU PRVW DSSOLFDWLRQV LW GRHVQ W PDWWHU LI WKH HUURU UDWH FDXVHG E\ ZURQJ VWHPPLQJ LV RU
,Q HLWKHU FDVH WKH DSSOLFDWLRQ KDV WR GHDO ZLWK VRPH DPRXQW RI XQFHUWDLQW\

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
7KH DOJRULWKP LQWURGXFHG LQ WKLV UHSRUW LV EDVHG RQ D WZR VWHS VWUDWHJ\ ,Q D ILUVW VWHS FHUWDLQ
FKDUDFWHUV DQG RU JURXSV RI FKDUDFWHUV DUH UHSODFHG ZLWKLQ HDFK ZRUG WR EH VWHPPHG ,Q D VHFRQG VWHS
VXIIL[HV DUH FXW RII LQ D FRQWH[W IUHH PDQQHU %RWK VWHSV FDXVH VWHPPLQJ HUURUV LQ D VHQVH WKDW
GLIIHUHQW ZRUGV DUH PDSSHG RQWR LGHQWLFDO GLVFULPLQDWRUV 7KH TXHVWLRQ RI LQWHUHVW LV LI WKLV DGGLWLRQDO
HUURU UDWH LV ORZ HQRXJK WR EH DFFHSWDEOH
2.1 Recursive Context Free Suffix-Stripping
2QH RI WKH PRVW FRPPRQ VWHPPLQJ PHWKRGV LV VXIIL[ VWULSSLQJ :LWK VXIIL[ VWULSSLQJ HDFK ZRUG LV
PDWFKHG DJDLQVW D OLVW RI VXIIL[HV 7KH ORQJHVW VXIIL[ PDWFKLQJ WKH ZRUG V HQG LV FXW RII ( J JRLQJ LV
VWHPPHG WR JR E\ FXWWLQJ RI WKH LQIOHFWLRQDO VXIIL[ LQJ ,I VXIIL[ VWULSSLQJ LV MXVW EDVHG RQ VLPSOH
FKDUDFWHU PDWFKLQJ LW LV FDOOHG FRQWH[W IUHH
7KH LGHD RI FRQWH[W IUHH VXIIL[ VWULSSLQJ LV QRW QHZ EXW LW LV RIWHQ FODLPHG WR EH HUURU SURQH
´8QIRUWXQDWHO\ FRQWH[W IUHH UHPRYDO OHDGV WR D VLJQLILFDQW HUURU UDWH )RU H[DPSOH ZH PD\
ZHOO ZDQW 8$/ UHPRYHG IURP )$&78$/ EXW QRW IURP (48$/ >5LMVEHUJHQ @
7KH SUREOHP DGGUHVVHG ZLWKLQ WKLV TXRWH LV HDV\ WR XQGHUVWDQG DQG HDV\ WR DFFHSW EXW LW LV LUUHOHYDQW
:K\ VKRXOG XDO QRW EH UHPRYHG IURP HTXDO " $V ORQJ DV WKHUH LV QR RWKHU ZRUG PDSSHG RQWR HT
LW LV QR SUREOHP WR VWHP HTXDO WR HT ( J P\ GLFWLRQDU\ OLVWV QLQH ZRUGV VWDUWLQJ ZLWK HT WKDW DUH
QRW GHULYHG IRUP HTXDO 1RQH RI WKHVH QLQH ZRUGV ZRXOG EH VWHPPHG WR HT E\ D FRQWH[W IUHH
VXIIL[ VWULSSLQJ DOJRULWKP 7KH RYHUVLPSOLILFDWLRQ RI WKLV TXRWH LV WKDW HT VXUHO\ LV QRW WKH VWHP RI
HTXDO EXW QHYHUWKHOHVV LW LV DQ XQLTXH GLVFULPLQDWRU IRU HTXDO
,Q *HUPDQ WKHUH DUH VHYHQ GHFOHQVLRQDO VXIIL[HV IRU QRXQV V HV H HQ Q HU DQG HUQ IRU
DGMHFWLYHV H HU HQ HP HUH HUHU HUHQ HUHP VWH VWHU VWHQ DQG VWHP DQG IRU YHUEV H
HVW VW HW W HQ HWH WH HWHVW WHVW HWHQ WHQ HWHW WHW HQG DQG QG HQG DQG QG WXUQ YHUEV
LQWR DGYHUEV DQG FDQ EH IROORZHG E\ DQ\ RI WKH DGMHFWLYH VXIIL[HV $GGLWLRQDOO\ JH LV HLWKHU XVHG DV D
SUHIL[ RU DQ LQIL[ WR GHQRWH SDUWLFLSOHV
7KHVH VXIIL[HV SDUWO\ LQFOXGH HDFK RWKHU ZKLFK OHDGV WR WKH REVHUYDWLRQ WKDW DQ\ GHFOHQVLRQDO VXIIL[
FDQ EH EXLOG XS IURP D FRPELQDWLRQ RI H V Q W HP HU DQG QG %\ JLYLQJ XS VRPH
DPRXQW RI FRUUHFWQHVV IRU VSHHG WKH VWHPPLQJ DOJRULWKP GHVFULEHG LQ WKLV UHSRUW UHFXUVLYHO\ FXWV RI
DQ\ RFFXUUHQFH RI H V Q W HP HU RU QG IURP WKH HQG RI WKH WHUP WR EH VWHPPHG 7KH
DGGLWLRQDO HUURU UDWH FDXVHG E\ WKLV VLPSOLILFDWLRQ LV PLQLPDO EXW WKH JDLQ LQ VSHHG LV VLJQLILFDQW DV QRZ
RQO\ GLIIHUHQW VXIIL[HV PXVW EH FKHFNHG LQVWHDG RI
$IWHU DOO VXIIL[HV KDYH EHHQ UHPRYHG DQ\ RFFXUUHQFH RI JH HLWKHU DV SUHIL[ RU VXIIL[ LV FXW RII %\
SRVW SURFHVVLQJ WHUPV LQ WKLV ZD\ SDUWLFLSOHV DUH UHGXFHG WR WKHLU UHVSHFWLYH VWHP 7KLV UHSODFHPHQW LV
ULVN\ EHFDXVH LW LV WKH VRXUFH IRU D QXPEHU RI GLIIHUHQW ZRUG VDPH GLVFULPLQDWRU HUURUV
,W ZDV SUHYLRXVO\ VWDWHG WKDW WKH DOJRULWKP LV FRQWH[W IUHH 7KLV LV QRW FRPSOHWHO\ WUXH EHFDXVH WKHUH
DUH IRXU UHVWULFWLRQV RQ VXIIL[ VWULSSLQJ ZKLFK WDNH WKH OHQJWK DQG WKH FDVH RI D WHUP LQWR DFFRXQW
• ,I D WHUP LV VKRUWHU WKDQ IRXU FKDUDFWHUV QR IXUWKHU FKDUDFWHUV DUH UHPRYHG
• ,I D WHUP LV VKRUWHU WKDQ ILYH FKDUDFWHUV QHLWKHU HP QRU HU LV UHPRYHG
• ,I D WHUP LV VKRUWHU WKDQ VL[ FKDUDFWHUV QR QG LV UHPRYHG
• W LV QRW UHPRYHG IURP WHUPV VWDUWLQJ ZLWK DQ XSSHUFDVH OHWWHU 7KLV LV EHFDXVH W LV D YHUE
VXIIL[ DQG LWV UHPRYDO LV RI QR KHOS IRU QRXQV ZKLFK VWDUW ZLWK DQ XSSHUFDVH OHWWHU LQ *HUPDQ

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
2QH RI WKH HIIHFWV RI WKLV UHVWULFWLRQV LV WKDW OHWWHU ZRUGV DUH LJQRUHG E\ WKH DOJRULWKP $V WKHUH DUH
MXVW D KDQGIXO RI VXFK ZRUGV LQ *HUPDQ WKH HIIHFW RI LJQRULQJ WKHP FDQ EH LJQRUHG
7KH IROORZLQJ WDEOH OLVWV VRPH WHUPV DQG WKHLU UHVSHFWLYH GLVFULPLQDWRUV DV FDOFXODWHG E\ VXIIL[
VWULSSLQJ
WHUP GLVFULPLQDWRU WHUP GLVFULPLQDWRU
VLQJW VLQJ VLQJHQ VLQJ
EHOLHEW EHOLHE EHOLHEWHVWHU EHOLHE
VW|UHQ VW| VW|KQHQ VW|K
.X‰ .X‰ . VVH . VV HUURU
9HUOLHUHU 9HUOL 9HUOLHV 9HUOL HUURU
0DXV 0DX 0DXHU 0DX HUURU
VW|UHQ VW| 6W|UVHQGHU VW| HUURU
7KH WRS WKUHH URZV JLYH H[DPSOHV RI FRUUHFW VWHPPLQJ WKH ODVW IRXU URZV H[DPSOHV RI LQFRUUHFW
VWHPPLQJ 6WHPPLQJ HUURUV DV JLYHQ LQ URZ IRXU DQG ILYH DUH SUHYHQWHG E\ WKH ILUVW SDUW RI WKH
VWHPPLQJ DOJRULWKP VXEVWLWXWLRQ (UURUV DV LQ OLQH VL[ DQG VHYHQ DUH WKH SULFH IRU WKH DOJRULWKP V
VSHHG DQG VLPSOLFLW\
2.2 Substitution
-XVW GRLQJ VXIIL[ VWULSSLQJ ZLWKRXW WDNLQJ DQ\ FRQWH[WXDO DQG OLQJXLVWLF LQIRUPDWLRQ LQWR DFFRXQW OHDGV
WR WZR PDLQ VWHPPLQJ HUURUV
• ,Q *HUPDQ ODQJXDJH PDQ\ SOXUDO IRUPV DUH EXLOW E\ FKDQJLQJ D YRZHO WR DQ 8PODXW l |
DQG RU UHSODFLQJ ‰ E\ VV 7KHVH FKDQJHV RI WKH VWHP FDQQRW EH KDQGOHG E\ VXIIL[ VWULSSLQJ
7KH VDPH KROGV IRU LUUHJXODU YHUE IRUPV H J KDOWHQ KLHOW
• &KDUDFWHU VHTXHQFHV WKDW EHORQJ WRJHWKHU EHFDXVH WKH\ IRUP D VLQJOH VRXQG H J VFK HL
DQG LH DUH VSOLW DQG SDUWO\ FXW RII E\ WKH VWULSSLQJ DOJRULWKP
7R SUHYHQW WKHVH VWHPPLQJ HUURUV VRPH VXEVWLWXWLRQV DUH GRQH EHIRUH VXIIL[ VWULSSLQJ
(DFK 8PODXW LV UHSODFHG E\ LWV FRUUHVSRQGLQJ YRZHO DQG ‰ LV VXEVWLWXWHG E\ VV
7KH VHFRQG FKDUDFWHU RI HDFK GRXEOH FKDUDFWHU LV UHSODFHG E\
VFK FK HL DQG LH DUH UHSODFHG E\ VSHFLDO FKDUDFWHUV †
3XUSRVH RI WKH ILUVW VXEVWLWXWLRQ LV WR FRQIODWH DOO SOXUDO IRUPV FRUUHFWO\ 'UDZEDFN RI WKLV VXEVWLWXWLRQ
LV WKDW GLIIHUHQW ZRUGV OLNH 6W FN DQG 6WXFN RU (LVElU DQG (LVEDU DUH PDSSHG RQWR WKH VDPH
GLVFULPLQDWRU $V WKH QXPEHU RI WKHVH HUURUV LV YHU\ ORZ RQO\ RI WKHVH SDLUV ZHUH IRXQG LQ D OLVW RI
PRUH WKDQ QRXQV WKHUH LV QR HIIRUW GRQH WR KDQGOH WKHP 7KH VHFRQG DQG WKLUG UHSODFHPHQWV
DUH PDLQO\ GRQH WR VDYH IL[HG FKDUDFWHU VHTXHQFHV IURP EHLQJ VSOLW )XUWKHU PRUH UHSODFLQJ VFK DQG
FK E\ VLQJOH FKDUDFWHUV VRPH PRUH FKDUDFWHUV DUH VDYHG IURP VSOLWWLQJ DW ZRUGV VWDUWLQJ ZLWK VFK
RU FK

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
7KH DOJRULWKP FDQ EH LPSURYHG E\ VXEVWLWXWLQJ RWKHU FKDUDFWHUV WRR H J [ IRU ] WR KDQGOH
LUUHJXODU SOXUDO IRUPV OLNH 0DWUL[ DQG 0DWUL]HQ PDWUL[ DQG PDWULFHV
7KH RQO\ UHTXLUHPHQW IRU DQ\ VXEVWLWXWLRQ LV WKDW LW VKRXOG HLWKHU UHVXOW LQ DQRWKHU PRUSKRORJLFDO IRUP
RI WKH VDPH ZRUG RU SURGXFH D QRQ ZRUG ,I WKLV UHTXLUHPHQW LV QRW PHW D VWHPPLQJ HUURU ZLOO RFFXU
( J VXEVWLWXWLQJ ‰ IRU VV LQ %X‰H OHDGV WR %XVVH ZKLFK LV WKH SOXUDO IRUP RI %XV )RU WKLV
UHDVRQ %XV DQG %X‰H DUH ERWK VWHPPHG WR WKH VDPH GLVFULPLQDWRU %XV
6XEVWLWXWLRQV DUH D YHU\ SRZHUIXO LQVWUXPHQW DV WKH\ FDQ FDSWXUH OLQJXLVWLF UXOHV DQG VWDWLVWLFDO
KHXULVWLFV ,I IRU H[DPSOH JH ZLWKLQ WKH FKDUDFWHU VHTXHQFH LJH FDQ QHYHU EH DQ LQIL[ GHQRWLQJ D
SDUWLFLSOH LJ VKRXOG EH VXEVWLWXWHG LQ RUGHU WR VDYH LW IURP EHLQJ VSOLW 0RVW RI WKHVH VXEVWLWXWLRQV
DUH UDWKHU VKRUW DQG FDQ EH LPSOHPHQWHG HIILFLHQWO\ XVLQJ WUDQVLWLRQ WDEOHV RU ILQLWH VWDWH PDFKLQHV
3 Evaluation
7KH DOJRULWKP GHVFULEHG LQ WKLV UHSRUW KDV EHHQ WHVWHG ZLWK D OLVW RI DERXW WHUPV WDNHQ IURP WKH
*HUPDQ YHUVLRQ RI WKH /LQX[ VSHOO FKHFNHU $GGLWLRQDO WHVWV KDYH EHHQ SHUIRUPHG ZLWK VFLHQWLILF WH[WV
DQG VKRUW VWRULHV
7KH WZR SRVVLEOH NLQGV RI VWHPPLQJ HUURUV DUH
• WZR GHFOHQVLRQV RI WKH VDPH ZRUG DUH QRW FRQIODWHG WR WKH VDPH GLVFULPLQDWRU XQGHUVWHPPLQJ
• WZR RUH PRUH GLIIHUHQW WHUPV DUH FRQIODWHG WR WKH VDPH GLVFULPLQDWRU RYHUVWHPPLQJ
(UURUV RI HLWKHU NLQG ZLWKLQ D JLYHQ WH[W RU ZRUGOLVW VXP XS WR WKH RYHUDOO HUURU UDWH RI WKH VWHPPLQJ
DOJRULWKP
3.1 Understemming Errors
(YHQ WKRXJK WKH VWHPPLQJ DOJRULWKP WHQGV WR VWULS RII PRUH OHWWHUV WKDQ QHFHVVDU\ LW PD\ KDSSHQ WKDW
QRW WKH ZKROH GHFOLQDWLRQDO VXIIL[ RI D WHUP LV UHPRYHG 7KLV NLQG RI HUURU RFFXUV ZLWK WKUHH JURXSV RI
ZRUGV
• ,UUHJXODU YHUEV DQG DOO RI WKHLU FRPSRXQGLQJV DUH QRW UHGXFHG WR WKH VDPH GLVFULPLQDWRU
7KH 'XGHQ OLVWV RI WKHVH YHUEV LQFOXGLQJ PDQ\ RI WKH PRVW FRPPRQO\ XVHG
• )HPDOH IRUPV RI SURIHVVLRQV DUH LQ PDQ\ FDVHV QRW FRQIODWHG WR WKH VDPH GLVFULPLQDWRU ( J
6FKDXVSLHOHULQ DFWUHVV LV QRW VWHPPHG DW DOO ZKLOH 6FKDXVSLHOHULQQHQ LV FRQIODWHG WR
6FKDXVSLHOHULQQ 7KH VDPH KROGV IRU IHPDOH LQKDELWDQWV RI PDQ\ FRXQWULHV DQG FLWLHV H J
(QJOlQGHULQ YV (QJOlQGHULQQHQ
• 0DQ\ ZRUGV ZLWK D *UHHN RU /DWLQ RULJLQ DUH QRW FRQIODWHG FRUUHFWO\ ([DPSOHV IRU WKHVH
NLQGV RI ZRUGV DUH 'UDPD 3OXUDO 'UDPHQ DQG 0LQLPXP 3OXUDO 0LQLPD
7KH VHFRQG NLQG RI HUURU FDQ HDVLO\ EH SUHYHQWHG E\ VXEVWLWXWLQJ HDFK RFFXUUHQFH RI HULQQ ZLWK
HULQ :LWK WKH /LQX[ ZRUG OLVW LW ZRXOG UHGXFH WKH DPRXQW RI VWHPPLQJ HUURUV E\ ZLWKRXW FDXVLQJ
DQ\ DGGLWLRQDO HUURUV ,Q )UDQ] .DIND V QRYHOO 'HU 3UR]H‰ RQO\ RQH IHPDOH IRUP RI D SURIHVVLRQ LV
PHQWLRQHG RQO\ LQ VLQJXODU DQG ZLWKLQ DOO VFLHQWLILF WH[WV DERXW FRPSXWHU VFLHQFH DQG OLQJXLVWLFV WKDW
KDYH EHHQ FKHFNHG QR ZRUG RI WKLV NLQG RFFXUUHG )RU WKLV UHDVRQ LW ZDV GHFLGHG QRW WR GR WKH HULQQ
HULQ UHSODFHPHQW DV WKH DGGLWLRQDO FRPSXWDWLRQDO WLPH LV QRW MXVWLILHG E\ WKDW PLQLPXP HIIHFW
(UURUV RI WKH ILUVW DQG WKLUG NLQGV FDQ RQO\ EH SUHYHQWHG E\ XVLQJ D GLFWLRQDU\

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
,Q JHQHUDO LW FRXOG EH VDLG WKDW FDVHV ZKHUH WZR GLIIHUHQW PRUSKRORJLFDO IRUPV RI WKH VDPH ZRUG DUH
VWHPPHG WR GLIIHUHQW GLVFULPLQDWRUV DUH YHU\ UDUH IRU QRXQV DQG DGMHFWLYHV *LYLQJ D TXDOLWDWLYH
HVWLPDWH IRU WKH DPRXQW RI XQGHUVWHPPLQJ HUURUV RQ YHUEV LV GLIILFXOW 7KH YDVW PDMRULW\ RI DOO YHUEV
DUH UHJXODU DQG HDV\ WR VWHP %XW WKH IHZ LUUHJXODU YHUEV WKDW FDXVH XQGHUVWHPPLQJ HUURUV DUH YHU\
FRPPRQ LQ VSRNHQ DQG ZULWWHQ *HUPDQ ,Q D ZRUGOLVW MXVW RI DOO YHUEV PD\ EH LUUHJXODU EXW LQ D
VLQJOH WH[W WKHLU DPRXQW FRXOG EH DQG PRUH 'HSHQGLQJ RQ WKH SXUSRVH WKH VXEVWLWXWH DQG VWHP
DOJRULWKP LV XVHG IRU LUUHJXODU YHUEV PD\ FDXVH DQ HUURU UDWH VRPHZKHUH EHWZHHQ DQG DERXW
RI DOO *HUPDQ ZRUGV DUH YHUEV $V WKLV HUURU UDWH PD\ QRW EH DFFHSWDEOH D VROXWLRQ IRU WKH
LUUHJXODU YHUE SUREOHP ZLOO EH JLYHQ DW WKH HQG RI WKLV VHFWLRQ
3.2 Overstemming Nouns
7KH FUXFLDO DVSHFW IRU WKH TXDOLW\ RI FRQWH[W IUHH VXIIL[ VWULSSLQJ LV WKH DPRXQW RI RYHUVWHPPLQJ
HUURUV WKDW LV WKH QXPEHU RI GLIIHUHQW ZRUGV WKDW DUH FRQIODWHG WR WKH VDPH GLVFULPLQDWRU
7KH ILUVW H[SHULPHQWDO WHVW ZDV GRQH RQ QRXQV E\ RQO\ UHPRYLQJ WKH VXIIL[HV H Q V DQG HU
7KH UHVXOW ZDV H[WUHPHO\ SRVLWLYH 7KH /LQX[ VSHOO FKHFNHU V ZRUGOLVW FRQWDLQV QRXQV VRPH RI
WKHP LQ ERWK VLQJXODU DQG SOXUDO IRUPV 7KHVH WHUPV ZHUH FRQIODWHG LQWR GLIIHUHQW
GLVFULPLQDWRUV E\ WKH VWHPPLQJ DOJRULWKP 2I WKHVH GLVFULPLQDWRUV RQO\ ZHUH QRW
XQLTXH 2I WKH QRXQV RQO\ ZHUH QRW VWHPPHG WR D XQLTXH GLVFULPLQDWRU ,Q RQH
FDVH GLIIHUHQW ZRUGV ZHUH VWHPPHG WR WKH VDPH GLVFULPLQDWRU %XFK % FKVH %XFKVH DQG
% FKQHU LQ FDVHV GLIIHUHQW ZRUGV ZHUH UHGXFHG WR WKH VDPH GLVFULPLQDWRU
7KH QRQ XQLTXH GLVFULPLQDWRUV FDQ EH JURXSHG DV IROORZV
• ZLWK RI WKHVH HUURUV DW OHDVW RQH RI WKH ZRUGV ZDV QRW *HUPDQ H J &HQW DQG &HQWHU
• HUURUV ZHUH FDXVHG E\ QDPHV H J $OEUHFKW ' UHU V QDPH ZDV VWHPPHG WR 'XU
• HUURUV RFFXUUHG RQ ZRUGV ZLWK RYHUODSSLQJ VWHPV ([DPSOHV DUH 5LQG DQG 5LQGH RU
(LV DQG (LVHQ ,Q RI WKHVH FDVHV WKH HUURU ZDV FDXVHG E\ VWHPV HQGLQJ RQ HU
• HUURUV RFFXUUHG RQ GHULYHG IRUPV RI WKH VDPH VWHP ([DPSOHV IRU WKLV NLQG RI HUURU DUH
7DQ] DQG 7lQ]HU
• HUURUV ZHUH FDXVHG E\ 8PODXW VXEVWLWXWLRQ ([DPSOHV DUH 6WXFN DQG 6W FN RU %DU
DQG %lU PRUH HUURUV ZHUH QRW FDXVHG E\ EXW HQDEOHG E\ 8PODXW VXEVWLWXWLRQ H J
.|USHU DQG .RUSV ZHUH ERWK VWHPPHG WR .RUS
• DOO UHPDLQLQJ HUURUV ZHUH FDXVHG E\ SDLUV RI ZRUGV ZKHUH WKH DOJRULWKP VWULSSHG OHWWHUV
IURP ERWK ZRUGV VWHPV ([DPSOHV DUH :LHQ DQG :LHVH RU +DIHQ DQG +DIHU
7KHVH ILJXUHV DOORZ IRU D FRPSDULVRQ RI FRQWH[W IUHH VXIIL[ VWULSSLQJ ZLWK OLQJXLVWLF DQG GLFWLRQDU\
EDVHG VWHPPLQJ DOJRULWKPV
(UURUV RI WKH ILUVW WZR NLQGV 1RQ *HUPDQ ZRUGV DQG QDPHV FRXOG RFFXU DV ZHOO ZLWK WKHVH PRUH
VRSKLVWLFDWHG DSSURDFKHV 2YHUODSSLQJ VWHPV FDQ RQO\ EH KDQGOHG LI WKH JHQGHU RI D ZRUG LV NQRZQ
'HWHFWLQJ JHQGHU LV YHU\ GLIILFXOW IRU *HUPDQ QRXQV VR PDQ\ RI WKH HUURUV SURGXFHG E\ VXIIL[
VWULSSLQJ ZRXOG DV ZHOO FDXVH SUREOHPV ZLWK DQ\ RWKHU DOJRULWKP � 2QO\ HUURUV RI WKH ODVW WKUHH NLQGV
ZKLFK DUH DERXW RI DOO QRQ XQLTXH GLVFULPLQDWRUV DUH W\SLFDO IRU VXIIL[ VWULSSLQJ
� )RU H[DPSOH WKH 3RUWHU VWHPPHU FRQIODWHV JHQHUDO JHQHURXV JHQHUDWLRQ DQG JHQHULF WR WKH VDPH URRW >+XOO @

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
1RQH RI WKH ZRUGV VWHPPHG WR D QRQ XQLTXH GLVFULPLQDWRU ZDV ORQJHU WKDQ WZHOYH FKDUDFWHUV 0RUH
WKDQ ZHUH HYHQ VKRUWHU WKDQ RU HTXDO WR FKDUDFWHUV 7KLV SURRIV WKH DVVXPSWLRQ WKDW WKH ORQJHU
WKH ZRUGV WKH IHZHU DUH WKH HUURUV FDXVHG E\ VXIIL[ VWULSSLQJ
:LWK PRVW VLQJOH GRFXPHQWV VWHPPHG ZLWK WKH DOJRULWKP WKH DPRXQW RI RYHUVWHPPLQJ HUURUV IRU
QRXQV ZDV DERXW 0RUH WKDQ KDOI RI WKH QRQ XQLTXH VWHPV ZHUH FDXVHG HLWKHU E\ QDPHV RU E\
GHULYHG IRUPV RI WKH VDPH ZRUG 2QFH DJDLQ WKH JUHDW PDMRULW\ RI HUURU FDXVLQJ WHUPV ZHUH VKRUWHU
WKDQ VHYHQ FKDUDFWHUV
3.3 Overstemming Verbs, Adjectives, and Nouns
7KH VHFRQG WHVW ZDV SHUIRUPHG RQ WKH VDPH VHW RI GRFXPHQWV ,Q WKLV FDVH DOO VXIIL[HV OLVWHG LQ FKDSWHU
ZHUH UHPRYHG $V ZHDN VWHPPLQJ ZDV GHVLUHG LGHQWLFDO GLVFULPLQDWRUV ZHUH DVVXPHG WR EH GLIIHUHQW
LI WKHLU ILUVW OHWWHU ZDV QRW RI WKH VDPH FDVH H J NUDQNHU LV GLVWLQJXLVKDEOH IURP .UDQNHU $V
*HUPDQ VHQWHQFHV YHU\ VHOGRP VWDUW ZLWK YHUEV RU DGMHFWLYHV WKH DPRXQW RI VDPH ZRUG GLIIHUHQW
GLVFULPLQDWRU HUURUV RQO\ LQFUHDVHG VOLJKWO\ )RU WKH PRVW UHSUHVHQWDWLYH WHVW ZLWK WKH FRPSOHWH /LQX[
ZRUGOLVW WKH IROORZLQJ UHVXOWV ZHUH REWDLQHG
7KH VL]H RI WKH ZRUGOLVW LV DERXW WHUPV RI ZKLFK DERXW DUH QRXQV 7KH VWHPPLQJ
DOJRULWKP FDOFXODWHG GLIIHUHQW GLVFULPLQDWRUV RI WKHP IRU QRXQV 7KH QXPEHU RI
RYHUVWHPPLQJ HUURUV UDLVHG IURP QRQ XQLTXH GLVFULPLQDWRUV IRU QRXQV WR DERXW QRQ XQLTXH
GLVFULPLQDWRUV IRU WKH ZKROH ZRUGOLVW $ERXW ZRUGV ZHUH GHWHFWHG WKDW ZHUH QRW
FRQIODWHG WR DQ XQLTXH GLVFULPLQDWRU RI DOO ZRUGV )RU YHUEV DQG DGMHFWLYHV RI DOO
GLVFULPLQDWRUV ZHUH QRW XQLTXH DQG RI DOO YHUE DQG DGMHFWLYH IRUPV ZHUH VWHPPHG WR QRQ XQLTXH
GLVFULPLQDWRUV
,Q D WKLUG WHVWV DOO ZRUGV ZHUH FRQYHUWHG LQWR ORZHUFDVH DIWHU VWHPPLQJ 7KLV VFHQDULR FDOOHG PHGLXP
VWHPPLQJ LV FORVH WR VWURQJ VWHPPLQJ DV PDQ\ GHULYHG IRUPV DUH UHGXFHG WR WKH VDPH GLVFULPLQDWRU DV
WKHLU VWHP 1HYHUWKHOHVV LW LV DVVXPHG WKDW VWLOO ZHDN VWHPPLQJ LV GHVLUHG EXW WKDW WKHUH LV QR SUREOHP
ZLWK FRQIODWLQJ FORVHO\ UHODWHG WHUPV WR WKH VDPH GLVFULPLQDWRU )RU PRVW UHWULHYDO DQG PLQLQJ
DSSOLFDWLRQV WKLV VKRXOG EH WKH FDVH DV PDQ\ RI WKHVH HUURUV FRXOG RQO\ KDYH EHHQ GHWHFWHG E\ YHU\
WLPH FRQVXPLQJ OLQJXLVWLF DQG VHPDQWLF DQDO\VLV
:LWK PHGLXP VWHPPLQJ DERXW QRQ XQLTXH GLVFULPLQDWRUV ZHUH GHWHFWHG IRU WKH ZKROH
ZRUGOLVW $ERXW ZRUGV ZHUH QRW FRQIODWHG WR DQ XQLTXH GLVFULPLQDWRU $V ZLWK WKH
SUHYLRXV WHVW PRVW RI WKH HUURUV ZHUH FDXVHG E\ YHUEV DQG DGMHFWLYHV
3.4 Improvements
:LWK QRQH RI WKH WHVWV WKH DPRXQW RI RYHUVWHPPLQJ HUURUV ZDV DERYH )RU PRVW VLQJOH WH[WV LW ZDV
DW DERXW :LWK PRVW WHVWV WKH QXPEHU RI RYHUVWHPPLQJ HUURUV ZDV ORZHU WKDQ WKH QXPEHU RI
XQGHUVWHPPLQJ HUURUV 7KH UHDVRQ IRU WKLV XQH[SHFWHG EHKDYLRU LV WKH KLJK IUHTXHQF\ RI LUUHJXODU
YHUEV LQ ZULWWHQ WH[WV
,UUHJXODU YHUEV YDQ YHU\ HDVLO\ EH KDQGOHG E\ H[WHQGLQJ WKH VXEVWLWXWLRQ SDUW RI WKH DOJRULWKP 7KH LGHD
LV WR UHGXFH DOO PRUSKRORJLFDO IRUPV RI DQ LUUHJXODU YHUE WR RQH RI WKHVH IRUPV E\ XVLQJ D VPDOO ZRUG
OLVW
7KH FRPPRQ IRUP VKRXOG EH WKH PRVW VLJQLILFDQW FKDUDFWHU VHTXHQFH RI DOO IRUPV ( J WKH FRPPRQ
IRUP IRU NRPPHQ NDP LV NRPP ZKLOH WKH FRPPRQ IRUP IRU ODXIHQ OLHI LV OLHI
6XEVWLWXWLRQ LV GRQH RQ D VXEVWULQJ EDVH LQ RUGHU WR KDQGOH FRPSRXQG ZRUGV WRR %\ GRLQJ WKLV

$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
VLPSOH VXEVWLWXWLRQ WKH YHUE DQNDP ZRXOG EH FKDQJHG LQWR DQNRPP DQG ]XJHODXIHQ ZRXOG EH
FKDQJHG LQWR ]XJHOLHIHQ $V UHSODFHPHQWV RI LUUHJXODU YHUE IRUPV LQ PRVW FDVHV OHDG WR QRQ ZRUGV
WKH QXPEHU RI DGGLWLRQDO RYHUVWHPPLQJ HUURUV LV YHU\ VPDOO
%\ XVLQJ D VPDOO ZRUGOLVW WKH QXPEHU RI XQGHUVWHPPLQJ HUURUV FDQ EH GHFUHDVHG VLJQLILFDQWO\ 7KH
WUDGHRII LV D ORVV LQ WLPH DV DERXW DGGLWLRQDO VXEVWULQJ FRPSDULVRQV KDYH WR EH GRQH IRU HDFK WHUP
,I KDUG VWHPPLQJ LV UHTXLUHG PRUH VXIIL[HV VKRXOG EH FXW RII (VSHFLDOO\ IRU WKH PRVW FRPPRQ
GHULYDWLRQ VXIIL[HV XQJ KHLW NHLW HWF WKH QXPEHU RI DGGLWLRQDO RYHUVWHPPLQJ HUURUV FDQ EH
LJQRUHG
4 Conclusion
,Q WKLV UHSRUW D VWHPPLQJ DOJRULWKP EDVHG RQ VXEVWULQJ VXEVWLWXWLRQ DQG FRQWH[W IUHH VXIIL[ VWULSSLQJ
LV SUHVHQWHG 7KUHH YDULDQWV RI WKH DOJRULWKP KDYH EHHQ WHVWHG
:KHQ RQO\ QRXQV ZHUH FRQVLGHUHG WKH DPRXQW RI VWHPPLQJ HUURUV ZDV YHU\ ORZ ,W
FDQ EH DVVXPHG WKDW D PD[LPXP HUURU UDWH RI LV QRW ZRUVH WKDQ WKH HUURU UDWHV SURGXFHG
E\ PRUH VRSKLVWLFDWHG DOJRULWKPV EDVHG RQ OLQJXLVWLF DQDO\VLV RU ZRUG OLVWV 7KH DGYDQWDJH RI
VXEVWLWXWH DQG VWULS DOJRULWKP EHVLGH LWV VSHHG LV WKDW LW JHWV WKH EHWWHU WKH ORQJHU WKH WHUPV
WR EH VWHPPHG DUH
:KHQ DOO NLQGV RI ZRUGV ZHUH FRQVLGHUHG WKH DPRXQW RI RYHUVWHPPLQJ HUURUV UDLVHG XS WR
QHDUO\ GHSHQGLQJ RQ WKH VWHPPLQJ VHPDQWLFV $ VLJQLILFDQW QXPEHU RI DGGLWLRQDO HUURUV
ZHUH FDXVHG E\ XQGHUVWHPPLQJ PDLQO\ LUUHJXODU YHUEV 7KLV OHDGV WR DQ RYHUDOO HUURU UDWH
EHWZHHQ DQG GHSHQGLQJ RQ WKH WH[WV WR EH VWHPPHG
%\ PDWFKLQJ HDFK WHUP DJDLQVW D OLVW RI LUUHJXODU YHUEV PRVW XQGHUVWHPPLQJ HUURUV FRXOG EH
SUHYHQWHG $V WKH QXPEHU RI RYHUVWHPPLQJ HUURUV RQO\ EDUHO\ LQFUHDVHV WKH RYHUDOO HUURU UDWH
FDQ EH DVVXPHG WR EH OHVV WKDQ
)RU PRVW DSSOLFDWLRQV LQ WKH DUHD RI LQIRUPDWLRQ UHWULHYDO D VWHPPLQJ HUURU UDWH RI DERXW LV
DVVXPHG WR EH DFFHSWDEOH >YDQ5LMVEHUJHQ @ 7KLV KDQGLFDS FDQ HDVLO\ EH PHW E\ WKH VXEVWLWXWH DQG
VWULS DOJRULWKP
7KH ORZ HUURU UDWH RI WKH DOJRULWKP LV YHU\ DVWRQLVKLQJ DV LW LV YHU\ VPDOO DQG IDVW )URP SUDFWLFDO
H[SHULHQFHV DQG WKH WHVWV SUHVHQWHG LQ WKLV UHSRUW LW ORRNV DV LI WKLV OLQHV RI FRGH DOJRULWKP LV RQO\
KDUGO\ ZRUVH WKDQ RWKHU DSSURDFKHV ZKLFK DUH HLWKHU EDVHG RQ VRSKLVWLFDWHG OLQJXLVWLF PHWKRGV RU RQ
ZRUGOLVWV ZLWK DQG PRUH HQWULHV
)XUWKHU PRUH WKH DOJRULWKP LV DQ LGHDO H[WHQVLRQ WR ZRUGOLVW EDVHG DSSURDFKHV 7KHVHV V\VWHPV WHQG WR
KDYH HUURU UDWHV FORVH WR ]HUR IRU VKRUW WHUPV ZKLOH WKH VXEVWLWXWH DQG VWHP DOJRULWKP LV QHDUO\ HUURU
IUHH IRU ORQJ WHUPV %\ FRPELQLQJ ERWK DSSURDFKHV D ZRUGOLVW FRQWDLQLQJ OHVV WKDQ HQWULHV
VKRXOG EH VXIILFLHQW WR UHGXFH WKH DPRXQW RI VWHPPLQJ HUURUV WR OHVV WKDQ SOXV QRLVH
7KH RQO\ GUDZEDFN RI WKH DOJRULWKP LV WKH UHODWLYHO\ KLJK HUURU UDWH IRU YHUEV DQG DGMHFWLYHV 1HDUO\
RI DOO WHUPV ZLWKLQ WKHVH JURXSV ZHUH QRW VWHPPHG WR XQLTXH GLVFULPLQDWRUV )RU WKLV UHDVRQ LW
VKRXOG QRW EH XVHG IRU VHPDQWLF DQDO\VLV RU RWKHU DUHDV ZHUH YHUEV DUH H[WUHPHO\ LPSRUWDQW %XW IRU
DQ\ RWKHU NLQG RI DSSOLFDWLRQV H J LQIRUPDWLRQ UHWULHYDO RU WH[W FRPSDULVRQV LW LV D JRRG VPDOO DQG
IDVW DOWHUQDWLYH WR H[LVWLQJ DSSURDFKHV 6LPSOLILHG YHUVLRQV RI WKH DOJRULWKP H J ZLWKRXW D ZRUGOLVW
FDQ EH XVHG IRU DOO NLQGV RI LQWHUDFWLYH V\VWHPV LQ RUGHU WR DOORZ XVHUV WR W\SH QDWXUDO ODQJXDJH
VHQWHQFHV LQWR HQWU\ ILHOGV DQG RWKHU GLDORJ FRQWUROV

References
$ )DVW DQG 6LPSOH 6WHPPLQJ $OJRULWKP IRU *HUPDQ :RUGV
>%UD\ @ %UD\ 7 ´0HDVXULQJ WKH :HEµ ,Q 3URF WK ,QWHUQDWLRQDO :RUOG :LGH :HE
&RQIHUHQFH ::: 3DULV 0D\
$YDLODEOH DW KWWS ZZZ FRQI LQULD IU ILFKBKWPO SDSHUV 3 2YHUYLHZ KWPO
>&DXPDQQV @ &DXPDQQV - ´$ %RWWRP 8S $SSURDFK WR 0XOWLPHGLD 7HDFKZDUH´ ,Q 3URF
WK ,QWHUQDWLRQDO &RQIHUHQFH RQ ,QWHOOLJHQW 7XWRULQJ 6\VWHPV ,76 6DQ $QWRQLR
$XJXVW
>'LMNVWUD @ 'LMNVWUD 7 .HPSHQ * (LQI KUXQJ LQ GLH 3V\FKROLQJXLVWLN %HUQ *|WWLQJHQ
9HUODJ +DQV +XEHU
>'XGHQ @ 'XGHQ *UDPPDWLN GHU GHXWVFKHQ *HJHQZDUWVVSUDFKH 0DQQKHLP %LEOLRJUDSKLVFKHV
,QVWLWXW
>+XOO @ +XOO ' $ ´6WHPPLQJ $OJRULWKPV $ &DVH 6WXG\ IRU 'HWDLOHG (YDOXDWLRQµ
-RXUQDO RI WKH $PHULFDQ 6RFLHW\ IRU ,QIRUPDWLRQ 6FLHQFH SS -DQXDU\
>3DLFH @ 3DLFH & ' ´0HWKRG IRU (YDOXDWLRQ RI 6WHPPLQJ $OJRULWKPV %DVHG RQ (UURU
&RXQWLQJµ -RXUQDO RI WKH $PHULFDQ 6RFLHW\ IRU ,QIRUPDWLRQ 6FLHQFH SS
$XJXVW
>3LRWURZVNL @ 3LRWURZVNL 0 1/3 6XSSRUWHG )XOO 7H[W 5HWULHYDO 0DVWHU V 7KHVLV 8QLYHUVLWlW
(UODQJHQ 1 UQEHUJ
$YDLODEOH DW KWWS ZZZ OLQJXLVWLN XQL HUODQJHQ GH aP[S 0DJLVWHU PD DV
UHSRUW SGI
>3RUWHU @ 3RUWHU 0 ) ´$Q $OJRULWKP IRU 6XIIL[ 6WULSSLQJµ 3URJUDP SS
-XO\
>YDQ5LMVEHUJHQ @ YDQ 5LMVEHUJHQ & - ,QIRUPDWLRQ 5HWULHYDO /RQGRQ %XWWHUZRUWK
$YDLODEOH DW KWWS ZZZ GFV JODVJRZ DF XN .HLWK 3UHIDFH KWPO
>6KHULGDQ @ 6KHULGDQ 3 %DOOHULQL - 3 ´([SHULPHQWV LQ 0XOWLOLQJXDO ,QIRUPDWLRQ
5HWULHYDO XVLQJ WKH 63,'(5 6\VWHPµ ,Q 3URF WK $QQXDO ,QWHUQDWLRQDO $&0
6,*,5 &RQIHUHQFH RQ 5HVHDUFK DQG 'HYHORSPHQW LQ ,QIRUPDWLRQ 5HWULHYDO 6,*,5
=XULFK $XJXVW