Eckhard Bick - VISL

ambiguous words), moving them to "lower" ambiguity groups. At the same time, there
was nearly no effect on the very highly ambiguous word forms.
When judging the changes in the table below, one has to consider, however, that
even the original percentages were arrived at by some degree of local disambiguation,
in that my parsing program from the beginning has had successive level analysis for
suffixes, so the changes involve only prefixed readings being rated against each other,
and prefixed readings of low complexity substituting high complexity suffixation
readings. The overall effect of local disambiguation may be even more visible when
compared to an analysis technique with no "depth control" whatsoever.
(1) Effects of local disambiguation by minimum derivation selection
("Karlsson’s law"), data from the RNP literature corpus analysis
number of
readings
number of word forms % of all word forms cumulative %
without with local without with local without with local
disambig.
disambig.
disambig.
0 479 480 0.4 0.4 0.4 0.4
1 62527 62847 47.4 47.6 47.7 48.0
2 30860 34303 23.4 26.0 71.1 74.0
3 15075 16159 11.4 12.2 82.5 86.2
4 17126 12945 13.0 9.8 95.5 96.0
5 4209 4564 3.2 2.7 98.7 98.7
6 1437 1418 1.1 1.1 99.8 99.8
7 159 159 0.1 0.1 99.9 99.9
8 79 78 0.1 0.1 100.0 100.0
9 1 1 - - - -
10 15 15 - - - -
11 15 14 - - - -
total 131981 131981 100.0 100.0 100.0 100.0
- 130 -