Unni Cathrine Eiken February 2005

the EPAS can be used in the classification phase when the category to be assigned is not literally
a part of the structures to be learnt from.
Test 3
Training set: EPAS_arg1 with no pronouns and concept classes as category label, argument 1
ignored.
Test set: EPAS_arg1 with pronouns and concept classes as category label
Result: 76,92% (20/26)
As was the case in the corresponding test in section 4.1.2.1, two of the wrongly assigned
categories were in fact within the same semantic group as the correct category. Regarding these
as correct assignments would heighten the result to 84,61%. As was the case in the previous two
tests, the assigned categories in these cases are too infrequent in the EPAS list to surface in the
associated concept groups.
Test 4
Training set: EPAS_arg2 with no pronouns and concept classes as category label, argument 2
ignored.
Test set: EPAS_arg2 with pronouns and concept classes as category label
Result: 83,33% (5/6)
When training the classifier on the EPAS_arg2 list using concept class labels as categories and
testing on the set of EPAS with pronouns in argument 2 position, the classifier resolved five of
the six test instances correctly. In the corresponding test in section 4.1.2, the classifier did not
assign the correct category in any of the six test cases. We did, however, see that five of the test
instances were assigned categories which were semantically similar to the correct antecedent. In
view of the results in the initial test, it came as no surprise that the classifier performed so much
better when used in connection with the concept class labels.
77