Semantic Annotation for Process Models: - Department of Computer ...

134 CHAPTER 8. QUALITY EVALUATION OF THE METHOD
Modeler — model annotator
In this scenario, model annotators are modelers. They create the annotation by applying
their modeling and domain knowledge. In the exemplar studies, we assume that
the annotators of PM A know the modeling language BPMN and their BPMN models
quite well. The similar assumption for the annotators of PM B1 and PM B2 is the knowledge
of the EEML modeling language and EEML models. Moreover, they understand
thoroughly their business process and domain definitions. Such a role corresponds to
the modeler in the quality framework.
Participant actor — annotation user
Annotation users are the consumers of the annotation results. In the cases, they make
use of the annotation information in the process knowledge management activities, such
as querying information, analyzing models, and eliciting/inferring interested knowledge.
They correspond to the participant actors in the quality framework.
Annotation tool
The annotation tool is used to support the annotation procedure. The annotation tool
— Pro-SEAT provides the functions for profile annotation, meta-model annotation,
model annotation and goal annotation.
8.3 Quality Analysis
The quality evaluation includes the quality of GPO, the PSAM definitions, the annotated
PSAM model instances and the annotation tool for the cases. GPO is defined
as the meta-model of the annotation model, and the PSAM definitions are applied as
the notation of the modeling. Thus, the language quality is analyzed on GPO and
the PSAM definitions. The model quality is discussed based on the instances in the
exemplar studies. The quality categories of SEQUAL are also applied to evaluate to
which extent it improves the model quality.
8.3.1 Quality evaluation of GPO and PSAM
1. Domain appropriateness. GPO has been defined by referring most process modeling
languages in enterprise modeling, and GPO includes the most vital and
frequently used concepts in describing a business process. Compared with those
languages, the GPO concepts are more general in the enterprise process domain.
Accordingly, specific semantics in the domain can only be abstracted or encapsulated
into a set in GPO. Such a quality evaluation can be made through the
analysis of the meta-model annotation in the exemplars. For example, in EEML
the resources could be the following different concepts — Organization, Person,
Information Object, Skill, Software Tool, Manual Tool, and Material Tool. And
the resource role is played by those resources. In the meta-model annotation,
only two concepts Actor-role and Artifact in GPO are found to correspond