Download - Российский комитет Программы ЮНЕСКО ...

Evaluation is done mainly focusing on the process of answering questions.
The main points of evaluation are 1) how communication works in a
multilingual chat and 2) how the shared whiteboard is used to help
communication. For 1), we did a quantitative evaluation using a bibliometric
method for English texts, Flesch Kincaid Reading Ease (FKRE) and the
amount of conversation. For 2), we did also a qualitative evaluation by
tracking whiteboard usage and communication between avatars to the level
of comparison of their contents.
1) How Does Communication Work in a Multilingual Chat
FKRE, the rating scale for communication – measures of a multilingual chat –
have the following characters : the smaller FKRE 84 value shows complex
communication.
In the experiment, we define “complex communication” as “frequent use of
technical terms” namely, they make discussion along the theme. Calculating
these values to the contents of multilingual chat we evaluate the quality of
the communication. The results are shown in Table 3, where L e
means the
number of efficient chat sentences, W m
means the number of mean words
per sentence, E means using English, NT means using mother tongue, Δ is
(E-NT).
Table 3. The value of FKRE, Le, and Wm.
Group 1 Group 2
E NT Δ E NT Δ
FKRE 96.8 79.5 -17.3 96.8 88.4 -8
Le 16 65 +49 21 31 +10
Wm 1.23 5.46 +4.23 3.29 4.58 +1.29
First, we focus on the values of FKRE. FKRE score of communication
in mother tongues supported by translation function is clearly reduced
compared with that in English. Especially the group 1 shows reduction by
17.3 points. Words and sentence structures used in communication in mother
tongues supported by translation function are clearly more advanced than
those in English.
Figure 4 shows the relation between the elapsed time and line number of
conversation of each group either in English or in mother tongues.
84
See Reference 2.
256