Intelligent Tutoring Systems for Ill-Defined Domains - Philippe ...

Version 2: What religion is Momo? Because he is named Moses. Also, he
has excluded M Ibrahim
The other 10 posts simply made trivial changes so that their new posts would be accepted
by the system. We investigated why certain posts may have been revised and
why others were left as they were. There appeared to be two factors. First, students
were more likely to revise their earlier posts than their later posts. Second, unsurprisingly,
students were more likely to revise posts that received relevant feedback.
Table 1. Percent of posts in individual support study containing each dimension (human rated)
On
topic
Multiple
perspectives
Correct
facts
Novel
facts
Posts that made no revisions 1 .0 .30 .10 .30
Posts that made revisions –
before feedback
Posts that made revisions -
after feedback
3.2 Moderator Support System
Two Approaches for Providing Adaptive Support 8
1 .13 .27 .27 .20
1 .27 .53 .33 .53
Good
argument
We evaluated the moderator support system in an upper-level French classroom using
the same materials as the adaptive support study. Participants were 5 students: 3 posters,
and 2 students who volunteered to be moderators. The instructions for this study
were similar to those of the previous study, but the moderators were given separate
instructions to read posts and reply on Tuesday and Thursday, so that there would be
time for students to read the moderators’ posts before writing to the board the second
and third time. The moderator received adaptive support in moderating. The board
received 12 posts total over the week (4 from moderators and 8 from the other students),
which was slightly less than the assignment required. Moderator posts were on
average 62 words, longer than the regular posts which averaged 50 words. Two coders
then rated all posts on the five dimensions of our model and resolved differences
through consensus.
Our first research question related to the nature of the feedback given by the moderators.
On the surface, moderators did not appear to utilize the support. One of the
moderators did use the rating system and arrived at ratings similar to our ratings of
the posts, and the other didn’t follow the rating system at all, choosing instead to give
the posts she replied to a perfect score. Both moderators deleted the feedback tem-