Critical Thinking Assessment Report 12/13 AY

6. Follow where evidence and reasons lead?
7. Adhere to the conventions of Standardized American English?
Each reader gave a score of 1, 2, 3 or 4 to each criterion.
1=very poor or missing
2=poor/weak
3=okay/satisfactory
4=strong/excellent
A score of 3 or 4 is considered acceptable; a score of 1 or 2 is considered not acceptable.
Of the seven criteria, on criterion 7 had an average that was acceptable; all others had averages that
were in the unacceptable range. The follow graph provides a visual of the averages:
Data were also collected on how many of the artifacts were in-class versus out-of-class assignments.
There were 19 in-class assignment artifacts and 28 out-of-class assignment artifacts.
Data were also compiled regarding splits. A split is considered any reading by the two independent
readers that bridged the acceptable/unacceptable range. In other words, if one reader gave a criterion
on a particular artifact a 4 and the second reader gave the same criterion on the same artifact a 2, this is
considered a split. Given that there were 47 artifacts assessed and each artifacts was scored for seven
criteria, that provides 329 separate pairs to examine for splits. Of the 329 pairs, 49 had splits, which is
15%. Another way to look at splits is by artifact. Of the 47 artifacts, there was at least one criterion over