CMPT-741 Fall 2009 Data Mining Martin Ester Course Project

Total marks: 30 % of the class
Due date: November 30, 2009
Introduction
CMPT-741 Fall 2009
Data Mining
Martin Ester
Course Project
This course project is to be conducted in small groups of two to three students. You will be using
the public domain data mining tool WEKA, to be downloaded from
http://www.cs.waikato.ac.nz/ml/weka/index_downloading.html.
Dataset
You will be using reviews from Epinions.com. Each review consists of the full text, the pros and
cons (a summary of the review) and the numerical rating (1, 2, 3, 4, or 5). The texts are provided
both as raw texts and in a version with part-of-speech tags. More specifically, here are the
attributes of a product review:
PKey|ProductRate|Pros|Cons|FullReview|TaggedPros|TaggedCons|TaggedFullReview
Our dataset contains reviews for each of the following product categories and products:
Camcorder
Pkey Product
1 Pure Digital Flip Video Ultra (2 GB) Camcorder
2 Canon Elura 100 Mini DV Camcorder
3 Canon ZR40 Mini DV Camcorder
4 Canon GL2 Mini DV Camcorder
5 Samsung SC-D23 Mini DV Camcorder
6 Sony Handycam DCR-TRV250 Digital-8 Camcorder
7 Panasonic Palmcorder® PV-DV203 Mini DV Camcorder
8 Canon Elura 50 Mini DV Camcorder

Cellular Phone
Digital Camera
DVD Player
MP3 Player
Pkey Product
1 Apple iPhone (8 GB) Smartphone
2 Nokia 6210 Cell Phone
3 Samsung SPH-A500 Cell Phone
4 RIM BlackBerry Pearl 8100 Smartphone
5 Palm Treo 650 Smartphone
6 Sony Ericsson T68IS Cell Phone
7 Motorola V400 Cell Phone
8 Motorola Qâ„¢ Smartphone
Pkey Product
1 Sony Mavica MVC-FD83 Digital Camera
2 Olympus Camedia D-360L Digital Camera
3 Nikon D40 Digital Camera with 18-55mm Lens
4 Canon PowerShot® S5 IS Digital Camera
5 Kodak EasyShare LS443 Digital Camera
6 Hewlett Packard Photosmart 435 Digital Camera
7 BenQ DC1500 Digital Camera
8 Agfa ePhoto Smile Digital Camera
Pkey Product
1 Panasonic DVD-LV50 5 in. Portable DVD Player
2 Toshiba SD-1200 DVD Player
3 Panasonic DMR-E85H (120 GB) DVD Recorder
4 Toshiba RD-XS32SU DVD Recorder / HDD Recorder
5 Apex Digital AD-1200 DVD Player
6 Initial IDM-1731 7 in. Portable DVD Player
7 Cyberhome DVR 1600 DVD Recorder
8 Cyberhome CH-LDV 712 7 in. Portable DVD Player
Pkey Product
1 Apple iPod touch 2nd Generation (16 GB) MP3 Player
2 Intel Pocket Concert (128 MB) MP3 Player
3 Apple iPod classic 5th Generation White (30 GB) MP3 Player
4 Apple iPod classic 4th Generation (20 GB) MP3 Player
5 Apple iPod shuffle 1st Generation White (512 MB, M9724LL/A) MP3 Player

6 SanDisk Sansa m240 (1 GB) MP3 Player
7 Dell DJ (20 GB) MP3 Player
8 RCA Lyra RD2840 (40 GB) MP3 Player
The dataset contains multiple reviews for each product.
Tasks
Your task is sentiment classification. We create class labels for reviews as follows:
Rating = 1 or 2: negative, rating = 3: neutral, rating = 4 or 5: positive.
Build a sentiment classifier using any of the methods implemented in WEKA. Submit a hard
copy report addressing the following issues:
1) Describe the features that you used for your classifier as well as why and how you selected
them.
2) Discuss your choice of a classification method. You may have to experiment with several
methods and may report some of the preliminary results as arguments.
3) Give the classification accuracy, the precision and recall and the F-measure (for the positive
class and for the negative class) of your sentiment classifier. You need to perform 5-fold
cross-validation to compute your performance measures.
4) Design and implement a method that explains the results of your sentiment classifier. Discuss
your design and provide the actual explanations produced for the classification of the first
reviews of each product category.
Marking scheme
Each of the four issues listed above is worth 25% of the course project marks.