Methods of Data Collection and Mode of Administration

More documents

Recommendations

Info

Web-based surveys: Considerations• Security• Server capacity• Additional layer of testing related to usability• Variable platform environment• Questionnaire design• Usability• Graphics, video streamOther modes: Diary surveys• Major uses: expenditures, time use, nutrition• Advantages• Avoid recall errors• Obtain detailed information• Reduce proxy reporting, social desirability effects• Reduce costs, relative to face to face interview• Disadvantages:• Declining interest, reporting over time• Underreporting• Change of behavior• Structure and complexity of diary• Problems of late placement and recall periodOther modes: Administrative recordsOther modes: Direct observation• Major uses: income data (tax forms), hospital data• Advantages:• Relatively cheap (data already exist)• Low (no) additional respondent burden• May augment survey data• May provide opportunities for validity studies• Disadvantages:• Limited to data available on records• Quality and timeliness of information on records• Coverage problems• Informed consent, confidentiality issues• Examples of measurements by visual inspection• Condition of housing unit or neighborhood• Display of books, furniture in home• Interaction among household members• Physical condition of respondent• Can be unobtrusive or obtrusive• Generally requires more careful interviewer training because of lack ofstructure of visual observation• Little is known about interviewer variability for such measures
Summary: Advantages of face-to-face surveys• Face-to-face interviews are only possible if the address of the sample unit isavailable• Most compatible with area probability and list samples• Nonparticipation• Can contact respondents without telephones• Best for gaining cooperation (high response rate)• Physical presence of interviewer provides more information aboutinterviewer, which can aid in building trust• Physical presence provides interviewer more information about respondent,which can aid her in tailoring appeals for cooperation• Measurement• Advantages of interviewer administration• answer questions and provide clarification• probe• following skips• longer, more complex interviews possible• use of visual aids• Advantages of interviewer presence• Permits addition of self-administered portion• Permits other types of data collection (observation, visual cues)Summary: Disadvantages of face-to-face surveys• Staff and field costs• Need trained staff of geographically dispersed interviewers• Training and supervision more complicated• Workload must be maintained to retain staff• Requires longer field period to collect data than telephone method• These may need to higher cost than telephone• Nonparticipation• Some areas (high rise buildings, high crime areas) may be lessaccessible to personal interview• Measurement• Effect of interviewer• Interviewer bias (cheating, distortion, errors)• Physical presence provides respondent more information aboutinterviewer, which may increase impact of social presence orrapport on socially desirable answersSummary: Advantages of telephone surveys• Telephone interviews are only possible if the telephone number is available• Most compatible with RDD or list samples• Sampling error• Can reach geographically dispersed sample• List samples can be spread over a wide area• RDD samples have low clustering• Staff and field costs• No travel costs• Staff can be centralized, reducing costs of recruiting, training, supervising, and retaining• Field period may be shorter than FTF or mail• Leads to lower costs than FTF• Nonparticipation• Some units may be easier or safer to reach by telephone than personal visit• Restricted access or high crime areas are easier to reach by telephone• Measurement• Advantages of interviewer administration• answer questions and provide clarification• probe• following skips• longer, more complex interviews possible than self-administered on paper• Better interviewer training and supervision in centralized facility• Interviewer variance and bias reducedSummary: Disadvantages of telephone surveys• Frame: Coverage and eligibility• Those without phone or with only cell phone cannot be included• For RDD designs, this results in coverage problems• More difficult to identify ineligible, non-household numbers• Nonparticipation• For list designs, units without telephones cannot be contacted andbecome unit nonrespondents• Access problems (answering machines, caller-ID)• More limited methods of recruitment (e.g., may not always haveaddress)• Nonresponse typically higher than FTF• Measurement• Questionnaire constraints• Fewer response alternatives• No visual aids• No interviewer observations
Page 1 and 2: IntroductionMethods of Data Collect
Page 3 and 4: Choosing method of data collection:
Page 5 and 6: Comparison of address-based samplin
Page 7 and 8: Choice of mode: Measurement process
Page 9 and 10: Choice of mode: Costs• Staff• C
Page 11 and 12: Sample and nonsample addresses by m
Page 13 and 14: Effect of mode: Comments about item
Page 15: Mode Effects and Reports of Illicit

Methods of Data Collection and Mode of Administration

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?