RESEARCH METHOD COHEN ok
RESEARCH METHOD COHEN ok RESEARCH METHOD COHEN ok
POSTAL, INTERVIEW AND TELEPHONE SURVEYS 221 Box 9.4 continued Study type Features Strengths Weaknesses Retrospective longitudinal studies 1Retrospective analysis of history of a sample. 2Individual-and micro-level data. 1Usefulforestablishingcausal relationships. 2Clearfocus(e.g.howdidthis particular end state or set of circumstances come to be). 3Enablesdatatobeassembled that are not susceptible to experimental analysis. 1Rememberedinformation might be faulty, selective and inaccurate. 2Peoplemightforget,suppress or fail to remember certain factors. 3Individualsmightinterpret their own past behaviour in light of their subsequent events, i.e. the interpretations are not contemporaneous with the actual events. 4Therootsandcausesofthe end state may be multiple, diverse, complex, unidentified and unstraightforward to unravel. 5Simplecausalityisunlikely. 6Acausemaybeaneffectand vice versa. 7Itisdifficulttoseparatereal from perceived or putative causes. 8Itisseldomeasilyfalsifiableor confirmable. Chapter 9 strong in face-to-face encounters (Dooley 2001: 122). Further, interviewers can either ensure that the sequence of the survey protocol is strictly adhered to or they can tailor the order of responses to individual participants, making certain, incidentally, that all questions are answered. Interview surveys, moreover, can guarantee that it is the respondent alone who answers the questions, whereas in postal surveys the researcher never knows what help or comments are solicited from or given by other parties. Bailey (1994) adds that the opportunity for spontaneous behaviour and responses is also possible in interview surveys. Further, interviews can use more complex structures than postal questionnaires, the researcher being on hand to take participants through the schedule. On the other hand, the very features that make interview methods attractive may also make them problematic. For example, interview survey methods may be affected by the characteristics of the interviewer (e.g. sex, race, ethnicity, personality, skills, social status, clothing and appearance). They may also be affected by the conduct of the interview itself (e.g. rapport between the interviewer and the interviewee), and interviewees may be reluctant to disclose some information if they feel that the interview will not be anonymous or if sensitive information is being requested. The flexibility which the interview gives also contributes to the potential lack of standardization of the interview survey, and this may render consistency and, thereby, reliability, a problem. Further, interview surveys are costly in time for the researcher and the interviewee, and, as they are conducted at a fixed time, they may prevent the interviewee from consulting records that may be important to answer the questions. Further, they may require
222 SURVEYS AND DEVELOPMENTAL STUDIES the interviewer to travel long distances to reach interviewees, which can be expensive both in time and travel costs (Bailey 1994: 175). If interviews are intended to be conducted in the participants’ own homes, then participants may be unwilling to admit strangers. Moreover, neighbourhoods may be dangerous for some researchers to visit (e.g. awhiteresearcherwithaclipboardgoingintoa non-white area of great deprivation, or a black researcher going into a conservative white area). Telephone surveys Telephone surveys, it is claimed (Dooley 2001: 122), have the advantage of reducing costs in time and travel, for where a potential respondent is not at home a call-back costs only a few coins and the time to redial. Re-visits to often distant locations, on the other hand, can incur considerable expense in time and travel. Furthermore, if the intended participant is unable or unwilling to respond, then it is a relatively easy matter to maintain the required sample size by calling a replacement. Again, where respondents are unable or unwilling to answer all the questions required, then their partial replies may be discarded and further substitutes sought from the sample listing. It is easy to see why telephone interviews must always have a much longer list of potential respondents in order to attain the required sample size. On the other hand, not everyone has a telephone (e.g. the poor, the young, the less educated) and this may lead to a skewed sample. Nor, for that matter, is everyone available for interview, particularly if they work. Furthermore, many people are ex-directory, i.e. their numbers are withheld from public scrutiny. In addition, Dooley (2001: 123) reports that others – the younger, unmarried and higher occupational status groups – use answering machines that may screen out and delete researchers’ calls. These could also lead to a skewed sample. Even when the telephone is answered, the person responding may not be the most suitable one to take the call; she or he may not know the answer to the questions or have access to the kind of information required. For example, in an inquiry about household budgets, the respondent may simply be ignorant about a family’s income or expenditure on particular items. A child may answer the call or an elderly person who may not be the householder. Interviewers will need to prepare a set of preliminary, screening questions or arrange a call-back time when a more appropriate person can be interviewed. Telephone interviewing has its own strengths and weaknesses. For example, more often than not arespondent’ssexwillbeclearfromtheirvoice,so particular questions may be inappropriate. On the other hand, it is unwise to have several multiple choices in a telephone interview, as respondents will simply forget the categories available, there being no written prompts to which the respondent can refer. Similarly, order effects can be high: items appearing early in the interview exert an influence on responses to later ones, while items appearing early in a list of responses may be given greater consideration than those occurring later, amatternotconfinedtotelephonesurveysbut to questionnaires in general. Dooley (2001: 136) indicates that 17 per cent difference in agreement was recorded to a general statement question when it appeared before rather than after aspecific statement. He cites further research demonstrating that responses to particular questions are affected by questions surrounding them. His advice is to ask general questions before specific ones. Otherwise, the general questions are influenced by earlier responses to specific questions. Once again, this is amatternotconfinedtotelephonesurveysbutto questionnaires in general. Further, if the questioning becomes too sensitive, respondents may simply hang up in the middle of the survey interview, tell lies or withhold information. Dooley (2001: 123) reports that, in comparison to face-to-face interviews, telephone respondents tend to produce more missing data, to be more evasive, more acquiescent (i.e. they tend to agree more with statements) and more extreme in their responses (e.g. opting for the extreme ends of rating scales). Because telephone interviews lack the sensory stimulation of visual or face-to-face interviews
- Page 190 and 191: PLANNING NATURALISTIC RESEARCH 171
- Page 192 and 193: PLANNING NATURALISTIC RESEARCH 173
- Page 194 and 195: PLANNING NATURALISTIC RESEARCH 175
- Page 196 and 197: PLANNING NATURALISTIC RESEARCH 177
- Page 198 and 199: PLANNING NATURALISTIC RESEARCH 179
- Page 200 and 201: PLANNING NATURALISTIC RESEARCH 181
- Page 202 and 203: PLANNING NATURALISTIC RESEARCH 183
- Page 204 and 205: PLANNING NATURALISTIC RESEARCH 185
- Page 206 and 207: CRITICAL ETHNOGRAPHY 187 Relatio
- Page 208 and 209: SOME PROBLEMS WITH ETHNOGRAPHIC AND
- Page 210 and 211: 8 Historical and documentary resear
- Page 212 and 213: DATA COLLECTION 193 One can see fro
- Page 214 and 215: WRITING THE RESEARCH REPORT 195 Ext
- Page 216 and 217: THE USE OF QUANTITATIVE METHODS 197
- Page 218 and 219: LIFE HISTORIES 199 Box 8.2 Atypolog
- Page 220 and 221: DOCUMENTARY RESEARCH 201 Documentar
- Page 222 and 223: DOCUMENTARY RESEARCH 203 What are
- Page 224 and 225: 9 Surveys, longitudinal, cross-sect
- Page 226 and 227: SOME PRELIMINARY CONSIDERATIONS 207
- Page 228 and 229: PLANNING A SURVEY 209 structured or
- Page 230 and 231: LONGITUDINAL, CROSS-SECTIONAL AND T
- Page 232 and 233: LONGITUDINAL, CROSS-SECTIONAL AND T
- Page 234 and 235: STRENGTHS AND WEAKNESSES OF LONGITU
- Page 236 and 237: STRENGTHS AND WEAKNESSES OF LONGITU
- Page 238 and 239: POSTAL, INTERVIEW AND TELEPHONE SUR
- Page 242 and 243: POSTAL, INTERVIEW AND TELEPHONE SUR
- Page 244 and 245: EVENT HISTORY ANALYSIS 225 may be p
- Page 246 and 247: INTERNET-BASED SURVEYS 227 packages
- Page 248 and 249: INTERNET-BASED SURVEYS 229 instruc
- Page 250 and 251: INTERNET-BASED SURVEYS 231 Box 10.1
- Page 252 and 253: INTERNET-BASED SURVEYS 233 Box 10.1
- Page 254 and 255: INTERNET-BASED SURVEYS 235 Box 10.1
- Page 256 and 257: INTERNET-BASED SURVEYS 237 Witte et
- Page 258 and 259: INTERNET-BASED EXPERIMENTS 239 requ
- Page 260 and 261: INTERNET-BASED INTERVIEWS 241 ‘ne
- Page 262 and 263: SEARCHING FOR RESEARCH MATERIALS ON
- Page 264 and 265: COMPUTER SIMULATIONS 245 autho
- Page 266 and 267: COMPUTER SIMULATIONS 247 computer s
- Page 268 and 269: COMPUTER SIMULATIONS 249 On the oth
- Page 270 and 271: GEOGRAPHICAL INFORMATION SYSTEMS 25
- Page 272 and 273: 11 Case studies What is a case stud
- Page 274 and 275: WHAT IS A CASE STUDY 255 (providing
- Page 276 and 277: WHAT IS A CASE STUDY 257 argue that
- Page 278 and 279: EXAMPLES OF KINDS OF CASE STUDY 259
- Page 280 and 281: PLANNING A CASE STUDY 261 accounts
- Page 282 and 283: CONCLUSION 263 In the narrativ
- Page 284 and 285: CO-RELATIONAL AND CRITERION GROUPS
- Page 286 and 287: CHARACTERISTICS OF EX POST FACTO RE
- Page 288 and 289: DESIGNING AN EX POST FACTO INVESTIG
POSTAL, INTERVIEW AND TELEPHONE SURVEYS 221<br />
Box 9.4<br />
continued<br />
Study type Features Strengths Weaknesses<br />
Retrospective<br />
longitudinal studies<br />
1Retrospective<br />
analysis of history of a<br />
sample.<br />
2Individual-and<br />
micro-level data.<br />
1Usefulforestablishingcausal<br />
relationships.<br />
2Clearfocus(e.g.howdidthis<br />
particular end state or set of<br />
circumstances come to be).<br />
3Enablesdatatobeassembled<br />
that are not susceptible to<br />
experimental analysis.<br />
1Rememberedinformation<br />
might be faulty, selective and<br />
inaccurate.<br />
2Peoplemightforget,suppress<br />
or fail to remember certain<br />
factors.<br />
3Individualsmightinterpret<br />
their own past behaviour in light<br />
of their subsequent events, i.e.<br />
the interpretations are not<br />
contemporaneous with the<br />
actual events.<br />
4Therootsandcausesofthe<br />
end state may be multiple,<br />
diverse, complex, unidentified<br />
and unstraightforward to<br />
unravel.<br />
5Simplecausalityisunlikely.<br />
6Acausemaybeaneffectand<br />
vice versa.<br />
7Itisdifficulttoseparatereal<br />
from perceived or putative<br />
causes.<br />
8Itisseldomeasilyfalsifiableor<br />
confirmable.<br />
Chapter 9<br />
strong in face-to-face encounters (Dooley 2001:<br />
122). Further, interviewers can either ensure<br />
that the sequence of the survey protocol is<br />
strictly adhered to or they can tailor the<br />
order of responses to individual participants,<br />
making certain, incidentally, that all questions<br />
are answered. Interview surveys, moreover, can<br />
guarantee that it is the respondent alone who<br />
answers the questions, whereas in postal surveys<br />
the researcher never knows what help or<br />
comments are solicited from or given by other<br />
parties. Bailey (1994) adds that the opportunity<br />
for spontaneous behaviour and responses is also<br />
possible in interview surveys. Further, interviews<br />
can use more complex structures than postal<br />
questionnaires, the researcher being on hand to<br />
take participants through the schedule.<br />
On the other hand, the very features that make<br />
interview methods attractive may also make them<br />
problematic. For example, interview survey methods<br />
may be affected by the characteristics of the<br />
interviewer (e.g. sex, race, ethnicity, personality,<br />
skills, social status, clothing and appearance).<br />
They may also be affected by the conduct of the<br />
interview itself (e.g. rapport between the interviewer<br />
and the interviewee), and interviewees may<br />
be reluctant to disclose some information if they<br />
feel that the interview will not be anonymous or if<br />
sensitive information is being requested. The flexibility<br />
which the interview gives also contributes<br />
to the potential lack of standardization of the interview<br />
survey, and this may render consistency<br />
and, thereby, reliability, a problem. Further, interview<br />
surveys are costly in time for the researcher<br />
and the interviewee, and, as they are conducted<br />
at a fixed time, they may prevent the interviewee<br />
from consulting records that may be important to<br />
answer the questions. Further, they may require