A Typology of Management Studies Based on Three Classifications ...
A Typology of Management Studies Based on Three Classifications ...
A Typology of Management Studies Based on Three Classifications ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
A <str<strong>on</strong>g>Typology</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>Studies</str<strong>on</strong>g> <str<strong>on</strong>g>Based</str<strong>on</strong>g> <strong>on</strong> <strong>Three</strong><br />
Classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches According To Purpose,<br />
Method, and Applicati<strong>on</strong><br />
Malek Elahi* and Massoud Dehdashti**<br />
There are a number <str<strong>on</strong>g>of</str<strong>on</strong>g> classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> researches such as to<br />
purpose, method, and applicati<strong>on</strong>. However, a number <str<strong>on</strong>g>of</str<strong>on</strong>g> researches<br />
do not fall squarely <strong>on</strong> any <str<strong>on</strong>g>of</str<strong>on</strong>g> the abovementi<strong>on</strong>ed classificati<strong>on</strong>s;<br />
hence, a manner <str<strong>on</strong>g>of</str<strong>on</strong>g> classifying the said researches to a group is<br />
needed by simply listing them as bel<strong>on</strong>ging to a typology such as the<br />
following:<br />
i) Experimental Research<br />
ii) Causal-Comparative Research<br />
iii) Case Study<br />
iv) C<strong>on</strong>tent Analysis<br />
v) Correlati<strong>on</strong>al Research<br />
vi) Historical Research<br />
Keywords: Classificati<strong>on</strong> according to purpose, method, and applicati<strong>on</strong>,<br />
<str<strong>on</strong>g>Typology</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, Experimental Research, C<strong>on</strong>tent Analysis, Historical<br />
Research.<br />
1. Introducti<strong>on</strong><br />
I. What are the c<strong>on</strong>tents <str<strong>on</strong>g>of</str<strong>on</strong>g> researches, classified according to purpose or<br />
where the researcher may find himself/herself to be situated am<strong>on</strong>g the three<br />
stages in the decisi<strong>on</strong>-making process; namely: explorati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> dependent and<br />
independent variables, establishing c<strong>on</strong>clusi<strong>on</strong>s based <strong>on</strong> the explored<br />
variables, and performance-m<strong>on</strong>itoring <str<strong>on</strong>g>of</str<strong>on</strong>g> the dependent variable using the<br />
explanatory independent variables?<br />
Researches can be classified according to Purpose or Stage in the Decisi<strong>on</strong>-<br />
Making Process; it is claimed that the research purpose or stage in the<br />
decisi<strong>on</strong>-making process, determines the characteristics desired in the<br />
research design (Silverman, 2005).<br />
*Pr<str<strong>on</strong>g>of</str<strong>on</strong>g>. Malek Elahi, Head <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> Group, PN University South - East Asia, Kuala<br />
Lumpur, Malaysia, Email: elahi_ac_edu@yahoo.com<br />
**Massoud Dehdashti, Ec<strong>on</strong>omics Department, Islamic Azad University, Dashtestan, Iran,<br />
Email: dehdashti@diau.ac.ir
If we may repeat, research purposes --it is claimed-- depend <strong>on</strong> the phases<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> the decisi<strong>on</strong>-making process for which informati<strong>on</strong> is needed and<br />
accordingly yields three types <str<strong>on</strong>g>of</str<strong>on</strong>g> research designs; namely:<br />
a) Exploratory,<br />
b) C<strong>on</strong>clusive<br />
c) Performance-m<strong>on</strong>itoring research design.<br />
A. Exploratory research design<br />
The central purpose is to formulate hypotheses regarding potential problems<br />
and opportunities present in the decisi<strong>on</strong> situati<strong>on</strong>. The hypotheses can be<br />
tested at a later phase with a c<strong>on</strong>clusive research design (Leinhardt and<br />
Leinhardt, 1980).<br />
Exploratory research design applies when the research objectives include the<br />
following:<br />
a. identifying problems (threats or opportunities)<br />
b. developing a more precise formulati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a vaguely identified<br />
problem(threat or opportunity)<br />
c. gaining perspective regarding the breath <str<strong>on</strong>g>of</str<strong>on</strong>g> variables operating in a<br />
situati<strong>on</strong><br />
d. establishing priorities regarding the potential significance <str<strong>on</strong>g>of</str<strong>on</strong>g> various<br />
problems (threats or opportunities)<br />
e. gaining management and researcher perspective c<strong>on</strong>cerning the<br />
character <str<strong>on</strong>g>of</str<strong>on</strong>g> the problem situati<strong>on</strong><br />
f. identifying and formulating alternative courses <str<strong>on</strong>g>of</str<strong>on</strong>g> acti<strong>on</strong>; and<br />
g. gathering informati<strong>on</strong> <strong>on</strong> the problems associated with doing c<strong>on</strong>clusive<br />
research.<br />
h. identificati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> problems (threats or opportunities) can be assisted<br />
through the following:<br />
i) Searching sec<strong>on</strong>dary sources<br />
ii) Interviewing knowledgeable pers<strong>on</strong>s<br />
iii) Compiling case histories.<br />
B. C<strong>on</strong>clusive research design<br />
Provides informati<strong>on</strong> for the evaluati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> alternative courses <str<strong>on</strong>g>of</str<strong>on</strong>g> acti<strong>on</strong> .The<br />
sub-classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> c<strong>on</strong>clusive research design follows (Singer and Willett,<br />
2003):<br />
a. Descriptive Research<br />
i) Cross-secti<strong>on</strong>al design –takes a sample <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong> at <strong>on</strong>e point in<br />
time<br />
ii) L<strong>on</strong>gitudinal design –describes changes in a sample’s characteristic<br />
over a period <str<strong>on</strong>g>of</str<strong>on</strong>g> time<br />
b. Causal Research<br />
Descriptive Research relies heavily <strong>on</strong> interview <str<strong>on</strong>g>of</str<strong>on</strong>g> resp<strong>on</strong>dents and data<br />
available in sec<strong>on</strong>dary data sources. Descriptive research is proper when the<br />
research objectives include the following:<br />
i) Portraying the characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> a social or physical phenomena and<br />
determining the frequency <str<strong>on</strong>g>of</str<strong>on</strong>g> occurrence
ii) Determining the degree to which the variables are associated (however,<br />
cause-and-effect relati<strong>on</strong>ships, discussed under causal research design,<br />
are different from measurements <str<strong>on</strong>g>of</str<strong>on</strong>g> degrees <str<strong>on</strong>g>of</str<strong>on</strong>g> associati<strong>on</strong> in descriptive<br />
research design)<br />
iii) Making predicti<strong>on</strong>s regarding the occurrence <str<strong>on</strong>g>of</str<strong>on</strong>g> social or physical<br />
phenomena.<br />
Causal Research relies <strong>on</strong> interviews and in the c<strong>on</strong>duct <str<strong>on</strong>g>of</str<strong>on</strong>g> experiments.<br />
Causal research is proper when the research objective is to identify variables<br />
that cause the phenomen<strong>on</strong> being predicted and understand why they cause<br />
what is being predicted. A suspected variable that predicts an identified<br />
phenomen<strong>on</strong> must be freed <str<strong>on</strong>g>of</str<strong>on</strong>g> other variables that pollute it by doing either<br />
<strong>on</strong>e <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />
i) Avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> time that tends to combine other factors with the<br />
suspected variable as it influences the phenomen<strong>on</strong> being predicted by using<br />
a cross-secti<strong>on</strong>al design that gathers data as <str<strong>on</strong>g>of</str<strong>on</strong>g> a point in time (so as to<br />
”purify” a specific explanatory variable <str<strong>on</strong>g>of</str<strong>on</strong>g> accreti<strong>on</strong>s arising from the passage<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> time);<br />
ii) If a l<strong>on</strong>gitudinal data cannot be avoided, at least achieve stability and hence<br />
predictability in the relati<strong>on</strong>ship between the suspected explanatory variable<br />
and the phenomen<strong>on</strong> to be predicted by invoking the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large numbers<br />
which asserts that regardless <str<strong>on</strong>g>of</str<strong>on</strong>g> the distributi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong> am<strong>on</strong>g the<br />
values <str<strong>on</strong>g>of</str<strong>on</strong>g> the suspected explanatory variable, the mean <str<strong>on</strong>g>of</str<strong>on</strong>g> the sampling<br />
means tends towards a normal distributi<strong>on</strong>. The mean <str<strong>on</strong>g>of</str<strong>on</strong>g> a normal distributi<strong>on</strong><br />
equals the mean <str<strong>on</strong>g>of</str<strong>on</strong>g> a student-t distributi<strong>on</strong>; hence, what is important here, is it<br />
reduces finding the partners-in-a-descripti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a populati<strong>on</strong> (the mean and<br />
the standard deviati<strong>on</strong>) by looking for its margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error <strong>on</strong>ly (since the mean<br />
is already given) through the statement <str<strong>on</strong>g>of</str<strong>on</strong>g> the researcher regarding his/her<br />
desired c<strong>on</strong>fidence level and desired margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error in determining the<br />
desired sample size given the following equati<strong>on</strong> (Cohen, 1988).<br />
s 2 z 2<br />
Desired sample size “n” = _____<br />
e 2<br />
Where:<br />
s –the standard error <str<strong>on</strong>g>of</str<strong>on</strong>g> the pilot sample arbitrarily chosen by the researcher,<br />
when there is no standard deviati<strong>on</strong> given in a census <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong><br />
z –the equivalent in a standardized renditi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a normal distributi<strong>on</strong>, <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
c<strong>on</strong>fidence level desired by the researcher<br />
e –the desired margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error from the true mean<br />
Please note that the standard error <str<strong>on</strong>g>of</str<strong>on</strong>g> the pilot sample is essential in this<br />
computati<strong>on</strong>. The inability to avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> time as it pollutes an<br />
explanatory variable such as in l<strong>on</strong>gitudinal data can be remedied by invoking<br />
the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large numbers. Another inability to avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another<br />
factor <strong>on</strong> the dependent variable, hidden in the explicit explanatory variable,<br />
even in cross-secti<strong>on</strong> data can be minimized by also invoking the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large<br />
numbers.
Post Test-Only C<strong>on</strong>trol Group Design (Patrick and Hisley and Kempler, 2000).<br />
The Solom<strong>on</strong> Four-Group Design c<strong>on</strong>trols the inability to avoid the influence<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit explanatory<br />
variable, even in cross-secti<strong>on</strong> data. Unfortunately, time, effort, and cost<br />
necessary in c<strong>on</strong>ducting the experiment outweighs the benefits particularly<br />
the time involved so that by the time the results are out, time has introduced<br />
changes in the alleged “pure” explanatory factors.<br />
A smaller design was needed for a relatively faster turn out <str<strong>on</strong>g>of</str<strong>on</strong>g> results before<br />
time takes it toll <strong>on</strong> an allegedly “pure” explanatory variable. And such a<br />
design is the Posttest-Only C<strong>on</strong>trol Group Design as follows:<br />
Experimental group: R X O 1<br />
C<strong>on</strong>trol group : R O 2<br />
Where:<br />
R –indicates that individuals have been assigned at random to separate<br />
treatment groups (random selecti<strong>on</strong>) or that groups themselves have been<br />
allocated at random to separate treatments (random assignment).<br />
X –represents the exposure <str<strong>on</strong>g>of</str<strong>on</strong>g> a test group to an experimental treatment, the<br />
effects <str<strong>on</strong>g>of</str<strong>on</strong>g> which are to be determined.<br />
O –refers to processes <str<strong>on</strong>g>of</str<strong>on</strong>g> observati<strong>on</strong> or measurement <str<strong>on</strong>g>of</str<strong>on</strong>g> the dependent<br />
variable <strong>on</strong> the test units.<br />
Here the O 1 and the O 2 measurements are composed <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />
O 1 = TE + EXT<br />
O 2 = EXT<br />
Where:<br />
TE –treatment effect<br />
EXT-effect <str<strong>on</strong>g>of</str<strong>on</strong>g> extraneous variables<br />
Therefore: O 1 - O 2 = TE + EXT – EXT = TE<br />
There is no pretest in the design which avoids the interactive effect or the<br />
influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit<br />
explanatory variable due to the passage <str<strong>on</strong>g>of</str<strong>on</strong>g> time. Further, it avoids the<br />
influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit<br />
explanatory variable, even in cross-secti<strong>on</strong> data.<br />
But two critical assumpti<strong>on</strong>s have to be made, based <strong>on</strong> the drawing <str<strong>on</strong>g>of</str<strong>on</strong>g> large<br />
enough samples and proper randomizati<strong>on</strong>, as follows:<br />
a) The random assignment <str<strong>on</strong>g>of</str<strong>on</strong>g> test units to the groups has resulted in the<br />
groups being approximately equal <strong>on</strong> the dependent variable before the<br />
presentati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the treatment to the experimental group.<br />
b) The test units withdrawing from the experiment while it is in progress affect<br />
each group in the same way.
C. Performance-m<strong>on</strong>itoring research design is an essential element in the<br />
c<strong>on</strong>trol <str<strong>on</strong>g>of</str<strong>on</strong>g> programs in accordance with plans. The purpose <str<strong>on</strong>g>of</str<strong>on</strong>g> the design is to<br />
achieve an early warning system to predict potential threats or opportunities<br />
(Wils<strong>on</strong>, 2004). The objectives <str<strong>on</strong>g>of</str<strong>on</strong>g> Performance-M<strong>on</strong>itoring Research Designs<br />
in m<strong>on</strong>itoring and reporting changes follow:<br />
a) In performance measures, to determine whether plans are accomplishing<br />
desired objectives<br />
b) In situati<strong>on</strong>al variables in the envir<strong>on</strong>ment, to determine whether the<br />
situati<strong>on</strong>al climate is as anticipated when plans were formulated.<br />
The sources <str<strong>on</strong>g>of</str<strong>on</strong>g> data that is proper for Performance-M<strong>on</strong>itoring Research<br />
Designs follows:<br />
a) Interview <str<strong>on</strong>g>of</str<strong>on</strong>g> resp<strong>on</strong>dents, b) Sec<strong>on</strong>dary data, and c) Observati<strong>on</strong><br />
Markovian Projecti<strong>on</strong> achieves an early warning system to predict potential<br />
threats or opportunities, as follows:<br />
Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong> Propensities to Gain and Future State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong><br />
Retain Status<br />
A B A B A B<br />
90% 10% Propensity Propensity 0% 100%<br />
To retain<br />
To Gain<br />
Status<br />
Status<br />
90% x 0% = 0% ; 90% x 100% = 90%<br />
Propensity<br />
To Gain<br />
Status<br />
Propensity<br />
To Retain<br />
Status<br />
10% x 0% = 0% ; 10% x 100% = 10%<br />
0% 100%<br />
Figure 1. MARKOVIAN PROJECTION<br />
The critical factor in the system is the informati<strong>on</strong> <strong>on</strong> the Propensities to Gain<br />
and Retain Status in Percentage.
Please observe that the outcome <str<strong>on</strong>g>of</str<strong>on</strong>g> the forecasted “Future State <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
Distributi<strong>on</strong>” does not dependent <strong>on</strong> the current historical informati<strong>on</strong> <strong>on</strong><br />
“Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong>” as the following dem<strong>on</strong>strates:<br />
Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong> Propensities to Gain and Future State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong><br />
Retain Status<br />
A B A B A B<br />
10% 90% Propensity Propensity 0% 100%<br />
To retain To Gain<br />
Status<br />
Status<br />
10% x 0% = 0% ; 10% x 100% = 10%<br />
Propensity Propensity<br />
To Gain To Retain<br />
Status Status<br />
90% x 0% = 0% ; 90% x 100% = 90%<br />
0% 100%<br />
Figure 2. MARKOVIAN PROJECTION<br />
II. For the research classificati<strong>on</strong>s according to the following:<br />
a) PURPOSE; namely: exploratory, c<strong>on</strong>clusive, and performance m<strong>on</strong>itoring<br />
researches; and<br />
b) METHOD <str<strong>on</strong>g>of</str<strong>on</strong>g> data collecti<strong>on</strong>-and-analysis can either be any <str<strong>on</strong>g>of</str<strong>on</strong>g> the following<br />
depending <strong>on</strong> their availability in addressing the research questi<strong>on</strong>s:<br />
i. Quantitative<br />
ii. Qualitative<br />
iii. A combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> Quantitative and Qualitative methods with the<br />
following parts:<br />
I) Introductory secti<strong>on</strong><br />
II) Research Procedure<br />
III) Research Outcomes:<br />
a. Discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> results in Qualitative research<br />
b. Analysis, Interpretati<strong>on</strong>, C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s<br />
in Quantitative research<br />
IV) C<strong>on</strong>clusi<strong>on</strong>s and recommendati<strong>on</strong>; the third questi<strong>on</strong> is <strong>on</strong> their<br />
APPLICATION.<br />
III. What are the possible APPLICATIONS <str<strong>on</strong>g>of</str<strong>on</strong>g> the two research classificati<strong>on</strong>s;<br />
namely: according to PURPOSE and METHOD in the following disciplines?<br />
a) Educati<strong>on</strong>, Arts, Sciences and<br />
b) <str<strong>on</strong>g>Management</str<strong>on</strong>g> (Business Administrati<strong>on</strong> and Public Administrati<strong>on</strong>)<br />
The research classificati<strong>on</strong>s, according to the following:<br />
a. <strong>Three</strong> decisi<strong>on</strong>-making phases, <str<strong>on</strong>g>of</str<strong>on</strong>g> exploratory, c<strong>on</strong>clusive, and<br />
performance-m<strong>on</strong>itoring researches (please see the preceding Classificati<strong>on</strong><br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, according to PURPOSE, in questi<strong>on</strong> no. I.)
. Method <str<strong>on</strong>g>of</str<strong>on</strong>g> data collecti<strong>on</strong>-and-analysis (please see the preceding<br />
Classificati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, according to METHOD, in questi<strong>on</strong> no. II.)<br />
are executed in <strong>on</strong>e or three <str<strong>on</strong>g>of</str<strong>on</strong>g> the following kinds <str<strong>on</strong>g>of</str<strong>on</strong>g> APPLICATIONS. Please<br />
see articulati<strong>on</strong> in the paragraph following item no. III.) Below (Yin, 2008):<br />
i) Acti<strong>on</strong> research<br />
ii) Evaluati<strong>on</strong> research<br />
iii) Dissertati<strong>on</strong>/thesis writing<br />
A) Acti<strong>on</strong> research in <str<strong>on</strong>g>Management</str<strong>on</strong>g>:<br />
ACTION RESEARCH GUIDELINES, Though CHED Memo Circular # 53,<br />
series <str<strong>on</strong>g>of</str<strong>on</strong>g> 2007, applies the c<strong>on</strong>duct <str<strong>on</strong>g>of</str<strong>on</strong>g> Acti<strong>on</strong> Research particularly for the<br />
Masters <str<strong>on</strong>g>of</str<strong>on</strong>g> Educati<strong>on</strong> in (pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al area), it can be a semester’s<br />
requirement for the <str<strong>on</strong>g>Management</str<strong>on</strong>g> courses as well. Acti<strong>on</strong> Research is “a form<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> applied research whose primary purpose is to increase the quality, impact,<br />
and justice <str<strong>on</strong>g>of</str<strong>on</strong>g>…pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als’ practice.” (Gall, 2007):<br />
1. Provide the pers<strong>on</strong>al, pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al, and political purposes you want the<br />
project to serve in designing an acti<strong>on</strong> research project.<br />
2. Determine the best research design methods in answering the research<br />
questi<strong>on</strong>/s according to purpose, such as exploratory, c<strong>on</strong>clusive, and<br />
performance-m<strong>on</strong>itoring research designs (Hoaglin and Mosteller and Tukey,<br />
2000).<br />
B) Evaluati<strong>on</strong> Research: (Rossi and Lipsey and Freeman, 2004)<br />
Another possible applicati<strong>on</strong> in <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> the three research designs <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
exploratory, c<strong>on</strong>clusive, and performance m<strong>on</strong>itoring research design is in<br />
Evaluati<strong>on</strong> Research. C<strong>on</strong>siderati<strong>on</strong>s for effective evaluati<strong>on</strong> follows :<br />
Utility –the extent to which the evaluati<strong>on</strong> is informative, timely, and useful to<br />
the affected pers<strong>on</strong>s.<br />
Feasibility –the extent to which the evaluati<strong>on</strong> design satisfies the following:<br />
a) Appropriate to the setting in which the study is to be c<strong>on</strong>ducted<br />
b) Cost - Effective.<br />
Propriety –the extent to which the evaluati<strong>on</strong> is c<strong>on</strong>ducted legally and<br />
ethically.<br />
Accuracy –the extent to which the evaluati<strong>on</strong> produces judgements <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
evaluated program’s worth which satisfies the following:<br />
a) Valid,<br />
b) Reliable, and<br />
c) Comprehensive.<br />
The following questi<strong>on</strong>s capture the c<strong>on</strong>siderati<strong>on</strong>s for effective evaluati<strong>on</strong>:<br />
i) How great is the need for the product?<br />
ii) How large and important is the market for the product?<br />
iii) How generalizable are the results <str<strong>on</strong>g>of</str<strong>on</strong>g> field tests <str<strong>on</strong>g>of</str<strong>on</strong>g> the product?<br />
iv) Did the field tests result in good data samples <str<strong>on</strong>g>of</str<strong>on</strong>g> all relevant user<br />
groups?
v) How thorough was the cost analysis for the product?<br />
vi) Were side-effects <str<strong>on</strong>g>of</str<strong>on</strong>g> the product diligently sought?<br />
vii) Were side-effects <str<strong>on</strong>g>of</str<strong>on</strong>g> the product diligently sought?<br />
viii)Were any <str<strong>on</strong>g>of</str<strong>on</strong>g> the standards in the following which were relevant during<br />
the product development process applied:<br />
a) Ethical<br />
b) Pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al and<br />
c) Research?<br />
ix) Was the research design used in the field trial sufficiently rigorous to<br />
determine that the product was the actual cause <str<strong>on</strong>g>of</str<strong>on</strong>g> any observed<br />
effects?<br />
x) How rigorous was the comparis<strong>on</strong> between the product and its<br />
competitors?<br />
xi) How appropriate were the statistical analyses <str<strong>on</strong>g>of</str<strong>on</strong>g> field-test results? And<br />
if statistical significance tests were d<strong>on</strong>e, did they yield significant<br />
results?<br />
xii) How great is the significance <str<strong>on</strong>g>of</str<strong>on</strong>g> the product in relevant disciplines?<br />
C) Dissertati<strong>on</strong> / Thesis Research<br />
The last but not the least applicati<strong>on</strong> in Educati<strong>on</strong>, Arts, Sciences, and<br />
<str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> the three research designs <str<strong>on</strong>g>of</str<strong>on</strong>g> exploratory, c<strong>on</strong>clusive, and<br />
performance m<strong>on</strong>itoring research design is in Dissertati<strong>on</strong>/thesis research<br />
writing.<br />
The basic difference between a dissertati<strong>on</strong> and a thesis is in their purposes.<br />
A dissertati<strong>on</strong> pushes the fr<strong>on</strong>tiers <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge while a thesis either<br />
rec<strong>on</strong>firms or invalidates a prior research c<strong>on</strong>clusi<strong>on</strong>.<br />
2. C<strong>on</strong>clusi<strong>on</strong><br />
Whatever research classificati<strong>on</strong>s are combined for implementati<strong>on</strong>; such as,<br />
classificati<strong>on</strong>s according to PURPOSE, METHOD, and APPLICATION, the<br />
format below has to be followed: an Introductory secti<strong>on</strong>, Research<br />
procedures, Research Outcomes, C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s:<br />
Introductory Secti<strong>on</strong><br />
1) The researcher explains his/her experience, orientati<strong>on</strong>, and expectati<strong>on</strong>s<br />
relevant to the problem being investigated and indicates how these factors<br />
might affect the results;<br />
2) Given the c<strong>on</strong>textual background, the research must be carried out<br />
currently in a real-life setting;<br />
3) Determine whether any research traditi<strong>on</strong>s shall be used as a basis for the<br />
study, and if so, they should be used appropriately in the definiti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
research problem and in the collecti<strong>on</strong>, analysis, and interpretati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
data;
Research Procedures<br />
1) Specify a preliminary plan for the study and be ready to modify the plan as<br />
needed in resp<strong>on</strong>se to analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> data early in the study;<br />
2) Use a random sampling strategy to select participants to the research<br />
questi<strong>on</strong> and the definiti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the phenomen<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> interest but be ready to<br />
shift to purposeful sampling when resp<strong>on</strong>dents do not appear for interview<br />
despite repeated attempts to reach them; this shift in sampling procedure<br />
will change the generalizing procedure from deducti<strong>on</strong> (starts with a<br />
theoretical or c<strong>on</strong>ceptual guideline in collecting particular data to prove<br />
the validity <str<strong>on</strong>g>of</str<strong>on</strong>g> the theory) to inducti<strong>on</strong>(from particular cases towards the<br />
derivati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a general pattern or theory <str<strong>on</strong>g>of</str<strong>on</strong>g> social behaviour).<br />
3) Use the data-collecti<strong>on</strong> method/s suitable to the intended purpose (such<br />
as either through interview, or through observati<strong>on</strong>, or through sec<strong>on</strong>darydata<br />
collecti<strong>on</strong> from documents);<br />
4) Allow sufficient time-frame for data collecti<strong>on</strong> so that an in-depth study <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
the research questi<strong>on</strong> can be made;<br />
5) Use strategies that will ensure c<strong>on</strong>sistency across observers or other data<br />
collectors that would dem<strong>on</strong>strate agreement am<strong>on</strong>g observers in their<br />
observati<strong>on</strong>s; particularly the fit between the data and what occurs in the<br />
setting under study.<br />
6) Use quantitative data, if it can be obtained, whenever appropriate to<br />
understanding the research problem or questi<strong>on</strong>; specially when the<br />
quantitative comments as to expected research findings are identified by<br />
catch phrases or words, such as “more than”, significant”, “extremely”, “not<br />
very much”, etc.<br />
7) Examine whether quantitative measures can be used to document the<br />
preceding catch phrases or words in terms <str<strong>on</strong>g>of</str<strong>on</strong>g> data that indicate means,<br />
standard deviati<strong>on</strong>s, correlati<strong>on</strong>s, and predictability coming from<br />
regressi<strong>on</strong>;<br />
8) See to it that various data-collecti<strong>on</strong> methods or sources <str<strong>on</strong>g>of</str<strong>on</strong>g> data are used<br />
and compared to c<strong>on</strong>firm or clarify the key findings <str<strong>on</strong>g>of</str<strong>on</strong>g> the study;<br />
Research Outcomes<br />
In this secti<strong>on</strong>, a discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the following should include:<br />
1) Discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> results in Qualitative research, guided by the following:<br />
a) See to it that the written report makes clear each research procedure<br />
used and the order in which they occurred so that it would be possible<br />
for other researchers to replicate the study;<br />
b) See to it that the written report includes sufficient quotati<strong>on</strong>s or<br />
summary comments from the research participants/resp<strong>on</strong>dents in<br />
order to clarify (emic) their perspective<br />
c) Check the findings with members before finalizing the written report;<br />
d) Check whether you, as the researcher, have summarized your<br />
pers<strong>on</strong>al reacti<strong>on</strong> to the findings or have compared (etic) your<br />
perspective <strong>on</strong> the phenomen<strong>on</strong> studied to those <str<strong>on</strong>g>of</str<strong>on</strong>g> research<br />
participants or resp<strong>on</strong>dents;<br />
2) Research results in Quantitative research, which c<strong>on</strong>tains ways to:<br />
-Identify how you interpreted the findings and whether you c<strong>on</strong>sidered<br />
alternative interpretati<strong>on</strong>s;
C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s<br />
This secti<strong>on</strong> should c<strong>on</strong>tain a discussi<strong>on</strong> <strong>on</strong> the type <str<strong>on</strong>g>of</str<strong>on</strong>g> research selected,<br />
guided by the following:<br />
1. Qualitative research may end-up with no c<strong>on</strong>clusi<strong>on</strong> as to an emergent<br />
theory when the observati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the participants do not harm<strong>on</strong>ize with those<br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> the researcher [the emic and the etic are irrec<strong>on</strong>cilable] (Altheide and<br />
Johns<strong>on</strong>, 1998)<br />
2. In Quantitative research, pay attenti<strong>on</strong> to the following:<br />
a) C<strong>on</strong>clusi<strong>on</strong>s are supported by the data and its analysis;<br />
b) Determine how the research findings can be applied to other settings<br />
or types <str<strong>on</strong>g>of</str<strong>on</strong>g> research participants/resp<strong>on</strong>dents; and give justificati<strong>on</strong> for<br />
said extensi<strong>on</strong>;<br />
c) Draw reas<strong>on</strong>able implicati<strong>on</strong>s for practice and future research and see<br />
whether such implicati<strong>on</strong>s are justified by the research findings.<br />
3. In Qualitative research, include a reflecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the acti<strong>on</strong> research process<br />
via autobiographical narrative/s or journaling by making a pers<strong>on</strong>al <strong>on</strong>going<br />
written record as the researcher regarding a specific domain that could be<br />
broad and open-ended or <strong>on</strong> a specific topic.<br />
4. Apply Gary Anders<strong>on</strong> and Kathryn Herr’s validity tests as follows (Anders<strong>on</strong><br />
and Herr, 1999):<br />
a) Outcome validity test -extent to which new acti<strong>on</strong>s lead to a resoluti<strong>on</strong><br />
<str<strong>on</strong>g>of</str<strong>on</strong>g> the problem that prompted the project;<br />
b) Process validity test -the adequacy <str<strong>on</strong>g>of</str<strong>on</strong>g> the processes used in different<br />
phases <str<strong>on</strong>g>of</str<strong>on</strong>g> the project so as to protect the findings from bias such as in<br />
data collecti<strong>on</strong>, analysis, and interpretati<strong>on</strong>; and also whether<br />
triangulati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> data sources and methods were used so that<br />
corroborative evidence for the validity <str<strong>on</strong>g>of</str<strong>on</strong>g> the qualitative research<br />
findings are obtained from a multiplicity <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />
i) Data-collecti<strong>on</strong> methods,<br />
ii) Data sources Analysts, or<br />
iii) Theories.<br />
c) Democratic validity test -the extent to which the perspectives and<br />
interests <str<strong>on</strong>g>of</str<strong>on</strong>g> all stakeholders were taken into account;<br />
d) Catalytic validity test -the extent to which the project causes<br />
stakeholders to transform their view <str<strong>on</strong>g>of</str<strong>on</strong>g> reality in relati<strong>on</strong> to their<br />
pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al practice;<br />
e) Dialogic validity test -the extent to which colleagues shared in the<br />
development <str<strong>on</strong>g>of</str<strong>on</strong>g> the practiti<strong>on</strong>er/researcher’s findings and<br />
interpretati<strong>on</strong>s.<br />
5. C<strong>on</strong>tinue or modify the acti<strong>on</strong> research project depending <strong>on</strong> the results <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
acti<strong>on</strong> taken based <strong>on</strong> the earlier results or findings <str<strong>on</strong>g>of</str<strong>on</strong>g> the research project.<br />
6. Reduce the discrepancy between the practiti<strong>on</strong>er-researchers’ espoused<br />
theories or “the pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als” beliefs about how they deal with problems <str<strong>on</strong>g>of</str<strong>on</strong>g><br />
practice” and theories-in-acti<strong>on</strong> or “the actual behaviour <str<strong>on</strong>g>of</str<strong>on</strong>g> pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als as<br />
they engage in their work”.<br />
7. Suggest strategies for dealing with the unique ethical issues in acti<strong>on</strong><br />
research such as the extent <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge <str<strong>on</strong>g>of</str<strong>on</strong>g> participants’ knowledge <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />
c<strong>on</strong>sequential risks involved <strong>on</strong> their lives <str<strong>on</strong>g>of</str<strong>on</strong>g> the research project --either in<br />
processes involved or the resulting findings or in both.
8. Help other researchers determine to what extent your findings fit their<br />
situati<strong>on</strong> by properly designing and reporting the results <str<strong>on</strong>g>of</str<strong>on</strong>g> the acti<strong>on</strong><br />
research.<br />
3. Recommendati<strong>on</strong><br />
As can be gleaned from the preceding discussi<strong>on</strong>s, an appropriate format<br />
must c<strong>on</strong>tain elements <str<strong>on</strong>g>of</str<strong>on</strong>g> both quantitative and qualitative methods for<br />
purposes <str<strong>on</strong>g>of</str<strong>on</strong>g> better triangulati<strong>on</strong> following any <str<strong>on</strong>g>of</str<strong>on</strong>g> the below-listed fourth<br />
typology <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>Studies</str<strong>on</strong>g> resulting from the c<strong>on</strong>vergence <str<strong>on</strong>g>of</str<strong>on</strong>g> the three<br />
classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> PURPOSE, METHOD, and APPLICATION:<br />
i) Experimental Research<br />
ii) Causal-Comparative Research<br />
iii) Case Study<br />
iv) C<strong>on</strong>tent Analysis<br />
v) Correlati<strong>on</strong>al Research<br />
vi) Historical Research<br />
Reference<br />
Altheide, D.L & Johns<strong>on</strong>, J. M. (1998), Criteria for assessing interpretive<br />
validity in qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.),<br />
Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> qualitative research (pp.485-499), Thousand Oaks, CA”Sage.<br />
Anders<strong>on</strong>, G. and Herr, K., (1999). The new paradigm wars: Is there room for<br />
rigorous practiti<strong>on</strong>er knowledge in schools and universities? Educati<strong>on</strong>al<br />
Research, 28(5),12 – 21, 40.<br />
Cohen, J. (1988) Statistical power analysis for the behavioural sciences (2 nd<br />
ed.) Mahwah,NJ: Erlbaum.<br />
Gall,M. D. Joyce P. Gall, Walter R. Borg, (2007). Educati<strong>on</strong>al Research,<br />
Bost<strong>on</strong>: Pears<strong>on</strong>.<br />
Hoaglin D.C, Mosteller, F. & Tukey, J. (2000). Understanding robust and<br />
exploratory data analysis, New York: Wiley.<br />
Leinhardt,G., Leinhardt, S.(1980). Exploratory data analysis: new tools for the<br />
analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> empirical data. In D.C. Berliner, Review <str<strong>on</strong>g>of</str<strong>on</strong>g> Research in<br />
Educati<strong>on</strong> (Vol.8, pp.85-157, Washingt<strong>on</strong>,D.C.:American Educati<strong>on</strong>al<br />
Research Associati<strong>on</strong>.<br />
Patrick, B.C. Hisley, J. and Kempler,T. (2000). “What’s everybody so excited<br />
about? The effects <str<strong>on</strong>g>of</str<strong>on</strong>g> teacher enthusiasm <strong>on</strong> student intrinsic motivati<strong>on</strong> and<br />
vitality, Journal <str<strong>on</strong>g>of</str<strong>on</strong>g> Experimental Educati<strong>on</strong>, 68,217-236<br />
Rossi, P.H., Lipsey,M and Freeman, H.E. (2004), Evaluati<strong>on</strong>: A systematic<br />
approach. Thousand Oaks, CA: Sage.<br />
Silverman, D. (2005). Analyzing talk and text, In N. K. Denzin and Y. S.<br />
Lincoln (Eds.), Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> qualitative research (2 nd ed., pp.821-834) CA:<br />
Sage.<br />
Singer,D. J. D., and Willett,J.B. (2003) Applied l<strong>on</strong>gitudinal data analysis:<br />
Modeling change and event occurrence. New York: Oxford University Press.<br />
Wils<strong>on</strong>,M. (2004).C<strong>on</strong>structing measures: An item resp<strong>on</strong>se modeling<br />
approach, Mahwah, NJ: Erlbaum.<br />
Yin, R.K. (2008) Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> Applied Research, CA: Sage.