29.11.2014 Views

A Typology of Management Studies Based on Three Classifications ...

A Typology of Management Studies Based on Three Classifications ...

A Typology of Management Studies Based on Three Classifications ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

A <str<strong>on</strong>g>Typology</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>Studies</str<strong>on</strong>g> <str<strong>on</strong>g>Based</str<strong>on</strong>g> <strong>on</strong> <strong>Three</strong><br />

Classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches According To Purpose,<br />

Method, and Applicati<strong>on</strong><br />

Malek Elahi* and Massoud Dehdashti**<br />

There are a number <str<strong>on</strong>g>of</str<strong>on</strong>g> classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> researches such as to<br />

purpose, method, and applicati<strong>on</strong>. However, a number <str<strong>on</strong>g>of</str<strong>on</strong>g> researches<br />

do not fall squarely <strong>on</strong> any <str<strong>on</strong>g>of</str<strong>on</strong>g> the abovementi<strong>on</strong>ed classificati<strong>on</strong>s;<br />

hence, a manner <str<strong>on</strong>g>of</str<strong>on</strong>g> classifying the said researches to a group is<br />

needed by simply listing them as bel<strong>on</strong>ging to a typology such as the<br />

following:<br />

i) Experimental Research<br />

ii) Causal-Comparative Research<br />

iii) Case Study<br />

iv) C<strong>on</strong>tent Analysis<br />

v) Correlati<strong>on</strong>al Research<br />

vi) Historical Research<br />

Keywords: Classificati<strong>on</strong> according to purpose, method, and applicati<strong>on</strong>,<br />

<str<strong>on</strong>g>Typology</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, Experimental Research, C<strong>on</strong>tent Analysis, Historical<br />

Research.<br />

1. Introducti<strong>on</strong><br />

I. What are the c<strong>on</strong>tents <str<strong>on</strong>g>of</str<strong>on</strong>g> researches, classified according to purpose or<br />

where the researcher may find himself/herself to be situated am<strong>on</strong>g the three<br />

stages in the decisi<strong>on</strong>-making process; namely: explorati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> dependent and<br />

independent variables, establishing c<strong>on</strong>clusi<strong>on</strong>s based <strong>on</strong> the explored<br />

variables, and performance-m<strong>on</strong>itoring <str<strong>on</strong>g>of</str<strong>on</strong>g> the dependent variable using the<br />

explanatory independent variables?<br />

Researches can be classified according to Purpose or Stage in the Decisi<strong>on</strong>-<br />

Making Process; it is claimed that the research purpose or stage in the<br />

decisi<strong>on</strong>-making process, determines the characteristics desired in the<br />

research design (Silverman, 2005).<br />

*Pr<str<strong>on</strong>g>of</str<strong>on</strong>g>. Malek Elahi, Head <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> Group, PN University South - East Asia, Kuala<br />

Lumpur, Malaysia, Email: elahi_ac_edu@yahoo.com<br />

**Massoud Dehdashti, Ec<strong>on</strong>omics Department, Islamic Azad University, Dashtestan, Iran,<br />

Email: dehdashti@diau.ac.ir


If we may repeat, research purposes --it is claimed-- depend <strong>on</strong> the phases<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> the decisi<strong>on</strong>-making process for which informati<strong>on</strong> is needed and<br />

accordingly yields three types <str<strong>on</strong>g>of</str<strong>on</strong>g> research designs; namely:<br />

a) Exploratory,<br />

b) C<strong>on</strong>clusive<br />

c) Performance-m<strong>on</strong>itoring research design.<br />

A. Exploratory research design<br />

The central purpose is to formulate hypotheses regarding potential problems<br />

and opportunities present in the decisi<strong>on</strong> situati<strong>on</strong>. The hypotheses can be<br />

tested at a later phase with a c<strong>on</strong>clusive research design (Leinhardt and<br />

Leinhardt, 1980).<br />

Exploratory research design applies when the research objectives include the<br />

following:<br />

a. identifying problems (threats or opportunities)<br />

b. developing a more precise formulati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a vaguely identified<br />

problem(threat or opportunity)<br />

c. gaining perspective regarding the breath <str<strong>on</strong>g>of</str<strong>on</strong>g> variables operating in a<br />

situati<strong>on</strong><br />

d. establishing priorities regarding the potential significance <str<strong>on</strong>g>of</str<strong>on</strong>g> various<br />

problems (threats or opportunities)<br />

e. gaining management and researcher perspective c<strong>on</strong>cerning the<br />

character <str<strong>on</strong>g>of</str<strong>on</strong>g> the problem situati<strong>on</strong><br />

f. identifying and formulating alternative courses <str<strong>on</strong>g>of</str<strong>on</strong>g> acti<strong>on</strong>; and<br />

g. gathering informati<strong>on</strong> <strong>on</strong> the problems associated with doing c<strong>on</strong>clusive<br />

research.<br />

h. identificati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> problems (threats or opportunities) can be assisted<br />

through the following:<br />

i) Searching sec<strong>on</strong>dary sources<br />

ii) Interviewing knowledgeable pers<strong>on</strong>s<br />

iii) Compiling case histories.<br />

B. C<strong>on</strong>clusive research design<br />

Provides informati<strong>on</strong> for the evaluati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> alternative courses <str<strong>on</strong>g>of</str<strong>on</strong>g> acti<strong>on</strong> .The<br />

sub-classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> c<strong>on</strong>clusive research design follows (Singer and Willett,<br />

2003):<br />

a. Descriptive Research<br />

i) Cross-secti<strong>on</strong>al design –takes a sample <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong> at <strong>on</strong>e point in<br />

time<br />

ii) L<strong>on</strong>gitudinal design –describes changes in a sample’s characteristic<br />

over a period <str<strong>on</strong>g>of</str<strong>on</strong>g> time<br />

b. Causal Research<br />

Descriptive Research relies heavily <strong>on</strong> interview <str<strong>on</strong>g>of</str<strong>on</strong>g> resp<strong>on</strong>dents and data<br />

available in sec<strong>on</strong>dary data sources. Descriptive research is proper when the<br />

research objectives include the following:<br />

i) Portraying the characteristics <str<strong>on</strong>g>of</str<strong>on</strong>g> a social or physical phenomena and<br />

determining the frequency <str<strong>on</strong>g>of</str<strong>on</strong>g> occurrence


ii) Determining the degree to which the variables are associated (however,<br />

cause-and-effect relati<strong>on</strong>ships, discussed under causal research design,<br />

are different from measurements <str<strong>on</strong>g>of</str<strong>on</strong>g> degrees <str<strong>on</strong>g>of</str<strong>on</strong>g> associati<strong>on</strong> in descriptive<br />

research design)<br />

iii) Making predicti<strong>on</strong>s regarding the occurrence <str<strong>on</strong>g>of</str<strong>on</strong>g> social or physical<br />

phenomena.<br />

Causal Research relies <strong>on</strong> interviews and in the c<strong>on</strong>duct <str<strong>on</strong>g>of</str<strong>on</strong>g> experiments.<br />

Causal research is proper when the research objective is to identify variables<br />

that cause the phenomen<strong>on</strong> being predicted and understand why they cause<br />

what is being predicted. A suspected variable that predicts an identified<br />

phenomen<strong>on</strong> must be freed <str<strong>on</strong>g>of</str<strong>on</strong>g> other variables that pollute it by doing either<br />

<strong>on</strong>e <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />

i) Avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> time that tends to combine other factors with the<br />

suspected variable as it influences the phenomen<strong>on</strong> being predicted by using<br />

a cross-secti<strong>on</strong>al design that gathers data as <str<strong>on</strong>g>of</str<strong>on</strong>g> a point in time (so as to<br />

”purify” a specific explanatory variable <str<strong>on</strong>g>of</str<strong>on</strong>g> accreti<strong>on</strong>s arising from the passage<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> time);<br />

ii) If a l<strong>on</strong>gitudinal data cannot be avoided, at least achieve stability and hence<br />

predictability in the relati<strong>on</strong>ship between the suspected explanatory variable<br />

and the phenomen<strong>on</strong> to be predicted by invoking the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large numbers<br />

which asserts that regardless <str<strong>on</strong>g>of</str<strong>on</strong>g> the distributi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong> am<strong>on</strong>g the<br />

values <str<strong>on</strong>g>of</str<strong>on</strong>g> the suspected explanatory variable, the mean <str<strong>on</strong>g>of</str<strong>on</strong>g> the sampling<br />

means tends towards a normal distributi<strong>on</strong>. The mean <str<strong>on</strong>g>of</str<strong>on</strong>g> a normal distributi<strong>on</strong><br />

equals the mean <str<strong>on</strong>g>of</str<strong>on</strong>g> a student-t distributi<strong>on</strong>; hence, what is important here, is it<br />

reduces finding the partners-in-a-descripti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a populati<strong>on</strong> (the mean and<br />

the standard deviati<strong>on</strong>) by looking for its margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error <strong>on</strong>ly (since the mean<br />

is already given) through the statement <str<strong>on</strong>g>of</str<strong>on</strong>g> the researcher regarding his/her<br />

desired c<strong>on</strong>fidence level and desired margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error in determining the<br />

desired sample size given the following equati<strong>on</strong> (Cohen, 1988).<br />

s 2 z 2<br />

Desired sample size “n” = _____<br />

e 2<br />

Where:<br />

s –the standard error <str<strong>on</strong>g>of</str<strong>on</strong>g> the pilot sample arbitrarily chosen by the researcher,<br />

when there is no standard deviati<strong>on</strong> given in a census <str<strong>on</strong>g>of</str<strong>on</strong>g> the populati<strong>on</strong><br />

z –the equivalent in a standardized renditi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a normal distributi<strong>on</strong>, <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

c<strong>on</strong>fidence level desired by the researcher<br />

e –the desired margin-<str<strong>on</strong>g>of</str<strong>on</strong>g>-error from the true mean<br />

Please note that the standard error <str<strong>on</strong>g>of</str<strong>on</strong>g> the pilot sample is essential in this<br />

computati<strong>on</strong>. The inability to avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> time as it pollutes an<br />

explanatory variable such as in l<strong>on</strong>gitudinal data can be remedied by invoking<br />

the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large numbers. Another inability to avoid the influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another<br />

factor <strong>on</strong> the dependent variable, hidden in the explicit explanatory variable,<br />

even in cross-secti<strong>on</strong> data can be minimized by also invoking the law <str<strong>on</strong>g>of</str<strong>on</strong>g> large<br />

numbers.


Post Test-Only C<strong>on</strong>trol Group Design (Patrick and Hisley and Kempler, 2000).<br />

The Solom<strong>on</strong> Four-Group Design c<strong>on</strong>trols the inability to avoid the influence<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit explanatory<br />

variable, even in cross-secti<strong>on</strong> data. Unfortunately, time, effort, and cost<br />

necessary in c<strong>on</strong>ducting the experiment outweighs the benefits particularly<br />

the time involved so that by the time the results are out, time has introduced<br />

changes in the alleged “pure” explanatory factors.<br />

A smaller design was needed for a relatively faster turn out <str<strong>on</strong>g>of</str<strong>on</strong>g> results before<br />

time takes it toll <strong>on</strong> an allegedly “pure” explanatory variable. And such a<br />

design is the Posttest-Only C<strong>on</strong>trol Group Design as follows:<br />

Experimental group: R X O 1<br />

C<strong>on</strong>trol group : R O 2<br />

Where:<br />

R –indicates that individuals have been assigned at random to separate<br />

treatment groups (random selecti<strong>on</strong>) or that groups themselves have been<br />

allocated at random to separate treatments (random assignment).<br />

X –represents the exposure <str<strong>on</strong>g>of</str<strong>on</strong>g> a test group to an experimental treatment, the<br />

effects <str<strong>on</strong>g>of</str<strong>on</strong>g> which are to be determined.<br />

O –refers to processes <str<strong>on</strong>g>of</str<strong>on</strong>g> observati<strong>on</strong> or measurement <str<strong>on</strong>g>of</str<strong>on</strong>g> the dependent<br />

variable <strong>on</strong> the test units.<br />

Here the O 1 and the O 2 measurements are composed <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />

O 1 = TE + EXT<br />

O 2 = EXT<br />

Where:<br />

TE –treatment effect<br />

EXT-effect <str<strong>on</strong>g>of</str<strong>on</strong>g> extraneous variables<br />

Therefore: O 1 - O 2 = TE + EXT – EXT = TE<br />

There is no pretest in the design which avoids the interactive effect or the<br />

influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit<br />

explanatory variable due to the passage <str<strong>on</strong>g>of</str<strong>on</strong>g> time. Further, it avoids the<br />

influence <str<strong>on</strong>g>of</str<strong>on</strong>g> another factor <strong>on</strong> the dependent variable, hidden in the explicit<br />

explanatory variable, even in cross-secti<strong>on</strong> data.<br />

But two critical assumpti<strong>on</strong>s have to be made, based <strong>on</strong> the drawing <str<strong>on</strong>g>of</str<strong>on</strong>g> large<br />

enough samples and proper randomizati<strong>on</strong>, as follows:<br />

a) The random assignment <str<strong>on</strong>g>of</str<strong>on</strong>g> test units to the groups has resulted in the<br />

groups being approximately equal <strong>on</strong> the dependent variable before the<br />

presentati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the treatment to the experimental group.<br />

b) The test units withdrawing from the experiment while it is in progress affect<br />

each group in the same way.


C. Performance-m<strong>on</strong>itoring research design is an essential element in the<br />

c<strong>on</strong>trol <str<strong>on</strong>g>of</str<strong>on</strong>g> programs in accordance with plans. The purpose <str<strong>on</strong>g>of</str<strong>on</strong>g> the design is to<br />

achieve an early warning system to predict potential threats or opportunities<br />

(Wils<strong>on</strong>, 2004). The objectives <str<strong>on</strong>g>of</str<strong>on</strong>g> Performance-M<strong>on</strong>itoring Research Designs<br />

in m<strong>on</strong>itoring and reporting changes follow:<br />

a) In performance measures, to determine whether plans are accomplishing<br />

desired objectives<br />

b) In situati<strong>on</strong>al variables in the envir<strong>on</strong>ment, to determine whether the<br />

situati<strong>on</strong>al climate is as anticipated when plans were formulated.<br />

The sources <str<strong>on</strong>g>of</str<strong>on</strong>g> data that is proper for Performance-M<strong>on</strong>itoring Research<br />

Designs follows:<br />

a) Interview <str<strong>on</strong>g>of</str<strong>on</strong>g> resp<strong>on</strong>dents, b) Sec<strong>on</strong>dary data, and c) Observati<strong>on</strong><br />

Markovian Projecti<strong>on</strong> achieves an early warning system to predict potential<br />

threats or opportunities, as follows:<br />

Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong> Propensities to Gain and Future State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong><br />

Retain Status<br />

A B A B A B<br />

90% 10% Propensity Propensity 0% 100%<br />

To retain<br />

To Gain<br />

Status<br />

Status<br />

90% x 0% = 0% ; 90% x 100% = 90%<br />

Propensity<br />

To Gain<br />

Status<br />

Propensity<br />

To Retain<br />

Status<br />

10% x 0% = 0% ; 10% x 100% = 10%<br />

0% 100%<br />

Figure 1. MARKOVIAN PROJECTION<br />

The critical factor in the system is the informati<strong>on</strong> <strong>on</strong> the Propensities to Gain<br />

and Retain Status in Percentage.


Please observe that the outcome <str<strong>on</strong>g>of</str<strong>on</strong>g> the forecasted “Future State <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

Distributi<strong>on</strong>” does not dependent <strong>on</strong> the current historical informati<strong>on</strong> <strong>on</strong><br />

“Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong>” as the following dem<strong>on</strong>strates:<br />

Present State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong> Propensities to Gain and Future State <str<strong>on</strong>g>of</str<strong>on</strong>g> Distributi<strong>on</strong><br />

Retain Status<br />

A B A B A B<br />

10% 90% Propensity Propensity 0% 100%<br />

To retain To Gain<br />

Status<br />

Status<br />

10% x 0% = 0% ; 10% x 100% = 10%<br />

Propensity Propensity<br />

To Gain To Retain<br />

Status Status<br />

90% x 0% = 0% ; 90% x 100% = 90%<br />

0% 100%<br />

Figure 2. MARKOVIAN PROJECTION<br />

II. For the research classificati<strong>on</strong>s according to the following:<br />

a) PURPOSE; namely: exploratory, c<strong>on</strong>clusive, and performance m<strong>on</strong>itoring<br />

researches; and<br />

b) METHOD <str<strong>on</strong>g>of</str<strong>on</strong>g> data collecti<strong>on</strong>-and-analysis can either be any <str<strong>on</strong>g>of</str<strong>on</strong>g> the following<br />

depending <strong>on</strong> their availability in addressing the research questi<strong>on</strong>s:<br />

i. Quantitative<br />

ii. Qualitative<br />

iii. A combinati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> Quantitative and Qualitative methods with the<br />

following parts:<br />

I) Introductory secti<strong>on</strong><br />

II) Research Procedure<br />

III) Research Outcomes:<br />

a. Discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> results in Qualitative research<br />

b. Analysis, Interpretati<strong>on</strong>, C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s<br />

in Quantitative research<br />

IV) C<strong>on</strong>clusi<strong>on</strong>s and recommendati<strong>on</strong>; the third questi<strong>on</strong> is <strong>on</strong> their<br />

APPLICATION.<br />

III. What are the possible APPLICATIONS <str<strong>on</strong>g>of</str<strong>on</strong>g> the two research classificati<strong>on</strong>s;<br />

namely: according to PURPOSE and METHOD in the following disciplines?<br />

a) Educati<strong>on</strong>, Arts, Sciences and<br />

b) <str<strong>on</strong>g>Management</str<strong>on</strong>g> (Business Administrati<strong>on</strong> and Public Administrati<strong>on</strong>)<br />

The research classificati<strong>on</strong>s, according to the following:<br />

a. <strong>Three</strong> decisi<strong>on</strong>-making phases, <str<strong>on</strong>g>of</str<strong>on</strong>g> exploratory, c<strong>on</strong>clusive, and<br />

performance-m<strong>on</strong>itoring researches (please see the preceding Classificati<strong>on</strong><br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, according to PURPOSE, in questi<strong>on</strong> no. I.)


. Method <str<strong>on</strong>g>of</str<strong>on</strong>g> data collecti<strong>on</strong>-and-analysis (please see the preceding<br />

Classificati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> Researches, according to METHOD, in questi<strong>on</strong> no. II.)<br />

are executed in <strong>on</strong>e or three <str<strong>on</strong>g>of</str<strong>on</strong>g> the following kinds <str<strong>on</strong>g>of</str<strong>on</strong>g> APPLICATIONS. Please<br />

see articulati<strong>on</strong> in the paragraph following item no. III.) Below (Yin, 2008):<br />

i) Acti<strong>on</strong> research<br />

ii) Evaluati<strong>on</strong> research<br />

iii) Dissertati<strong>on</strong>/thesis writing<br />

A) Acti<strong>on</strong> research in <str<strong>on</strong>g>Management</str<strong>on</strong>g>:<br />

ACTION RESEARCH GUIDELINES, Though CHED Memo Circular # 53,<br />

series <str<strong>on</strong>g>of</str<strong>on</strong>g> 2007, applies the c<strong>on</strong>duct <str<strong>on</strong>g>of</str<strong>on</strong>g> Acti<strong>on</strong> Research particularly for the<br />

Masters <str<strong>on</strong>g>of</str<strong>on</strong>g> Educati<strong>on</strong> in (pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al area), it can be a semester’s<br />

requirement for the <str<strong>on</strong>g>Management</str<strong>on</strong>g> courses as well. Acti<strong>on</strong> Research is “a form<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> applied research whose primary purpose is to increase the quality, impact,<br />

and justice <str<strong>on</strong>g>of</str<strong>on</strong>g>…pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als’ practice.” (Gall, 2007):<br />

1. Provide the pers<strong>on</strong>al, pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al, and political purposes you want the<br />

project to serve in designing an acti<strong>on</strong> research project.<br />

2. Determine the best research design methods in answering the research<br />

questi<strong>on</strong>/s according to purpose, such as exploratory, c<strong>on</strong>clusive, and<br />

performance-m<strong>on</strong>itoring research designs (Hoaglin and Mosteller and Tukey,<br />

2000).<br />

B) Evaluati<strong>on</strong> Research: (Rossi and Lipsey and Freeman, 2004)<br />

Another possible applicati<strong>on</strong> in <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> the three research designs <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

exploratory, c<strong>on</strong>clusive, and performance m<strong>on</strong>itoring research design is in<br />

Evaluati<strong>on</strong> Research. C<strong>on</strong>siderati<strong>on</strong>s for effective evaluati<strong>on</strong> follows :<br />

Utility –the extent to which the evaluati<strong>on</strong> is informative, timely, and useful to<br />

the affected pers<strong>on</strong>s.<br />

Feasibility –the extent to which the evaluati<strong>on</strong> design satisfies the following:<br />

a) Appropriate to the setting in which the study is to be c<strong>on</strong>ducted<br />

b) Cost - Effective.<br />

Propriety –the extent to which the evaluati<strong>on</strong> is c<strong>on</strong>ducted legally and<br />

ethically.<br />

Accuracy –the extent to which the evaluati<strong>on</strong> produces judgements <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

evaluated program’s worth which satisfies the following:<br />

a) Valid,<br />

b) Reliable, and<br />

c) Comprehensive.<br />

The following questi<strong>on</strong>s capture the c<strong>on</strong>siderati<strong>on</strong>s for effective evaluati<strong>on</strong>:<br />

i) How great is the need for the product?<br />

ii) How large and important is the market for the product?<br />

iii) How generalizable are the results <str<strong>on</strong>g>of</str<strong>on</strong>g> field tests <str<strong>on</strong>g>of</str<strong>on</strong>g> the product?<br />

iv) Did the field tests result in good data samples <str<strong>on</strong>g>of</str<strong>on</strong>g> all relevant user<br />

groups?


v) How thorough was the cost analysis for the product?<br />

vi) Were side-effects <str<strong>on</strong>g>of</str<strong>on</strong>g> the product diligently sought?<br />

vii) Were side-effects <str<strong>on</strong>g>of</str<strong>on</strong>g> the product diligently sought?<br />

viii)Were any <str<strong>on</strong>g>of</str<strong>on</strong>g> the standards in the following which were relevant during<br />

the product development process applied:<br />

a) Ethical<br />

b) Pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al and<br />

c) Research?<br />

ix) Was the research design used in the field trial sufficiently rigorous to<br />

determine that the product was the actual cause <str<strong>on</strong>g>of</str<strong>on</strong>g> any observed<br />

effects?<br />

x) How rigorous was the comparis<strong>on</strong> between the product and its<br />

competitors?<br />

xi) How appropriate were the statistical analyses <str<strong>on</strong>g>of</str<strong>on</strong>g> field-test results? And<br />

if statistical significance tests were d<strong>on</strong>e, did they yield significant<br />

results?<br />

xii) How great is the significance <str<strong>on</strong>g>of</str<strong>on</strong>g> the product in relevant disciplines?<br />

C) Dissertati<strong>on</strong> / Thesis Research<br />

The last but not the least applicati<strong>on</strong> in Educati<strong>on</strong>, Arts, Sciences, and<br />

<str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>of</str<strong>on</strong>g> the three research designs <str<strong>on</strong>g>of</str<strong>on</strong>g> exploratory, c<strong>on</strong>clusive, and<br />

performance m<strong>on</strong>itoring research design is in Dissertati<strong>on</strong>/thesis research<br />

writing.<br />

The basic difference between a dissertati<strong>on</strong> and a thesis is in their purposes.<br />

A dissertati<strong>on</strong> pushes the fr<strong>on</strong>tiers <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge while a thesis either<br />

rec<strong>on</strong>firms or invalidates a prior research c<strong>on</strong>clusi<strong>on</strong>.<br />

2. C<strong>on</strong>clusi<strong>on</strong><br />

Whatever research classificati<strong>on</strong>s are combined for implementati<strong>on</strong>; such as,<br />

classificati<strong>on</strong>s according to PURPOSE, METHOD, and APPLICATION, the<br />

format below has to be followed: an Introductory secti<strong>on</strong>, Research<br />

procedures, Research Outcomes, C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s:<br />

Introductory Secti<strong>on</strong><br />

1) The researcher explains his/her experience, orientati<strong>on</strong>, and expectati<strong>on</strong>s<br />

relevant to the problem being investigated and indicates how these factors<br />

might affect the results;<br />

2) Given the c<strong>on</strong>textual background, the research must be carried out<br />

currently in a real-life setting;<br />

3) Determine whether any research traditi<strong>on</strong>s shall be used as a basis for the<br />

study, and if so, they should be used appropriately in the definiti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

research problem and in the collecti<strong>on</strong>, analysis, and interpretati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

data;


Research Procedures<br />

1) Specify a preliminary plan for the study and be ready to modify the plan as<br />

needed in resp<strong>on</strong>se to analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> data early in the study;<br />

2) Use a random sampling strategy to select participants to the research<br />

questi<strong>on</strong> and the definiti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the phenomen<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> interest but be ready to<br />

shift to purposeful sampling when resp<strong>on</strong>dents do not appear for interview<br />

despite repeated attempts to reach them; this shift in sampling procedure<br />

will change the generalizing procedure from deducti<strong>on</strong> (starts with a<br />

theoretical or c<strong>on</strong>ceptual guideline in collecting particular data to prove<br />

the validity <str<strong>on</strong>g>of</str<strong>on</strong>g> the theory) to inducti<strong>on</strong>(from particular cases towards the<br />

derivati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> a general pattern or theory <str<strong>on</strong>g>of</str<strong>on</strong>g> social behaviour).<br />

3) Use the data-collecti<strong>on</strong> method/s suitable to the intended purpose (such<br />

as either through interview, or through observati<strong>on</strong>, or through sec<strong>on</strong>darydata<br />

collecti<strong>on</strong> from documents);<br />

4) Allow sufficient time-frame for data collecti<strong>on</strong> so that an in-depth study <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

the research questi<strong>on</strong> can be made;<br />

5) Use strategies that will ensure c<strong>on</strong>sistency across observers or other data<br />

collectors that would dem<strong>on</strong>strate agreement am<strong>on</strong>g observers in their<br />

observati<strong>on</strong>s; particularly the fit between the data and what occurs in the<br />

setting under study.<br />

6) Use quantitative data, if it can be obtained, whenever appropriate to<br />

understanding the research problem or questi<strong>on</strong>; specially when the<br />

quantitative comments as to expected research findings are identified by<br />

catch phrases or words, such as “more than”, significant”, “extremely”, “not<br />

very much”, etc.<br />

7) Examine whether quantitative measures can be used to document the<br />

preceding catch phrases or words in terms <str<strong>on</strong>g>of</str<strong>on</strong>g> data that indicate means,<br />

standard deviati<strong>on</strong>s, correlati<strong>on</strong>s, and predictability coming from<br />

regressi<strong>on</strong>;<br />

8) See to it that various data-collecti<strong>on</strong> methods or sources <str<strong>on</strong>g>of</str<strong>on</strong>g> data are used<br />

and compared to c<strong>on</strong>firm or clarify the key findings <str<strong>on</strong>g>of</str<strong>on</strong>g> the study;<br />

Research Outcomes<br />

In this secti<strong>on</strong>, a discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the following should include:<br />

1) Discussi<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> results in Qualitative research, guided by the following:<br />

a) See to it that the written report makes clear each research procedure<br />

used and the order in which they occurred so that it would be possible<br />

for other researchers to replicate the study;<br />

b) See to it that the written report includes sufficient quotati<strong>on</strong>s or<br />

summary comments from the research participants/resp<strong>on</strong>dents in<br />

order to clarify (emic) their perspective<br />

c) Check the findings with members before finalizing the written report;<br />

d) Check whether you, as the researcher, have summarized your<br />

pers<strong>on</strong>al reacti<strong>on</strong> to the findings or have compared (etic) your<br />

perspective <strong>on</strong> the phenomen<strong>on</strong> studied to those <str<strong>on</strong>g>of</str<strong>on</strong>g> research<br />

participants or resp<strong>on</strong>dents;<br />

2) Research results in Quantitative research, which c<strong>on</strong>tains ways to:<br />

-Identify how you interpreted the findings and whether you c<strong>on</strong>sidered<br />

alternative interpretati<strong>on</strong>s;


C<strong>on</strong>clusi<strong>on</strong>s and Recommendati<strong>on</strong>s<br />

This secti<strong>on</strong> should c<strong>on</strong>tain a discussi<strong>on</strong> <strong>on</strong> the type <str<strong>on</strong>g>of</str<strong>on</strong>g> research selected,<br />

guided by the following:<br />

1. Qualitative research may end-up with no c<strong>on</strong>clusi<strong>on</strong> as to an emergent<br />

theory when the observati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the participants do not harm<strong>on</strong>ize with those<br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> the researcher [the emic and the etic are irrec<strong>on</strong>cilable] (Altheide and<br />

Johns<strong>on</strong>, 1998)<br />

2. In Quantitative research, pay attenti<strong>on</strong> to the following:<br />

a) C<strong>on</strong>clusi<strong>on</strong>s are supported by the data and its analysis;<br />

b) Determine how the research findings can be applied to other settings<br />

or types <str<strong>on</strong>g>of</str<strong>on</strong>g> research participants/resp<strong>on</strong>dents; and give justificati<strong>on</strong> for<br />

said extensi<strong>on</strong>;<br />

c) Draw reas<strong>on</strong>able implicati<strong>on</strong>s for practice and future research and see<br />

whether such implicati<strong>on</strong>s are justified by the research findings.<br />

3. In Qualitative research, include a reflecti<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> the acti<strong>on</strong> research process<br />

via autobiographical narrative/s or journaling by making a pers<strong>on</strong>al <strong>on</strong>going<br />

written record as the researcher regarding a specific domain that could be<br />

broad and open-ended or <strong>on</strong> a specific topic.<br />

4. Apply Gary Anders<strong>on</strong> and Kathryn Herr’s validity tests as follows (Anders<strong>on</strong><br />

and Herr, 1999):<br />

a) Outcome validity test -extent to which new acti<strong>on</strong>s lead to a resoluti<strong>on</strong><br />

<str<strong>on</strong>g>of</str<strong>on</strong>g> the problem that prompted the project;<br />

b) Process validity test -the adequacy <str<strong>on</strong>g>of</str<strong>on</strong>g> the processes used in different<br />

phases <str<strong>on</strong>g>of</str<strong>on</strong>g> the project so as to protect the findings from bias such as in<br />

data collecti<strong>on</strong>, analysis, and interpretati<strong>on</strong>; and also whether<br />

triangulati<strong>on</strong> <str<strong>on</strong>g>of</str<strong>on</strong>g> data sources and methods were used so that<br />

corroborative evidence for the validity <str<strong>on</strong>g>of</str<strong>on</strong>g> the qualitative research<br />

findings are obtained from a multiplicity <str<strong>on</strong>g>of</str<strong>on</strong>g> the following:<br />

i) Data-collecti<strong>on</strong> methods,<br />

ii) Data sources Analysts, or<br />

iii) Theories.<br />

c) Democratic validity test -the extent to which the perspectives and<br />

interests <str<strong>on</strong>g>of</str<strong>on</strong>g> all stakeholders were taken into account;<br />

d) Catalytic validity test -the extent to which the project causes<br />

stakeholders to transform their view <str<strong>on</strong>g>of</str<strong>on</strong>g> reality in relati<strong>on</strong> to their<br />

pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>al practice;<br />

e) Dialogic validity test -the extent to which colleagues shared in the<br />

development <str<strong>on</strong>g>of</str<strong>on</strong>g> the practiti<strong>on</strong>er/researcher’s findings and<br />

interpretati<strong>on</strong>s.<br />

5. C<strong>on</strong>tinue or modify the acti<strong>on</strong> research project depending <strong>on</strong> the results <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

acti<strong>on</strong> taken based <strong>on</strong> the earlier results or findings <str<strong>on</strong>g>of</str<strong>on</strong>g> the research project.<br />

6. Reduce the discrepancy between the practiti<strong>on</strong>er-researchers’ espoused<br />

theories or “the pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als” beliefs about how they deal with problems <str<strong>on</strong>g>of</str<strong>on</strong>g><br />

practice” and theories-in-acti<strong>on</strong> or “the actual behaviour <str<strong>on</strong>g>of</str<strong>on</strong>g> pr<str<strong>on</strong>g>of</str<strong>on</strong>g>essi<strong>on</strong>als as<br />

they engage in their work”.<br />

7. Suggest strategies for dealing with the unique ethical issues in acti<strong>on</strong><br />

research such as the extent <str<strong>on</strong>g>of</str<strong>on</strong>g> knowledge <str<strong>on</strong>g>of</str<strong>on</strong>g> participants’ knowledge <str<strong>on</strong>g>of</str<strong>on</strong>g> the<br />

c<strong>on</strong>sequential risks involved <strong>on</strong> their lives <str<strong>on</strong>g>of</str<strong>on</strong>g> the research project --either in<br />

processes involved or the resulting findings or in both.


8. Help other researchers determine to what extent your findings fit their<br />

situati<strong>on</strong> by properly designing and reporting the results <str<strong>on</strong>g>of</str<strong>on</strong>g> the acti<strong>on</strong><br />

research.<br />

3. Recommendati<strong>on</strong><br />

As can be gleaned from the preceding discussi<strong>on</strong>s, an appropriate format<br />

must c<strong>on</strong>tain elements <str<strong>on</strong>g>of</str<strong>on</strong>g> both quantitative and qualitative methods for<br />

purposes <str<strong>on</strong>g>of</str<strong>on</strong>g> better triangulati<strong>on</strong> following any <str<strong>on</strong>g>of</str<strong>on</strong>g> the below-listed fourth<br />

typology <str<strong>on</strong>g>of</str<strong>on</strong>g> <str<strong>on</strong>g>Management</str<strong>on</strong>g> <str<strong>on</strong>g>Studies</str<strong>on</strong>g> resulting from the c<strong>on</strong>vergence <str<strong>on</strong>g>of</str<strong>on</strong>g> the three<br />

classificati<strong>on</strong>s <str<strong>on</strong>g>of</str<strong>on</strong>g> PURPOSE, METHOD, and APPLICATION:<br />

i) Experimental Research<br />

ii) Causal-Comparative Research<br />

iii) Case Study<br />

iv) C<strong>on</strong>tent Analysis<br />

v) Correlati<strong>on</strong>al Research<br />

vi) Historical Research<br />

Reference<br />

Altheide, D.L & Johns<strong>on</strong>, J. M. (1998), Criteria for assessing interpretive<br />

validity in qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.),<br />

Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> qualitative research (pp.485-499), Thousand Oaks, CA”Sage.<br />

Anders<strong>on</strong>, G. and Herr, K., (1999). The new paradigm wars: Is there room for<br />

rigorous practiti<strong>on</strong>er knowledge in schools and universities? Educati<strong>on</strong>al<br />

Research, 28(5),12 – 21, 40.<br />

Cohen, J. (1988) Statistical power analysis for the behavioural sciences (2 nd<br />

ed.) Mahwah,NJ: Erlbaum.<br />

Gall,M. D. Joyce P. Gall, Walter R. Borg, (2007). Educati<strong>on</strong>al Research,<br />

Bost<strong>on</strong>: Pears<strong>on</strong>.<br />

Hoaglin D.C, Mosteller, F. & Tukey, J. (2000). Understanding robust and<br />

exploratory data analysis, New York: Wiley.<br />

Leinhardt,G., Leinhardt, S.(1980). Exploratory data analysis: new tools for the<br />

analysis <str<strong>on</strong>g>of</str<strong>on</strong>g> empirical data. In D.C. Berliner, Review <str<strong>on</strong>g>of</str<strong>on</strong>g> Research in<br />

Educati<strong>on</strong> (Vol.8, pp.85-157, Washingt<strong>on</strong>,D.C.:American Educati<strong>on</strong>al<br />

Research Associati<strong>on</strong>.<br />

Patrick, B.C. Hisley, J. and Kempler,T. (2000). “What’s everybody so excited<br />

about? The effects <str<strong>on</strong>g>of</str<strong>on</strong>g> teacher enthusiasm <strong>on</strong> student intrinsic motivati<strong>on</strong> and<br />

vitality, Journal <str<strong>on</strong>g>of</str<strong>on</strong>g> Experimental Educati<strong>on</strong>, 68,217-236<br />

Rossi, P.H., Lipsey,M and Freeman, H.E. (2004), Evaluati<strong>on</strong>: A systematic<br />

approach. Thousand Oaks, CA: Sage.<br />

Silverman, D. (2005). Analyzing talk and text, In N. K. Denzin and Y. S.<br />

Lincoln (Eds.), Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> qualitative research (2 nd ed., pp.821-834) CA:<br />

Sage.<br />

Singer,D. J. D., and Willett,J.B. (2003) Applied l<strong>on</strong>gitudinal data analysis:<br />

Modeling change and event occurrence. New York: Oxford University Press.<br />

Wils<strong>on</strong>,M. (2004).C<strong>on</strong>structing measures: An item resp<strong>on</strong>se modeling<br />

approach, Mahwah, NJ: Erlbaum.<br />

Yin, R.K. (2008) Handbook <str<strong>on</strong>g>of</str<strong>on</strong>g> Applied Research, CA: Sage.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!