pdf - Nyenrode Business Universiteit

pdf - Nyenrode Business Universiteit pdf - Nyenrode Business Universiteit

30.08.2013 Views

3.1. INTRODUCTION 61 Holmstrom’s conclusions concerning the noise-reducing properties of RPE are supported by other analytical research, such as the work of Gibbons & Murphy (1990). The second stream of literature that explains RPE use from a noise reduction standpoint, is the empirical RPE literature. The empirical RPE literature focuses on why and to what extent organizations use RPE. Although the empirical support for RPE is limited in general, as argued in the previous chapters of this thesis, several studies confirm the prevalence of RPE based on noise-reduction arguments. Examples of these papers include Matsumara & Shin (2006), Albuquerque (2009), Gong et al. (2011), and chapter 2 of this thesis. However, whereas the analytical literature explicitly studies the extent to which RPE reduces noise, the empirical stream does not test noise reduction directly. Rather, the empirical literature assumes that RPE reduces noise and uses this assumption as an explanation for RPE use in practice. This assumption leaves the noise-reduction claim concerning the usefulness of RPE largely untested from an empirical standpoint. However, to further examine a theory, one must assess its untested assumptions in as direct a manner as possible. Testing a theory’s assumptions furthers our understanding about the quality of the applied theoretical perspective. For example, it is possible that, instead of the applied theoretical explanation, an alternative mechanism drove prior results. Specifically, based on the findings in chapter 2, I claim support for the noise-reduction explanation of RPE use. This conclusion is based on analyses of how an uncertaintymeasure (derived from the noise-reduction perspective) increases RPE use. The empirical confirmation of this relationship, provided in the same chapter, supports the underlying noise-reduction theory. However, despite the theoretical grounding in prior studies and the empirical confirmation of the noise-reduction theory, it remains entirely possible that the relation between uncertainty and RPE use is, in fact, not due to noise reduction, but due to an alternative theoretical explanation. Prior studies have suggested several alternative explanations for RPE use that may drive the results in chapter 2. For example, RPE may be used as a means to pit employees or organizational parts against each other to create a sense of internal rivalry that increases the efficiency of the individual agents (Holmstrom 1982). A second example suggested by Gibbons & Murphy (1990:33-S) is that RPE is used to facilitate organizational learning (e.g., in the form of benchmarking the outputs and processes). Both of the presented applications can be especially useful in a highly uncertain environment, where environmental turbulence demands that firms perform optimal to survive. An analysis of the relation between uncertainty and RPE use (as conducted in chapter 2 of this thesis) does not help to distinguish between the noise-reduction explanation and the two presented alternative explanations. Additionally, because the latter two explanations

62 CHAPTER 3. NOISE REDUCTION EFFECTIVENESS would be confirmed in this type of analysis, this analysis falsely suggests support for the noise-reduction claim of RPE-theory. To test the noise-reduction assumption, I require a more direct test. To test the noise-reduction assumption of RPE-theory in a more direct manner, the current research analyses noise-reduction effectiveness. This analysis assesses whether organizational reliance on RPE actually reduces the noise levels in the performance evaluation of employees. For the empirical analysis, I use survey data of 325 business unit managers in the Netherlands. Overall, the results are consistent with the findings of the analytical agency literature and the conclusions of chapter 2. The analyses support the main claim of RPE theory: namely RPE reduces the amount of noise in an agent’s performance evaluation. This chapter is organized into five sections. After the introductory section, section 3.2 provides the development of the hypotheses and presents the research model. The measurement is described in section 3.3, and the analyses and results are described in section 3.4. Section 3.5 addresses the findings and the conclusions. 3.2 Development of the Model This section describes the development of the research model, which consists of the research hypothesis and additional expectations. Firstly, the research hypothesis is presented in subsection 3.2.1. This hypothesis addresses the assumed noise-reduction properties of RPE. Subsection 3.2.2 presents a set of expectations consisting of noise-inducing and noisereducing factors. These factors are included to address the measurement problems of the model’s dependent variable rather than because of their theoretical relevance to the noisereduction assumption. The dependent variable noise in the performance evaluation is measured with a perceptual measure that refers to how respondents perceive their noise levels under their currently installed control systems. However, the currently perceived noise level includes the effects of potential noise-reducing control instruments, such as RPE. If I aim to estimate the effect of RPE on noise, it is necessary to predict a noise level ‘theoretically’ before it is reduced by RPE. To estimate the effect of RPE on noise, I extend the model with factors that affect the noise level outside the influence of RPE. These factors include environmental uncertainty, goal ambiguity, measurability of outputs, and the extent to which the performance measurement system relies on personal level and disaggregate measures. In section 3.2.2, I discuss how these factors (positively or negatively) affect the noise level that a manager experiences in his performance evaluation.

3.1. INTRODUCTION 61<br />

Holmstrom’s conclusions concerning the noise-reducing properties of RPE are supported<br />

by other analytical research, such as the work of Gibbons & Murphy (1990).<br />

The second stream of literature that explains RPE use from a noise reduction standpoint,<br />

is the empirical RPE literature. The empirical RPE literature focuses on why and to<br />

what extent organizations use RPE. Although the empirical support for RPE is limited<br />

in general, as argued in the previous chapters of this thesis, several studies confirm the<br />

prevalence of RPE based on noise-reduction arguments. Examples of these papers include<br />

Matsumara & Shin (2006), Albuquerque (2009), Gong et al. (2011), and chapter 2 of this<br />

thesis. However, whereas the analytical literature explicitly studies the extent to which<br />

RPE reduces noise, the empirical stream does not test noise reduction directly. Rather,<br />

the empirical literature assumes that RPE reduces noise and uses this assumption as an<br />

explanation for RPE use in practice. This assumption leaves the noise-reduction claim<br />

concerning the usefulness of RPE largely untested from an empirical standpoint.<br />

However, to further examine a theory, one must assess its untested assumptions in as direct<br />

a manner as possible. Testing a theory’s assumptions furthers our understanding about<br />

the quality of the applied theoretical perspective. For example, it is possible that, instead<br />

of the applied theoretical explanation, an alternative mechanism drove prior results.<br />

Specifically, based on the findings in chapter 2, I claim support for the noise-reduction<br />

explanation of RPE use. This conclusion is based on analyses of how an uncertaintymeasure<br />

(derived from the noise-reduction perspective) increases RPE use. The empirical<br />

confirmation of this relationship, provided in the same chapter, supports the underlying<br />

noise-reduction theory. However, despite the theoretical grounding in prior studies and the<br />

empirical confirmation of the noise-reduction theory, it remains entirely possible that the<br />

relation between uncertainty and RPE use is, in fact, not due to noise reduction, but due<br />

to an alternative theoretical explanation.<br />

Prior studies have suggested several alternative explanations for RPE use that may drive<br />

the results in chapter 2. For example, RPE may be used as a means to pit employees or<br />

organizational parts against each other to create a sense of internal rivalry that increases<br />

the efficiency of the individual agents (Holmstrom 1982). A second example suggested by<br />

Gibbons & Murphy (1990:33-S) is that RPE is used to facilitate organizational learning<br />

(e.g., in the form of benchmarking the outputs and processes). Both of the presented applications<br />

can be especially useful in a highly uncertain environment, where environmental<br />

turbulence demands that firms perform optimal to survive.<br />

An analysis of the relation between uncertainty and RPE use (as conducted in chapter 2 of<br />

this thesis) does not help to distinguish between the noise-reduction explanation and the<br />

two presented alternative explanations. Additionally, because the latter two explanations

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!