The Alberta Report - COAA Major Projects Benchmarking Summary
The Alberta Report - COAA Major Projects Benchmarking Summary
The Alberta Report - COAA Major Projects Benchmarking Summary
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>The</strong> <strong>Alberta</strong> <strong>Report</strong><br />
<strong>COAA</strong> <strong>Major</strong> <strong>Projects</strong> <strong>Benchmarking</strong> <strong>Summary</strong><br />
February 2009
Prepared for:<br />
<strong>Alberta</strong> Finance and Enterprise, <strong>Alberta</strong> Energy<br />
Construction Owners Association of <strong>Alberta</strong> (<strong>COAA</strong>)<br />
Sponsored by:<br />
<strong>Alberta</strong> Finance and Enterprise, <strong>Alberta</strong> Energy<br />
Construction Owners Association of <strong>Alberta</strong> (<strong>COAA</strong>)<br />
Under Research Contract: UTA05-782
Table of Contents<br />
List of Tables ....................................................................................................................................... i<br />
List of Figures..................................................................................................................................... ii<br />
Executive <strong>Summary</strong> .......................................................................................................................... iv<br />
1 Introduction .................................................................................................................................. 1<br />
1.1 Background......................................................................................................................... 1<br />
1.2 <strong>COAA</strong> / CII Partnership....................................................................................................... 2<br />
1.3 Research Objectives........................................................................................................... 4<br />
1.4 Scope and Approach .......................................................................................................... 4<br />
2 <strong>COAA</strong> <strong>Major</strong> <strong>Projects</strong> <strong>Benchmarking</strong> System and Data Collection........................................ 7<br />
2.1 Development of <strong>Alberta</strong> <strong>Benchmarking</strong> System ................................................................. 7<br />
2.2 Hierarchical Structure for Project Comparison ................................................................. 10<br />
2.3 Project Key <strong>Report</strong>............................................................................................................ 11<br />
3 <strong>COAA</strong> Project Performance and Productivity Metrics........................................................... 14<br />
3.1 General Metrics................................................................................................................. 14<br />
3.1.1 Project Performance Metrics.................................................................................. 14<br />
3.1.2 Engineering and Construction Productivity Metrics ............................................... 14<br />
3.1.3 Practices ................................................................................................................ 15<br />
3.2 <strong>COAA</strong>-Specific Metrics ..................................................................................................... 15<br />
3.3 Understanding <strong>Benchmarking</strong> <strong>Report</strong>s and Analyses ...................................................... 17<br />
3.3.1 Metrics.................................................................................................................... 17<br />
3.3.2 Explanation of Statistics......................................................................................... 18<br />
4 Data Analysis ............................................................................................................................. 20<br />
4.1 Description of <strong>Alberta</strong> Dataset .......................................................................................... 20<br />
4.2 Selected Descriptive Analyses ......................................................................................... 22<br />
4.3 Selected Inferential Analyses ........................................................................................... 25<br />
4.4 Comparison of <strong>Alberta</strong> and U.S. Project Performance ..................................................... 32<br />
4.5 Engineering Productivity ................................................................................................... 35<br />
4.6 Construction Productivity .................................................................................................. 38<br />
4.7 Analysis of Impact Factors................................................................................................ 44<br />
5 <strong>Major</strong> Findings ........................................................................................................................... 49<br />
5.1 Project Performance ......................................................................................................... 49<br />
5.2 Productivity ....................................................................................................................... 51<br />
5.3 Impact Factors .................................................................................................................. 51<br />
5.4 Project Management......................................................................................................... 52<br />
6 Conclusions and Recommendations ...................................................................................... 53<br />
Appendices ....................................................................................................................................... 55<br />
Appendix A: <strong>Summary</strong> of Correlation between Project Performance and Related Factors of<br />
<strong>Alberta</strong> Based <strong>Projects</strong> ............................................................................................... 56<br />
Appendix B: Performance Metric Formulas and Definitions......................................................... 60<br />
Appendix C: Glossary ...................................................................................................................... 69<br />
References ........................................................................................................................................ 74<br />
i
List of Tables<br />
Table 2-1 Comparison Algorithm of <strong>Alberta</strong> Project Performance Metrics ........................................ 10<br />
Table 2-2 Comparison Algorithm of <strong>Alberta</strong> Engineering and Construction Productivity Metrics ......... 10<br />
Table 2-3 Hierarchical Structure of <strong>Alberta</strong> Project Types.................................................................. 11<br />
Table 3-1 Additional Study-Specific Performance Metrics.................................................................. 16<br />
Table 4-1 Submitted <strong>Projects</strong> by Owners and Contractors at Project Completion and Sanction ....... 21<br />
Table 5-1 <strong>The</strong> Top 5 Factors Affecting Cost, Schedule or Productivity .............................................. 52<br />
Table A-1 Correlations of Project Characteristics with Project Performance...................................... 53<br />
Table A-2 Correlations of Project Characteristics with Project Performance (Cont’d)........................ 54<br />
Table A-3 Correlations of Project Characteristics with Project Performance (Cont’d)........................ 55<br />
Table A-4 Correlations of Project Characteristics with Project Performance (Cont’d)........................ 56<br />
i
List of Figures<br />
Figure 2-1 Development Process of <strong>Alberta</strong> <strong>Benchmarking</strong> System.................................................... 7<br />
Figure 2-2 Number of Submitted Project Data...................................................................................... 9<br />
Figure 2-3 Sample of Project Cost and Schedule Performance Metrics ............................................ 12<br />
Figure 2-4 Sample of Project Engineering Productivity Metrics.......................................................... 13<br />
Figure 2-5 Sample of Project Construction Productivity Metrics......................................................... 13<br />
Figure 3-1 Example of Performance Metrics....................................................................................... 17<br />
Figure 3-2 Example of Practice Metrics .............................................................................................. 17<br />
Figure 3-3 Box and Whisker Diagram ................................................................................................. 18<br />
Figure 4-1 Number of Submitted <strong>Projects</strong> by Project Nature and Delivery System............................ 21<br />
Figure 4-2 Number of <strong>Projects</strong> Submitted at Sanction and Completion by Total Project Cost Category<br />
($CDN in 2007) .................................................................................................................. 22<br />
Figure 4-3 Construction Indirect / Direct Work hours (%) ................................................................... 23<br />
Figure 4-4 Construction Indirect Cost / Total Project Cost (%)........................................................... 23<br />
Figure 4-5 Modularization by Project Nature....................................................................................... 24<br />
Figure 4-6 Project Cost Growth by Project Delivery System .............................................................. 25<br />
Figure 4-7 Project Schedule Growth by Project Delivery System....................................................... 25<br />
Figure 4-8 Effect of % Engineering Completed before Construction Started ..................................... 26<br />
Figure 4-9 Actual / Estimated Number of Peak Construction Workforce............................................ 27<br />
Figure 4-10 Construction Indirect Work-hours/ Direct Work hours (%) .............................................. 28<br />
Figure 4-11 Construction Indirect Cost Growth by Project Size ($) .................................................... 28<br />
Figure 4-12 Project Risk Assessment vs. Project Cost Growth .......................................................... 29<br />
Figure 4-13 Constructability vs. Project Schedule Growth.................................................................. 30<br />
Figure 4-14 Planning for Startup vs. Startup Phase Cost Growth ...................................................... 31<br />
Figure 4-15 Workface Planning vs. Construction Schedule Growth................................................... 31<br />
Figure 4-16 Project Size ($M CDN, in 2007)....................................................................................... 32<br />
Figure 4-17 Contingency Budget (%).................................................................................................. 33<br />
Figure 4-18 Project Cost Growth......................................................................................................... 34<br />
Figure 4-19 Project Schedule Growth ................................................................................................. 34<br />
Figure 4-20 Development and Scope Change Cost Factor ................................................................ 35<br />
Figure 4-21 Comparison of Project Size ($M CDN, in 2007) for Engineering Productivity Dataset ... 36<br />
Figure 4-22 Comparison of Concrete Engineering Productivity (WH/ Cubic Meter)........................... 37<br />
Figure 4-23 Comparison of Structural Steel Engineering Productivity (WH/ Metric Ton) ................... 37<br />
ii
Figure 4-24 Comparison of Piping Engineering Productivity (WH/ Linear Meter)............................... 38<br />
Figure 4-25 Comparison of Project Size ($M CDN, in 2007) for Construction Productivity................ 39<br />
Figure 4-26 Comparison of Total Concrete Construction Productivity (WH/ m 3 )................................ 40<br />
Figure 4-27 Comparison of Total Structural Steel Construction Productivity (WH/ Metric Ton) ......... 40<br />
Figure 4-28 Comparison of Instrumentation- Devices Construction Productivity (WH/ Count) .......... 41<br />
Figure 4-29 Comparison of Insulation- Piping Construction Productivity (WH/ Linear Meter)............ 42<br />
Figure 4-30 Construction Productivity Project Level Index vs. Project Size ($M CDN, in 2007) ........ 42<br />
Figure 4-31 Actual / Estimated Construction Productivity Rate by Work Discipline ........................... 43<br />
Figure 4-32 Actual / Estimated Total Installed Unit Cost (TIUC) by Work Discipline.......................... 44<br />
Figure 4-33 Factors Impacting Project Cost........................................................................................ 46<br />
Figure 4-34 Impact of Factors vs. Cost Growth.................................................................................... 46<br />
Figure 4-35 Factors Impacting Project Schedule................................................................................ 47<br />
Figure 4-36 Impact of Factors vs. Schedule Growth ............................................................................ 47<br />
Figure 4-37 Factors Impacting Construction Productivity (Field Productivity) .................................... 48<br />
Figure 4-38 Impact of Factors vs. Project Construction Productivity (CPM)......................................... 49<br />
Figure 5-1 Project Change Cost Factor vs. Project Cost Growth ......................................................... 51<br />
iii
Executive <strong>Summary</strong><br />
<strong>The</strong> Construction Owners Association of <strong>Alberta</strong> (<strong>COAA</strong>) as the principal industry association for<br />
heavy industrial construction in <strong>Alberta</strong> provides leadership to enable our owner members to be<br />
successful in their drive for safe, effective and productive project execution. <strong>The</strong> heavy industrial<br />
construction sector represents a significant portion of the GDP in <strong>Alberta</strong> with announced major<br />
projects in excess of $100B. In 2008, the Oil Sands sector in particular was forecasting significant<br />
capital expenditures of $10B per year in 2009, rising to $15B by 2015. This level of construction<br />
activity has strained the industries’ ability to execute the work effectively and has led to significant<br />
concerns about low productivity along with cost and schedule overruns. With these concerns in mind<br />
the <strong>COAA</strong> embarked on a benchmarking initiative in 2003, engaging the Construction Industry<br />
Institute (CII) at the University of Texas in Austin to develop a benchmarking system which would<br />
assess project performance considering the unique characteristics of <strong>Alberta</strong> major projects. <strong>The</strong> CII<br />
has extensive experience benchmarking projects in the United States and globally, permitting<br />
comparisons between <strong>Alberta</strong> projects and similar projects in the CII database. This report<br />
summarizes the results of the first series of project assessments completed in October 2008.<br />
A total of 78 <strong>Alberta</strong> projects were initiated in the benchmarking system since December 2005 and of<br />
these 37 completed the data input required for benchmarking analysis at the cut off for this report in<br />
August 2008. Twenty-seven of the 37 projects in this study were related to the Oil Sands sector with<br />
only natural gas processing (4) and pipeline (2) sectors submitting more than one project. About half<br />
of the projects were grass roots with additions (38%) and modernizations (11%) making up the<br />
balance. Execution strategies varied with almost half of the projects using parallel primes; designbuild<br />
was the second most frequent strategy at 32% of the projects. Project sizes varied from
<strong>The</strong> average cost growth for <strong>Alberta</strong> projects was 19% and average schedule growth was 17%. Cost<br />
growth was generally lower as the % engineering completed increased and more effective Project<br />
Risk Assessment also reduced project cost growth. Constructability assessments lead to reduced<br />
schedule growth but had no impact on cost growth. Indirect costs averaged about 21% of total<br />
project costs and indirect cost growth increased as the project size increased. As for other project<br />
best practices, Planning for Start-up reduced the cost growth in start-up but there was no detectable<br />
correlation between Workface Planning and construction schedule growth, although there were only<br />
7 data points in this assessment.<br />
A number of comparisons were made between <strong>Alberta</strong> and comparable U.S. projects. Although the<br />
comparison is for similar industrial projects, no adjustment has been made to account for the<br />
differences in project size, the prevailing economy while the projects were built and other potentially<br />
significant project drivers. <strong>The</strong> median project size in the <strong>Alberta</strong> dataset is $186M vs. $40M for the<br />
U.S. dataset. Project cost growth was much higher in <strong>Alberta</strong> (19%) vs. the U.S. (3%) and <strong>Alberta</strong><br />
project cost growth had much wider range (-27% to 69%). Development and scope changes were<br />
similar between <strong>Alberta</strong> and the U.S..<br />
Engineering productivity is measured as the ratio of direct engineering hours per installed quantity in<br />
the field (e.g., for structural steel, hours per ton of steel; lower is better). In a similar way,<br />
construction productivity is measured as the ratio of field direct work hours per installed quantity (e.g.,<br />
for structural steel, hours per ton of steel; again, lower is better). All comparisons noted below<br />
between the <strong>Alberta</strong> and U.S. data sets are based on weighted averages (i.e., larger projects count<br />
more in the average productivity than smaller projects).<br />
Engineering productivity for concrete was better in <strong>Alberta</strong> vs. the U.S. (3.5 vs. 6.3); structural steel<br />
engineering productivity was worse in <strong>Alberta</strong> vs. the U.S. (12.6 vs. 5.9) while piping engineering<br />
productivity is comparable (1.28 vs. 1.23).<br />
Construction productivity for concrete is worse in <strong>Alberta</strong> vs. the U.S. (13.1 vs. 9.8) and<br />
instrumentation devices productivity is much worse in <strong>Alberta</strong> (21.4 vs. 8.3), although the nonweighted<br />
average between the two was comparable, so further research into this comparison is<br />
warranted. Construction productivity for structural steel was comparable between the two datasets<br />
(about 38) while insulation productivity was better (1.4 vs. 2.2) in <strong>Alberta</strong>.<br />
To sum up the results to date, productivity is better in <strong>Alberta</strong> for some disciplines but worse (or<br />
much worse) for others, so the productivity picture is mixed. Average wage rates in <strong>Alberta</strong> are<br />
v
higher than the U.S., particularly when compared to the U.S. Gulf Coast where many of the heavy<br />
industrial projects occur, so improved productivity in <strong>Alberta</strong> will enhance competitive advantage.<br />
Furthermore, indirect costs are higher in <strong>Alberta</strong>. All this helps explain the significantly higher cost<br />
growth in <strong>Alberta</strong> vs. the U.S. data. <strong>The</strong> <strong>COAA</strong> and its members have developed and are<br />
implementing a number of initiatives such as Work Face Planning and Re-Work Reduction that will<br />
help improve project productivity. <strong>The</strong> reduced pace of project development in <strong>Alberta</strong> in the near<br />
term should also contribute to improved project execution.<br />
Companies that submitted data are given customized reports which show the comparison of their<br />
projects against the <strong>Alberta</strong> and U.S. datasets. This will help determine strengths and weaknesses<br />
and should lead to better project execution in future, which in the end is the goal of all benchmarking<br />
work. <strong>The</strong> <strong>COAA</strong> is considering extending the benchmarking initiative for another 2 years to allow<br />
submission of additional projects which will strengthen the data analysis and improve our insight into<br />
causes of and potential solutions to poor project performance.<br />
<strong>The</strong> <strong>COAA</strong> would like to thank the <strong>Benchmarking</strong> Committee and in particular the current and past<br />
committee co-chairs, Steve Revay of Revay and Associates, Larry Sondrol of Suncor and Donald<br />
Mousseau of Husky Energy Inc. for their outstanding efforts. <strong>The</strong> <strong>COAA</strong> is also indebted to CII for<br />
their expertise and efforts and to the Government of <strong>Alberta</strong> who helped fund this study.<br />
vi
1 Introduction<br />
<strong>The</strong> oil sands industry plays a crucial role in Canada’s global economic position and the delivery of<br />
energy to the world. In fact, Canada’s oil reserves are second in the world behind Saudi Arabia<br />
(OSDG, 2008). Of these reserves, 97 percent are oil sands. Commercial production of the oil sands<br />
began over 40 years ago and current output is expected to triple by 2020 (ibid.). <strong>The</strong> advances that<br />
have been made in surface mining and in-situ production technologies have been driving the rapid<br />
pace of development of the oil sands reserves. Over the past 11 years, a total of $102 Billion (CDN)<br />
was spent on construction and operation capital necessary to develop these resources. Some have<br />
projected that through 2012, an additional $205 Billion (CDN) could be invested given favorable<br />
economic conditions.<br />
<strong>The</strong> realities of the oil sands resource and the Canadian energy industry place tremendous demands<br />
on companies engaged in the efficient and effective execution of capital projects. This report<br />
chronicles the efforts made by owners, contractors, and other stakeholders in their delivery of capital<br />
projects in the heavy industry sector in <strong>Alberta</strong>. Using estimated and completed capital projects as<br />
its basis, the report examines project performance from cost, schedule, change, rework, safety, and<br />
productivity standpoints. It recognizes the uniqueness of heavy industrial projects in <strong>Alberta</strong>,<br />
projects often characterized by their remote locations and challenges posed by severe weather. <strong>The</strong><br />
story of their development is a compelling one.<br />
<strong>The</strong> Construction Industry Institute (CII) was selected by <strong>COAA</strong> to explore the performance and<br />
productivity concerning the execution of capital projects in <strong>Alberta</strong>. This selection was premised on<br />
the extensive experience of CII in researching and benchmarking industrial facilities in the United<br />
States and around the world. Extending CII’s reach into <strong>Alberta</strong> permitted tremendous<br />
understanding of the performance of these projects, especially when compared with similar projects<br />
in the United States. <strong>The</strong> results obtained through this study are both surprising and expected.<br />
Using quantitative methods, the report dispels common myths regarding project execution in <strong>Alberta</strong><br />
while establishing a solid footing for the future study of additional projects.<br />
1.1 Background<br />
<strong>Benchmarking</strong> has long been used to improve the process of manufacturing. It is the continuous and<br />
systematic process of measuring one’s own performance against the results of recognized leaders<br />
for the purpose of finding best practices that lead to superior performance when implemented. In the<br />
capital projects industry, benchmarking is primarily used at the project level to help participants<br />
1
identify gaps in their work processes which lead to compromised performance. For a given company,<br />
benchmarking provides sets of external comparisons to its peer group that can be used to establish<br />
improvement goals and objectively understand what “best in class” performance means.<br />
<strong>The</strong> execution of capital projects in <strong>Alberta</strong> is truly unique. It is one of few geographic areas that has<br />
such a great prevalence of capital projects. At last estimate, over 240,000 people were engaged in<br />
the development of the oil sands resources in <strong>Alberta</strong> (OSDG, 2008). In fact, construction comprised<br />
9.0% of <strong>Alberta</strong>’s gross domestic product (GDP) in 2007 (AFE, 2008). Spending on the Athabasca<br />
Oil Sands resource in particular rose to $37.7 Billion (CDN) in 2007 (ibid.). However, this dramatic<br />
amount of growth has also brought its challenges. Increasing pressures on capital projects have<br />
been created due to significant worldwide cost escalations and labour shortages. This has led to the<br />
creation of many perceptions regarding the potential loss of productivity or excessive indirect costs,<br />
for example.<br />
<strong>The</strong> purpose of this study was to quantitatively assess the performance of capital projects in <strong>Alberta</strong>.<br />
<strong>The</strong> combined resources of <strong>COAA</strong>, CII, and <strong>Alberta</strong> Finance and Enterprise were directed to<br />
objectively measure the performance of actual projects planned and executed in <strong>Alberta</strong> within the<br />
past seven or eight years. While it was not possible to obtain measures of every aspect of project<br />
performance, this study does provide data necessary to gain new insights to the results of <strong>Alberta</strong>’s<br />
heavy industry sector projects. It directly addresses many common perceptions regarding<br />
engineering and construction productivity and it provides a baseline of project data that can be used<br />
to help improve the work processes used by companies developing projects in <strong>Alberta</strong>.<br />
1.2 <strong>COAA</strong> / CII Partnership<br />
As the principal industry association for capital projects in <strong>Alberta</strong>, the Construction Owners<br />
Association of <strong>Alberta</strong> (<strong>COAA</strong>) strives to provide leadership to enable owner members to be<br />
successful in their drive for safe, effective and productive project execution. Principal members of<br />
<strong>COAA</strong> include the users of construction services in capital expansion plans. Indeed, <strong>COAA</strong><br />
represents a broad cross-section of owners' interests which are associated with many sectors of the<br />
<strong>Alberta</strong> construction community. <strong>COAA</strong> also includes Associate Members which provide<br />
construction services and other activities. <strong>COAA</strong>’s mission is to assist its members in achieving<br />
excellence in the execution of capital projects by:<br />
• Creating and promoting Best Practices in the construction industry<br />
• Serving as a voice for owners to stakeholders that can make a difference<br />
2
• Providing a forum for dialogue and debate among owners, contractors, labour providers and<br />
government<br />
• Bringing new ideas to the construction industry and to government leaders<br />
Headquartered at the University of Texas at Austin, CII is a consortium of leading owners,<br />
engineering and construction contractors, and suppliers that have come together to improve the cost<br />
effectiveness of capital projects. As the major public benchmarking resource in the capital projects<br />
industry, CII has over 15 years experience in benchmarking capital project delivery and best<br />
practices. CII was formed in 1983 by 28 organizations based on recommendations from an intensive<br />
five year study of the engineering and construction industry, known as the Construction Industry Cost<br />
Effectiveness (CICE) project. Today, there are 117 members around the world engaged in capital<br />
projects. Over the past 25 years, CII has partnered industry practitioners with academia to study the<br />
capital projects industry to create a vast array of knowledge. In fact, CII research products have<br />
been widely disseminated throughout the industry through publications, conferences and workshops<br />
and have led to the creation of a number of best practices.<br />
CII started its <strong>Benchmarking</strong> and Metrics (BM&M) program in 1993 with an initial purpose to validate<br />
the benefit of best practices and to support CII research. Today, CII’s BM&M program employs 10<br />
staff members to advance project performance through benchmarking research. Over the years, an<br />
online benchmarking system known as Project Central has been developed to allow benchmarking<br />
participants known as <strong>Benchmarking</strong> Associates (BA’s) to enter project data and get real-time<br />
feedback 24 hours per day. BA training is provided three times a year to ensure understanding of<br />
CII metrics and compliance with standard data definitions. As of 2008, over 800 BAs have been<br />
trained and a total of 1,738 projects representing over $81 Billion (USD) have been collected from<br />
leading construction owners and contractors around the world.<br />
Building on the collective expertise of <strong>COAA</strong> and CII, a research contract was established in 2005<br />
between the two organizations for the purpose of benchmarking capital projects in <strong>Alberta</strong>. It was<br />
funded by <strong>COAA</strong> with assistance from <strong>Alberta</strong> Finance and Enterprise, a component of the provincial<br />
government of <strong>Alberta</strong>. Besides this research report, the contract established a comprehensive<br />
benchmarking system comprised of a customized questionnaire, a dedicated database, and a suite<br />
of individualized reports for each company submitting project data. <strong>The</strong> relationship between <strong>COAA</strong><br />
and CII has been very productive and has yielded many discoveries regarding <strong>Alberta</strong>’s heavy<br />
industry sector capital projects, many of which are presented here.<br />
3
1.3 Research Objectives<br />
<strong>The</strong> purpose of the research was to develop a benchmarking system to assess the performance of<br />
<strong>Alberta</strong> major projects considering factors unique to their execution, to permit analysis of this<br />
performance over time, and to include measures of engineering and field productivity. In particular,<br />
specific research objectives included:<br />
1) Identification of <strong>Alberta</strong> metric requirements<br />
2) Development of a customized benchmarking questionnaire based upon the CII questionnaire,<br />
but tailored to the characteristics and environment of <strong>Alberta</strong> projects<br />
3) Establishment of a set of benchmarks for <strong>Alberta</strong> projects using the customized<br />
questionnaire<br />
4) Documentation of <strong>Alberta</strong> project performance against the <strong>Alberta</strong> benchmarks<br />
5) Identification and documentation of factors and practices impacting project performance<br />
As the research evolved from 2005 to 2008, <strong>COAA</strong>’s benchmarking committee worked directly with<br />
CII benchmarking and metrics staff members to continually refine the research program, its<br />
questionnaire and its information technology (IT) tools. For example, besides including additional<br />
data definitions for <strong>Alberta</strong> projects, specific <strong>COAA</strong> best practices such as Workface Planning were<br />
added to the research’s customized questionnaire. Taken together, these efforts have produced a<br />
premier benchmarking research program for <strong>Alberta</strong> projects.<br />
1.4 Scope and Approach<br />
This research program used the principal components of CII’s benchmarking research program as its<br />
foundation. CII’s existing large project questionnaire for heavy industry sector projects was used as<br />
a basis for the <strong>COAA</strong> questionnaire. A series of development meetings was held in 2005, 2006, and<br />
2007 between <strong>COAA</strong>’s benchmarking committee and CII benchmarking and metrics staff to create<br />
and prioritize new metrics specific to <strong>Alberta</strong> capital projects. This led to the programming of a<br />
customized web-based data collection instrument and key report.<br />
Throughout the study period, and into 2008, CII conducted seven training sessions for <strong>COAA</strong><br />
participants in this study. <strong>The</strong>se individuals, known as <strong>COAA</strong> <strong>Benchmarking</strong> Associates (BA’s), were<br />
given access to the online system and key reports. Using the knowledge gained in training, these<br />
BA’s collected project-specific data and entered them into the online system. Subsequently, they<br />
worked with CII staff to validate their data to ensure conformance to accepted definitions. Finally,<br />
4
the BA’s used the information contained within the key reports to communicate knowledge gained<br />
about their projects to their individual firms in order to improve key work processes.<br />
<strong>The</strong> final aspect of this research program was the creation of this report, entitled the “<strong>Alberta</strong> <strong>Report</strong>”.<br />
This report is intended to examine all the projects collected through this research to identify common<br />
factors or new findings concerning the execution of capital projects in <strong>Alberta</strong>. It is also the means of<br />
communication regarding the entirety of this research. Consequently, this report describes not only<br />
the interesting findings of this research, but also the system used to collect, analyze, and<br />
disseminate this information. <strong>The</strong> contents of this report have been distilled to provide commentary<br />
only on the most critical aspects and results of this research effort. Certainly, other queries<br />
regarding the collected project data were investigated, but only the most statistically significant are<br />
presented here.<br />
This research was intended to provide the first step in the dedicated study of heavy industry sector<br />
capital projects in <strong>Alberta</strong>. Future steps are planned. Principally, this report provides quantitative<br />
assessments of <strong>Alberta</strong> oil sands projects. It can be used to:<br />
1) Aid understanding of generalized, current perspectives of project performance in <strong>Alberta</strong><br />
2) Aid understanding of the benefits obtained through best practice use in the management of<br />
capital projects<br />
3) Aid understanding of the drivers for improved capital project performance, especially in the<br />
areas of planning, estimating, and productivity<br />
4) Plan for improvements to work processes to execute capital projects more effectively<br />
Importantly, this report should not be used to estimate any current or future projects. Results should<br />
not be extrapolated to projects beyond those studied as, by definition, every project is both<br />
temporary and unique. Results contained herein pertain only to those projects submitted for analysis;<br />
projects which were executed by particular individuals in particular periods of time. Continued<br />
benchmarking is recommended to maximize the benefits received.<br />
Acknowledgement<br />
Funding for this research was provided by both the Government of <strong>Alberta</strong> and <strong>COAA</strong>. In addition,<br />
this study would not have been possible without the endless support from the <strong>COAA</strong> <strong>Alberta</strong> <strong>Major</strong><br />
<strong>Projects</strong> <strong>Benchmarking</strong> Committee. <strong>The</strong> individuals who collected and submitted their project data<br />
through this study are greatly appreciated, though their names are not listed due to confidentiality<br />
5
policies which are in effect. Members of the <strong>COAA</strong> <strong>Alberta</strong> <strong>Major</strong> <strong>Projects</strong> <strong>Benchmarking</strong> Committee<br />
are listed next.<br />
<strong>The</strong> <strong>COAA</strong> <strong>Alberta</strong> <strong>Major</strong> <strong>Projects</strong> <strong>Benchmarking</strong> Committee<br />
Steve Revay*, Revay and Associates Limited<br />
Larry Sondrol*, Suncor Energy Inc.<br />
Donald Mousseau**, Husky Energy Inc.<br />
Patricia Armitage, <strong>Alberta</strong> Finance and Enterprise<br />
Aamer Ahmed, Shell Canada Limited<br />
Billy Bai, Ledcor<br />
Bob Montgomery, Colt Engineering<br />
Dale Elmer, Flint Energy<br />
Dave Williams – Bantrel<br />
Douglas Shako, Flint Energy<br />
Ed Catolico, WorleyParsons Ltd.<br />
Mahendra Bhatia – Suncor Energy Inc.<br />
Mel Otteson, Imperial Oil Resources Ltd.<br />
Greg Sillak, BA Energy<br />
Greg Taylor, Nexen Inc.<br />
Hans Raj, Colt Engineering<br />
Jared Wharton, EPCOR<br />
Johnnas Jagonos, Flint Energy<br />
Jennifer Koivuneva, Jacobs<br />
Korey Jackson, Stantec<br />
Lea Chambers, Golder Associates Ltd.<br />
Lubo Iliev, Petro-Canada<br />
Renee Roberge, Flint Energy<br />
Rheal Guenette, Shell Canada Limited<br />
Richard Haack, Shell Canada Limited<br />
Stephan Chudleigh, Flint Energy<br />
Tim Silbernagel, Bantrel<br />
Umesh Krishnappa, Suncor Energy Inc.<br />
Vladimir Deriabine, Petro-Canada<br />
Warren Rogers, Flint Energy<br />
Include past members and denote them as such<br />
*current chairs<br />
**past chairs<br />
6
2 <strong>COAA</strong> <strong>Major</strong> <strong>Projects</strong> <strong>Benchmarking</strong> System and Data Collection<br />
<strong>Benchmarking</strong> has been recognized as a core component of continuous improvement programs in<br />
the capital projects industry. Implementing specific benchmarking approaches on <strong>Alberta</strong>-based<br />
projects will provide the participating companies with a systematic process to measure project<br />
performance, enable external comparisons with peers’ projects, and establish project objectives.<br />
Moreover, a comprehensive benchmarking system can identify areas for work process improvement.<br />
This was the basis for the development of the <strong>Alberta</strong> <strong>Benchmarking</strong> System.<br />
2.1 Development of <strong>Alberta</strong> <strong>Benchmarking</strong> System<br />
This research comprises the first round of benchmarking heavy industry sector projects in <strong>Alberta</strong>.<br />
Accordingly, a significant amount of time and effort was spent by <strong>COAA</strong>’s benchmarking committee<br />
and CII benchmarking program staff to develop the <strong>Alberta</strong> benchmarking system. <strong>The</strong> development<br />
process of this system can be seen in Figure 2-1.<br />
c<br />
Figure 2-1 Development Process of <strong>Alberta</strong> <strong>Benchmarking</strong> System<br />
Principally, the development of a benchmarking system includes the following aspects: development<br />
of metrics and a survey instrument, development of a data collection and reporting system, and<br />
validation of submitted data. Each is discussed next.<br />
7
a) Development of Metrics<br />
This study applies most of the project performance, best practice, and engineering and construction<br />
productivity metrics developed by CII’s <strong>Benchmarking</strong> and Metrics (BM&M) program. Definition of<br />
these metrics can be seen in Appendix B. This study also incorporates many additional metrics<br />
focused on specific areas of interest concerning projects executed in <strong>Alberta</strong>. <strong>The</strong>se additional<br />
metrics were developed through meetings with <strong>COAA</strong>’s benchmarking committee, industry experts,<br />
and CII’s BM&M staff. Development activities for all additional metrics are described in section 3.4.<br />
b) Development of Survey Instrument<br />
Once the metrics were defined, CII’s existing Large Project Questionnaire was modified to include<br />
additional metrics for projects executed in <strong>Alberta</strong>. Primarily, this was accomplished through input<br />
obtained from the <strong>COAA</strong> benchmarking committee. In addition, the questionnaire was refined using<br />
the feedback and input from 180 industry representatives who attended <strong>COAA</strong> benchmarking<br />
training over three years. To ensure the reliability and consistency of questionnaire responses, all<br />
questions were reviewed and validated by an expert in survey design at the University of Texas at<br />
Austin. It should be mentioned that the questionnaire was developed with both owner and contractor<br />
data in mind. <strong>The</strong> final questionnaire was subsequently programmed by CII staff from 2005 to 2007<br />
and can be downloaded through <strong>COAA</strong>’s website. Notably, the questionnaire requires each project<br />
to report data concerning general project information, budget, schedule, change orders, rework,<br />
safety, practice use, productivity, and factors known to impact project performance.<br />
c) Data Collection System<br />
CII has developed a robust web-based data collection system over the last eight years. This<br />
development activity has resulted in a mature, online system that is recognized as a cost-effective<br />
tool that companies can use to benchmark a large number of projects. This system also supports<br />
the collaboration of data entry among multiple project participants and allows benchmarking at two<br />
milestones: at project sanction (i.e., Approval for Expenditure (AFE)) and after project completion<br />
(see definitions of terms in Appendix B). <strong>Benchmarking</strong> at AFE uses project estimates, while<br />
benchmarking after completion relies upon both estimates and actual data. In addition, the <strong>Alberta</strong><br />
benchmarking system supports both imperial and metric systems of measurement. Here, the system<br />
is capable of converting concrete quantities between cubic yards and cubic meters, and wire and<br />
cable quantities between linear feet and linear meters, for example. This feature supports projects<br />
using a hybrid quantity unit system which is advantageous to large projects managed by multiple<br />
companies working in different unit environments.<br />
8
d) Data Collection and Validation<br />
Figure 2-2 contains a history of <strong>COAA</strong> project data collection beginning in November 2005. Data<br />
collection was planned to complete in October 2008 for the first round. As can be seen in the Figure,<br />
a total of 78 projects were created by 19 <strong>COAA</strong> member companies through the end of 2008. <strong>The</strong>se<br />
19 firms include ten owner companies and nine contractors. However, only 37 projects containing<br />
complete project data were submitted before the deadline in October 2008. For this reason, only<br />
these projects were validated for inclusion in this study.<br />
100<br />
Number of Project Data in <strong>COAA</strong> DB by Month (last updated Oct. 24th, 08)<br />
Number of Project Data<br />
90<br />
80<br />
70<br />
60<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
Nov-05<br />
3<br />
9<br />
Dec-05<br />
Jan-06<br />
Training # 1<br />
Nov. 05<br />
Feb-06<br />
Mar-06<br />
Apr-06<br />
May-06<br />
55<br />
53<br />
51<br />
47<br />
36<br />
38<br />
37<br />
30<br />
23<br />
13 15 18 21 25 2931 11<br />
12<br />
9<br />
13<br />
10<br />
7<br />
2 2 3 6 1 2<br />
0<br />
3 0 2 0 1 1<br />
2 1<br />
Jun-06<br />
Jul-06<br />
Aug-06<br />
Sep-06<br />
Oct-06<br />
Nov-06<br />
Dec-06<br />
Training #2<br />
Oct. 06<br />
Jan-07<br />
Feb-07<br />
Number of projects created in database<br />
Total number of submitted projects<br />
Number of projects submitted by months<br />
Mar-07<br />
Apr-07<br />
May-07<br />
Jun-07<br />
Jul-07<br />
Aug-07<br />
Sep-07<br />
Oct-07<br />
Nov-07<br />
Dec-07<br />
Training #3<br />
Nov. 07<br />
Jan-08<br />
Feb-08<br />
Mar-08<br />
Apr-08<br />
May-08<br />
Training #4<br />
May 08<br />
75<br />
Jun-08<br />
Jul-08<br />
Aug-08<br />
Sep-08<br />
37<br />
7<br />
78<br />
Oct-08<br />
Nov-08<br />
Dec-08<br />
Round 1<br />
Data Cut Off :<br />
Aug. 1st, 08<br />
Figure 2-2 Number of Submitted Project Data<br />
To ensure the quality and integrity of data included in the <strong>Alberta</strong> database, a comprehensive data<br />
validation process was established by the research team. This process consists of two phases.<br />
First, <strong>COAA</strong> benchmarking associates (BA) validate their project data through internal comparisons<br />
and submit these data only once they have been verified. Secondly, the <strong>COAA</strong> Account Manager at<br />
CII examined the submitted data using comparisons with additional <strong>Alberta</strong> projects, primarily to<br />
identify outliers, thereby generating a series of questions to the responsible BA.<br />
9
2.2 Hierarchical Structure for Project Comparison<br />
To provide meaningful benchmarking results, comparisons are made amongst projects that are as<br />
similar as possible using five different project characteristics. <strong>The</strong>se characteristics are used in a<br />
hierarchical structure and programmed as a comparison algorithm, the logic of which can be seen in<br />
Tables 2-1 and 2-2. <strong>The</strong> <strong>COAA</strong> and CII development teams collaboratively created these algorithms<br />
in order to mine the database based upon: 1) project cost category, 2) project nature, 3) project type<br />
level 2, 4) project type level 1, and 5) respondent types. In order to achieve reasonable<br />
benchmarking by project size ($CDN), time adjustments of project costs are required. <strong>The</strong> year<br />
during the middle of the project was used to normalize project cost dollar values to July 2007.<br />
Table 2-1 Comparison Algorithm of <strong>Alberta</strong> Project Performance Metrics<br />
Loop #<br />
# 1 – no slices found,<br />
go to 2<br />
#2 – no slices found,<br />
go to 3<br />
#3– no slices found,<br />
go to 4<br />
4: Stop! Data Slice<br />
found with n=10!!<br />
Respondent<br />
Type<br />
Owner<br />
Owner<br />
Owner<br />
Level 1 Level 2 Nature<br />
Upstream<br />
Upstream<br />
Upstream<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Grassroots<br />
Cost<br />
Category<br />
$100-250MM<br />
Grassroots ALL<br />
ALL ALL<br />
Owner Upstream ALL ALL ALL<br />
#5 Owner ALL ALL ALL ALL<br />
#6 ALL ALL ALL ALL ALL<br />
Table 2-2 Comparison Algorithm of <strong>Alberta</strong> Engineering and Construction Productivity Metrics<br />
Loop #<br />
# 1 – no slices found,<br />
go to 2<br />
#2 – no slices found,<br />
go to 3<br />
#3– no slices found,<br />
go to 4<br />
4: Stop! Data Slice<br />
found with n=10!!<br />
Respondent<br />
Type<br />
Owner<br />
Owner<br />
Owner<br />
Level 1 Level 2 Nature<br />
Upstream<br />
Upstream<br />
Upstream<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Grassroots<br />
Cost<br />
Category<br />
$100-250MM<br />
Grassroots ALL<br />
ALL ALL<br />
Owner Upstream ALL ALL ALL<br />
#5 Owner ALL ALL ALL ALL<br />
#6- Second Round with<br />
All Response Type<br />
ALL<br />
Upstream<br />
#7 ALL Upstream<br />
#8 ALL Upstream<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Oil Sands<br />
SAGD<br />
Grassroots $100-250MM<br />
Grassroots ALL<br />
ALL ALL<br />
#9 ALL Upstream ALL ALL ALL<br />
#10 ALL ALL ALL ALL ALL<br />
10
<strong>The</strong> hierarchical structure of <strong>Alberta</strong> project type (level 1 and level 2) can be seen in Table 2-3.<br />
<strong>Alberta</strong> projects were divided to four types (level 1) which includes upstream and downstream oil and<br />
gas, natural gas, and pipeline projects. This was done for data comparison and analysis purposes.<br />
Level 1 projects are also further broken down to a second level (level 2). For example, upstream oil<br />
and gas is divided into oil sands Steam Assisted Gravity Drainage (SAGD) and oil sands mining.<br />
After metric values are calculated for each project, metrics are compared with the closest specific<br />
data slice according to the previously-developed algorithms (e.g., $100M- $250M project size,<br />
grassroots, oil sands SAGD, upstream, heavy industry, and contractor). This can be seen in ‘loop 1’<br />
of Table 2-1. Additionally, if the comparable dataset has less than 10 projects or data from less than<br />
3 companies, the comparison was moved to the next loop (and so on) until enough data are<br />
available.<br />
Table 2-3 Hierarchical Structure of <strong>Alberta</strong> Project Types<br />
Level 1<br />
Upstream<br />
Level 2<br />
Oil Sands SAGD<br />
Level 3<br />
Cogeneration<br />
Central Plant Processing Facilities<br />
(Oil Exploration/<br />
Pad and Gathering<br />
Production)<br />
Oil Sands Mining<br />
Oil Sands Mining/ Extraction<br />
Central Plant Processing Facilities<br />
Naptha Hydrotreater Unit<br />
Oil Sands Upgrading<br />
Downstream<br />
Hydrogen Plant<br />
Oil Refining<br />
Utilities and Offsite<br />
Natural Gas Natural Gas Processing<br />
Process Pipeline<br />
Pipeline Pipeline SAGD<br />
Pipeline (Gas Distribution)<br />
2.3 Project Key <strong>Report</strong><br />
For each participating company in this research, a standardized report was created that contained all<br />
metric values that could be calculated based on questionnaire responses for a given project. This<br />
standardized report is known as the ‘project key report’ which was generated to provide comparisons<br />
of selected project performance with other similar projects in the <strong>Alberta</strong> benchmarking database<br />
following the procedures discussed previously. <strong>The</strong> key report presents metric scores, database<br />
means, performance quartiles, and sample size of the comparable dataset. <strong>The</strong> key report was<br />
customized for <strong>Alberta</strong> based projects based on a series of discussions with the <strong>COAA</strong><br />
<strong>Benchmarking</strong> committee. A sample of the report can be seen in Figure 2-3, while a complete<br />
sample report can be downloaded at the <strong>COAA</strong> website. Generally, metrics scores are presented in<br />
11
quartiles with the first quartile (1Q) being preferred. However, some metrics scores are not<br />
presented using quartiles, but rather, are presented as a continuum of observed project performance.<br />
In the case of Figure 2-3, schedule metrics are qualified as the percent of projects spending more<br />
time.<br />
Figure 2-3 Sample of Project Cost and Schedule Performance Metrics<br />
<strong>The</strong> key report also contains comparisons for both engineering and construction productivity. A<br />
sample of engineering productivity metrics can be seen in Figure 2-4. In this figure, a calculation of<br />
unit rate is provided that divides the total design work hours by its corresponding issued for<br />
construction (IFC) quantity. Again, comparisons for each metric are provided with the database<br />
mean and all comparable projects are organized into quartiles (e.g., with n=12, three projects would<br />
reside in each quartile). While the quartiles appear to be a uniform width from a unit rate perspective,<br />
this rarely happens in practice. Rather, project metrics may be clustered or spread out for each<br />
observed quartile.<br />
Figure 2-5 provides a sample of the key report for construction productivity. In this figure,<br />
calculations and comparisons for each metric are provided in much the same way as previously<br />
discussed. In general, additional detail is provided for construction productivity when compared with<br />
engineering productivity for the same disciplines. In addition, the construction productivity section<br />
12
also provides for the ability to compare estimates of construction productivity generated at sanction<br />
with actual data from completed projects.<br />
Figure 2-4 Sample of Project Engineering Productivity Metrics<br />
Structural Steel<br />
Metric<br />
Wk-Hrs<br />
Installed<br />
Quantity<br />
(MT)<br />
Unit Rate<br />
(Wk-Hrs/MT)<br />
Database<br />
Mean<br />
n<br />
Structural Steel 15,304 637 24.03 23.74 12*<br />
Pipe Racks & Utility Bridge 5,391 289 18.64 28.58 19*<br />
Miscellaneous Steel 11,882 173 68.57 51.14 11*<br />
: Total Structural Steel<br />
Productivity Rate<br />
32,577 1,099 29.64 14<br />
Est.<br />
Wk-Hrs<br />
Est.<br />
Quantity<br />
(MT)<br />
Est.<br />
Unit Rate<br />
(Wk-Hrs/ MT)<br />
: Total Estimated Structural<br />
Steel Productivity Rate 29,000 1,000 29.00<br />
30.80<br />
n<br />
14<br />
: Total Installed Unit Cost<br />
Actual<br />
($/MT)<br />
Estimated<br />
($/MT)<br />
Actual DB Mean<br />
($/MT)<br />
3,200 3,000 3,100 14<br />
n<br />
Figure 2-5 Sample of Project Construction Productivity Metrics<br />
13
3 <strong>COAA</strong> Project Performance and Productivity Metrics<br />
This section introduces the metrics used in this research. It provides an explanation of interpretation of<br />
the project key report. In addition, this section also provides an overview of statistical terms used in<br />
conducting the analyses for this report. As discussed previously, the <strong>COAA</strong> benchmarking system<br />
adopted most of the proven CII project performance and practice metrics, plus some specific metrics<br />
created for the unique factors found on projects in <strong>Alberta</strong>.<br />
3.1 General Metrics<br />
<strong>The</strong> category of general metrics pertains to those metrics used by CII’s benchmarking and metrics<br />
(BM&M) program for many years. <strong>The</strong> use of these metrics was necessary to ensure the<br />
compatibility of comparisons between project data collected in <strong>Alberta</strong> and by CII in the U.S. and in<br />
other countries around the world. <strong>The</strong>re are three sub-categories of general metrics. <strong>The</strong>se are<br />
discussed next.<br />
3.1.1 Project Performance Metrics<br />
<strong>The</strong> CII BM&M program measures five aspects of project performance, notably: 1) cost, 2) schedule, 3)<br />
safety, 4) change, and 5) field rework. Project cost and schedule performance metrics evaluate the<br />
amount of variation from planned cost and schedule estimates at sanction. <strong>The</strong>se performance metrics<br />
are further decomposed to address five primary phases of capital project execution. Known as phase<br />
cost and schedule factors, these metrics portray the proportion of total project time and money<br />
expended during each phase of the project. Safety, change, and rework are measured in terms of<br />
overall project performance at project completion. <strong>The</strong> definitions of these metrics are described in<br />
detail in Appendix B. <strong>The</strong> only aspect of project performance metrics that differs between the CII and<br />
<strong>COAA</strong> system concerns safety metrics. For this research, the safety metrics commonly used in<br />
Canada were included.<br />
3.1.2 Engineering and Construction Productivity Metrics<br />
<strong>The</strong> productivity metrics used in this research are based on the engineering and construction<br />
productivity measurements used by CII’s BM&M program. Metrics are defined as ratios of work<br />
hours (WH) to quantities. For most, these metrics are easy to understand and are consistent with<br />
most estimating and cost accounting systems. For these metrics, a lower productivity rate is<br />
generally preferred.<br />
14
Engineering productivity metrics are defined as actual engineering work hours per Issued for<br />
Construction (IFC) quantity, which is the number of actual direct work hours required to design a<br />
particular unit of work. This calculation can be seen in Equation 1. Engineering productivity metrics<br />
were captured for significant work activities for the following design disciplines: 1) concrete, 2)<br />
structural steel, 3) equipment, 4) piping, 5) electrical, and 6) instrumentation. A definition of direct<br />
labour for all engineering productivity metrics can be seen in the questionnaire and in Appendix B.<br />
Engineering Productivity<br />
Input Actual Design Work Hours<br />
= =<br />
[Equation 1]<br />
Output IFC Quantity<br />
Construction productivity metrics are defined as actual direct work hours required to install a unit<br />
quantity. This calculation can be seen in Equation 2. In this research, construction productivity rates<br />
were captured for significant work activities for the following disciplines: 1) concrete, 2) structural steel,<br />
3) equipment, 4) piping, 5) electrical, 6) instrumentation, 7) insulation and 8) scaffolding. Additionally,<br />
in this research, both estimated and actual quantity and work hours are captured for construction<br />
activities.<br />
Construction Productivity<br />
Input Actual Installed Direct Work Hours<br />
= =<br />
[Equation 2]<br />
Output Installed Quantity<br />
3.1.3 Practices<br />
This study also assessed the use of 14 project best practices during the execution of a capital project<br />
including: Front End Planning, Project Risk Assessment, Team Building, Alignment during Front End<br />
Planning, Constructability, Design for Maintainability, Material Management, Project Change<br />
Management, Zero Accident Techniques, Quality Management, Automation/Integration (AI)<br />
Technology, Planning for Startup, Prefabrication/ Preassembly/ Modularization and Workface<br />
Planning. Excluding Workface Planning, all these best practices were adopted from the original CII<br />
benchmarking questionnaire. A complete list of these 14 Best Practices and definitions for each are<br />
provided in Appendix B.<br />
3.2 <strong>COAA</strong>-Specific Metrics<br />
This research included additional <strong>COAA</strong>-specific metrics to quantify <strong>Alberta</strong> project performance and<br />
productivity. <strong>The</strong>se metrics are listed in Table 3-1. Many of these additional metrics relate to indirect<br />
15
and direct construction costs, mechanical and equipment costs, scaffolding work hours, the use of<br />
offsite modules, as well as various workforce metrics. <strong>The</strong> additional metrics were developed to<br />
evaluate suspected major causes of cost overruns and schedule delays common to large projects<br />
(Flyvberg 2003; <strong>COAA</strong> 2005). In addition, for projects in <strong>Alberta</strong>, metrics regarding estimated<br />
construction productivity, estimated total installed unit cost (TIUC), and metrics related to actual<br />
versus estimated productivity and TIUC were captured in the construction productivity section. A list<br />
of all metrics developed specifically for projects in <strong>Alberta</strong> is provided in Appendix B.<br />
Table 3-1 Additional Study-Specific Performance Metrics<br />
Metrics<br />
Related to<br />
Project Cost<br />
Metrics<br />
Related to<br />
Workforce<br />
Metrics<br />
Related to<br />
Construction<br />
Productivity<br />
Direct Construction Cost<br />
= Direct Construction Costs<br />
Total Construction Cost<br />
Indirect Construction Cost<br />
= Indirect Construction Costs<br />
Total Construction Cost<br />
Indirect/ Direct<br />
= Indirect Construction Costs<br />
Direct Construction Costs<br />
<strong>Major</strong> Equipment<br />
= <strong>Major</strong> Equipment Cost<br />
Total Project Cost<br />
Mechanical & Process Equipment = Mech. and Process Equipment Costs<br />
Total Project Cost<br />
Direct-Indirect Workhours<br />
= Total Construction Indirect Work-Hours<br />
Total Construction Direct Work-hours<br />
%Offsite Construction WH = Offsite Construction WH of Modules x 100<br />
Total Construction Hours<br />
%Overtime Work-hours = Overtime Craft Work-hours x 100<br />
Total Construction Field Work-hours<br />
Peak Construction Workforce = Actual Peak Workforce<br />
Planned Peak Workforce<br />
Mode of Travel to Worksite<br />
% Workers Living in Camps and Living Out Allowance<br />
Scaffolding WH Factor<br />
= Scaffolding WH<br />
Total Direct WH<br />
Scaffolding Cost Factor<br />
= Total Scaffolding Cost<br />
Total Direct Cost<br />
Modules Installation : Pipe Rack, Process Equipment, and Building Modules<br />
Total Installed Unit Cost ($/ Unit Quantity)<br />
Productivity Estimate Accuracy = Estimated Productivity Rate<br />
Actual Productivity Rate<br />
Cost Estimate Accuracy<br />
= Estimated Total Installed Unit Cost<br />
Actual Total Installed Unit Cost<br />
Practices<br />
Workface Planning<br />
16
3.3 Understanding <strong>Benchmarking</strong> <strong>Report</strong>s and Analyses<br />
<strong>The</strong> project key report provides the feedback to a company regarding how their selected project(s)<br />
performed. It compares the project against the most comparable set of projects available for each<br />
individual metric. Importantly, each participating company can use their key report(s) to identify<br />
performance gaps in order to set objectives on future projects and to initiate improvements to key<br />
work processes.<br />
3.3.1 Metrics<br />
<strong>COAA</strong> Project performance metrics consist of cost, schedule, safety, change, field rework,<br />
engineering and construction productivity, and estimating performance (actual / estimated<br />
productivity rate and total installed unit cost). A lower score generally indicates better performance.<br />
For each individual metric, a typical comparison is provided in Figure 3-1. This figure shows that the<br />
sample project overran the budget by 3.6%, while the comparable dataset has 35 projects with an<br />
average cost growth of -4.0% (i.e., actual cost was 4% less than initially predicted). Overall, this<br />
project ranks in the third quartile on cost growth when compared with its peer projects. First quartile<br />
metrics are considered ‘best in class’.<br />
Figure 3-1 Example of Performance Metrics<br />
Practice metrics were scored using a ten point scale, with a higher number (i.e., 10) indicating better<br />
implementation of the selected practice. As can be seen in Figure 3-2, this sample project received<br />
a score of 8.929 for the use of Front End Planning (FEP). In comparison with 36 similar projects, this<br />
project ranks in the second quartile, which indicates that the project implemented FEP relatively well.<br />
Figure 3-2 Example of Practice Metrics<br />
17
3.3.2 Explanation of Statistics<br />
In addition to descriptive analyses previously presented and available in project key reports, this<br />
research also employed various statistical techniques to analyze projects residing in both <strong>COAA</strong> and<br />
CII databases. Primarily, box and whisker plots, pie charts and tabular descriptions were used to<br />
portray descriptive statistics for both databases. Where inferential statistics were used, methods of<br />
correlation including regression with trend lines and statistical tests of significance were incorporated<br />
in this research. Where used, box and whisker plots also incorporate a variety of test statistics<br />
including the standard T-test or Analysis of Variance (ANOVA) techniques, depending on the number<br />
of comparison groups and distribution of sample variances (Agresti and Finlay 1999). Figure 3-3<br />
provides an example of a Box and Whisker plot and associated terminology.<br />
Mean refers to the arithmetic average of a set of values, which is the sum of the variable value<br />
divided by the number of samples.<br />
Median is the number separating the higher half of a sample from the lower half.<br />
equivalent to the second quartile (Q2).<br />
Median is<br />
Sample Box and W hisker Diagram<br />
OutlierSymbol<br />
Third Quartile<br />
(Q 3)<br />
Last Obs ervation below<br />
(Q3 + 1.5IQR)<br />
Median<br />
Mean<br />
First Quartile<br />
(Q1)<br />
Las t Observation above<br />
(Q1 - 1.5IQR)<br />
Figure 3-3 Box and Whisker Diagram<br />
First Quartile (Q1) is also called as the 25 th percentile or lower quartile which refers to the threshold<br />
below which 25% of the sample have observed value(s).<br />
18
Third Quartile (Q3) indicates the 75 th percentile and delineates the highest 25% of data.<br />
Interquartile Range (IQR) refers to the range between the first quartile and the third quartile.<br />
Correlation (r) measures the strength of the linear relationship between variables (metrics) ranging<br />
from -1 to 1. However, a strong correlation does not prove that a causal relationship exists between<br />
observed variables. <strong>The</strong> magnitude close to -1 and to +1 merely indicates that a strong negative or<br />
positive relationship is observed between the two variables (i.e., when the relationship between them<br />
follows a straight line on a scatter plot). Notably, a correlation close to 0 indicates virtually no linear<br />
relationship. In this study, r0.5 is considered to have a high degree of<br />
correlation.<br />
Trend Line is based on the subjective evaluation of the best fit for the data and should not be used<br />
for the purpose of extrapolation. In the case where no evident trends exist, trend lines were omitted.<br />
<strong>The</strong> Coefficient of Determination (R 2 ) is the most frequently quoted measure representing the<br />
goodness of linear fit of the least square regression line. R 2 can be interpreted as the percentage of<br />
variation of the response variable explained by the regression line with the independent variable as<br />
the only explanatory variable. <strong>The</strong> better fit the line possesses, the closer R 2 should be to 1.<br />
Significant Value (p) is defined as the probability of making a decision to reject the null hypothesis<br />
when the null hypothesis is actually true. Usually, social science research accepts any probability<br />
value below 0.05 (or alpha level = 0.05) as being statistically meaningful. Consequently, any<br />
probability value below 0.05 is regarded as indicative of genuine effect (Field, 2005).<br />
19
4 Data Analysis<br />
This chapter presents selected results of significant analyses discovered by the research team.<br />
Instead of examining each project, this chapter describes how the databases of CII and <strong>COAA</strong><br />
projects were used to evaluate different hypotheses regarding the performance of projects in <strong>Alberta</strong>.<br />
<strong>The</strong> first three sub-sections provide a perspective of the database through the use of descriptive<br />
statistics. Subsequent sub-sections provide selected inferential analyses surrounding factors known<br />
and suspected to affect project performance. Notably, the fourth sub-section compares the project<br />
performance of <strong>Alberta</strong> and U.S. projects. <strong>The</strong> fifth and sixth sub-sections present analysis results<br />
for the observed engineering and construction productivity (respectively) in <strong>Alberta</strong> in comparison<br />
with U.S. projects. Finally, the results of factors impacting project cost, schedule and construction<br />
productivity are presented in the last sub-section.<br />
4.1 Description of <strong>Alberta</strong> Dataset<br />
<strong>The</strong> first round of data collection was completed over a period of 36 months. During this time, 78<br />
<strong>Alberta</strong>-based projects were established in the <strong>Alberta</strong> benchmarking system, though not all were<br />
finalized and submitted. By the end of October 2008, a total of 37 projects were submitted, validated<br />
and analyzed in this research. 28 projects were submitted by owners and 9 projects were submitted<br />
by contractors at either project sanction or completion. Table 4-1 and Figure 4-1 contain further<br />
descriptions of the dataset by type, nature, and delivery system. As can be seen in these exhibits,<br />
the majority of submitted projects are oil sands SAGD and upgrading facilities. Most submitted<br />
projects are grassroots facilities using parallel prime and design-bid-build (DBB) delivery systems.<br />
Importantly, all submitted projects used cost reimbursable contracts for their construction phases.<br />
<strong>The</strong>se terms, along with others used in this study, are presented in a glossary in Appendix C. It<br />
should be noted that due to the limited number of projects in the first round of this research, the<br />
lowest level of analysis that can be presented contains 10 or more projects in accordance with<br />
guidelines established by CII and <strong>COAA</strong>. <strong>The</strong>se provisions assure statistical significance and<br />
confidentiality and conform to published policies of the <strong>COAA</strong> <strong>Benchmarking</strong> Committee.<br />
20
Table 4-1 Submitted <strong>Projects</strong> by Owners and Contractors at Project Completion and Sanction<br />
Submitted at<br />
Project Types # <strong>Projects</strong> Completion<br />
Sanction<br />
Owner Contractor Owner Contractor<br />
Oil Sands Upgrading 12 3 1 6 2<br />
Oil Sands SAGD 12 8 3 1 -<br />
Natural Gas Processing 4 1 3 - -<br />
Oil Sands Mining/Extraction 3 1 - 2 -<br />
Pipeline 2 2 - - -<br />
Cogeneration 1 1 - - -<br />
Oil Refining 1 1 - - -<br />
Electrical (Generating) 1 - - 1 -<br />
Gas Distribution 1 1 - - -<br />
Total 37 18 7 10 2<br />
Modernization<br />
4 (11%)<br />
Traditional<br />
D-B-B<br />
3 (8%)<br />
CM at Risk<br />
5 (14%)<br />
Grass Roots<br />
19 (51%)<br />
Addition<br />
14 (38%)<br />
Parallel Primes<br />
17 (46%)<br />
Design-Build<br />
12 (32%)<br />
# of <strong>Projects</strong> (%of Total)<br />
# of <strong>Projects</strong> (%of Total)<br />
Figure 4-1 Number of Submitted <strong>Projects</strong> by Project Nature and Delivery System<br />
In this research, the total project cost is defined as the total installed cost for owners, whereas<br />
contractors reported total cost of their work scope. <strong>The</strong> distribution of all submitted projects at either<br />
sanction or completion and total project cost ($CDN) in 2007 can be seen in Figure 4-2. While all<br />
projects were normalized to July 2007, all submitted projects were also completed after 2003. Time<br />
adjustments were accomplished by using the historical index values contained in RS Means in order<br />
to produce valid comparison bases. <strong>The</strong> total number of projects shown in Figure 4-2 is 35,<br />
reflecting the fact that 2 projects did not provide project cost information. As a common practice in<br />
<strong>Alberta</strong>, most mega projects were split into several smaller projects (sub projects) and managed as a<br />
portfolio. Among the 37 submitted projects, half of these are considered as sub projects.<br />
Consequently, all are treated as individual projects for purposes of data analysis and comparison in<br />
the following sections.<br />
21
Number of Submitted <strong>Projects</strong> at Sanction& Completion<br />
Number of <strong>Projects</strong><br />
10<br />
9<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
1<br />
$1B<br />
Total<br />
11<br />
24<br />
Figure 4-2 Number of <strong>Projects</strong> Submitted at Sanction and Completion by Total Project Cost<br />
Category ($CDN in 2007)<br />
4.2 Selected Descriptive Analyses<br />
<strong>The</strong> analyses in this sub-section were conducted to provide an appreciation of the baseline metric<br />
values for the projects submitted by both owners and contractors. For these analyses, the<br />
distribution of metrics mostly related to project characteristics and performance and is presented with<br />
mean, median, range and quartile statistics using box and whisker diagrams.<br />
• Construction Indirect Cost and Work-Hours<br />
Figure 4-3 contains the distribution of construction indirect work hours for 20 projects as a proportion<br />
of direct work hours (i.e., the n value below the graph indicates the number of projects reporting this<br />
particular data). On average, the amount of indirect construction work hours for <strong>Alberta</strong>-based<br />
projects is about 34% of direct construction work hours. Moreover, the average indirect construction<br />
cost is 20.71% of total project cost. This can be seen in Figure 4-4.<br />
22
Construction Indirect/ Direct Work-Hours (%)<br />
70<br />
60<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
(N=20)<br />
34.09%<br />
Figure 4-3 Construction Indirect / Direct Work hours (%)<br />
Construction Indirect Cost/ Total Project Cost (%)<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
20.71%<br />
(N=20)<br />
Figure 4-4 Construction Indirect Cost / Total Project Cost (%)<br />
• % Modularization 1<br />
Figure 4-5 contains a comparison of the percentage of project cost spent using modularization by<br />
project nature. Here, the dataset includes 17 grass roots projects and 13 addition projects with<br />
modularization data (there was insufficient data to report for modernization projects). On average,<br />
grassroots projects spent 19.4% of their total project cost on modularization, compared to 12.3%<br />
spent on addition projects. This difference, however, is not statistically significant (t = 1.517, p>0.05).<br />
1 % Modularization is a percentage value that describes the level of modularization (offsite construction), and<br />
defined as a ratio of the cost of all modules divided by total installed cost.<br />
23
Modularization/Total Proejct Cost(%)<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
19.41<br />
Grass Roots<br />
(N=17)<br />
12.31<br />
Addition<br />
(N=13)<br />
Figure 4-5 Modularization by Project Nature<br />
• Project Delivery Systems<br />
Figures 4-6 and 4-7 compare the effectiveness of parallel primes and all other project delivery<br />
methods combined by cost and schedule growth, respectively. <strong>The</strong> research found that 46% of the<br />
projects in the <strong>Alberta</strong> benchmarking database used a parallel primes project delivery method. Other<br />
project delivery methods included traditional design/bid/build (D/B/B), design/build (D/B), multiple<br />
design-build and construction management (CM). <strong>The</strong>se methods were combined due to insufficient<br />
numbers of projects in each of these categories. Nonetheless, these results show a slight advantage<br />
to the use of parallel primes over other delivery methods with respect to schedule, but not with<br />
respect to project cost. In addition, parallel primes projects had slightly lower average project<br />
schedule growth (0.15) in comparison with all other project delivery methods (0.19) and,<br />
simultaneously, higher project cost growth (0.23 vs. 0.13). <strong>The</strong>se differences are not statistically<br />
significant (t = -0.378, p>0.05) for project schedule growth, nor are they significant for project cost<br />
growth (t = 0.756, p>0.05). <strong>The</strong>se results are presented here merely for the reader’s enhanced<br />
understanding of the project data used for this report.<br />
24
1.2<br />
1.0<br />
Project Cost Growth<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
0.23<br />
0.13<br />
-0.2<br />
-0.4<br />
Parallel Primes<br />
(N=14)<br />
Other<br />
(N=10)<br />
Figure 4-6 Project Cost Growth by Project Delivery System<br />
1.00<br />
Project Schedule Growth<br />
0.75<br />
0.50<br />
0.25<br />
0.15<br />
0.19<br />
0.00<br />
Parallel Primes<br />
(N=14)<br />
Other<br />
(N=10)<br />
Figure 4-7 Project Schedule Growth by Project Delivery System<br />
4.3 Selected Inferential Analyses<br />
Inferential analyses were used to explore the relationships amongst project characteristics and the<br />
implementation of best practices on project performance. This sub-section provides samples of<br />
analyses used to determine if any trends or relationships exist between variables for the purpose of<br />
identifying the potential root causes that may help explain the performance of <strong>Alberta</strong>-based projects.<br />
Importantly, it should be noted that the trends or relationships presented in this sub-section should<br />
25
not be used to predict, or forecast the performance of any current or future project. Regression and<br />
trend lines shown here are considered explanatory only for the projects being analyzed.<br />
• Percent Engineering Completed before Construction Started<br />
<strong>The</strong> relationship between percent engineering completed before construction started and<br />
construction phase cost growth can be seen in Figure 4-8. Note that a complete list of project<br />
metrics is included in Appendix B. Given the expert opinions of members of the <strong>COAA</strong><br />
<strong>Benchmarking</strong> Committee, the relationship displayed in Figure 4-8 uses a cubic polynomial pattern<br />
due to the fact that as more design is completed before construction begins, the project tends to<br />
have less construction phase cost growth. This trend holds true until, at a certain point, the cost<br />
growth curve flattens and subsequently increases. Thus, an optimum value is found at approximately<br />
60% engineering complete. This result is consistent with other studies completed by CII and other<br />
industry forums. <strong>The</strong> results are also statistically significant, meaning that a strong relationship<br />
exists between the percentage of engineering completed prior to construction start and construction<br />
phase cost growth (R 2 = 0.63, p = 0.016). Likewise, the results also demonstrate a statistically<br />
significant correlation with r = -0.723, p = 0.003. Due to limited number of data, predictability is not<br />
inferred, nor concluded, in this research.<br />
1.00<br />
Construction Phase Cost Growth<br />
0.75<br />
0.50<br />
0.25<br />
0.00<br />
-0.25<br />
-0.50<br />
-0.75<br />
0<br />
10 20 30 40 50 60 70 80 90<br />
% Design completed before construction started<br />
100<br />
Figure 4-8 Effect of % Engineering Completed before Construction Started<br />
26
• Peak Construction Workforce<br />
Analyses were conducted to examine how a change in construction workforce peak numbers affects<br />
project performance. This can be seen in Figure 4-9. <strong>The</strong> results indicate that the projects which<br />
estimated their actual peak workforce numbers with greater precision experienced higher levels of<br />
project cost and schedule performance. In fact, the relationship between the ratio of actual to<br />
estimated peak workforce and project cost growth is statistically strong (r = 0.787, p =0.001). <strong>The</strong><br />
regression model also indicates a statistically strong high R-square (R 2 = 0.62, p< 0.001). A medium<br />
to strong relationship was also identified between project schedule growth and the ratio of actual to<br />
estimated peak construction workforce (r = 0.486, p = 0.011).<br />
1.2<br />
1.0<br />
Project Cost Growth<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
-0.2<br />
-0.4<br />
0.0<br />
0.5<br />
1.0<br />
1.5<br />
2.0<br />
2.5<br />
3.0<br />
Actual/ Estimated Peak Construction Workforce<br />
Figure 4-9 Actual / Estimated Number of Peak Construction Workforce<br />
• Construction Indirect Work-Hours/ Direct Work hours (%)<br />
<strong>The</strong> relationship between construction indirect work hours and project schedule factor can be seen in<br />
Figure 4-10. This figure indicates that projects with high ratios of construction indirect work hours tend<br />
to have better project schedule performance. Here, the lower schedule factor may mean that better<br />
schedule performance may be obtained by isolating the schedule impact of change orders. <strong>The</strong><br />
analysis shows that the relationship between these metrics can be characterized as medium to strong<br />
and statistically significant (r= -0.446, p=0.05). <strong>The</strong> linear regression model is also statistically<br />
significant, yet presents a low R-square value (R 2 = 0.20, p= 0.05).<br />
27
2.00<br />
1.75<br />
Project Schedule Factor<br />
1.50<br />
1.25<br />
1.00<br />
0.75<br />
0.50<br />
0.25<br />
0.00<br />
0<br />
10<br />
20<br />
30<br />
40<br />
50<br />
60<br />
70<br />
80<br />
90<br />
100<br />
Construction Indirect WH/Direct WH (%)<br />
Figure 4-10 Construction Indirect Work-hours/ Direct Work hours (%)<br />
• Project Size ($)<br />
Figure 4-11 contains the analysis of how project size ($ CDN, in 2007) affects construction indirect<br />
cost growth. Construction indirect cost growth is calculated as actual indirect cost divided by<br />
estimated indirect cost. <strong>The</strong> results indicate that larger projects tend to have higher levels of<br />
construction indirect cost growth, based on their own estimates. <strong>The</strong>se results are statistically strong<br />
(r= 0.599, p=0.011) and indicate that a relationship does exist between project size and construction<br />
indirect cost growth. <strong>The</strong> regression model also possesses a medium R-square (R 2 = 0.36, p= 0.011)<br />
value.<br />
1.50<br />
Construction Indirect Cost Growth<br />
1.25<br />
1.00<br />
0.75<br />
0.50<br />
0.25<br />
0.00<br />
-0.25<br />
-0.50<br />
0<br />
200 400 600 800 1000<br />
Adjusted Total Project Cost ($M CDN, in 2007)<br />
1200<br />
Figure 4-11 Construction Indirect Cost Growth by Project Size ($)<br />
28
• Project Risk Assessment (PRA)<br />
<strong>The</strong> effects of Project Risk Assessment (PRA) on project performance are well known and were<br />
investigated for this study. As defined by CII, PRA is the process needed to identify, assess and<br />
manage risk. In PRA, the project team evaluates risk exposure for potential project impacts in order<br />
to provide focus for mitigation strategies. <strong>The</strong> analysis of <strong>COAA</strong> data indicate that high levels of<br />
implementation success of PRA are accompanied by better project cost performance as can be seen<br />
in Figure 4-12.<br />
For this practice, the statistical relationship is medium-strong and statistically<br />
significant (r = -0.436, p = 0.048). However, for PRA as implemented on <strong>Alberta</strong> projects, the<br />
regression model exhibits low R-square values (R 2 = 0.19, p= 0.048).<br />
1.2<br />
1.0<br />
Project Cost Growth<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
-0.2<br />
-0.4<br />
-0.6<br />
0<br />
1<br />
2<br />
3<br />
4<br />
5<br />
6<br />
7<br />
8<br />
9<br />
10<br />
Project Risk Assessment<br />
Figure 4-12 Project Risk Assessment vs. Project Cost Growth<br />
• Constructability<br />
Constructability is defined as the effective and timely integration of construction knowledge and<br />
experience into the conceptual planning, design, construction, and field operations of a project to<br />
achieve the overall project objectives.<br />
As can be seen in Figure 4-13, increased use of<br />
constructability on <strong>Alberta</strong> project leads to better project schedule performance (i.e., lower project<br />
schedule growth). This relationship is statistically significant (r = -0.528, p = 0.008), (R 2 = 0.28, p =<br />
0.008). Interestingly, the effect of constructability on cost performance is not significant for the<br />
<strong>COAA</strong> dataset.<br />
<strong>The</strong>se results are consistent with previous analyses developed using CII’s<br />
benchmarking and metrics database.<br />
29
1.25<br />
Project Schedule Growth<br />
1.00<br />
0.75<br />
0.50<br />
0.25<br />
0.00<br />
-0.25<br />
-0.50<br />
0<br />
1<br />
2<br />
3<br />
4 5 6<br />
Constructability<br />
7<br />
8<br />
9<br />
10<br />
Figure 4-13 Constructability vs. Project Schedule Growth<br />
• Analysis of Other Best Practices<br />
Analyses of other best practices were also conducted. Two are included here: planning for startup<br />
and workface planning. Other evaluations of additional surveyed best practices are not presented<br />
here due to limited space and the fact that they are summarized in a table which can be found in<br />
Appendix A.<br />
Planning for startup is defined as the effective facilitation of the activities that occur between<br />
mechanical completion (i.e., plant construction completion) and the commencement of commercial<br />
operations. As can be seen in Figure 4-14, the analysis conducted by this research indicates that<br />
improved use of planning for startup methods tends to improve the cost performance of the startup<br />
phase. However, this conclusion is made with caution due to the small sample size involved.<br />
Finally, the <strong>COAA</strong> best practice of workface planning was also assessed. Workface planning is<br />
defined by <strong>COAA</strong> as the process of organizing and delivering all elements necessary, before work is<br />
started, to enable craft persons to perform quality work in a safe, effective and efficient manner. <strong>The</strong><br />
relationship between workface planning and construction phase schedule performance can be seen<br />
in Figure 4-15. However, no regression line is plotted due to the limited number of projects reported<br />
in this first round. Nonetheless, the figure is shown here as it is believed that workface planning<br />
does help improve jobsite productivity by assuring that the required resources, tools, equipment and<br />
material are made available to craft workers in a timely fashion. More data will be needed for a more<br />
30
comprehensive evaluation of this specific best practice. However, even then, as discussed by<br />
Kellogg et al (1981), the optimization of jobsite performance may be limited in comparison with the<br />
planning and engineering.<br />
3<br />
Startup Phase Cost Growth<br />
2<br />
1<br />
0<br />
-1<br />
-2<br />
5<br />
6<br />
7<br />
8<br />
Planning for Startup<br />
9<br />
10<br />
Figure 4-14 Planning for Startup vs. Startup Phase Cost Growth<br />
0.8<br />
Construction Schedule Growth<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
-0.2<br />
-0.4<br />
0<br />
1<br />
2<br />
3<br />
4<br />
5<br />
6<br />
7<br />
8<br />
9<br />
10<br />
Workface Planning Index<br />
Figure 4-15 Workface Planning vs. Construction Schedule Growth<br />
31
4.4 Comparison of <strong>Alberta</strong> and U.S. Project Performance<br />
A primary focus for this research effort was to obtain comparisons of project performance in <strong>Alberta</strong> with<br />
projects executed in the United States using the CII <strong>Benchmarking</strong> and Metrics (BM&M) database. To<br />
accomplish this objective, U.S. projects are limited to projects with an adjusted total installed cost<br />
greater than $5 million (CDN), normalized to 2007. In this study, we consider U.S. EMR projects to<br />
include oil exploration / production, oil upgrading / refining, natural gas, pipeline, chemical manufacturing,<br />
power generation, and mining. In the following analyses, the symbol ♦ is used to indicate arithmetic<br />
mean and the symbol is used to indicate the median of a particular group.<br />
<strong>Alberta</strong>-based projects are unique projects. <strong>The</strong>re are significant differences when comparing them<br />
to U.S.-based projects. Principally, most of the <strong>COAA</strong> projects are larger than their U.S.<br />
counterparts in terms of cost. <strong>The</strong>y are also located in remote locations and are subjected to<br />
extreme (northern climate) weather conditions. Often, work camps are built and transportation for<br />
large numbers of workers becomes necessary. However, the analyses presented in this sub-section<br />
are not intended to quantify these differences, but rather, examine differences in project size,<br />
contingency, and cost, schedule, and change performance.<br />
• Comparison of Project Size ($) for two Datasets<br />
Figure 4-16 provides the distribution of <strong>Alberta</strong>-based and U.S.-based projects included in this study<br />
in terms of project cost. Notably, the average size and range of the 353 included U.S. projects are<br />
Adjusted Project Cost ($M, in 2007)<br />
1200<br />
1000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
367.83<br />
185.82<br />
<strong>Alberta</strong><br />
(N=23)<br />
84.83<br />
40.43<br />
U.S.<br />
(N=353)<br />
Figure 4-16 Project Size ($M CDN, in 2007)<br />
32
notably smaller when compared with <strong>Alberta</strong>-based projects.<br />
Based on past research and<br />
benchmarking experience, this difference is a significant factor in quantifying performance and<br />
should be considered in understanding the analyses presented here.<br />
• Comparison of Contingency Budget (%)<br />
As can be seen in Figure 4-17, the amount of contingency for <strong>Alberta</strong> and U.S.-based projects are<br />
quite comparable.<br />
Project data shows a slightly higher average contingency rate (8.04%) for<br />
<strong>Alberta</strong>-based projects when compared to U.S.-based projects (7.77%). However, the difference is<br />
not statistically different (t= 0.33, p= 0.742).<br />
Total Contingency Budget/ Total Project Cost (%)<br />
20<br />
18<br />
16<br />
14<br />
12<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
8.04%<br />
<strong>Alberta</strong><br />
7.77%<br />
U.S.<br />
(N=17)<br />
(N=52)<br />
Figure 4-17 Contingency Budget (%)<br />
• Comparison of Project Cost and Schedule Performance<br />
Figures 4-18 and 4-19 compare the project cost growth and project schedule growth of projects<br />
executed in <strong>Alberta</strong> and in the U.S. Results show significantly higher average cost growth and<br />
schedule growth for the <strong>Alberta</strong> projects. <strong>The</strong>se projects also demonstrate that a much wider range<br />
of performance exists as well. On average, <strong>Alberta</strong>-based projects experienced 19% project cost<br />
growth and 17% project schedule growth, while U.S. projects experienced 3% and 6% cost and<br />
schedule growth, respectively. <strong>The</strong> test of mean difference between these two groups also indicates<br />
that the average cost and schedule growth of <strong>Alberta</strong> project is statistically significant (t = 3.89, p =<br />
0.000 for cost and t = 3.838, p = 0.000 for schedule). Additionally, these figures show that the<br />
33
<strong>Alberta</strong>-based projects possess a much wider range of performance (i.e., -27% to 69% for cost<br />
growth and -15% to 35% for schedule growth) when compared to projects executed in the U.S.<br />
1.2<br />
1.0<br />
Project Cost Growth<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
0.19<br />
0.03<br />
-0.2<br />
-0.4<br />
<strong>Alberta</strong><br />
(N=24)<br />
U.S.<br />
(N=352)<br />
Figure 4-18 Project Cost Growth<br />
1.25<br />
1.00<br />
Project Schedule Growth<br />
0.75<br />
0.50<br />
0.25<br />
0.00<br />
0.17<br />
0.06<br />
-0.25<br />
-0.50<br />
<strong>Alberta</strong><br />
(N=24)<br />
U.S.<br />
(N=338)<br />
Figure 4-19 Project Schedule Growth<br />
• Comparison of Change Cost Factor<br />
Figure 4-20 contains an analysis of the comparison of development change cost factor and scope<br />
change cost factor for the selected <strong>Alberta</strong> and U.S. projects. In this analysis, the <strong>Alberta</strong>-based<br />
projects have a slightly higher average development change cost factor (0.06) when compared to<br />
U.S.-based projects (0.04). In contrast, the average scope change cost factor for projects in <strong>Alberta</strong><br />
34
is slightly lower than that of U.S. projects. However, these differences are not considered to be<br />
statistically significant (p > 0.05). Finally, an analysis of total field rework cost (defined as a ratio of<br />
total direct cost of field rework to actual construction phase cost) indicated that <strong>Alberta</strong> projects are<br />
also in line with U.S.-based projects.<br />
0.4<br />
0.3<br />
Change Cost Factor<br />
0.2<br />
0.1<br />
0.0<br />
0.06<br />
0.04<br />
0.02<br />
0.04<br />
-0.1<br />
-0.2<br />
<strong>Alberta</strong><br />
U.S.<br />
<strong>Alberta</strong><br />
U.S.<br />
Development_Change<br />
Scope_Change<br />
(N=11) (N=14) (N=13) (N=14)<br />
Figure 4-20 Development and Scope Change Cost Factor<br />
4.5 Engineering Productivity<br />
Twenty-three of the 37 <strong>Alberta</strong>-based projects submitted for this research provided measures of<br />
engineering productivity. Of these 23 projects, their average project cost was $367 Million (CDN),<br />
normalized to July 2007. As can be seen in Figure 4-21, the CII BM&M database was able to return<br />
57 EMR projects that also contained engineering productivity data. <strong>The</strong>se projects reported an<br />
average cost of $90 Million (CDN), also normalized to July 2007. As previously described, this<br />
differential in average project cost may impact the direct measures of engineering productivity<br />
reported here. Also, in order to ensure appropriate comparisons, the unit of measure of both U.S.<br />
and <strong>Alberta</strong> projects used to calculate engineering productivity is the metric system (e.g., linear<br />
meter, metric ton) and data have been converted to meet this standard. In general, engineering<br />
productivity metrics use direct engineering work hours in metrics comparing them with specific<br />
issued for construction (IFC) quantities for specific disciplines. <strong>The</strong>se are discussed next.<br />
35
Adjusted Project Cost ($M, in 2007)<br />
1200<br />
1000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
367.83<br />
185.82<br />
<strong>Alberta</strong><br />
U.S.<br />
90.40<br />
30.88<br />
(N=23)<br />
(N=57)<br />
Figure 4-21 Comparison of Project Size ($M CDN, in 2007) for Engineering Productivity<br />
Dataset<br />
• Comparison between <strong>Alberta</strong> versus U.S. <strong>Projects</strong> by Engineering Disciplines<br />
Selected disciplines of engineering productivity are presented in this section. Comparisons between<br />
<strong>Alberta</strong>-based and U.S.-based projects are presented by using both arithmetic mean value (indicated<br />
by the symbol ♦), and weighted mean value (represented by the symbol ⊗). Here, the weighted<br />
mean is calculated as an aggregated productivity rate and is weighted by project size. Essentially,<br />
this mean creates one large, imaginary project where total work hours and total quantities are<br />
assimilated. Previous analysis by CII indicates that this approach is valid and that large projects<br />
typically experience better productivity rates (due to larger quantities) when compared with smaller<br />
projects possessing smaller quantities and lower levels of repetitive work and economies of scale.<br />
• Concrete Engineering Productivity 2<br />
As can be seen in Figure 4-22, the results of engineering productivity metrics for <strong>Alberta</strong>-based<br />
projects and U.S.-based projects are mixed. <strong>Alberta</strong>-based projects have comparable concrete<br />
engineering productivity in line with U.S.-based projects when considering mean values. In fact, after<br />
considering project size, the weighted average concrete engineering productivity rate of <strong>Alberta</strong><br />
projects is actually better than that of U.S. projects.<br />
2 Total Concrete include slabs, foundations, and concrete structures.<br />
36
Total Concrete- Eng. Prod. Rate (WH/CM)<br />
20<br />
15<br />
10<br />
5<br />
0<br />
5.92<br />
⊗ 3.53<br />
<strong>Alberta</strong><br />
(N=17)<br />
⊗ 6.26<br />
4.52<br />
U.S.<br />
(N=31)<br />
Figure 4-22 Comparison of Concrete Engineering Productivity (WH/ Cubic Meter)<br />
• Total Structural Steel Engineering Productivity 3<br />
Figure 4-23 indicates that U.S.-based EMR projects perform the engineering of structural steel with<br />
higher levels of productivity when compared with <strong>Alberta</strong>-based projects (10.96 WH / ton versus<br />
23.08 WH / ton). <strong>The</strong> weighted average productivity rate of U.S. projects is also better (5.86 WH /<br />
ton versus 12.64 WH / ton). This difference of average structural steel engineering productivity<br />
rates is statistically different (t = 2.501, p = 0.02). No cause of this difference is indicated.<br />
Steel- Eng. Prod. Rate (WH/Metric Ton)<br />
70<br />
60<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
23.08<br />
⊗ 12.64<br />
<strong>Alberta</strong><br />
(N=19)<br />
10.96<br />
⊗ 5.86<br />
U.S.<br />
(N=56)<br />
Figure 4-23 Comparison of Structural Steel Engineering Productivity (WH/ Metric Ton)<br />
3 Total of structural steel include structural steel, pipe racks & utility bridges, and miscellaneous steel.<br />
37
• Piping Engineering Productivity 4<br />
As can be seen in Figure 4-24, <strong>Alberta</strong>-based projects demonstrate higher levels of piping<br />
engineering productivity when compared with U.S.-based projects. This holds true for comparisions<br />
of small bore pipe, large bore pipe, and all pipe sizes combined. <strong>The</strong>se results are consistent using<br />
both measures of average and weighted productivity as can be seen in the figure. It should be noted<br />
that the difference portrayed here in the average piping engineering productivity rates is statistically<br />
significant only for large bore pipe (t = -2.663, p = 0.012), yet this difference is negligible when<br />
examining only the projects which reported only total piping data (i.e., no reporting of bore size).<br />
Again, no cause of the differential reported here is indicated.<br />
8<br />
Piping- Eng. Prod. Rate (WH/LM)<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
2.58<br />
2.08<br />
⊗ 1.97<br />
⊗ 1.70<br />
2.03 1.60<br />
⊗<br />
1.00<br />
0.88<br />
1.28 ⊗ 1.23<br />
⊗ 0.78 ⊗ 0.47<br />
<strong>Alberta</strong> U.S. <strong>Alberta</strong> U.S. <strong>Alberta</strong> U.S.<br />
SmallBore(
time adjustment to July 2007. While the project sizes differ, the comparisons which follow are<br />
considered to be valid because of how this study defined construction productivity as the ratio of field<br />
direct work hours (WH) per applicable installed quantity.<br />
1800<br />
Adjusted Project Cost ($M, in 2007)<br />
1600<br />
1400<br />
1200<br />
1000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
459.68<br />
285.49<br />
122.08<br />
81.13<br />
<strong>Alberta</strong><br />
(N=33)<br />
U.S.<br />
(N=29)<br />
Figure 4-25 Comparison of Project Size ($M CDN, in 2007) for Construction Productivity<br />
• Comparison Between <strong>Alberta</strong> and U.S. <strong>Projects</strong> by Work Disciplines<br />
Construction productivity for selected disciplines are presented in this sub-section. As was done with<br />
measures of engineering productivity, the arithmetic mean is represented by the symbol (♦), and the<br />
weighted mean (i.e., a hypothetical single large project) is represented by the symbol (⊗) for<br />
purposes of comparisons of construction productivity rates between <strong>Alberta</strong> and U.S.-based projects.<br />
• Concrete Construction Productivity 5<br />
Figure 4-26 provides an assessment of concrete construction productivity. As can be seen in the<br />
figure, U.S.-based projects place concrete more efficiently than do <strong>Alberta</strong> projects (U.S. average<br />
total concrete productivity rate is 14.44 WH/m 3 , compared to 19.39 WH/m 3 for <strong>Alberta</strong> projects). <strong>The</strong><br />
results are also considered to be consistent even given the differences in the size of the projects<br />
used for this analysis. Notably, the weighted average productivity rates of U.S.-based projects is<br />
9.72 WH/m 3 , compared to 13.10 WH/m 3 for <strong>Alberta</strong>-based projects, although this difference is not<br />
considered to be statistically significant.<br />
5 Total Concrete includes slabs, foundations, and concrete structures.<br />
39
Total Concrete Productivity Rate (WH/ CM)<br />
60<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
19.39<br />
⊗ 13.10<br />
<strong>Alberta</strong><br />
(N=12)<br />
14.44<br />
⊗ 9.72<br />
U.S.<br />
(N=32)<br />
Figure 4-26 Comparison of Total Concrete Construction Productivity (WH/ m 3 )<br />
• Total Structural Steel Construction Productivity<br />
As can be seen in Figure 4-27, U.S.-based projects are more productive in erecting structural steel<br />
than <strong>Alberta</strong> projects are (53.95 WH/MT versus 42.41 WH/MT). This difference is not statistically<br />
significant. However, the weighted average productivity rate of <strong>Alberta</strong>-based projects is slightly<br />
better than that of U.S.-based projects by 1.06% when considering project size.<br />
Total Steel Prod. Rate (WH/Metric Ton)<br />
180<br />
160<br />
140<br />
120<br />
100<br />
80<br />
60<br />
40<br />
20<br />
0<br />
53.95<br />
⊗ 37.96<br />
<strong>Alberta</strong><br />
(N=21)<br />
42.41<br />
⊗ 38.37<br />
U.S.<br />
(N=32)<br />
Figure 4-27 Comparison of Total Structural Steel Construction Productivity (WH/ Metric Ton)<br />
40
• Instrumentation – Devices Construction Productivity<br />
Figure 4-28 provides an assessment of the productivity of installation of instrumentation – devices.<br />
Project data reported for this study revealed that the arithmetic mean of instrumentation – devices<br />
productivity rate of <strong>Alberta</strong>-based projects is comparable to that of U.S.-based projects (13.37<br />
WH/Count versus 13.53 WH/Count, respectively). However, the weighted average productivity rate<br />
of U.S.-based projects is significantly better (i.e., 158% better) than that of their <strong>Alberta</strong>-based<br />
counterparts. This is primarily due to the discrepancies that exist for instrumentation – devices<br />
productivity rates between small projects and large projects.<br />
Instrumentation- Devices Con. Prod. Rate (WH/ Count)<br />
50<br />
40<br />
30<br />
20<br />
10<br />
0<br />
⊗<br />
21.40<br />
13.37<br />
<strong>Alberta</strong><br />
(N=9)<br />
13.53<br />
⊗ 8.28<br />
U.S.<br />
(N=22)<br />
Figure 4-28 Comparison of Instrumentation- Devices Construction Productivity (WH/ Count)<br />
• Insulation – Piping Construction Productivity<br />
As can be seen in Figure 4-29, the average (i.e., arithmetic mean) piping insulation productivity rate<br />
of <strong>Alberta</strong>-based projects is comparable to that of U.S.-based projects (i.e., 1.90 WH/LM versus 1.93<br />
WH/LM, respectively). However, when the weighted mean calculation is used, the <strong>Alberta</strong>-based<br />
projects outperformed their U.S.-based counterparts by 35.6%. One hypothesis for this observed<br />
difference is that <strong>Alberta</strong>-based projects likely have much more piping insulation, on average, and<br />
that the metrics used for this study are possibly indicating the benefits of repetition for this particular<br />
construction activity.<br />
41
Insulation- Piping Con. Prod. Rate (WH/LM)<br />
8<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
1.90<br />
⊗<br />
1.41<br />
<strong>Alberta</strong><br />
(N=16)<br />
2.19<br />
⊗ 1.93<br />
U.S.<br />
(N=15)<br />
Figure 4-29 Comparison of Insulation- Piping Construction Productivity (WH/ Linear Meter)<br />
• Construction Productivity Project Level Index (CPM Index)<br />
Recently, CII has produced a method for examining construction productivity at the project level by<br />
weighting and combining the productivity rates for various disciplines for each observed project. This<br />
method, known currently as the Construction Productivity Method (CPM) Index, provides a macroview<br />
of project performance. As a relative productivity performance measure, the CPM Index ranges<br />
from -3 to 3, with -3 indicating the poorest observed productivity performance. Here, one unit<br />
difference in the CPM index is equivalent to a 100% observed difference in productivity.<br />
Construction Prod. Project Level Index<br />
3<br />
2<br />
1<br />
0<br />
-1<br />
-2<br />
-3<br />
0<br />
200 400 600 800 1000 1200<br />
Adjusted Total Project Cost ($M CDN, in 2007)<br />
Figure 4-30 Construction Productivity Project Level Index vs. Project Size ($M CDN, in 2007)<br />
42
<strong>The</strong> project-level CPM index is critical to the examination of factors affecting construction productivity<br />
because, most of the time, these factors affect all disciplines and not individual disciplines. As can<br />
be seen in Figure 4-30, the project data for <strong>Alberta</strong>-based projects indicates that large projects had<br />
better overall construction productivity than small projects did. <strong>The</strong> analysis provides for a<br />
statistically significant, medium strength correlation (r = -0.374, p = 0.008), although the linear<br />
regression line is not statistically significant (R 2 = 0.13, p = 0.115) and should not be used for<br />
estimating or forecasting purposes. However, the idea that larger projects have better construction<br />
productivity is made with caution since the CPM index includes only measures direct construction<br />
productivity. Indeed, larger projects tend to have larger installed quantities and higher amounts of<br />
repetitive work and these factors may impact overall construction productivity figures. Notably, these<br />
results are consistent with previous analyses conducted by CII.<br />
This research explored other aspects of construction productivity as well. One example involves the<br />
analysis of the effect work schedule (days on and off) has on construction productivity. This study<br />
concluded that a work schedule of 10 days on and 4 days off was more productive than a work<br />
schedule of 5 days on and 2 days off. In fact, an 11% difference was observed using the CPM Index,<br />
although strong statistical significance was not present due to low numbers of project observations.<br />
• Actual / Estimated Construction Productivity Rate by Work Discipline<br />
Figure 4-31 provides an assessment of the accuracy of field productivity estimates for three crafts.<br />
This research discovered that <strong>Alberta</strong>-based projects significantly underestimate construction<br />
productivity. Observed data demonstrate that piping, structural steel, and concrete actual rates<br />
exceeded their estimated rates by 4%, 22% and 45% (respectively), on average.<br />
3.0<br />
Actual/ Estimated Productivity Rate<br />
2.5<br />
2.0<br />
1.5<br />
1.0<br />
0.5<br />
0.0<br />
1.45<br />
1.22<br />
1.04<br />
Total_Concrete<br />
Total_Steel<br />
Total_Piping<br />
(N=8) (N=17) (N=10)<br />
Figure 4-31 Actual / Estimated Construction Productivity Rate by Work Discipline<br />
43
• Actual / Estimated Total Installed Unit Cost (TIUC) 6 by Work Discipline<br />
To give some context to Figure 4-31, Figure 4-32 provides an assessment of the accuracy of unit<br />
cost estimates by craft. Due to the fact that labour accounts for about 30% of total installed unit cost<br />
(TIUC), a moderating effect exists on field productivity when other factors are considered. In fact,<br />
underestimates of 2%, 11%, and 10% were observed for piping, structural steel, and concrete,<br />
respectively. Consequently, construction labour productivity rates must be estimated with caution.<br />
Actual/ Est. Total Installed Unit Cost<br />
2.5<br />
2.0<br />
1.5<br />
1.0<br />
0.5<br />
0.0<br />
1.10 1.11<br />
1.02<br />
Total_Concrete<br />
Total_Steel<br />
Total_Piping<br />
(N=9) (N=15) (N=8)<br />
Figure 4-32 Actual / Estimated Total Installed Unit Cost (TIUC) by Work Discipline<br />
4.7 Analysis of Impact Factors<br />
Working with CII, the <strong>COAA</strong> <strong>Benchmarking</strong> Committee developed a list of 18 potential factors known<br />
to impact project cost, schedule, and engineering and construction productivity. This sub-section<br />
contains analyses of these impact factors and their relationship to cost, schedule, and overall<br />
construction productivity performance. Importantly, these analyses rely upon the subjective<br />
knowledge of industry professionals working on the <strong>Alberta</strong>-based projects contributing data for this<br />
study. Beyond the 12 impact factors routinely used by CII, the <strong>COAA</strong> <strong>Benchmarking</strong> Committee<br />
added an additional 6 factors, specifically for <strong>Alberta</strong>-based projects:<br />
6 Total installed unit cost (TIUC) is defined as the burdened cost of direct labour, bulk material, final asset equipment, and<br />
civil and sitework equipment by pro rata share including overhead and profit from both direct hire and subcontract. Burden<br />
cost of direct labour includes insurance, welfare and other fund and charges associated to labour by regulations.<br />
44
1) Quality of Field-Level Supervision<br />
2) Amount of Scheduled Overtime<br />
3) Amount of Unplanned Overtime<br />
4) Engineering Labour Skill<br />
5) Percentage of Engineering Completed Prior to Project Sanction<br />
6) Percentage of Engineering Completed Prior to Construction Start<br />
For this study, the industry professionals contributing data for each project were requested to assess<br />
whether each of these factors adversely or positively affected project performance (beyond which<br />
was planned for) using a scale ranging from “highly negative”, to “highly positive”.<br />
<strong>The</strong> results in this sub-section show the combined, relative impact of factors affecting project cost,<br />
schedule and construction productivity. In Figures 4-33, 4-35, and 4-37, each factor is ranked using<br />
the average degree of impact as reported on all projects as indicated by the symbol ( ). In these<br />
figures, the whisker line spreading out from the average indicates the dispersion of impact rating by<br />
using one standard deviation (S.D.) in both directions (i.e., -1 to +1). Notably, the factors with less<br />
than 10 responses were not reported. Consequently, some figures contain more comparisons of<br />
impact factors than others.<br />
As can be seen in Figure 4-33, the factor having the most impact on project cost (when compared to<br />
that which was planned) was the amount of unplanned overtime. This was followed closely by the<br />
percent of engineering completed prior to construction, business market conditions, craft labour skill,<br />
and coordination of plant shut down. <strong>The</strong>se are the top four impact factors on project cost and<br />
demonstrate an average impact of -0.889, -0.722, -0.565, and -0.500, respectively.<br />
Figure 4-34 provides a perspective of the impact of 16 factors on project cost growth. <strong>The</strong><br />
cumulative impact is significant and a very strong correlation exists (i.e., R 2 = 0.56). As a result, this<br />
research found that the 16 factors seen in Figure 4-33 had a large, negative impact on the cost<br />
performance of the <strong>Alberta</strong>-based projects. In all cases, these impacts (on average) were worse<br />
than the projects had planned for.<br />
45
Figure 4-33 Factors Impacting Project Cost<br />
Hi Positive<br />
Impact<br />
Hi Negative<br />
Impact<br />
Sum Degree Impact of Top 16 Factors vs. Cost Growth<br />
Sum Degree of<br />
Impact<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
-1.2 -1 -0.8 -0.6 -0.4 -0.2-2<br />
0 0.2 0.4 0.6 0.8 1 1.2<br />
-4<br />
-6<br />
-8<br />
-10<br />
Poor Cost<br />
Performance<br />
Figure 4-34 Impact of Factors vs. Cost Growth<br />
Project<br />
Cost Growth<br />
As can be seen in Figure 4-35, the factor having the most impact on project schedule (when<br />
compared to that which was planned) was the percentage of engineering completed prior to<br />
construction start. This was followed closely by business market conditions, craft labour skill, quality<br />
of field-level supervision and weather conditions. <strong>The</strong> top five impact factors on project schedule<br />
demonstrate an average impact of -0.667, -0.611, -0.565, -0.525, and -0.524, respectively.<br />
46
Figure 4-36 provides a perspective of the impact of the top 18 factors on project schedule growth. In<br />
this case, no regression line has been plotted as no significant correlation exists. Nonetheless, the<br />
figure provides some evidence that the surveyed project factors do provide an impact to the<br />
schedule performance of the project. In all but one factor (on average) the impact was worse than<br />
the projects had planned for.<br />
Figure 4-35 Factors Impacting Project Schedule<br />
Sum Degree Impact of Top 18 Factors vs. Project Schedule Growth<br />
Hi Positive<br />
Impact<br />
Hi<br />
Negative<br />
Impact<br />
Sum Degree of<br />
Impact<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
-1.2 -1 -0.8 -0.6 -0.4 -0.2-2<br />
0 0.2 0.4 0.6 0.8 1 1.2<br />
-4<br />
-6<br />
-8<br />
-10<br />
Poor Cost<br />
Performance<br />
Project<br />
Schedule<br />
Growth<br />
Figure 4-36 Impact of Factors vs. Schedule Growth<br />
47
As can be seen in Figure 4-37, the greatest impact factor on construction productivity (when<br />
compared to plan) was the percentage of engineering completed prior to construction start. This was<br />
followed by the amount of unplanned overtime, business market conditions, the quality of field-level<br />
supervision, and craft labour skill. <strong>The</strong> top five impact factors on construction productivity<br />
demonstrate an average of -0.833, -0.778, -0.765, -0.476 and -0.455, respectively.<br />
Figure 4-38 provides a perspective of the impact of the top 17 factors on construction productivity.<br />
Notably, a medium-strength correlation exists (i.e., R 2 = 0.27) between the CPM Index of<br />
construction productivity and the cumulative impact factors observed for each project. Indeed, this<br />
research found that the 17 factors seen in Figure 4-37 had an overall, negative impact on the<br />
construction productivity performance of the <strong>Alberta</strong>-based projects. In all cases, these impacts (on<br />
average) were worse than that which the projects had planned for.<br />
Figure 4-37 Factors Impacting Construction Productivity (Field Productivity)<br />
48
Sum Degree Impact of Top 17 Factors vs. Project Construction<br />
Productivity (CPM)<br />
Hi Positive<br />
Impact<br />
Hi Negative<br />
Impact<br />
Sum Degree of<br />
Impact<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
-3 -2.5 -2 -1.5 -1 -0.5-2<br />
0 0.5 1 1.5 2 2.5 3<br />
-4<br />
-6<br />
-8<br />
-10<br />
CPM<br />
Unproductive Direct<br />
Construction Productivity<br />
Figure 4-38 Impact of Factors vs. Project Construction Productivity (CPM)<br />
5 <strong>Major</strong> Findings<br />
Through the participation of <strong>COAA</strong> members in this research, a number of major findings were made<br />
concerning the performance of major capital projects in <strong>Alberta</strong>’s heavy industry sector. However,<br />
this is only seen as a ‘first step’ on the journey of continuous improvement for many <strong>COAA</strong> members.<br />
Because the <strong>COAA</strong> benchmarking system enables each member to identify gaps in their project<br />
execution performance relative to that of their peers, the system may empower them to modify work<br />
processes or implement best practices. This type of introspection, development, and deployment is<br />
critical. Without it, industry-wide improvement is not possible.<br />
This report contains selected perspectives of observed data across multiple <strong>COAA</strong> member<br />
companies and their unique projects. Taken collectively, there are a number of significant findings<br />
amongst the projects analyzed for this research. <strong>The</strong>se are discussed next.<br />
5.1 Project Performance<br />
<strong>Alberta</strong>-based projects demonstrated significant issues with cost and schedule performance as<br />
evidenced by cost growth and schedule growth metrics used in this study. Compared to similar U.S.-<br />
based projects, these metrics were 533% and 183% higher, respectively. <strong>The</strong>se overruns are<br />
49
eyond unpredictable – they are alarming. Due to the fact that these two metrics compare actual<br />
and planned costs and durations, the estimation of anticipated costs and schedules is seemingly an<br />
issue and potentially at the heart of the capital project performance which was observed in <strong>Alberta</strong>.<br />
Several factors may be at work:<br />
1) <strong>Alberta</strong>-based projects have comparatively high proportions of indirect (to direct) cost. This<br />
study found, on average, that indirects account for 20.71% of total project cost. <strong>The</strong>se costs<br />
may be due to factors such as large projects in remote jobsites and executed in harsh<br />
climates. However, the estimation and management of indirects deserves close attention.<br />
2) This research revealed that the actual peak construction workforce was highly correlated<br />
with project cost growth. Yet, the research also discovered that, in many cases, construction<br />
productivity was not highly differential to that experienced on U.S.-based projects. Again,<br />
the proportion of indirect labor is an issue. While this study did note that higher amounts of<br />
construction indirect labor hours results in better schedule performance, a renewed effort to<br />
accurately estimate peak workforce, indirect cost, construction productivity, and unit cost is<br />
suggested. Additional benchmarking data can be useful for this purpose.<br />
3) A number of <strong>Alberta</strong>-based projects submitted for this study began construction with less<br />
than 30% engineering complete. CII has conducted many previous studies that show that<br />
the most appropriate time to start construction is when more than 60% of engineering is<br />
complete. This dichotomy reveals itself in metrics related to construction phase growth and<br />
construction productivity, amongst others. Mobilizing to the field too soon is often<br />
accompanied by negative cost growth and construction productivity rates.<br />
4) <strong>Alberta</strong>-based project management teams frequently fail to recognize that project cost<br />
growth is driven by, and managed through, scope and project development changes. As<br />
can be seen in Figure 5-1, U.S.-based projects report virtually all variance in actual project<br />
costs as change. This is visually represented as the near-overlay of the U.S. trend line with<br />
a line of unity between cost growth and change cost factor. Such is not the case with the<br />
<strong>Alberta</strong> project data set, which consistently experience cost growths which far exceed their<br />
associated change cost factors.<br />
50
1.4<br />
1.2<br />
Location<br />
<strong>Alberta</strong><br />
U.S.<br />
Project Cost Growth<br />
1.0<br />
0.8<br />
0.6<br />
0.4<br />
0.2<br />
0.0<br />
-0.2<br />
-0.4<br />
-0.4<br />
-0.2<br />
0.0<br />
0.2<br />
0.4<br />
0.6<br />
0.8<br />
1.0<br />
1.2<br />
1.4<br />
Project Change Cost Factor<br />
Figure 5-1 Project Change Cost Factor vs. Project Cost Growth<br />
5.2 Productivity<br />
Despite the wide range of observed capital project performance in <strong>Alberta</strong>, this research found that<br />
engineering productivity as well as construction rework and productivity were comparable to similar<br />
U.S.-based projects in some disciplines. However, construction productivity in some disciplines was<br />
much worse than U.S. projects. <strong>The</strong>se points are especially applicable when considered and<br />
measured at the discipline level for both engineering and construction labour productivity. However,<br />
it should be noted that this research measured productivity as a ratio of direct work hours to issued<br />
for construction (IFC) quantities for engineering and to installed quantities for construction.<br />
5.3 Impact Factors<br />
An array of factors exist that impact the performance of capital projects. Using the subjective<br />
evaluation of experienced project professionals, this research was able to categorize the primary<br />
factors impacting the cost, schedule, and construction productivity of <strong>Alberta</strong>-based projects.<br />
Surprisingly, there was a fair amount of consistency with the objective findings of this research. <strong>The</strong><br />
top five ranked factors are listed in Table 5-1 according to their impact on cost, schedule, and<br />
construction productivity performance. In many cases, the top five factors were contrary to popular<br />
opinion (as surveyed) as they dealt with both managerial and site-related issues.<br />
51
Table 5-1 <strong>The</strong> Top 5 Factors Affecting Cost, Schedule or Productivity<br />
Rank Cost Schedule Productivity<br />
1 Amount of Unplanned<br />
Overtime<br />
2 % Engineering completion<br />
prior to Construction Start<br />
% Engineering completion<br />
prior to Construction Start<br />
Business Market<br />
Conditions<br />
% Engineering completion<br />
prior to Construction Start<br />
Amount of Unplanned<br />
Overtime<br />
3 Business Market Conditions Craft Labour Skill Business Market Conditions<br />
4 Craft Labour Skill Quality of Field Level<br />
Supervision<br />
5 Coordination with Plant<br />
Shutdown<br />
Weather Conditions<br />
Quality of Field Level<br />
Supervision<br />
Craft Labour Skill<br />
5.4 Project Management<br />
Project management best practices make a huge difference in the performance of capital projects.<br />
Better implementation of Project Risk Assessment is shown to significantly reduce project cost<br />
growth. Constructability reviews can reduce project schedule growth as much as 50%. Not<br />
surprisingly, planning for startup improves startup phase cost performance. While insufficient data<br />
were available to examine the effects of workface planning on project performance, it is believed that<br />
its influence may be limited in an environment where effective project management is lacking. <strong>The</strong><br />
dedicated implementation of proven project management practices such as front-end planning,<br />
constructability reviews, and project risk assessment during a project’s earliest phases will maximize<br />
the project’s potential to achieve high levels of performance.<br />
52
6 Conclusions and Recommendations<br />
In recent years, numerous global forces have been at work dramatically altering the worldwide<br />
marketplace for energy. <strong>The</strong>se forces have also led to a significant increase in the amount of<br />
investment and project activity in <strong>Alberta</strong> surrounding its oil sands resources. Owner companies<br />
holding leases in the oil sands accelerated their development of capital projects needed for<br />
increased production during the study period. This acceleration of the pace of development may be<br />
explanatory to the findings and results of this study. To be sure, the increased pace and amount of<br />
capital projects in <strong>Alberta</strong> resulted in many effects observed in this research. <strong>The</strong>se effects were<br />
further compounded by extremes experienced in <strong>Alberta</strong> related to such things as labour availability,<br />
harsh weather conditions, and remote project locations, amongst others. Yet, the benefit of this<br />
research is that it was able to objectively quantify the performance of observed projects and the<br />
impact of certain factors submitted for this study.<br />
<strong>The</strong> research began with an overarching focus on engineering and construction productivity. <strong>The</strong><br />
implied belief was that productivity in <strong>Alberta</strong> was a prime component in the observed performance<br />
of its capital projects. <strong>The</strong> definitions of productivity adopted by <strong>COAA</strong>’s benchmarking committee<br />
were those used for many years by CII. Notably, these primarily measured direct productivity, that is,<br />
the ratio of work hours to installed quantities. By definition, they did not include indirect labour or<br />
costs. Because the <strong>COAA</strong> productivity definitions were common to CII, comparisons to U.S.<br />
productivity data were possible. For the projects included in this study, actual direct productivity for<br />
both engineering and construction was very similar to that observed in the United States. However,<br />
the observed project performance between <strong>Alberta</strong> and U.S. projects was differential in favor of the<br />
latter.<br />
Further investigation revealed that <strong>Alberta</strong> projects typically overestimate their direct productivity.<br />
For example, on average, actual construction productivity was 45% and 22% worse than estimated<br />
for concrete and steel craft workers, respectively. This overestimation is compounded by much<br />
higher amounts of indirect labour and cost required for <strong>Alberta</strong> projects when compared to U.S.<br />
projects. On average, 25% of hours worked were for indirect labour and almost half of the projects<br />
submitted experienced construction indirect costs more than 25% higher than estimated. Taken<br />
together, the underestimation of total labour required yielded significant resource peaks much higher<br />
than estimated which showed strong correlations with upward project cost growth. <strong>The</strong> analysis of<br />
this trend indicates that projects experiencing labour (direct and indirect) peaks of 50% more than<br />
estimated experienced project cost growth approaching 40%.<br />
53
It is worth mentioning that all the projects reported for this research that were executed in <strong>Alberta</strong><br />
used cost reimbursable contracts for their construction phase. This may have an impact on some of<br />
the project performance metrics reported here. Importantly, the <strong>Alberta</strong>-based projects presented<br />
here consistently demonstrate that large projects often experience much higher amounts of<br />
construction indirect cost growth when compared with their smaller counterparts. Given the<br />
anticipated number of planned projects exceeding $1 Billion (CDN) of total installed cost, the proper<br />
estimation and control of both direct and indirect costs is paramount. Future projects should not<br />
experience a range of project cost growth from -25% to 69% if the learnings from this report are<br />
applied effectively. Predictability in estimating and project management is needed. Here,<br />
management best practices such as project risk assessment, planning for startup, and<br />
constructability reviews are already showing significant abilities to impact project performance.<br />
Proper application of best practices would alleviate situations where 19% average cost growth was<br />
addressed using only 8% contingency (on average), for example. Indeed, improvement is needed in<br />
management-related aspects of planning, estimating, and controlling work. This is not just a<br />
contractor issue; owners routinely gave full funding authorization to projects with as little as 10%<br />
engineering complete. A thorough evaluation of management policies and procedures is<br />
recommended.<br />
<strong>The</strong> path forward is bright. While a focus on improved engineering and construction productivity is<br />
always warranted, quicker improvement is possible through increased focus on application of better<br />
project management practices. For owners, adherence to effective planning through asset<br />
development processes (ADP’s) tailored to <strong>Alberta</strong> projects may be helpful. For contractors, revised<br />
emphasis on effective project execution plans (PEP’s) may be needed. Intensive implementation of<br />
industry best practices and stern adherence to basic project management practices is recommended.<br />
Fortunately, the lessons of the past few years have created an improved awareness and added<br />
experience to the abilities of <strong>Alberta</strong>-based companies and personnel to manage the unique projects<br />
found in <strong>Alberta</strong>. Regardless, the only way to truly and objectively know whether or not project<br />
execution is improving is through continued measurement. Continued use of benchmarking products<br />
in current and additional aspects will generate improved intelligence concerning <strong>Alberta</strong>-based<br />
projects. <strong>The</strong>re is ample reason to suspect that tomorrow’s projects will be much better than those<br />
executed today.<br />
54
Appendices<br />
55
Appendix A: <strong>Summary</strong> of Correlation between Project Performance and Related Factors of <strong>Alberta</strong> Based <strong>Projects</strong><br />
Table A- 1 Correlations of Project Characteristics with Project Performance<br />
Project Characteristics<br />
Total Project Cost<br />
($M CDN)<br />
Total Project<br />
Duration (weeks)<br />
Construction<br />
Duration (weeks)<br />
% Contingency<br />
Budget<br />
% Eng. completed<br />
before con.<br />
started<br />
Performance Metric 1 N r N r N r N r N r<br />
COST<br />
Project Cost Growth 23 0.468 22 0.017 21 0.714 17 -0.591 19 -0.551<br />
Project Budget Factor 23 0.499 22 0.362 21 0.522 17 -0.456 19 -0.248<br />
Construction Phase Cost Growth 18 -0.004 17 0.280 16 0.496 16 -0.470 14 -0.723*<br />
Construction Indirect Cost Growth 17 0.599* 16 0.487 15 0.751 15 -0.429 14 -0.679<br />
Startup Cost Growth 9 -0.162 10 -0.211 10 0.070 10 -0.177 8 -0.190<br />
SCHEDULE<br />
Project Schedule Growth 21 0.031 23 0.122 22 0.096 17 0.029 21 -0.117<br />
Project Schedule Factor 21 -0.056 23 -0.169 22 -0.233 17 0.285 21 -0.105<br />
Construction Phase Schedule Growth 20 -0.059 22 0.201 22 0.195 17 -0.254 20 0.016<br />
Startup Schedule Growth 17 -0.166 18 -0.129 18 -0.067 14 -0.120 16 -0.005<br />
CHANGES<br />
Total Change Cost Factor 14 0.055 15 0.429 15 0.499 12 -0.360 15 0.358<br />
Development Change Cost Factor 10 0.142 11 0.471 11 0.677 11 -0.556 10 -0.655<br />
Scope Change Cost Factor 12 0.148 13 0.497 13 0.460 10 -0.081 12 -0.469<br />
REWORK<br />
Field Rework Cost Factor 8 -0.174 8 0.411 8 0.083 8 0.394 8 0.418<br />
SAFETY<br />
Lost time Frequency (LTF) © © 8 -0.260 8 -0.482 © © © ©<br />
Lost Time Severity (LTS) 17 0.733 17 0.481 17 0.481 14 -0.447 15 -0.227<br />
PRODUCTIVITY<br />
Engineering Productivity (EPM Index) 20 0.329 22 0.203 20 0.518 15 -0.652 19 -0.401<br />
Construction Productivity (CPM Index) 20 -0.364* 19 -0.161 19 -0.128 15 0.143 17 -0.226<br />
1 Metric and phase definitions are provided in Appendix A.<br />
© indicate small sample size (N
Table A- 2 Correlations of Project Characteristics with Project Performance (cont’d)<br />
Performance Metrics<br />
%<br />
Modularization<br />
*<br />
% Offsite<br />
Work-hours<br />
Project Characteristics<br />
% Construction<br />
Indirect/Direct<br />
WH*<br />
%<br />
Construction<br />
Ind./ Dir. Cost*<br />
Actual/ Est.<br />
Peak<br />
Workforce<br />
% Scaffolding/<br />
Direct WH<br />
N r N r N r N r N r N r<br />
COST<br />
Project Cost Growth 22 -0.236 22 -0.119 19 -0.379 17 -0.033 20 0.787* 18 0.362<br />
Project Budget Factor 22 -0.114 22 -0.003 19 -0.353 17 -0.203 20 0.598 18 0.252<br />
Construction Phase Cost Growth 1 17 -0.211 17 -0.244 15 -0.307 17 -0.013 15 0.773 15 0.188<br />
Construction Indirect Cost Growth 16 -0.282 16 -0.413 14 -0.010 17 0.095 14 0.596 15 0.705<br />
Startup Cost Growth 10 -0.542 10 -0.271 10 0.537 8 -0.201 10 0.347 9 0.348<br />
SCHEDULE<br />
Project Schedule Growth 22 -0.362 22 -0.583 19 -0.194 15 0.055 21 0.543 17 -0.097<br />
Project Schedule Factor 22 0.081 22 -0.004 19 -0.446* 15 -0.109 21 0.314 17 -0.030<br />
Construction Phase Schedule Growth 21 -0.647 21 -0.337 19 0.067 14 0.144 21 0.486 17 0.020<br />
Startup Schedule Growth 18 -0.210 18 -0.425 18 -0.110 11 -0.206 19 0.402 16 -0.050<br />
CHANGES<br />
Total Change Cost Factor 16 -0.326 16 -0.386 16 0.511 10 0.356 16 -0.200 15 -0.261<br />
Development Change Cost Factor 11 -0.343 11 -0.530 11 -0.244 10 0.044 11 0.809 10 0.326<br />
Scope Change Cost Factor 13 -0.279 13 -0.184 13 0.063 8 0.588 13 -0.003 12 0.445<br />
REWORK<br />
Field Rework Cost Factor 11 0.242 11 0.406 10 -0.013 9 -0.121 10 -0.158 11 -0.347<br />
SAFETY<br />
Lost time Frequency (LTF) 8 0.629 8 0.672 8 -0.382 © © 8 -0.387 © ©<br />
Lost Time Severity (LTS) 18 -0.112 18 0.091 18 -0.327 13 0.512 19 0.520 17 0.171<br />
PRODUCTIVITY<br />
Engineering Productivity (EPM Index) 22 -0.201 22 -0.168 17 0.029 13 0.345 19 0.282 15 0.643<br />
Construction Productivity (CPM Index) 20 -0.387 20 -0.119 19 0.178 14 -0.093 20 -0.078 18 0.059<br />
57
Table A- 3 Correlations of Practices with Project Performance<br />
Practices<br />
Performance Metrics<br />
FEP PDRI PRA<br />
Team<br />
Building<br />
Alignment<br />
Design for<br />
Maintainability<br />
Constructability<br />
Material<br />
Mgmt.<br />
N r N r N r N r N r N r N r N r<br />
COST<br />
Project Cost Growth 21 0.560 17 0.119 21 -0.436* 22 0.197 21 0.308 15 -0.314 22 -0.036 22 -0.394<br />
Project Budget Factor 21 0.510 17 -0.165 5 0.252 22 0.151 21 0.265 15 0.075 22 0.066 22 -0.376<br />
Construction Phase Cost Growth 16 0.532 12 0.281 5 0.170 17 0.098 17 0.118 14 -0.437 17 -0.284 17 -0.240<br />
Construction Indirect Cost Growth 15 0.731 11 -0.444 15 -0.205 16 0.192 16 0.431 13 -0.078 16 -0.091 16 0.116<br />
Startup Cost Growth 10 0.544 © © © © 10 -0.517 10 -0.411 9 -0.625 10 -0.375 10 -0.351<br />
SCHEDULE<br />
Project Schedule Growth 23 0.224 19 -0.134 7 0.083 23 -0.200 22 -0.321 17 -0.230 24 -0.528* 24 -0.635<br />
Project Schedule Factor 23 -0.097 19 -0.229 7 0.431 23 -0.195 22 -0.368 17 -0.079 24 -0.296 24 -0.534<br />
Construction Phase Schedule Growth 22 0.333 18 0.062 7 -0.166 22 -0.215 21 -0.268 16 -0.487 23 -0.474 23 -0.523<br />
Startup Schedule Growth 19 0.142 15 0.152 6 0.179 18 -0.207 18 -0.411 14 -0.204 19 -0.715 19 -0.299<br />
CHANGES<br />
Total Change Cost Factor 16 0.126 12 0.249 16 0.158 15 0.025 15 0.202 11 0.284 16 0.091 16 0.338<br />
Development Change Cost Factor 11 0.285 © © 11 -0.775 11 0.002 11 0.163 9 -0.670 11 -0.379 11 -0.477<br />
Scope Change Cost Factor 13 0.432 9 -0.441 13 0.032 13 -0.077 13 0.365 8 -0.402 13 -0.108 13 0.050<br />
REWORK<br />
Field Rework Cost Factor 9 -0.390 © © 9 0.415 8 0.636 8 0.282 © © 9 0.351 9 0.181<br />
SAFETY<br />
Lost time Frequency (LTF) 8 -0.815 © © 8 0.610 8 0.565 8 0.316 © © 8 0.461 8 -0.077<br />
Lost Time Severity (LTS) 18 0.300 14 -0.505 18 -0.322 17 0.111 17 0.247 13 -0.203 18 0.217 18 -0.654<br />
PRODUCTIVITY<br />
Engineering Productivity (EPM Index) 22 0.569 18 0.022 22 -0.221 22 0.221 21 0.292 16 -0.049 22 -0.197 22 0.046<br />
Construction Productivity (CPM Index) 19 0.316 16 0.132 19 -0.221 19 -0.540 18 -0.397 13 -0.768 20 -0.312 20 0.000<br />
58
Table A- 4 Correlations of Practices with Project Performance (cont’d)<br />
Performance Metrics<br />
Change Mgmt.<br />
Zero Accident<br />
Tech.<br />
Practices<br />
Quality Mgmt. A/I Technology<br />
Planning for<br />
Startup<br />
PPMOF<br />
Workface<br />
Planning<br />
N r N r N r N r N r N r N r<br />
COST<br />
Project Cost Growth 22 -0.050 19 0.460 21 0.001 20 -0.617 20 0.808 19 0.278<br />
© ©<br />
Project Budget Factor 22 -0.165 19 0.282 21 0.050 20 -0.481 20 -0.731 19 0.364 © ©<br />
Construction Phase Cost Growth 17 -0.033 15 0.427 17 -0.386 15 -0.584 15 -0.750 14 0.086 © ©<br />
Construction Indirect Cost Growth 16 0.364 14 0.559 16 -0.288 14 -0.619 14 -0.515 13 0.345 © ©<br />
Startup Cost Growth 10 -0.559 10 0.533 10 -0.094 10 -0.588 10 -0.450* 9 -0.253 © ©<br />
SCHEDULE<br />
Project Schedule Growth 24 -0.182 21 0.107 23 -0.171 21 -0.358 22 -0.431 21 0.331<br />
© ©<br />
Project Schedule Factor 24 -0.291 21 -0.202 23 -0.171 21 -0.012 22 -0.365 21 0.055 © ©<br />
Construction Phase Schedule Growth 23 -0.340 21 0.288 22 -0.209 20 -0.508 22 -0.429 21 0.053 © ©*<br />
Startup Schedule Growth 19 -0.060 19 0.206 19 -0.408 18 -0.311 19 -0.087 18 0.213 © ©<br />
CHANGES<br />
Total Change Cost Factor 16 0.305 16 0.213 16 0.174 15 -0.399 16 0.356 15 0.266<br />
© ©<br />
Development Change Cost Factor* 11 0.075 11 0.325 11 0.161 11 -0.437 11 -0.544 10 -0.322 © ©<br />
Scope Change Cost Factor* 13 0.177 13 0.462 13 -0.227 13 -0.362 13 -0.270 12 0.376 © ©<br />
REWORK<br />
Field Rework Cost Factor 9 0.088 9 -0.594 9 0.425 8 0.717 9 0.518 9 0.368<br />
SAFETY<br />
Lost time Frequency (LTF) 8 -0.204 8 -0.003 8 0.247 8 0.759 8 0.034<br />
© ©<br />
© © © ©<br />
Lost Time Severity (LTS) 18 -0.350 18 0.045 18 0.412 17 -0.237 18 -0.748 17 0.407 © ©<br />
PRODUCTIVITY<br />
Engineering Productivity (EPM Index) 22 -0.058 18 0.525 21 -0.458 21 -0.543 20 -0.178 19 -0.062<br />
© ©<br />
Construction Productivity (CPM Index) 20 -0.170 19 0.077 19 -0.201 18 -0.368 19 -0.023 18 -0.166 © ©<br />
59
Appendix B: Performance Metric Formulas and Definitions<br />
Performance Metric Category: COST<br />
Formula:<br />
Metric: Project Cost Growth<br />
Actual Total Project Cost - Initial Predicted Project Cost<br />
Initial Predicted Project Cost<br />
Metric: Delta Cost Growth<br />
Formula:<br />
| Cost Growth |<br />
Metric: Project Budget Factor<br />
Formula:<br />
Actual Total Project Cost<br />
Initial Predicted Project Cost +Approved Changes<br />
Metric: Delta Budget Factor<br />
Formula:<br />
| 1- Budget Factor |<br />
Metric: Phase Cost Factor<br />
Metric: Phase Cost Growth<br />
Definition of Terms<br />
Actual Total Project Cost:<br />
• Owners –<br />
o<br />
o<br />
All actual project cost from front end<br />
planning through startup<br />
Exclude land costs but include in-house<br />
salaries, overhead, travel, etc.<br />
• Contractors – Total cost of the final scope of work.<br />
Initial Predicted Project Cost:<br />
• Owners – Budget at the time of Project Sanction.<br />
• Contractors – Cost estimate used as the basis of<br />
contract award.<br />
Formula:<br />
Formula:<br />
Actual Phase Cost<br />
Actual Total Project Cost<br />
Actual Phase Cost – Initial Predicted Phase Cost<br />
Initial Predicted Phase Cost<br />
Actual Phase Cost:<br />
• All costs associated with the project phase in<br />
question.<br />
• See the Project Phase Table in Appendix C for phase<br />
definitions.<br />
Initial Predicted Phase Cost:<br />
• Owners – Budget at the time of Project Sanction.<br />
• Contractors – Budget at the time of contract award.<br />
• See the Project Phase Table in Appendix C for phase<br />
definitions.<br />
Approved Changes:<br />
• Estimated cost of owner-authorized changes.<br />
60
Performance Metric Category: SCHEDULE<br />
Metric: Project Schedule Growth<br />
Formula:<br />
Actual Total Proj. Duration - Initial Predicted Proj. Duration<br />
Initial Predicted Proj. Duration<br />
Metric: Delta Schedule Growth<br />
Formula:<br />
| Schedule Growth |<br />
Metric: Project Schedule Factor<br />
Formula:<br />
Actual Total Project Duration<br />
Initial Predicted Project Duration + Approved Changes<br />
Metric: Delta Schedule Factor<br />
Formula:<br />
| 1- Schedule Factor |<br />
Metric: Phase Duration Factor<br />
Formula:<br />
Actual Phase Duration<br />
Actual Overall Project Duration<br />
Metric: Total Project Duration<br />
Actual Total Project Duration (weeks)<br />
Metric: Phase Schedule Growth<br />
Formula:<br />
Actual Phase Duration – Initial Predicted Phase Duration<br />
Initial Predicted Phase Duration<br />
Definition of Terms<br />
Actual Total Project Duration:<br />
(Detailed Engineering through Start-up)<br />
• Owners – Duration from beginning of detailed<br />
engineering to turnover to user.<br />
• Contractors - Total duration for the final scope<br />
of work from mobilization to completion.<br />
Actual Overall Project Duration:<br />
(Front End Planning through Start-up)<br />
• Unlike Actual Total Duration, Actual Overall<br />
Duration also includes time consumed for the<br />
Front End Planning Phase.<br />
Actual Phase Duration:<br />
• Actual total duration of the project phase in question.<br />
See the Project Phase Table in Appendix C for phase<br />
definitions.<br />
Initial Predicted Project Duration:<br />
• Owners – Predicted duration at the time of Project<br />
Sanction.<br />
• Contractors - <strong>The</strong> contractor's duration estimate at<br />
the time of contract award.<br />
Approved Changes<br />
• Estimated duration of owner-authorized changes.<br />
61
Performance Metric Category: SAFETY<br />
Metric: Lost Time Frequency (LTF)<br />
Formula:<br />
Total Number of Lost Time cases x 200,000<br />
Total Site Work-Hours<br />
Metric: Medical Aid Frequency (MAF)<br />
Metric: First Aid Frequency (FAF)<br />
Metric: Total Recordable Injury Frequency<br />
(TRIF)<br />
Formula:<br />
Formula:<br />
Formula:<br />
Total Number of Medical Aid Cases x 200,000<br />
Total Site Work-Hours<br />
Total Number of First Aid Cases x 200,000<br />
Total Site Work-Hours<br />
Total Number of Recordable Cases x 200,000<br />
Total Site Work-Hours<br />
Metric: Total Injury Frequency (TIF)<br />
Formula:<br />
Total number of all injury or illness cases x 200,000<br />
Total Site Work-Hours<br />
Metric: Restricted Work Frequency (RWF)<br />
Formula:<br />
Total Number of Restricted Work Cases x 200,000<br />
Total Site Work-Hours<br />
Metric: Lost Time Severity Rate (LTSR)<br />
Formula:<br />
Total Number of Lost Time Workdays x 200,000<br />
Total Site Work-Hours<br />
Metric: Total Severity Rate (TSR)<br />
Formula:<br />
Total Number of Recordable Lost Time Cases<br />
and all Restricted Work Cases x 200,000<br />
Total Site Work-Hours<br />
62
Performance Metric Category: SAFETY (cont’d.)<br />
Definition of Terms<br />
• Lost Time Days: Equals the number of scheduled work days away from work as a result of an<br />
occupational injury or illness, disabling injury or illness which prevents a worker from reporting to<br />
work on next regularly scheduled.<br />
• Medical Aid Case: Any occupational injury or illness requiring medical treatment administered by a<br />
physician, not including first aid treatment<br />
• First Aid Case: Any one time treatment which does not require medical care or further medical aid<br />
e.g. minor scratches, cuts, burns, splinters.<br />
• Recordable Case: A work event or exposure that is the discernable cause of an injury or illness or<br />
of a significant aggravation to a pre-existing condition. A recordable case requires medical aid,<br />
restricted work in relation to either medical aid or lost time, or fatality.<br />
• Total number of all injury or illness cases: Equals the number of lost time (LT) cases, medical aid<br />
(MA) cases, first aid (FA) cases and the number of restricted work cases for lost time (RWLT),<br />
medical aid (RWMA) and first aid (RWFA).<br />
• Total Number of Restricted Work Cases: Equals the number of restricted work lost time cases,<br />
restricted work medical aid cases and restricted work first aid cases.<br />
• Lost Time Case: Lost Time cases are the result of an occupational injury or illness including any<br />
disabling injury which prevents a worker from reporting to work on his/her next regularly scheduled.<br />
• Restricted Work Case: Includes restricted work lost time cases, restricted work medical aid cases<br />
and restricted work first aid cases.<br />
• Restricted Work Days: Equals the number of scheduled work days that the worker was unable to<br />
work their regular duties as a result of an injury or illness as defined in restricted work.<br />
• Total Number of Recordable Lost Time Cases and all Restricted Work Cases: Includes the<br />
number of lost workdays plus the number of restricted work days for all lost time, medical aid and<br />
first aids.<br />
63
Performance Metric Category: CHANGES<br />
Metric: Scope Change Cost Factor<br />
Metric: Project Development Change Cost Factor<br />
Formula:<br />
Formula:<br />
Total Cost of Scope Changes<br />
Actual Total Project Cost<br />
Total Cost of Project Development Changes<br />
Actual Total Project Cost<br />
Definition of Terms<br />
• Total Cost of Scope Changes: Total cost impact<br />
of scope and project development changes.<br />
• Total Cost of Project Development Changes:<br />
Total cost impact of project development<br />
changes.<br />
Actual Total Project Cost:<br />
• Owners –<br />
o All actual project cost from front end planning<br />
through startup<br />
o Exclude land costs but include in-house<br />
salaries, overhead, travel, etc.<br />
• Contractors – Total cost of the final scope of work.<br />
Performance Metric Category: REWORK<br />
Metric: Total Field Rework Factor<br />
Formula:<br />
Total Direct Cost of Field Rework<br />
Actual Construction Phase Cost<br />
Definition of Terms<br />
• Total Direct Cost of Field Rework: Total direct<br />
cost of field rework regardless of initiating cause.<br />
• Actual Construction Phase Cost: All costs associated<br />
with the construction phase. See the Project Phase<br />
Table in Appendix C for construction phase definition.<br />
64
Construction Productivity and Total Installed Unit Cost (TIUC)<br />
Metrics Categories and Breakouts<br />
Concrete<br />
- Total Concrete<br />
o Slabs (CM)<br />
• On-Grade (CM)<br />
• Elevated Slabs/On Deck (CM)<br />
• Area Paving (CM)<br />
o Foundations (CM)<br />
• < 4 CM<br />
• 4 – 15 CM<br />
• 15 –38 CM<br />
• ≥ 38 CM<br />
o Concrete Structures (CM)<br />
Structural Steel<br />
- Total Structural Steel (MT)<br />
o Structural Steel (MT)<br />
o Pipe Racks & Utility Bridges (MT)<br />
o Miscellaneous Steel (MT)<br />
Instrumentation<br />
- Loops (Count)<br />
- Devices (Count)<br />
Piping<br />
- Small Bore (2-1/2” & Smaller) (LM)<br />
o Carbon Steel (LM)<br />
o Stainless Steel (LM)<br />
o Chrome (LM)<br />
o Other Alloys (LM)<br />
o Non Metallic (LM)<br />
- Inside Battery Limits (ISBL) (LM)<br />
Large Bore (3” & Larger) (LM)<br />
o Carbon Steel (LM)<br />
o Stainless Steel (LM)<br />
o Chrome (LM)<br />
o Other Alloys (LM)<br />
o Non Metallic (LM)<br />
- Outside Battery Limits (OSBL) (LM)<br />
Large Bore (3” & Larger) (LM)<br />
o Carbon Steel (LM)<br />
o Stainless Steel (LM)<br />
o Chrome (LM)<br />
o Other Alloys (LM)<br />
o Non Metallic (LM)<br />
- Heat Tracing Tubing (LM)<br />
Electrical<br />
- Total Electrical Equipment (Each)<br />
o Panels and Small Devices (Each)<br />
o Electrical Equipment below 1kV (Each)<br />
o Electrical Equipment over 1kV (Each)<br />
- Conduit (LM)<br />
o Exposed or Above Ground Conduit (LM)<br />
o Underground, Duct Bank or Embedded Conduit (LM)<br />
- Cable Tray (LM)<br />
- Wire and Cable (LM)<br />
o Control Cable (LM)<br />
o Power and Control Cable below 1kV (LM)<br />
o Power Cable above 1kV (LM)<br />
- Transmission Line (LM)<br />
o High Voltage above 25kV (LM)<br />
- Other Electrical Metrics<br />
o Lighting (Each)<br />
o Grounding (LM)<br />
o Electrical Heat Tracing (LM)<br />
Equipment<br />
- Pressure Vessels (Field Fab.& Erected) (Each), (MT)<br />
- Atmospheric Tanks (Shop Fabricated) (Each), (MT)<br />
- Atmospheric Tanks (Field Fabricated) (Each), (MT)<br />
- Heat Transfer Equipment (Each), (MT)<br />
- Boiler & Fired Heaters (Each), (MT)<br />
- Rotating Equipment (Each), (HP)<br />
- Material Handling Equipment (Each), (MT)<br />
- Power Generation Equipment (Each), (kW)<br />
- Other Process Equipment (Each), (MT)<br />
- Modules & Pre-assembled Skids (Each), (MT)<br />
Insulation<br />
- Equipment<br />
o Insulation Equipment (SM)<br />
- Piping<br />
o Insulation Piping (ELM)<br />
Module Installation<br />
- Pipe Racks (MT)<br />
- Process Equipment Modules (MT)<br />
- Building (SM)<br />
Scaffolding<br />
- Scaffolding Work-Hours/ Total Direct Hours<br />
Construction Work-Hours<br />
- Construction Indirect/ Direct Work-Hours<br />
Construction Productivity Unit Rate =<br />
Productivity Estimating Performance =<br />
Direct Work hours<br />
Installed Quantity<br />
Actual Productivity Rate<br />
Estimated Productivity Rate<br />
Cost Estimating Performance = Actual TIUC<br />
Estimated TIUC<br />
65
Engineering Productivity Metrics Categories and Breakouts<br />
Concrete<br />
- Total Concrete (CM)<br />
o Total Slabs (CM)<br />
• Ground and Supported Slab (CM)<br />
• Area Paving (CM)<br />
o Total Foundations (except Piling) (CM)<br />
• Foundation (
Project Phase Definition Table<br />
Project Phase Start/Stop Typical Activities & Products Typical Cost Elements<br />
Front End Planning<br />
Typical Participants:<br />
• Owner Personnel<br />
• Planning Consultants<br />
• Constructability<br />
Consultant<br />
• Alliance / Partner<br />
Start: Single project adopted<br />
and Formal project team<br />
established<br />
Stop: Project Sanction<br />
• Options Analysis<br />
• Life-cycle Cost Analysis<br />
• Project Execution Plan<br />
• Appropriation Submittal Pkg<br />
• P&IDs and Site Layout<br />
• Project Scoping<br />
• Procurement Plan<br />
• Arch. Rendering<br />
• Owner Planning Team Personnel Expenses<br />
• Consultant Fees & Expenses<br />
• Environmental Permitting Costs<br />
• Project Manager / Construction Manager Fees<br />
• Licensor Costs<br />
Detail Engineering<br />
Typical Participants:<br />
• Owner Personnel<br />
• Design Contractor<br />
• Constructability Expert<br />
• Alliance / Partner<br />
Start: Contract award to<br />
engineering firm<br />
Stop: Release of all approved<br />
drawings and specs for<br />
Construction (or last<br />
package for fast-track)<br />
• Drawing & spec. preparation<br />
• Bill of material preparation<br />
• Procurement Status<br />
• Sequence of operations<br />
• Technical Review<br />
• Definitive Cost Estimate<br />
• Owner Project Management<br />
Personnel<br />
• Designer Fees<br />
• Project Manager / Construction<br />
Manager Fees<br />
Procurement<br />
Typical Participants:<br />
• Owner personnel<br />
• Design Contractor<br />
• Alliance / Partner<br />
Start: Procurement plan for<br />
engineered equipment<br />
Stop: All major equipment<br />
has been delivered to site<br />
• Vendor Qualification<br />
• Vendor Inquiries<br />
• Bid Analysis<br />
• Purchasing<br />
• Expediting<br />
• Engineered Equipment<br />
• Transportation<br />
• Vendor QA/QC<br />
• Owner project management personnel<br />
• Project Manager / Construction<br />
Manager fees<br />
• Procurement & Expediting personnel<br />
• Engineered Equipment<br />
• Transportation<br />
• Shop QA / QC<br />
Note: <strong>The</strong> demolition / abatement phase should be reported when the demolition / abatement work is a separate schedule activity (potentially paralleling the<br />
design and procurement phases) in preparation for new construction. Do not report the demolition / abatement phase if the work is integral with<br />
modernization or addition activities.<br />
67
Project Phase Table (Cont.)<br />
Project Phase Start/Stop Typical Activities & Products Typical Cost Elements<br />
Construction<br />
Typical Participants:<br />
• Owner personnel<br />
• Design Contractor<br />
(Inspection)<br />
• Construction Contractor and<br />
its subcontractors<br />
Start: Commencement of<br />
foundations or driving<br />
Piles<br />
Stop: Mechanical Completion<br />
• Set up trailers<br />
• Procurement of bulks<br />
• Issue Subcontracts<br />
• Construction plan for<br />
Methods/Sequencing<br />
• Build Facility & Install<br />
Engineered Equipment<br />
• Complete Punchlist<br />
• Demobilize construction<br />
equipment<br />
• Warehousing<br />
• Owner project management personnel<br />
• Project Manager / Construction<br />
Manager fees<br />
• Building permits<br />
• Inspection QA/QC<br />
• Construction labour, equipment &<br />
supplies<br />
• Bulk materials (including freight)<br />
• Construction equipment (including<br />
freight)<br />
• Contractor management personnel<br />
• Warranties<br />
Start-up / Commissioning<br />
Note: Does not usually apply to<br />
infrastructure or building type<br />
projects<br />
Typical Participants:<br />
• Owner personnel<br />
• Design Contractor<br />
• Construction Contractor<br />
• Training Consultant<br />
• Equipment Vendors<br />
Start: Mechanical Completion<br />
Stop: Custody transfer to<br />
user/operator (steady<br />
state operation)<br />
• Testing Systems<br />
• Training Operators<br />
• Documenting Results<br />
• Introduce Feedstocks and<br />
obtain first Product<br />
• Hand-off to user/operator<br />
• Operating System<br />
• Functional Facility<br />
• Warranty Work<br />
• Owner project management personnel<br />
• Project Manager / Construction<br />
Manager fees<br />
• Consultant fees & expenses<br />
• Operator training expenses<br />
• Wasted feedstocks<br />
• Vendor fees<br />
68
Appendix C: Glossary<br />
General Terms<br />
Addition (Add-on) – A new addition that ties in to an existing facility, often intended to expand capacity.<br />
Grass Roots, Green Field – A new facility from the foundations and up. A project requiring demolition of<br />
an existing facility before new construction begins is also classified as grass roots.<br />
Modernization, Renovation, Upgrade– A facility for which a substantial amount of the equipment,<br />
structure, or other components is replaced or modified, and which may expand capacity and/or improve<br />
the process or facility.<br />
Percent Offsite Construction Labour Hours– <strong>The</strong> level of offsite labour hours for building modules.<br />
This value should be determined as a ratio of the offsite labour hours of all modules divided by total<br />
construction hours.<br />
Rework - is defined as activities in the field that have to be done more than once in the field or activities<br />
which remove work previously installed as part of project.<br />
Total Construction Hours – <strong>The</strong> summation of all direct and indirect hours associated with the<br />
construction phase.<br />
Project Delivery System<br />
Design-Bid-Build– Serial sequence of design and construction phases; Owner contracts separately with<br />
designer and constructor.<br />
Design-Build (or EPC) – Overlapped sequence of design and construction phase; procurement normally<br />
begins during design; owner contracts with Design-Build (or EPC) contractor.<br />
CM at Risk– Overlapped sequence of design and construction phases; procurement normally begins<br />
during design; owner contracts separately with designer and CM at Risk (constructor). CM holds the<br />
contracts.<br />
Multiple Design-Build– Overlapped sequence of design and construction phases; procurement normally<br />
begins during design; owner contracts with two Design-Build (or EPC) contractors, one for process and<br />
one for facilities.<br />
Parallel Primes– Overlapped sequence of design and construction phases; Procurement normally<br />
begins during design. Owner contracts separately with designer and multiple prime constructors.<br />
Cost Definition<br />
Construction Costs – include the costs of construction activities from commencement of foundation or<br />
driving piles to mechanical completion. <strong>The</strong> costs include construction project management, construction<br />
labour, and also equipment& supplies costs that are used to support construction operations and<br />
removed after commissioning. See “Instruction for Construction Direct and Indirect Costs” for detail<br />
of typical cost element.<br />
Contingency –Contingency is defined as an estimated amount included in the project budget that may<br />
be required to cover costs that result from project uncertainties. <strong>The</strong>se uncertainties may result from<br />
incomplete design, unforeseen and unpredictable conditions, escalation, or lack of project scope<br />
definition. <strong>The</strong> amount of contingency usually depends on the status of design, procurement and<br />
construction, and the complexity and uncertainties of the component parts of the project.<br />
69
Direct Costs – Direct costs are those which are readily or directly attributable to, or become an<br />
identifiable part of, the final project (e.g., piping labour and material) [AACE].<br />
Direct Cost of Field Rework– <strong>The</strong> sum of those costs associated with actual performance of tasks<br />
involved in rework. Examples include: Labour, Materials, Equipment, Supervisory personnel, Associated<br />
overhead cost.<br />
Modularization– Modularization refers to the use of offsite construction. For the purposes of the<br />
benchmarking data, modularization includes all work that represents substantial offsite construction and<br />
assembly of components and areas of the finished project. Examples that would fall within this<br />
categorization include:<br />
• Skid assemblies of equipment and instrumentation that naturally ship to the site in one piece, and<br />
require minimal on-site reassembly.<br />
• Super-skids of assemblies of components that typically represent substantial portions of the plant,<br />
intended to be installed in a building.<br />
• Prefabricated modules comprising both industrial plant components and architecturally finished<br />
enclosures.<br />
Modularization does not include offsite fabrication of components. Examples of work that would be<br />
excluded from the definition of modularization include:<br />
• Fabrication of the component pieces of a structural framework<br />
• Fabrication of piping spool-pieces<br />
Indirect Costs – Indirect costs are all costs that cannot be attributed readily to a part of the final product<br />
(e.g., cost of managing the project) [AACE].<br />
Schedule Definition<br />
Project Sanction – is defined as the milestone event at which the project scope, budget, and schedule are<br />
authorized. Project Sanction is the start of the execution phase of the project.<br />
Commissioning and Startup – <strong>The</strong> transitional phase between construction and commercial operations;<br />
major steps include turnover, checkout, commissioning, and initial operations. Commissioning is the<br />
integrated testing of equipment and facilities that are grouped together in systems prior to the introduction<br />
of feedstocks.<br />
Detail Engineering – Detail engineering is the project phase initiated with a contract to the firm providing<br />
detail engineering for the project. <strong>The</strong> typical activities included in this phase are: preparation of drawings,<br />
specifications, bill of materials, development of a definitive cost estimate, technical reviews, and<br />
engineering procurement functions. <strong>The</strong> detail engineering phase terminates with release of all approved<br />
drawings and specifications for construction.<br />
Mechanical Completion - <strong>The</strong> point in time when a plant is capable of being operated although some<br />
trim, insulation, and painting may still be needed. This occurs after completion of pre commissioning.<br />
Changes Definition<br />
Change - A change is any event that results in a modification of the project work, schedule or cost.<br />
Owners and designers frequently initiate changes during design development to reflect changes in project<br />
scope or preferences for equipment and materials other than those originally specified. Contractors often<br />
initiate changes when interferences are encountered, when designs are found to be not constructable, or<br />
other design errors are found.<br />
Change Order - A contractual modification executed to document the agreement and approval of a<br />
change (See definition of Change above).<br />
70
Project Development Changes – Project Development Changes include those changes required to<br />
execute the original scope of work or obtain original process basis. Examples include:<br />
1) Unforeseen site conditions that require a change in design / construction methods<br />
2) Changes required due to errors and omissions<br />
3) Acceleration<br />
4) Change in owner preferences<br />
5) Additional equipment or processes required to obtain original planned throughput<br />
6) Operability or maintainability changes. (See Change above)<br />
Scope Changes – Scope Changes include changes in the base scope of work or process basis.<br />
Examples include: 1) Feedstock change, 2) Changed site location, 3) Changed throughput, 4) Addition of<br />
unrelated scope<br />
Practice Definition<br />
Front End Planning– is the essential process of developing sufficient strategic information with which<br />
owners can address risk and make decisions to commit resources in order to maximize the potential for a<br />
successful project. Front End Planning is also known as pre-project planning, front end loading, feasibility<br />
analysis, conceptual planning/ schematic design, and early project planning.<br />
Project Risk Assessment –Project risk assessment is the process to identify, assess and manage risk.<br />
<strong>The</strong> project team evaluates risk exposure for potential project impact to provide focus for mitigation<br />
strategies.<br />
Team Building– is a project- focused process that builds and develops shared goals, interdependence,<br />
trust and commitment, and accountability among team members and that seeks to improve team<br />
members’ problem- solving skills.<br />
Alignment during Front End Planning– is the condition where appropriate project participants are<br />
working with acceptable tolerances to develop and meet a uniform defined and understood set of project<br />
objectives.<br />
Constructability– is the effective and timely integration of construction knowledge into the conceptual<br />
planning, design, construction, and filed operations of a project to achieve the overall project objectives in<br />
the best possible time and accuracy at the most cost- effective levels.<br />
Design for Maintainability– Design for maintainability is the optimum use of facility maintenance<br />
knowledge and experience in the design/engineering of a facility to pertain the ease, accuracy, safety and<br />
economy in the performance of maintenance action; a design parameter related to the ability to maintain.<br />
Material Management – the planning, controlling, and integrating of the materials takeoff, purchasing,<br />
economic, expediting, transportation, warehousing, and issue functions in order to achieve a smooth,<br />
timely, efficient flow of materials to the project in the required quantity, the required time, and at an<br />
acceptable price and quality, and the planning and controlling of these functions (CII Publication SP-4)<br />
Project Change Management– is the process of incorporating a balanced change culture of recognition,<br />
planning, and evaluation of project changes in an organization to effectively manage project changes.<br />
Practices related to the management and control of both scope changes and project changes.<br />
Zero Accident Techniques– include the site- specific safety programs and implementation, auditing,<br />
and incentive efforts to create a project environment and a level of that embraces the mind set that all<br />
accidents are preventable and that zero accidents is an obtainable goal.<br />
71
Quality Management– Quality management incorporates all activities conducted to improve the<br />
efficiency, contract compliance and cost effectiveness of design, engineering, procurement, QA/QC,<br />
construction and startup elements of construction projects.<br />
Automation/Integration (AI) Technology– <strong>The</strong> Automation and Integration Technology practice<br />
addresses the degree of automation/level of use and integration of automated systems for predefined<br />
tasks/work functions common to most projects.<br />
Planning for Startup– is the effectiveness of planning on startup activities that facilitate the<br />
implementation of the transitional phase between plant construction completion and commercial<br />
operations, including all of the activities bridging these two phases. Critical steps within the startup phase<br />
include systems turnover, checkout of systems, commissioning of systems, introduction of feed stocks,<br />
and performance testing.<br />
Prefabrication/ Preassembly/ Modularization– Prefabrication/Preassembly/Modularization (PPMOF) is<br />
defined as several manufacturing and installation techniques, which move many fabrication and<br />
installation activities from the plant site into a safer and more efficient environment. For each technique,<br />
more specific definitions are provided below.<br />
• Prefabrication: a manufacturing process, generally taking place at a specialized facility, in which<br />
various materials are joined to form a component part of a final installation. Prefabricated components<br />
often involve the work of a single craft.<br />
• Preassembly: a process by which various materials, prefabricated components, and/or equipment are<br />
joined together at a remote location for subsequent installation as a sub-unit: generally focused on a<br />
system.<br />
• Module: a major section of a plant resulting from a series of remote assembly operations and may<br />
include portions of many systems: usually the largest transportable unit or component of a facility.<br />
• Offsite Fabrication: the practice of preassembly or fabrication of components both off the site and<br />
onsite at a location other than at the final installation location.<br />
This practice consists of two part, constructability at AFE phase and constructability at mechanical<br />
completion. Please fill out one part of this practice according to your current project phase.<br />
Workface Planning– <strong>The</strong> process of organizing and delivering all elements necessary, before work is<br />
started, to enable craft persons to perform quality work in a safe, effective and efficient manner<br />
Engineering Productivity<br />
Engineering Direct Work hours - should include all detailed design hours used to produce deliverables<br />
including site investigations, meetings, planning, constructability, RFIs, etc., and rework. Specifically<br />
exclude work hours for operating manuals and demolition drawings.<br />
- Engineering work hours reported should only be for the categories requested and may not equal<br />
the total engineering work hours for the project. (See “Instructions for Computation of Work<br />
hours and Rework-Hours” reference table)<br />
- Exclude the following categories: architectural design, plumbing, process design, civil/site prep,<br />
HVAC, insulation and paint, sprinkler/deluge systems, etc. Within a category, direct work hours that<br />
cannot be specifically assigned into the provided classifications, and have not been excluded,<br />
should be prorated based on known work hours or quantities as appropriate.<br />
IFC Drawing– Issued for Construction drawings.<br />
Construction Productivity<br />
Actual Quantities and Work hours - are all quantities and work hours of actual installation and include<br />
rework hours for these quantities and work-hours.<br />
72
Estimated Productivity – are the estimated productivity of direct labour work hours required for<br />
installation according to the estimated quantity.<br />
For owners:<br />
For contractors:<br />
Estimated Quantity, Work hours and Total Installed Unit Cost at the time of<br />
Project Sanction (or as soon as available following sanction)<br />
Estimated Quantity, Work hours and Total Installed Unit Cost used as the basis<br />
of Contract Award.<br />
Estimated Quantities and Work hours – are the estimated quantity to be installed, the estimated work<br />
hours required for the installation and include all change orders.<br />
Estimated Total Installed Unit Cost – including labour and material cost at the time of project sanction<br />
(or as soon as available following sanction).<br />
Estimated Total Installed Unit Costs (TIUC) – is the burdened direct cost of labour, material and<br />
equipment by pro rata share which are directly attribute to, or become a part of the final product including<br />
overhead and profit at the time of project sanction (or as soon as available following sanction).<br />
Actual Total Installed Unit Costs (TIUC) – the burdened direct cost of labour, material and equipment<br />
by pro rata share which are directly attribute to, or become a part of the final product including overhead<br />
and profit from both direct hire and subcontract.<br />
• <strong>The</strong> direct labour costs are considered as the costs of the labours listed as Direct in the<br />
“Instructions for Computation of Actual Work-Hours, Rework-Hours, and Installed Costs” table in<br />
Construction Productivity Section.<br />
73
References<br />
AACE (2004). “Estimating Lost Labour Productivity in Construction Claims.” TCM Framework: 6.4-<br />
Forensic Performance Assessment, AACE International Recommended Practice No. 25R-03.<br />
Agresti, A. and Finlay, B. (1999). Statistical methods for the social sciences, 3rd ed., Prentice Hall, Inc.,<br />
Upper Saddle River, NJ, 07458, Prentice Hall, Inc., Upper Saddle River, NJ, 07458.<br />
<strong>Alberta</strong> Finance and Enterprise (AFE) (2008). “Highlights of the Highlights of the <strong>Alberta</strong> Economy”,<br />
http://www.albertacanada.com/statpub.<br />
Aminah R. (2005). “Results of a Survey of Performance Deviations on <strong>Major</strong> Industrial Construction <strong>Projects</strong> in<br />
<strong>Alberta</strong> (1990-2003).” <strong>Report</strong> to Construction Owner Association of <strong>Alberta</strong>, Spring, 2005.<br />
<strong>COAA</strong> (2008). “Construction Owners Association of <strong>Alberta</strong>”, http://www.coaa.ab.ca.<br />
Field, A. (2005). “Discovering Statistics Using SPSS.” Second Edition, SAGE Publications.<br />
Flyvbjerg, B., Bruzelius, N., & Rothengatter, W. (2003). “Megaprojects and risk: An anatomy of ambition.”<br />
Cambridge, UK: Cambridge University Press.<br />
Kellogg, J., Taylor, D., and Howell, G. (1981). “Hierarchy Model of Construction Productivity.”<br />
Journal of the Construction Division, 107(1), March 1981, pp. 137-152.<br />
ASCE,<br />
OSDG (2008). “Oil Sands – Important to Canada’s Present and Future”. Oil Sands Developers Group.<br />
E-mail: info@oilsandsdevlopers.ca.<br />
74
Companies Participating in <strong>COAA</strong> <strong>Benchmarking</strong> Training Sessions:<br />
• Air Products & Chemicals Inc.<br />
• <strong>Alberta</strong> Economic Development<br />
• <strong>Alberta</strong> Infrastructure and Transportation<br />
• Ascension Systems Inc.<br />
• BA Energy<br />
• Bantrel<br />
• BIRD Construction Company<br />
• Canadian Natural Resources<br />
• Canonbie Contracting Ltd.<br />
• Cobra Group of Companies<br />
• Colt Corporation<br />
• ConocoPhillips<br />
• CPI Construction<br />
• DriverCheck<br />
• Enbridge Pipelines Inc.<br />
• EPCOR<br />
• Esso Petroleum Canada<br />
• Flint Energy<br />
• Fluor Corporation<br />
• Husky Energy Inc.<br />
• IBEW Local 424<br />
• Imperial Oil Resources Ltd.<br />
• Intergraph Corporation<br />
• Jacobs<br />
• Kellogg Brown & Root<br />
• Laird Electric Inc.<br />
• Ledcor<br />
• Murdoch International Inc.<br />
• Nexen Inc.<br />
• OPTI Canada Inc.,<br />
• PCL<br />
• Petro-Canada<br />
• Revay and Associates Limited<br />
• RSC Equipment Rental<br />
• SafeTech Consulting Group Ltd.<br />
• Shell Canada Limited<br />
• Stantec<br />
• Steeplejack Industrial Group Inc.<br />
• Suncor Energy Inc.<br />
• Syncrude Canada Ltd.<br />
• Tartan Canada Corporation<br />
• ThyssenKrupp Safway, Inc.<br />
• TransCanada Pipelines, Ltd.<br />
• Westwood Companies<br />
• WorleyParsons Limited<br />
CII Staff:<br />
Stephen Mulva, Ph.D., Associate Director <strong>Benchmarking</strong> and Metrics<br />
Stephen R. Thomas, Ph.D., Associate Director, Research, Academic, and Breakthrough<br />
Jiukun Dai, Ph.D., Research Engineer<br />
Arpamart Chanmeka, Graduate Research Assistant<br />
Deborah DeGezelle, Senior Systems Analyst<br />
Hong Zhao, Senior Systems Analyst<br />
75
<strong>The</strong> Construction Industry Institute<br />
<strong>The</strong> University of Texas at Austin<br />
3925 West Braker Lane<br />
Austin, TX 78759-5316<br />
(512) 232-3000<br />
FAX (512) 499-8101<br />
Construction Industry Institute<br />
http://construction-institute.org<br />
Bureau of Engineering Research<br />
<strong>The</strong> University of Texas at Austin