Guidance on Monitoring Internal Control Systems

Guidance on Monitoring Internal Control Systems Guidance on Monitoring Internal Control Systems

easyfinance.com.cn
from easyfinance.com.cn More from this publisher
13.07.2015 Views

Internal Control —Integrated Frameworkong>Guidanceong> on MonitoringInternal Control SystemsVolume III — Application TechniquesJune 2008Exposure DraftPublic Comment PeriodCloses August 15, 2008

<strong>Internal</strong> C<strong>on</strong>trol —Integrated Framework<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring<strong>Internal</strong> C<strong>on</strong>trol <strong>Systems</strong>Volume III — Applicati<strong>on</strong> TechniquesJune 2008Exposure DraftPublic Comment PeriodCloses August 15, 2008


Committee of Sp<strong>on</strong>soring Organizati<strong>on</strong>sof the Treadway Commissi<strong>on</strong>Board MembersLarry E. RittenbergCOSO ChairMark S. BeasleyAmerican Accounting Associati<strong>on</strong>Charles E. LandesAmerican Institute of CertifiedPublic AccountantsEdith G. OrensteinFinancial Executives Internati<strong>on</strong>alMichael P. CangemiFinancial Executives Internati<strong>on</strong>alDavid A. RichardsThe Institute of <strong>Internal</strong> AuditorsJeffrey Thoms<strong>on</strong>Institute of Management AccountantsGrant Thornt<strong>on</strong> LLP ⎯ AuthorPrincipal C<strong>on</strong>tributorsR. Trent Gazzaway (Project Leader)Managing Partner of Corporate GovernanceGrant Thornt<strong>on</strong> LLP ⎯ CharlotteJames P. Burt<strong>on</strong>PartnerGrant Thornt<strong>on</strong> LLP ⎯ DenverJ. Russell GatesPresidentDupage C<strong>on</strong>sulting LLC ⎯ ChicagoKeith O. Newt<strong>on</strong>PartnerGrant Thornt<strong>on</strong> LLP ⎯ ChicagoSridhar RamamoortiPartnerGrant Thornt<strong>on</strong> LLP ⎯ ChicagoRichard L. WoodPartnerGrant Thornt<strong>on</strong> LLP ⎯ Tor<strong>on</strong>toR. Jay BrietzSenior ManagerGrant Thornt<strong>on</strong> LLP ⎯ CharlotteReview TeamAndrew D. Bailey Jr.Senior Policy AdvisorGrant Thornt<strong>on</strong> LLP ⎯ PhoenixDorsey L. Baskin Jr.Regi<strong>on</strong>al Partner ofProfessi<strong>on</strong>al StandardsGrant Thornt<strong>on</strong> LLP ⎯ DallasCraig A. EmrickVP - Senior Accounting AnalystMoody’s Investors ServicePhilip B. Livingst<strong>on</strong>Vice Chairman, Approva Corporati<strong>on</strong>Former President and CEO,Financial Executives Internati<strong>on</strong>alCOSO Task ForceAbraham D. AkreshSenior Level Expert for Auditing StandardsU.S. Government Accountability OfficeDouglas J. Anders<strong>on</strong>Corporate AuditorDow Chemical CompanyRobert J. BenoitPresident and Director ofSOX ResearchLord & Benoit, LLCRichard D. BrounsteinChief Financial Officer,NewCardio, Inc.Director, The CFO NetworkJennifer M. BurnsPartnerDeloitte & Touche LLPPaul CabanAssistant DirectorU.S. Government AccountabilityOfficeJames W. DeLoachManaging DirectorProtivitiMiles E. Evers<strong>on</strong>PartnerPricewaterhouseCoopers LLPAudrey A. GramlingAssociate ProfessorKennesaw State UniversityScott L. MitchellChairman and CEOOpen Compliance & Ethics GroupJames E. Newt<strong>on</strong>PartnerKPMG LLPJohn H. RifePartnerErnst & Young LLPMichael P. RoseCEO and Senior PartnerGR C<strong>on</strong>sulting LLPRobert S. RousseyProfessor of AccountingUniversity of Southern CaliforniaAndre Van HoekVice President, Corporate C<strong>on</strong>trollerCelgene Corporati<strong>on</strong>ObserversSecurities and Exchange Commissi<strong>on</strong>Josh K. J<strong>on</strong>esSEC ObserverProfessi<strong>on</strong>al Accounting Fellow


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Table of C<strong>on</strong>tentsI. Introducti<strong>on</strong> 1A Model for M<strong>on</strong>itoring 2II. Establishing a Foundati<strong>on</strong> for M<strong>on</strong>itoring 3T<strong>on</strong>e from the Top 3Organizati<strong>on</strong>al Structure 4III. Designing and Executing M<strong>on</strong>itoring Procedures 12Understand and Prioritize Risks 13Understand the <strong>Internal</strong> C<strong>on</strong>trol System and Identify Key C<strong>on</strong>trols 14Identify Persuasive Informati<strong>on</strong> 16Implement M<strong>on</strong>itoring Procedures 19IV. Assessing and Reporting Results 24Prioritizing and Communicating Results 24Reporting <strong>Internal</strong>ly 25Reporting Externally 26V. Comprehensive Examples 28Large Retail Organizati<strong>on</strong>’s M<strong>on</strong>itoring of C<strong>on</strong>trols over StoreInventory 29M<strong>on</strong>itoring of C<strong>on</strong>trols over Certain Operati<strong>on</strong>al Risks in a Mid-SizedManufacturing Organizati<strong>on</strong> 46M<strong>on</strong>itoring Certain Informati<strong>on</strong> Technology (IT) C<strong>on</strong>trols 59Appendices 72


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 1I. Introducti<strong>on</strong>This volume (Applicati<strong>on</strong> Techniques or Volume III) of COSO’s <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong>M<strong>on</strong>itoring <strong>Internal</strong> C<strong>on</strong>trol <strong>Systems</strong> illustrates techniques used by organizati<strong>on</strong>sin applying principles outlined in Volume II (the <str<strong>on</strong>g>Guidance</str<strong>on</strong>g>). The structure ofApplicati<strong>on</strong> Techniques parallels that of the <str<strong>on</strong>g>Guidance</str<strong>on</strong>g>, providing easy referencebetween the two volumes.Chapters II–IV of this volume c<strong>on</strong>tain brief examples of various organizati<strong>on</strong>s’current m<strong>on</strong>itoring processes, dem<strong>on</strong>strating the c<strong>on</strong>cepts set forth in thecorresp<strong>on</strong>ding chapters of the <str<strong>on</strong>g>Guidance</str<strong>on</strong>g>. Chapter V of this volume c<strong>on</strong>tains threecomprehensive examples of applying the core c<strong>on</strong>cepts presented in the<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> — designing and executing m<strong>on</strong>itoring procedures and assessing andreporting results.Some users may benefit from first reading the examples in Chapter V in order togain a more complete understanding of how m<strong>on</strong>itoring might be applied indifferent situati<strong>on</strong>s.In order to provide further linkage between Volumes II and III, summaries of the<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> are included in shaded boxes at the beginning of each secti<strong>on</strong> inChapters II–IV. Those passages also provide a foundati<strong>on</strong> for the illustratedtechniques. To gain the desired benefit from this material, users should be familiarwith the <str<strong>on</strong>g>Guidance</str<strong>on</strong>g>.This material is designed to be useful to those seeking to apply internal c<strong>on</strong>trolm<strong>on</strong>itoring techniques. Proper m<strong>on</strong>itoring of internal c<strong>on</strong>trol, however, is notdependent up<strong>on</strong> use of the illustrated techniques, nor is their applicati<strong>on</strong> requiredfor the m<strong>on</strong>itoring comp<strong>on</strong>ent of internal c<strong>on</strong>trol to be effective. Accordingly, thedescripti<strong>on</strong>s and exhibits are presented as examples rather than as preferredmethods or “best practices.”While some techniques are best applied in smaller, n<strong>on</strong>-complex organizati<strong>on</strong>s,others are more relevant to larger, complex entities — and many can be applied toorganizati<strong>on</strong>s of all sizes and levels of complexity.


2 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008A Model for M<strong>on</strong>itoring<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Effective m<strong>on</strong>itoring involves (1) establishing an effectivefoundati<strong>on</strong> for m<strong>on</strong>itoring, (2) designing and executing m<strong>on</strong>itoring proceduresthat are prioritized based <strong>on</strong> risk, and (3) reporting the results, and following up<strong>on</strong> corrective acti<strong>on</strong> where necessary (See Figure 1).The M<strong>on</strong>itoring ProcessFigure 1


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 3II. Establishing a Foundati<strong>on</strong> for M<strong>on</strong>itoring<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: M<strong>on</strong>itoring is effective when properly planned andsupported by the organizati<strong>on</strong>. This planning and support form the foundati<strong>on</strong>for m<strong>on</strong>itoring, which includes (1) a t<strong>on</strong>e from the top about the importance ofinternal c<strong>on</strong>trol (including m<strong>on</strong>itoring), (2) an organizati<strong>on</strong>al structure thatc<strong>on</strong>siders the roles of management and the board in regard to m<strong>on</strong>itoring, andthe use of evaluators with appropriate capabilities and objectivity, and (3) abaseline understanding of internal c<strong>on</strong>trol effectiveness.T<strong>on</strong>e from the Top<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: As with every internal c<strong>on</strong>trol comp<strong>on</strong>ent, the ways inwhich management and the board express their beliefs about the importance ofm<strong>on</strong>itoring have a direct impact <strong>on</strong> its effectiveness. Management’s t<strong>on</strong>einfluences how employees c<strong>on</strong>duct and react to m<strong>on</strong>itoring. Likewise, theboard’s t<strong>on</strong>e influences how management c<strong>on</strong>ducts and reacts to m<strong>on</strong>itoring.The following examples highlight ways in which various organizati<strong>on</strong>s haveimplemented an effective t<strong>on</strong>e from the top.Many of these examples are broad, covering the t<strong>on</strong>e from the top regardingthe importance of all internal c<strong>on</strong>trol, including m<strong>on</strong>itoring. Othersdem<strong>on</strong>strate how management effectively and c<strong>on</strong>sistently communicates itsexpectati<strong>on</strong>s regarding risk and the importance of m<strong>on</strong>itoring in providingassurance that meaningful risks are properly managed or mitigated.Example 1: A large professi<strong>on</strong>al services organizati<strong>on</strong> maintains what it calls a“COSO Usage Document.” This document, updated annually, identifies how theorganizati<strong>on</strong> achieves the principles and attributes of each of the five COSOcomp<strong>on</strong>ents. The c<strong>on</strong>tents of the COSO Usage Document are validated by theglobal leadership resp<strong>on</strong>sible for processes across the enterprise (i.e., Finance,HR, CIO, Legal, Operati<strong>on</strong>s). In additi<strong>on</strong> to serving as a key design documentwhich helps management and the auditors understand the strength of their design,the COSO Usage Document also serves as evidence of the organizati<strong>on</strong>’sintegrated c<strong>on</strong>trol structure. Readers receive a clear message from the top of theorganizati<strong>on</strong> that internal c<strong>on</strong>trols, including m<strong>on</strong>itoring, are an important part ofthe success of their business. See Appendix A for excerpts from this COSOUsage Document.C<strong>on</strong>sistentdevelopment andcommunicati<strong>on</strong> ofexpectati<strong>on</strong>sregarding internalc<strong>on</strong>trol, includingm<strong>on</strong>itoring


4 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Use of a formal riskcommittee to developand communicatem<strong>on</strong>itoringexpectati<strong>on</strong>s<strong>Internal</strong> audit policythat encourages selfassessmentand selfreportingof potentialc<strong>on</strong>trol problemsExample 2: A large power generati<strong>on</strong> company has established a RiskOversight Committee (ROC) to focus <strong>on</strong> risk management and oversight of thecompany’s operati<strong>on</strong>s. The ROC includes members of senior management and isan active part of the m<strong>on</strong>itoring structure. The ROC sets the proper t<strong>on</strong>e from thetop by:• Establishing Risk Policies and the organizati<strong>on</strong>’s Business Risk Profile,• M<strong>on</strong>itoring compliance with the Risk Policies, and• Ensuring that operati<strong>on</strong>s are managed within the boundaries set in theorganizati<strong>on</strong>’s Business Risk Profile.Example 3: The internal audit department of a financial services organizati<strong>on</strong>has implemented a rewards system that encourages departments to m<strong>on</strong>itor theeffectiveness of their internal c<strong>on</strong>trol systems and self-report possible c<strong>on</strong>troldeficiencies. This encouragement comes in the form of an internal audit policythat gives departments credit in the internal audit grading system for deficienciesthat are self-reported. Deficiencies that are identified through an internal auditexaminati<strong>on</strong>, rather than through a department’s m<strong>on</strong>itoring efforts, are countedagainst the score.This credit for self-reporting does not preclude internal audit from reportingspecific deficiencies to management or the board when such reporting iswarranted, but it does positively affect the grading system, which can affectdepartmental compensati<strong>on</strong> and benefits, thus increasing the likelihood thatc<strong>on</strong>trol deficiencies will be identified and corrected before they can becomematerial to the organizati<strong>on</strong>.Clearly articulatedroles andresp<strong>on</strong>sibilitiesthrough theestablishment ofpreparer/reviewerstandards for keyjournal entriesOrganizati<strong>on</strong>al StructureExample 4: In relati<strong>on</strong> to financial reporting risks, an internati<strong>on</strong>al c<strong>on</strong>sumerproducts company developed a detailed descripti<strong>on</strong> of the roles andresp<strong>on</strong>sibilities of journal-entry preparers, detail reviewers and sec<strong>on</strong>daryreviewers. The organizati<strong>on</strong> then developed a matrix of key journal entries (i.e.,those with direct financial statement impact, primarily for the major functi<strong>on</strong>alcorporate areas including tax, accounting, treasury, legal, etc.), and compared thatmatrix to the policy.Through this analysis the organizati<strong>on</strong> determined that, in several complex areas,it did not have appropriate levels of journal-entry review. The organizati<strong>on</strong>developed a plan for each identified deficiency — mandating the formal sign-offby the preparer, detail reviewer and sec<strong>on</strong>dary reviewer for each key journal entry.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 5Independent pers<strong>on</strong>nel periodically select a sample of journal entries and evaluatecompliance with the policy. The audit committee receives a report <strong>on</strong> the testresults and reviews the key journal entry matrix <strong>on</strong> an annual basis.Example 5: Senior management at a provider of Internet-based securitiesbrokerage and financial services has established a formal Corporate RiskCommittee (CRC) tasked with facilitating the completi<strong>on</strong> of an enterprise riskmanagement program. One of this committee’s mandates is to determine andcommunicate how the organizati<strong>on</strong> will m<strong>on</strong>itor c<strong>on</strong>trols over the risks identifiedin its annual Corporate Risk Assessment process. As a result, management has a“road map” in which financial and operati<strong>on</strong>al c<strong>on</strong>trols in the business are linkedto the risks identified during the annual risk assessment.Example 6: An energy company created a new Risk C<strong>on</strong>trol functi<strong>on</strong> toaddress risks related to its complex energy trading operati<strong>on</strong>s. The additi<strong>on</strong> of thisfuncti<strong>on</strong> to the organizati<strong>on</strong>’s structure enables the company to better m<strong>on</strong>itor theinternal c<strong>on</strong>trol system’s ability to address some of the organizati<strong>on</strong>’s highestoperati<strong>on</strong>al, financial reporting and compliance-related risks. It also sends amessage throughout the organizati<strong>on</strong> that management is committed to m<strong>on</strong>itoringthe effectiveness of internal c<strong>on</strong>trol.Smaller organizati<strong>on</strong>s in similar situati<strong>on</strong>s (i.e., those in regulated industries, withunique, highly complex, highly material risks) may not need to establish a separaterisk c<strong>on</strong>trol functi<strong>on</strong> within the organizati<strong>on</strong>al structure. They might, instead,assign specific management or other independent pers<strong>on</strong>nel to (1) obtain andmaintain appropriate skills and training, and (2) perform <strong>on</strong>going m<strong>on</strong>itoring andperiodic separate evaluati<strong>on</strong>s in those high-risk areas. If deemed necessary,smaller organizati<strong>on</strong>s could also engage qualified external professi<strong>on</strong>als to helpm<strong>on</strong>itor the internal c<strong>on</strong>trol system’s ability to manage or mitigate theseunique risks.Example 7: A small software company has an organizati<strong>on</strong>al chart for itscorporate accounting department that is updated as new employees are added.Resp<strong>on</strong>sibility for overseeing financial reporting processes and m<strong>on</strong>itoringc<strong>on</strong>trols in key areas (e.g., Financial Reporting, Payroll, Human Resources,Payables and Billings) are assigned to appropriate pers<strong>on</strong>nel. The AuditCommittee c<strong>on</strong>ducts an annual review of the organizati<strong>on</strong>al chart andoversight resp<strong>on</strong>sibilities.Use of a formal riskcommittee to developand communicateexpectati<strong>on</strong>sCreati<strong>on</strong> of a RiskC<strong>on</strong>trol functi<strong>on</strong> tofacilitate both thedevelopment ofc<strong>on</strong>trols and them<strong>on</strong>itoring of thosec<strong>on</strong>trolsClear assignment ofoversightresp<strong>on</strong>sibilities


6 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Role of Management and the Board<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Management has the primary resp<strong>on</strong>sibility forimplementing effective internal c<strong>on</strong>trol, including m<strong>on</strong>itoring. As it relates tom<strong>on</strong>itoring, the board is resp<strong>on</strong>sible for determining whether management hasimplemented effective m<strong>on</strong>itoring procedures where necessary. It makes thisassessment by (1) understanding the risks the organizati<strong>on</strong> faces, and(2) gaining an understanding of how senior management manages or mitigatesthose risks that are meaningful to the organizati<strong>on</strong>’s objectives.The board also m<strong>on</strong>itors — often through the use of a competent and objectiveinternal audit functi<strong>on</strong> — those c<strong>on</strong>trols that senior management cannotobjectively m<strong>on</strong>itor, such as c<strong>on</strong>trols that address the risk of seniormanagementoverride.Audit committee’s useof internal audit toaddress certain risksExample 8: In order to determine that management has implemented effectivem<strong>on</strong>itoring procedures over certain identified risks, the audit committee of asmall, global manufacturing company has directed internal audit to performspecific annual reviews. One area of specific c<strong>on</strong>cern is manual journal entries,with a particular focus <strong>on</strong> potential management override activities. <strong>Internal</strong>audit’s review includes basic informati<strong>on</strong> such as the number, dollar amount,preparer, business unit, and timing relative to m<strong>on</strong>th- and quarter-end. Thisanalysis also includes more in-depth informati<strong>on</strong> such as:• Reas<strong>on</strong>ableness of significant entries (e.g., manual entries in traditi<strong>on</strong>allyautomated accounts such as inventory),• Review of the appropriateness of the individual performing the journalentry (e.g., senior executives or unauthorized pers<strong>on</strong>nel),• Review of the frequency of journal entries, particularly relevant tomanagement authorizati<strong>on</strong> levels (e.g., to identify potential statisticallyanomalous entries using Benford’s Law 1 ),• Identificati<strong>on</strong> of journal entries without descripti<strong>on</strong>s,1Benford’s Law, also knows as the “first-digit law,” is named for the late physicist Dr. FrankBenford. Building <strong>on</strong> a theory first proposed by the astr<strong>on</strong>omer Sim<strong>on</strong> Newcomb in 1881,Dr. Benford proved that in lists of numbers, leading digits typically are distributed in a specific,n<strong>on</strong>-uniform way. According to Benford's law, the first digit is 1 approximately 30 percent ofthe time, and larger numbers occur as the leading digit with less and less frequency as theygrow in magnitude. Benford’s Law is frequently used to search for instances of error or fraud.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 7Potentially fraudulent entries. The organizati<strong>on</strong> created a profile of potentialfraudulent entries from management override frauds known to have beenperpetuated at other companies. <strong>Internal</strong> audit statistically compares the manualjournal entries against this profile.Example 9: A provider of Internet-based securities brokerage and financialservices has instituted a formal <strong>Internal</strong> C<strong>on</strong>trol Assessment Program (ICAP).This program requires business unit owners, <strong>on</strong> a quarterly basis, to perform ac<strong>on</strong>trol self-assessment and certify the effectiveness of certain c<strong>on</strong>trols for whichthey are resp<strong>on</strong>sible. Management clearly communicates its expectati<strong>on</strong>sregarding the accuracy of the ICAP certificati<strong>on</strong>s and holds managers accountableif they improperly certify their internal c<strong>on</strong>trols.Management recognizes that self-assessment, while not completely objective, isan effective first line of defense against internal c<strong>on</strong>trol failure. As a result,management is able to focus more-objective m<strong>on</strong>itoring where the level of riskwarrants. Furthermore, <strong>Internal</strong> Audit helps compensate for the lack of objectivityin the c<strong>on</strong>trol self-assessments by performing independent m<strong>on</strong>itoring procedures<strong>on</strong> a periodic basis and comparing their results to the self-assessments.<strong>Internal</strong> Audit modifies its annual audit program, which includes both <strong>on</strong>goingm<strong>on</strong>itoring and separate evaluati<strong>on</strong>s, based <strong>on</strong> the results of:• The organizati<strong>on</strong>’s Annual Enterprise-wide Risk Assessment,• The results of the business unit owners’ <strong>Internal</strong> C<strong>on</strong>trol AssessmentProgram (ICAP),• <strong>Internal</strong> Audit’s own risk assessment process.Example 10: An internati<strong>on</strong>al manufacturer has an internal audit functi<strong>on</strong> that isboth functi<strong>on</strong>ally and administratively independent from the CFO, CEO, andbusiness unit leaders. The internal audit department aligns its annual objectiveswith the enterprise-wide strategic objectives. As a result, the focus of the annualaudit plan is c<strong>on</strong>sistent with the corporate strategic objectives at the corporate andbusiness unit level. Furthermore, audit budgets include time allocated foradditi<strong>on</strong>al requested reviews and projects that can be initiated at the request of anyexecutive within the organizati<strong>on</strong>, and executed up<strong>on</strong> approval of the corporateaudit committee.Example 11: The board at a medium-sized manufacturing company has standingresp<strong>on</strong>sibilities that ensure that they have visibility to key risk areas. For example,they recently determined that c<strong>on</strong>tract compliance was a high-risk area thatwarranted board oversight. Accordingly, they implemented a requirement that theboard review and approve any sales c<strong>on</strong>tracts over $50M or greater than five yearsin durati<strong>on</strong>, and any corporate c<strong>on</strong>tracts that vary from standard terms.Use of selfassessmentstoinstill m<strong>on</strong>itoringresp<strong>on</strong>sibilitiesthroughout themanagementstructureUse of internal auditto assist in riskassessment andm<strong>on</strong>itoring activitiesBoard of directors’oversight adjustedbased <strong>on</strong> risk


8 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Open lines of internaland externalcommunicati<strong>on</strong>Example 12: A large governmental agency has multiple stakeholders. Withrespect to fraud, waste, and abuse, this organizati<strong>on</strong>’s inspector general isauthorized to report <strong>on</strong> matters identified from its 1-800 hotline for an<strong>on</strong>ymouscallers, e-mail box, FraudNET, 2 etc. Further, the general counsel’s office has aforensic audit team who is called in when investigati<strong>on</strong>s are warranted.Characteristics of Evaluators 3<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Effective m<strong>on</strong>itoring is c<strong>on</strong>ducted by evaluators who areappropriately competent 3 and objective in the given circumstances.Competence refers to the evaluator’s knowledge of the c<strong>on</strong>trols and relatedprocesses, including how c<strong>on</strong>trols should operate and what c<strong>on</strong>stitutes a c<strong>on</strong>troldeficiency. The evaluator’s objectivity refers to the extent to which he or shecan be expected to perform an evaluati<strong>on</strong> with no c<strong>on</strong>cern about possiblepers<strong>on</strong>al c<strong>on</strong>sequences and no vested interest in manipulating the informati<strong>on</strong>for pers<strong>on</strong>al benefit or self-preservati<strong>on</strong>.Less<strong>on</strong>s learned fromthe correcti<strong>on</strong> of adifficult m<strong>on</strong>itoringand oversightproblemExample 13: Executive management at a medium-sized manufacturingcompany has modified its m<strong>on</strong>itoring to include more <strong>on</strong>going m<strong>on</strong>itoring ofinternal c<strong>on</strong>trol over financial reporting at the corporate level and reduce thefrequency and scope of separate evaluati<strong>on</strong>s at plant locati<strong>on</strong>s. This shift resultedfrom corrective acti<strong>on</strong> taken after the organizati<strong>on</strong> identified the following internalc<strong>on</strong>trol problems that had a direct impact <strong>on</strong> its ability to m<strong>on</strong>itor its internalc<strong>on</strong>trol system effectively. The organizati<strong>on</strong> determined that it:• Lacked appropriate internal ownership of risks and c<strong>on</strong>trols related tofinancial reporting, and• Had an insufficient number of competent pers<strong>on</strong>nel throughout theorganizati<strong>on</strong> who could effectively m<strong>on</strong>itor c<strong>on</strong>trols that address financialreporting-related risks.Senior management, through <strong>on</strong>going m<strong>on</strong>itoring at lower levels, did not receiveenough direct informati<strong>on</strong> regarding the operati<strong>on</strong> of key c<strong>on</strong>trols. As result, itwas forced to c<strong>on</strong>duct year-end separate evaluati<strong>on</strong>s of internal c<strong>on</strong>trol that werenot as efficient as they could have been if more-effective <strong>on</strong>going m<strong>on</strong>itoring hadbeen present.2 FraudNET is a communicati<strong>on</strong> vehicle through which the public can report allegati<strong>on</strong>s offraud, waste, abuse, or mismanagement of U.S. federal funds.3 Bold items are defined in the Glossary to Volume II.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 9Driven by the audit committee’s desire to see immediate improvement in thecompleteness, accuracy and integrity of financial informati<strong>on</strong> and internal c<strong>on</strong>trol,the organizati<strong>on</strong> made a number of changes, including extensive pers<strong>on</strong>nelchanges, and new external advisors. However, the company did not realize animmediate improvement in the results, as numerous accounting errors andsignificant internal c<strong>on</strong>trol deficiencies c<strong>on</strong>tinued to surface. The organizati<strong>on</strong> hadtaken steps to correct the pers<strong>on</strong>nel issues, but some procedural issues remained tobe addressed.For some of the excepti<strong>on</strong>s, up to five different reviewers had signed off <strong>on</strong>rec<strong>on</strong>ciliati<strong>on</strong>s that c<strong>on</strong>tained errors. Further analysis of the c<strong>on</strong>tinuing errorsrevealed that historical knowledge of certain accounting matters and rec<strong>on</strong>cilingitems was lost as a result of the turnover in pers<strong>on</strong>nel and a lack of previouslydeveloped supporting documentati<strong>on</strong>. In additi<strong>on</strong>, the new pers<strong>on</strong>nel sufferedfrom a lack of procedural documentati<strong>on</strong> or training for their new jobs, whichaffected their ability to operate effectively.The organizati<strong>on</strong> corrected these m<strong>on</strong>itoring problems by eliminating unnecessarym<strong>on</strong>itoring redundancies, formally assigning m<strong>on</strong>itoring resp<strong>on</strong>sibilities overaccounts and c<strong>on</strong>trols, documenting the m<strong>on</strong>itoring processes, and properlytraining pers<strong>on</strong>nel. With these adjustments in place, the momentum shiftedc<strong>on</strong>siderably. The company began to identify and address excepti<strong>on</strong>s andaccounting issues in a more timely, accurate and efficient manner. In additi<strong>on</strong>, theincreased competence and objectivity of the new pers<strong>on</strong>nel allowed theorganizati<strong>on</strong> to identify improvements in the m<strong>on</strong>itoring informati<strong>on</strong> supplied tosenior management throughout the year. As a result senior management has beenable to c<strong>on</strong>duct more <strong>on</strong>going m<strong>on</strong>itoring at the corporate level, and reduce thefrequency and scope of separate evaluati<strong>on</strong>s in the plant locati<strong>on</strong>s.


10 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Baseline of Effective <strong>Internal</strong> C<strong>on</strong>trol<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: M<strong>on</strong>itoring starts with a supported understanding of theinternal c<strong>on</strong>trol system’s design and of whether c<strong>on</strong>trols have beenimplemented to accomplish the organizati<strong>on</strong>’s internal c<strong>on</strong>trol objectives. Asmanagement gains experience with m<strong>on</strong>itoring, its baseline understanding willexpand based <strong>on</strong> the results of m<strong>on</strong>itoring. If an organizati<strong>on</strong> does not alreadyhave such a baseline understanding in an area with meaningful risks, it willneed to perform an initial, and perhaps extensive, evaluati<strong>on</strong> of the design ofinternal c<strong>on</strong>trol and determine whether appropriate c<strong>on</strong>trols have beenimplemented. An established baseline understanding of internal c<strong>on</strong>troleffectiveness provides an appropriate starting point for more-effective andmore-efficient m<strong>on</strong>itoring that focuses <strong>on</strong> changes either in the envir<strong>on</strong>ment orin the internal c<strong>on</strong>trol system (sees Figure 2).M<strong>on</strong>itoring for Change C<strong>on</strong>tinuumFigure 2Effective use of ac<strong>on</strong>trol baselineExample 14: A beverage manufacturer and distributor alters the type, timingand extent of its internal c<strong>on</strong>trol m<strong>on</strong>itoring based <strong>on</strong> the results of its riskassessment process (see Example 17:). In areas of meaningful risk the companyfirst “benchmarks” the key internal c<strong>on</strong>trols, meaning they c<strong>on</strong>duct a thoroughreview of the design and operating effectiveness of the c<strong>on</strong>trols in order toestablish a baseline of effective c<strong>on</strong>trol. With the risks prioritized and thebenchmark established, management (with the assistance of internal audit)identifies c<strong>on</strong>trols that can be m<strong>on</strong>itored for a reas<strong>on</strong>able period of time throughmore-efficient m<strong>on</strong>itoring techniques such as using indirect informati<strong>on</strong> or selfassessmentscoupled with supervisor review. On an interval that is commensuratewith the level of risk, internal audit performs periodic separate evaluati<strong>on</strong>s of key


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 11c<strong>on</strong>trols, thus rec<strong>on</strong>firming the benchmark and the effectiveness of the <strong>on</strong>goingm<strong>on</strong>itoring procedures.Example 15: A small semic<strong>on</strong>ductor research and development organizati<strong>on</strong>recognizes that many of its financial statement risks reside with the selecti<strong>on</strong> andapplicati<strong>on</strong> of accounting estimates. As a result, it c<strong>on</strong>ducted an initial riskassessment that identified the following related risks:• Calculati<strong>on</strong> of allowances for uncollectible accounts, inventoryobsolescence, and deferred tax assets,• Methodology for updating standard costs,• Review of cost provisi<strong>on</strong>s regarding its government c<strong>on</strong>tract and themethodologies used to identify unallowable costs and allocati<strong>on</strong>s,• Procedures to test for possible impairment of assets,• Update of the annual evaluati<strong>on</strong> of goodwill for possible additi<strong>on</strong>alimpairment analysis, and• Search for possible loss c<strong>on</strong>tingencies related to litigati<strong>on</strong>, envir<strong>on</strong>mentalremediati<strong>on</strong>, or possible product warranty liabilities.With the initial risk assessment completed, the organizati<strong>on</strong> can effect efficientupdates through periodic discussi<strong>on</strong> of factors that prompt reprioritizati<strong>on</strong> of theserisks and evaluati<strong>on</strong> of any new risks. For example, the company closed a majorplant during <strong>on</strong>e fiscal year. As a result of this identified change, managementc<strong>on</strong>sidered the related risks and determined to evaluate c<strong>on</strong>trols associated withaccounting for disc<strong>on</strong>tinued operati<strong>on</strong>s, including the process for capturing allcosts associated with the closed facility. Identifying the change in the envir<strong>on</strong>mentled to an assessment of the related risk and to at least a temporary modificati<strong>on</strong> ofthe internal c<strong>on</strong>trol m<strong>on</strong>itoring procedures.Modificati<strong>on</strong> tom<strong>on</strong>itoring as a resultof an identifiedchange in theenvir<strong>on</strong>ment


12 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008III. Designing and Executing M<strong>on</strong>itoring Procedures<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: The core of effective and efficient m<strong>on</strong>itoring lies indesigning and executing m<strong>on</strong>itoring procedures that evaluate importantc<strong>on</strong>trols over meaningful risks to the organizati<strong>on</strong>’s objectives. An overallmodel of m<strong>on</strong>itoring is shown in Figure 3 below that may help in designingand implementing the m<strong>on</strong>itoring comp<strong>on</strong>ent. The model reiterates theimportance of understanding risks and the relati<strong>on</strong>ship of c<strong>on</strong>trols to risks asboth a fundamental part of the COSO Framework, and an integral part ofm<strong>on</strong>itoring as well.Logical M<strong>on</strong>itoring Design Progressi<strong>on</strong>Figure 3


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 13Understand and Prioritize Risks<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Designing effective m<strong>on</strong>itoring begins with understandingand prioritizing the risks to achieving important organizati<strong>on</strong>al objectives.Prioritizing risks helps identify which risks are meaningful enough to subject toc<strong>on</strong>trol m<strong>on</strong>itoring.Example 16: Senior management of a beverage manufacturer and distributorfocuses the organizati<strong>on</strong>’s m<strong>on</strong>itoring efforts by locati<strong>on</strong> and by risk priority. Riskc<strong>on</strong>siderati<strong>on</strong>s include areas:• That are material or complex,• Where systems or processes have changed significantly,• Where errors or irregularities have been identified,• With high turnover, and• Where the self-assessment has indicated issues in the past.M<strong>on</strong>itoring begins with the c<strong>on</strong>trol owners, who perform a self-assessment of theirkey c<strong>on</strong>trols <strong>on</strong> a m<strong>on</strong>thly, quarterly or annual basis (depending <strong>on</strong> the c<strong>on</strong>trol’sfrequency) and document the results in a reporting tool that resides <strong>on</strong> thenetwork. Management-level process owners above the c<strong>on</strong>trol owner c<strong>on</strong>ductsupervisory reviews through a process they call Field <strong>Internal</strong> C<strong>on</strong>trolAssessments (FICA). These supervisory reviews are c<strong>on</strong>ducted <strong>on</strong> a frequencythat is commensurate with the level of risk, and are executed from an auditprogram designed to test key financial and operati<strong>on</strong>al c<strong>on</strong>trols.Example 17: A provider of Internet-based securities brokerage and financialservices has a formal Corporate Risk Committee (CRC) tasked with facilitatingthe enterprise risk management process.One of the key tasks of the CRC is the facilitati<strong>on</strong> and completi<strong>on</strong> of an AnnualEnterprise Risk Assessment using the COSO ERM Framework. CRC membersidentify, assess, and evaluate risks across all strategic, operati<strong>on</strong>al, reporting, andcompliance activities. Business unit leaders, who have input into the riskassessment process, are then tasked with managing or mitigating those risks withintheir area of resp<strong>on</strong>sibility. The process includes ensuring that internal c<strong>on</strong>trolover the identified risks is designed and operating effectively (i.e., m<strong>on</strong>itoring).The business unit leaders have established m<strong>on</strong>itoring procedures that are linkedto the prioritized risks. The results of those procedures are reported to seniormanagement <strong>on</strong> a regular basis. If risks change, the business unit leaders areAdjustment of type,timing and extent ofm<strong>on</strong>itoring based <strong>on</strong>the results of riskassessmentUse of a formalizedrisk assessmentmethodology


14 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008resp<strong>on</strong>sible for making any necessary modificati<strong>on</strong>s to internal c<strong>on</strong>trol and relatedm<strong>on</strong>itoring procedures.Use of a formalizedrisk assessmentmethodologyExample 18: In completing its annual Business Risk Assessment, managementof a retail chain store company utilizes rati<strong>on</strong>al groupings of risk (i.e., “realestate,” “general accounting,” or “loss preventi<strong>on</strong>”). These rati<strong>on</strong>al groupings arecomprised of a number of discretely defined risk factors. Once risks are defined,management identifies the specific c<strong>on</strong>trols that mitigate the discrete risk factors.This process helps management determine what c<strong>on</strong>trols to m<strong>on</strong>itor and how theywill be m<strong>on</strong>itored. After completi<strong>on</strong> of the first Business Risk Assessment, thecompany anticipates that future updates will be more limited in scope, focusing <strong>on</strong>envir<strong>on</strong>mental and organizati<strong>on</strong>al changes over the past year and revisiting therisk assessment in areas where problems have surfaced. (See Appendix D forexcerpts from this company’s risk matrix.)Understand the <strong>Internal</strong> C<strong>on</strong>trol System and Identify Key C<strong>on</strong>trols<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: In order to identify the important or key c<strong>on</strong>trols tom<strong>on</strong>itor, the people designing m<strong>on</strong>itoring procedures must first understand(1) how the internal c<strong>on</strong>trol system is designed to manage or mitigate theidentified risks, and (2) how the c<strong>on</strong>trol system could fail and that failure notbe detected in a timely manner. Important c<strong>on</strong>trols — often referred to as keyc<strong>on</strong>trols — are those that are most important to m<strong>on</strong>itor in order to support ac<strong>on</strong>clusi<strong>on</strong> about the internal c<strong>on</strong>trol system’s ability to manage or mitigatemeaningful risks. They often have <strong>on</strong>e or both of the following characteristics:• Their failure might materially affect the organizati<strong>on</strong>’s objectives, yetnot reas<strong>on</strong>ably be detected in a timely manner by other c<strong>on</strong>trols, and/or• Their operati<strong>on</strong> might prevent other c<strong>on</strong>trol failures or detect suchfailures before they have an opportunity to become material to theorganizati<strong>on</strong>’s objectives.The discussi<strong>on</strong> of key c<strong>on</strong>trols in this guidance is not intended to establishdifferent classes of internal c<strong>on</strong>trol. Rather, it is to help organizati<strong>on</strong>sunderstand how they might reas<strong>on</strong>ably c<strong>on</strong>clude that the internal c<strong>on</strong>trolsystem is effective in addressing a given risk by focusing m<strong>on</strong>itoring efforts <strong>on</strong>a subset of c<strong>on</strong>trols.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 15Example 19: The internal audit department at a financial services companybuilds its audit programs for corporate, departmental and individual locati<strong>on</strong>audits based <strong>on</strong>:• An understanding of how the internal c<strong>on</strong>trol system is designed toaddress meaningful risks, and• The identificati<strong>on</strong> of c<strong>on</strong>trols within that system that are most important toaddressing those risks.Its assessment is based <strong>on</strong> its experience in the industry, knowledge of theunderlying c<strong>on</strong>trol risk, the existence of any changes, or past problems in the area.Example 20: Management of a small manufacturing company has prioritized itsm<strong>on</strong>itoring procedures based <strong>on</strong> the significance and likelihood of risks and therelative importance of certain c<strong>on</strong>trols in mitigating those prioritized risks. Inselecting “key c<strong>on</strong>trols” to m<strong>on</strong>itor management first c<strong>on</strong>siders whether failure ina given c<strong>on</strong>trol might lead to a material error.Some key c<strong>on</strong>trols, such as the rec<strong>on</strong>ciliati<strong>on</strong> c<strong>on</strong>trols over certain significantaccounts, could cause an error if they fail even <strong>on</strong>ce. In such cases, managementm<strong>on</strong>itors those c<strong>on</strong>trols <strong>on</strong> an <strong>on</strong>going basis, using primarily direct informati<strong>on</strong>.Other key c<strong>on</strong>trols, such as c<strong>on</strong>trols over the changing of depreciable lives in thefixed asset system, would have to fail over an extended period of time in order tobe material. In those cases, management’s <strong>on</strong>going m<strong>on</strong>itoring utilizes moreindirect informati<strong>on</strong>, with periodic separate evaluati<strong>on</strong>s of the c<strong>on</strong>trols using directinformati<strong>on</strong>. The interval between separate evaluati<strong>on</strong>s is dependent <strong>on</strong> (1)management’s judgment of the level of risk, and (2) its related determinati<strong>on</strong> ofwhat c<strong>on</strong>stitutes a reas<strong>on</strong>able interval.Still other key c<strong>on</strong>trols serve to detect earlier c<strong>on</strong>trol weaknesses before they canlead to a material error. M<strong>on</strong>itoring these key c<strong>on</strong>trols allow management toimprove the efficiency of m<strong>on</strong>itoring without impairing its effectiveness. Forexample, the company employs a three-way match c<strong>on</strong>trol that compares thequantities and dollars included in purchase orders, receiving logs and invoices.This key c<strong>on</strong>trol, if it operates effectively, would detect failures in c<strong>on</strong>trols overdata entry in the receiving or accounts payable departments before such failurescould lead to improper payments or inaccurate accounting. Accordingly, ratherthan frequently test c<strong>on</strong>trols over data entry regarding receiving or accountspayable, management focuses its m<strong>on</strong>itoring efforts <strong>on</strong> the three-waymatch c<strong>on</strong>trol.Development of anaudit program based<strong>on</strong> an analysis of keyc<strong>on</strong>trolsSmall manufacturingcompany’sc<strong>on</strong>siderati<strong>on</strong> of keyc<strong>on</strong>trols


16 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Identify Persuasive Informati<strong>on</strong><str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: The persuasiveness of informati<strong>on</strong> refers to the degree towhich the m<strong>on</strong>itoring informati<strong>on</strong> is capable of providing adequate support fora c<strong>on</strong>clusi<strong>on</strong> regarding the effectiveness of internal c<strong>on</strong>trols. Persuasiveinformati<strong>on</strong> is both suitable and sufficient in the circumstances and gives theevaluator reas<strong>on</strong>able, but not necessarily absolute, support for a c<strong>on</strong>clusi<strong>on</strong>regarding the c<strong>on</strong>tinued effectiveness of the internal c<strong>on</strong>trol system in a givenrisk area.Suitability of informati<strong>on</strong> is a broad c<strong>on</strong>cept that implies that informati<strong>on</strong> isuseful within the c<strong>on</strong>text for which it is intended. In order to be suitable,informati<strong>on</strong> must be relevant, reliable, and timely (See Figure 4). Sufficiencyis a measure of the quantity of informati<strong>on</strong> (i.e., whether the evaluator hasenough suitable informati<strong>on</strong>).ReliableRelevantNeedTimelyNeedReliableInfoRelevant,InfoReliable &TimelyNeedRelevantInfoTimelyElements of Suitable Informati<strong>on</strong>Figure 4Integrati<strong>on</strong> ofoperati<strong>on</strong>s andfinance into <strong>on</strong>etechnology platformExample 21: An internati<strong>on</strong>al manufacturer implemented an integratedproducti<strong>on</strong> and financial reporting system across the organizati<strong>on</strong>. This systemreduces the amount of data transfer and rec<strong>on</strong>ciliati<strong>on</strong> needed to produce operatingand financial informati<strong>on</strong>, thus improving its reliability. As such, management isbetter able to m<strong>on</strong>itor product quality, operati<strong>on</strong>al, and financial results. Thisimproved reliability has a corresp<strong>on</strong>ding increase <strong>on</strong> the ability of the resultingindirect informati<strong>on</strong> to identify potential c<strong>on</strong>trol deficiencies.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 17Example 22: An internati<strong>on</strong>al manufacturer holds m<strong>on</strong>thly meetings to evaluateoperati<strong>on</strong>al and quality results against standard metrics that are linked to theorganizati<strong>on</strong>’s strategic objectives. Business units report their metrics and relatedanalysis using standardized templates which include the related goal, the currentstatus in relati<strong>on</strong> to the goal and the historical performance against the goal.Management may initiate a specific quality audit (i.e., a separate evaluati<strong>on</strong>) ofany process where statistical indicators show a negative trend or where itidentifies, through observati<strong>on</strong> or customer complaint, a potential quality issue.Business unit leaders also: execute regularly scheduled audits of producti<strong>on</strong>quality c<strong>on</strong>trols; recommend remediati<strong>on</strong>; and track and report remediati<strong>on</strong> ofproducti<strong>on</strong> quality issues. Finally, internal audit develops its annual plan, whichincludes <strong>on</strong>going and separate evaluati<strong>on</strong>s, based in part <strong>on</strong> the results of thisindirect informati<strong>on</strong> analysis.Example 23: In relati<strong>on</strong> to certain operati<strong>on</strong>al risks at plant locati<strong>on</strong>s, the VicePresident of Operati<strong>on</strong>s at a medium-sized manufacturing company has been ableto make more effective use of indirect informati<strong>on</strong> to determine whether plantc<strong>on</strong>trols are operating properly. Two specific examples include c<strong>on</strong>trols related tolabor costs and capital expenditures.Labor — This company experiences a moderate-to-high degree of turnover at itsplant locati<strong>on</strong>s, resulting in frequent additi<strong>on</strong>s to and terminati<strong>on</strong>s from plantpayroll. The company has determined that the risk of material, operati<strong>on</strong>al (orfinancial reporting) problems in this area is relatively low, given the c<strong>on</strong>sistencyand small dollar amounts involved <strong>on</strong> a per-pers<strong>on</strong> basis, and the relativesimplicity of the process. As a result, the company relies <strong>on</strong> m<strong>on</strong>itoring of laborvariances as opposed to frequent direct testing of specific c<strong>on</strong>trols over additi<strong>on</strong>s,terminati<strong>on</strong>s or adjustments to payroll.During the annual budgeting process the company determines its producti<strong>on</strong> plan,headcount requirements and expected overall labor costs. The VP of Operati<strong>on</strong>sm<strong>on</strong>itors the labor variance and investigates any large or unusual items. Anyincrease or decrease should be commensurate with the current m<strong>on</strong>th’s producti<strong>on</strong>activity and employee turnover.Capital Expenditures — The company has c<strong>on</strong>trols in place to address the risk ofimproper capital expenditures. These c<strong>on</strong>trols include required approvals forpurchase orders and invoices, and a three-way match of purchase orders, invoicesand receiving documents.Capital expenditures are approved as part of the annual budgeting process andallocated to the plant when incurred. Direct expenses are budgeted in accordancewith the anticipated producti<strong>on</strong> whereas indirect expenses are budgeted based <strong>on</strong>historical trends and allocated accordingly. The VP of Operati<strong>on</strong>s c<strong>on</strong>ductsUse of indirectinformati<strong>on</strong> inaddressingoperati<strong>on</strong>al risksBalanced use ofdirect and indirectinformati<strong>on</strong> inaddressingoperati<strong>on</strong>al risks


18 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008<strong>on</strong>going m<strong>on</strong>itoring through the review of these costs and investigati<strong>on</strong> of anylarge or unusual variances. He also meets weekly with the CEO to discussperformance and explain variances in detail.The company has c<strong>on</strong>cluded that the level of operati<strong>on</strong>al (and financial reporting)risk is higher in this area than with labor expenses. This higher risk is due, in part,to the frequency of these transacti<strong>on</strong>s and the greater potential for improperexpenditures to be incorporated into the budgeted amounts over time withoutbeing detected by the review of indirect informati<strong>on</strong>. As a result, the companysupplements the <strong>on</strong>going m<strong>on</strong>itoring of indirect informati<strong>on</strong> with annual directtests of the approval c<strong>on</strong>trols and the three-way match. The combinati<strong>on</strong> of<strong>on</strong>going m<strong>on</strong>itoring using indirect informati<strong>on</strong> and periodic separate evaluati<strong>on</strong>susing direct informati<strong>on</strong> has enabled the company to maximize the efficiency ofits m<strong>on</strong>itoring efforts related to capital expenditures while still addressing the riskin an adequate manner.Improved use ofindirect informati<strong>on</strong> tom<strong>on</strong>itor payrollExample 24: Approximately 90% of a medium-sized manufacturing company’semployees are located at plant sites. The company implemented a new payrollsoftware and workflow to review and approve payroll. All bi-weekly payrolls arereviewed in detail at the plant sites and submitted through the workflow. Thecorporate payroll manager reviews plant payrolls for unusual fluctuati<strong>on</strong>s, such asincrease/decrease in employee headcount, excessive overtime, etc. Any identifiedfluctuati<strong>on</strong>s are reviewed and require sufficient resp<strong>on</strong>se and support prior topayroll processing. This m<strong>on</strong>itoring c<strong>on</strong>trol allowed the corporate payroll managerto identify a plant accountant’s c<strong>on</strong>tinual excessive overtime, which occurredoutside the normal m<strong>on</strong>thly plant closing cycle. After further investigati<strong>on</strong>,management discovered that the plant accountant had falsified overtime hours.Thus, improving up<strong>on</strong> the review of indirect informati<strong>on</strong> enabled this organizati<strong>on</strong>to identify a c<strong>on</strong>trol deficiency and fraud in an area typically c<strong>on</strong>sidered to be oflow to moderate risk.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 19Implement M<strong>on</strong>itoring Procedures<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Once the risks are prioritized, key c<strong>on</strong>trols are noted, andthe available persuasive informati<strong>on</strong> is identified, the organizati<strong>on</strong> implementsm<strong>on</strong>itoring procedures that evaluate the effectiveness of the internal c<strong>on</strong>trolsystem’s ability to manage or mitigate the identified risks. M<strong>on</strong>itoring involvesthe use of <strong>on</strong>going m<strong>on</strong>itoring procedures and/or separate evaluati<strong>on</strong>s to gatherand analyze persuasive informati<strong>on</strong> supporting c<strong>on</strong>clusi<strong>on</strong>s about theeffectiveness of c<strong>on</strong>trols across all five COSO comp<strong>on</strong>ents. There may also beopportunities to improve the effectiveness and efficiency of m<strong>on</strong>itoring throughthe use of technology.Ongoing M<strong>on</strong>itoring and Separate Evaluati<strong>on</strong>s<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Ongoing m<strong>on</strong>itoring procedures are built into the normal,recurring operating activities of an organizati<strong>on</strong>. They include regularmanagement and supervisory activities, peer comparis<strong>on</strong>s and trend analysisusing internal and external data, rec<strong>on</strong>ciliati<strong>on</strong>s and other routine acti<strong>on</strong>s.Separate evaluati<strong>on</strong>s are planned and performed periodically and are notingrained in the daily operati<strong>on</strong>s of the organizati<strong>on</strong>. As such, they are notdesigned to evaluate c<strong>on</strong>trols as frequently as <strong>on</strong>going m<strong>on</strong>itoring.In general, as organizati<strong>on</strong>s increase the degree and effectiveness of <strong>on</strong>goingm<strong>on</strong>itoring, they will find less need for separate evaluati<strong>on</strong>s. The 1992 COSOFramework states, “An entity that perceives a need for frequent separateevaluati<strong>on</strong>s should focus <strong>on</strong> ways to enhance its <strong>on</strong>going m<strong>on</strong>itoring activitiesand, thereby, to emphasize ‘building in’ versus ‘adding <strong>on</strong>’ c<strong>on</strong>trols.”Usually, some combinati<strong>on</strong> of <strong>on</strong>going m<strong>on</strong>itoring and separate evaluati<strong>on</strong>swill ensure that the internal c<strong>on</strong>trol system maintains its effectivenessover time.Example 25: At a retail chain store company, <strong>on</strong>going management m<strong>on</strong>itoringof store operati<strong>on</strong>s has always been c<strong>on</strong>sidered crucial to the success of theorganizati<strong>on</strong>. However, growth in the number of stores combined with someincidents of fraud, led management and the board to invest in the development ofa m<strong>on</strong>itoring functi<strong>on</strong> at the corporate level — the Store Operati<strong>on</strong>s Group — toimprove the <strong>on</strong>going m<strong>on</strong>itoring of c<strong>on</strong>trols over store operati<strong>on</strong>s.Necessarymodificati<strong>on</strong>s toimprove <strong>on</strong>goingm<strong>on</strong>itoring


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 23allowed the organizati<strong>on</strong> to streamline and tailor its separate evaluati<strong>on</strong>s to servemore efficiently as periodic c<strong>on</strong>firmati<strong>on</strong> of the effectiveness of the <strong>on</strong>goingm<strong>on</strong>itoring procedures.Example 34: Many financial instituti<strong>on</strong>s employ c<strong>on</strong>tinuous c<strong>on</strong>trolm<strong>on</strong>itoring tools in areas such as (1) loan granting/management,(2) loan provisi<strong>on</strong>ing/performance, (3) m<strong>on</strong>ey laundering, (4) counterfeit checks,(5) Suspicious Activity Reporting (SARs) and resoluti<strong>on</strong>, and (6) wiretransfer anomalies.C<strong>on</strong>tinuousm<strong>on</strong>itoring usingregressi<strong>on</strong> analysisOne financial instituti<strong>on</strong> developed a simple regressi<strong>on</strong> analysis ofn<strong>on</strong>-performing loans by branch, by loan officer (see the figure below) as <strong>on</strong>eform of m<strong>on</strong>itoring indirecty = 0.0032x + 40.606N<strong>on</strong>-Performing Loans, by Branch, by Loan Officer Rinformati<strong>on</strong> related to c<strong>on</strong>trols2 = 0.7518250230over loan originati<strong>on</strong>. The red210statistical precisi<strong>on</strong> intervals190allow the organizati<strong>on</strong> to look170150for outliers across multiple130metrics (e.g., policy, industry110standards or statistical standard9020,000 25,000 30,000 35,000 40,000 45,000 50,000 55,000 60,000$'s of LOANSdeviati<strong>on</strong>s). Further, the reportcan be re-populated in either real-time or batch mode. This analysis helps theorganizati<strong>on</strong> identify loan officers and/or branches that may not be following loanoriginati<strong>on</strong> policies.$'s of NON-PERFORMING LOANS


24 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008IV. Assessing and Reporting Results<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: The m<strong>on</strong>itoring process is complete when the results arecompiled and reported to the appropriate pers<strong>on</strong>nel. This final stage enables theresults of m<strong>on</strong>itoring to either c<strong>on</strong>firm previously established expectati<strong>on</strong>sabout the effectiveness of internal c<strong>on</strong>trol, or highlight identified deficienciesfor possible corrective acti<strong>on</strong>.Prioritizing and Communicating Results<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: C<strong>on</strong>sistent with Principle 20 of COSO’s 2006 <str<strong>on</strong>g>Guidance</str<strong>on</strong>g>,effective m<strong>on</strong>itoring includes identifying c<strong>on</strong>trol deficiencies andcommunicating them to the right people in a timely manner. Someorganizati<strong>on</strong>s accomplish this goal by ranking identified c<strong>on</strong>trol issues byseverity al<strong>on</strong>g a c<strong>on</strong>tinuum such as high, medium, or low, or al<strong>on</strong>g a numericalscale (e.g., 1–5 or 1–10). Other organizati<strong>on</strong>s use a less formal mechanism.Use of a tool to helpprioritize, track andreport potentialdeficienciesUse of a tool to helpprioritize, track andreport potentialdeficienciesExample 35: An internati<strong>on</strong>al manufacturing company developed a customAccess database to track producti<strong>on</strong> quality issues — those identified bothexternally from clients and internally from management's m<strong>on</strong>itoring and QualityAudit reviews. Issues are prioritized, logged, traced to a root cause, assigned to amanager within the producti<strong>on</strong> area, and tracked until the issue is resolved.Management receives a presentati<strong>on</strong> from the Producti<strong>on</strong> Quality Audit Teamleader regarding the status of open quality issues <strong>on</strong> a m<strong>on</strong>thly, quarterly, andannual basis. Significant issues that may impact the ability of the business toachieve its operati<strong>on</strong>al, financial, and quality objectives receive special attenti<strong>on</strong>from business unit leadership and are reported to executive management duringtheir m<strong>on</strong>thly, quarterly, and annual meetings.Executive management of the organizati<strong>on</strong> requires business unit and functi<strong>on</strong>alleaders not <strong>on</strong>ly to test and report results to management, but also to certify thec<strong>on</strong>trols for which they are resp<strong>on</strong>sible (see Appendix B).Example 36: Senior management of trading operati<strong>on</strong>s at a large powergenerati<strong>on</strong> organizati<strong>on</strong> reviews all trading policy violati<strong>on</strong>s and assigns a level ofseverity for each violati<strong>on</strong> based <strong>on</strong> criteria defined in the Trading Risk Policy.The organizati<strong>on</strong> uses an automated reporting system that is integrated with thetrading platform to ensure that identified issues are reported to the appropriate


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 25level for follow-up. Notificati<strong>on</strong> routing varies from the individual’s directsupervisor, or in the case of more severe issues of n<strong>on</strong>-compliance, ExecutiveManagement, Risk Oversight Committee (ROC) Members, and <strong>Internal</strong> Audit.Example 37: A large government agency has a senior-level internal c<strong>on</strong>trolworking group that prioritizes remediati<strong>on</strong> efforts for identified c<strong>on</strong>troldeficiencies. In doing so, the group c<strong>on</strong>siders factors such as: the internal c<strong>on</strong>trolrisks, past internal c<strong>on</strong>trol assessments and experience with other federal agencies.Example 38: Management of an internati<strong>on</strong>al manufacturer has created aQuarterly and Annual Disclosure Committee (QADC) that is resp<strong>on</strong>sible forperforming a review and analysis of c<strong>on</strong>trols m<strong>on</strong>itoring. An important comp<strong>on</strong>entof this review is the quarterly and annual representati<strong>on</strong>s from line management,which includes representati<strong>on</strong>s related to the operati<strong>on</strong> of internal c<strong>on</strong>trols (seeAppendix B). Additi<strong>on</strong>ally, the Disclosure Committee utilizes a checklist (seeAppendix C) to ensure that m<strong>on</strong>itoring occurs in areas of meaningful risk.Factors c<strong>on</strong>sidered inranking identifiedc<strong>on</strong>trol deficienciesUse of people trainedspecifically toevaluate the severityof potentialdeficienciesReporting <strong>Internal</strong>ly<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Reporting protocols vary depending <strong>on</strong> the purpose forwhich the m<strong>on</strong>itoring is c<strong>on</strong>ducted and <strong>on</strong> the severity of the deficiencies.Typically, the results of m<strong>on</strong>itoring c<strong>on</strong>ducted for purposes of evaluating anorganizati<strong>on</strong>’s entity-wide objectives are reported to senior management andthe board. C<strong>on</strong>trol deficiencies should be reported to the pers<strong>on</strong> directlyresp<strong>on</strong>sible for the c<strong>on</strong>trol’s operati<strong>on</strong> and to at least <strong>on</strong>e management levelhigher that has oversight resp<strong>on</strong>sibilities. Reporting at least to these two levelsgives the resp<strong>on</strong>sible pers<strong>on</strong> the informati<strong>on</strong> necessary to correct c<strong>on</strong>troloperati<strong>on</strong> and also helps ensure that appropriately objective people areinvolved in the severity assessment and follow-up.Example 39: The <strong>Internal</strong> Audit Department at a medium-sized manufacturerlogs and tracks all identified c<strong>on</strong>trol deficiencies and assesses their impact to theorganizati<strong>on</strong>. These c<strong>on</strong>trol deficiencies are reported to the management teamresp<strong>on</strong>sible for the audited business unit. An individual within the business unit isassigned resp<strong>on</strong>sibility for remediati<strong>on</strong> of specific c<strong>on</strong>trol deficiencies. <strong>Internal</strong>Audit assigns a remediati<strong>on</strong> timeframe for each identified c<strong>on</strong>trol deficiency based<strong>on</strong> that specific deficiency’s ranking. Deficiencies must be remediated within thespecified timeframe or a clear plan must be in place to address the deficiency.Established reportingprotocols for identifieddeficiencies


26 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Use of a spreadsheetto track and reportdeficienciesEstablished gradingscale and reportingprotocol for identifieddeficienciesExample 40: The Store Operati<strong>on</strong>s Group at a retail chain store company tracksidentified c<strong>on</strong>trol deficiencies <strong>on</strong> a spreadsheet until they are resolved. Theseissues are communicated to executive management and the Audit committee <strong>on</strong> aquarterly basis.Example 41: At an internati<strong>on</strong>al insurance services organizati<strong>on</strong>, the <strong>Internal</strong>Audit Department classifies c<strong>on</strong>trol deficiencies identified during the course of anaudit as: Minor Deficiencies, Reportable Deficiencies, and SignificantDeficiencies. The communicati<strong>on</strong> structure for reporting deficiencies is based <strong>on</strong>the deficiencies’ potential impact to the organizati<strong>on</strong>. The Company’s internalreporting structure requires that:• Minor Deficiencies — are reported at the end of each audit, in detail, tothe manager resp<strong>on</strong>sible for the c<strong>on</strong>trol.• Reportable Deficiencies — are reported at the end of each audit, in detail,to the manager resp<strong>on</strong>sible for the c<strong>on</strong>trol and to the senior managementteam and <strong>on</strong> a quarterly basis, in summary, to the Audit Committee.• Significant Deficiencies — are reported at the end of the audit, in detail, tothe manager and the senior management team and <strong>on</strong> a quarterly basis, indetail, to the Audit Committee.Reporting Externally<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Many organizati<strong>on</strong>s are required to report to third parties<strong>on</strong> the effectiveness of their c<strong>on</strong>trols. A properly designed and executedm<strong>on</strong>itoring program helps support external asserti<strong>on</strong>s because effectivem<strong>on</strong>itoring provides persuasive informati<strong>on</strong> that c<strong>on</strong>trols operated effectivelyduring the period.Potential Modificati<strong>on</strong>s to M<strong>on</strong>itoring<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> Summary: Effective m<strong>on</strong>itoring procedures generally providesubstantial support for external reporting requirements regarding internalc<strong>on</strong>trol effectiveness. However, modificati<strong>on</strong>s to the m<strong>on</strong>itoring program insome areas may be warranted or beneficial to the organizati<strong>on</strong> when externalreporting is required. For example, assume that, in a given risk area, anorganizati<strong>on</strong> uses less objective forms of m<strong>on</strong>itoring (such as self-evaluati<strong>on</strong>s)for internal purposes. The organizati<strong>on</strong> may find that increasing the evaluator’sobjectivity allows the external auditors to use more of his or her work in thec<strong>on</strong>duct of their audit, thus improving overall efficiency.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 27Example 42: Senior–management and the <strong>Internal</strong> Audit department of a smallfinancial instituti<strong>on</strong> hold an annual audit planning meeting with the externalauditor. They discuss management’s approach to the evaluati<strong>on</strong> of internal c<strong>on</strong>trolover financial reporting and c<strong>on</strong>sider modificati<strong>on</strong>s to that approach in areaswhere doing so might increase the external auditor’s ability to use the work ofmanagement and/or internal audit in the c<strong>on</strong>duct of their external audit procedures.For example, internal audit decided to increase slightly its sample size of c<strong>on</strong>troltests in a few key areas in order to provide a large enough sample to meet theexternal auditor’s needs.Example 43: For several years, an internati<strong>on</strong>al manufacturer has utilizedexternal specialists to perform separate evaluati<strong>on</strong>s of c<strong>on</strong>trols over variousaspects of the organizati<strong>on</strong>. Use of these specialists is determined by managementbased <strong>on</strong> (1) the results of the annual risk assessment process, (2) c<strong>on</strong>siderati<strong>on</strong> ofthe external auditor’s needs and its ability to use the work of these specialistsin c<strong>on</strong>ducting its audit, and (3) the capabilities of the organizati<strong>on</strong>’s internalaudit staff. Results and issues identified by these specialists are reported andtracked internally.Benefits of jointplanning between theorganizati<strong>on</strong> and theexternal auditorC<strong>on</strong>siderati<strong>on</strong> of theuse of externalspecialists


28 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008V. Comprehensive ExamplesThe brief examples presented in Chapters II–IV of this volume are intended todem<strong>on</strong>strate how different organizati<strong>on</strong>s might apply the c<strong>on</strong>cepts set forth in the<str<strong>on</strong>g>Guidance</str<strong>on</strong>g> (Volume II). Their brevity provides an easy reference point for specificc<strong>on</strong>cepts, but it does not provide a comprehensive look at m<strong>on</strong>itoring a given riskfrom beginning to end.This chapter provides three comprehensive m<strong>on</strong>itoring examples that flow fromthe point at which a given risk is assessed, through the m<strong>on</strong>itoring process, and,ultimately, to the executi<strong>on</strong> of m<strong>on</strong>itoring procedures and the reporting of resultsto management and the audit committee. The first two examples — <strong>on</strong>e of a largeretail organizati<strong>on</strong> and the other of a mid-sized manufacturing company — arelive examples of m<strong>on</strong>itoring in two organizati<strong>on</strong>s. The third example is compiledfrom project team members’ experiences in helping companies m<strong>on</strong>itorinformati<strong>on</strong> technology risks effectively and efficiently.Table of C<strong>on</strong>tentsLarge Retail Organizati<strong>on</strong>’s M<strong>on</strong>itoring of C<strong>on</strong>trolsover Store InventoryM<strong>on</strong>itoring of C<strong>on</strong>trols over Certain Operati<strong>on</strong>al Risksin a Mid-Sized Manufacturing Organizati<strong>on</strong>M<strong>on</strong>itoring Certain Informati<strong>on</strong> Technology (IT)C<strong>on</strong>trols294659


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 29Large Retail Organizati<strong>on</strong>’s M<strong>on</strong>itoring of C<strong>on</strong>trols over StoreInventoryBackground Informati<strong>on</strong>1. A large retail organizati<strong>on</strong> has in excess of 3,000 store locati<strong>on</strong>s and a tieredmanagement structure for store operati<strong>on</strong>s, including:• Executive management,• 12 senior vice presidents (SVPs) each of whom oversees approximately6 regi<strong>on</strong>al directors,• Approximately 75 regi<strong>on</strong>al directors each of whom is resp<strong>on</strong>sible for6–8 districts,• Approximately 500 district managers each of whom is resp<strong>on</strong>sible for6–8 stores, and• Individual store managers for each locati<strong>on</strong>.


30 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 20082. <strong>Internal</strong> c<strong>on</strong>trol m<strong>on</strong>itoring takes various forms at every level of management.This example will c<strong>on</strong>centrate <strong>on</strong> risks associated with managing store inventory,which management has determined are important to the organizati<strong>on</strong> from both anoperati<strong>on</strong>s and a financial reporting standpoint.3. The primary resp<strong>on</strong>sibility for internal c<strong>on</strong>trol of store operati<strong>on</strong>s rests withstore managers. Through procedures performed during store visits that occur atleast m<strong>on</strong>thly, district managers perform the most direct m<strong>on</strong>itoring of thec<strong>on</strong>tinued effectiveness of c<strong>on</strong>trols in individual stores. Regi<strong>on</strong>al directors andother members of management also visit stores periodically; however, theirprimary m<strong>on</strong>itoring procedures involve the review of detailed store statistics (i.e.,indirect informati<strong>on</strong> that might identify a store with internal c<strong>on</strong>trol issuesaffecting operati<strong>on</strong>s and financial reporting) and their interacti<strong>on</strong>s with, andobservati<strong>on</strong>s of, district managers.4. The large size of the organizati<strong>on</strong> and the fact that its 3,000+ stores arestatistically comparable make it a practical candidate for maximizing the use ofm<strong>on</strong>itoring using indirect informati<strong>on</strong>. Thus, the senior vice presidents andmembers of executive management m<strong>on</strong>itor many c<strong>on</strong>trols, including store-levelinventory c<strong>on</strong>trols, through extensive <strong>on</strong>going m<strong>on</strong>itoring of store operatingstatistics.5. Over time, growth in the number of stores placed stress <strong>on</strong> the previousapproach to m<strong>on</strong>itoring store operati<strong>on</strong>s that c<strong>on</strong>sisted primarily of infrequentvisits by the <strong>Internal</strong> Audit functi<strong>on</strong>. As a result, management performed acomprehensive review of the organizati<strong>on</strong>’s internal c<strong>on</strong>trol over store operati<strong>on</strong>s(establishing a baseline of effective internal c<strong>on</strong>trol) and made three significantchanges to the underlying m<strong>on</strong>itoring structure. First, it shifted much of them<strong>on</strong>itoring resp<strong>on</strong>sibility to store managers and district managers. Sec<strong>on</strong>d, itenhanced the detail c<strong>on</strong>tained in operati<strong>on</strong>al reports reviewed by managers at alllevels. Third, it invested in the development of a m<strong>on</strong>itoring functi<strong>on</strong> at thecorporate level — the Store Operati<strong>on</strong>s Group (SOG) — to enhance both theunderlying c<strong>on</strong>trol activities and the <strong>on</strong>going m<strong>on</strong>itoring of c<strong>on</strong>trols at the storelevel.6. The SOG comprises former store managers, district managers, auditors, andtechnology pers<strong>on</strong>nel. The employee mix provides the group with bothcompetence and objectivity in performing its m<strong>on</strong>itoring duties. Furthermore, toenhance its objectivity, the SOG is part of the organizati<strong>on</strong>’s internal auditfuncti<strong>on</strong> rather than part of operati<strong>on</strong>s or corporate finance. As discussed later,however, the SOG does report potential internal c<strong>on</strong>trol issues to appropriatepers<strong>on</strong>nel outside of internal audit.7. The SOG accesses real-time store-operati<strong>on</strong>s and financial data to performstandard daily, weekly, m<strong>on</strong>thly, quarterly, and annual reviews of store-level


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 31financial and operati<strong>on</strong>al data. Using its extensive knowledge of store operati<strong>on</strong>s,risks, and related c<strong>on</strong>trols, the SOG designed custom database reports to cover keyareas of operati<strong>on</strong>s and internal c<strong>on</strong>trol, including informati<strong>on</strong> related to:• Executi<strong>on</strong> of weekly and m<strong>on</strong>thly store inventory audits,• Late-deposit activity,• Cash-drawer activity,• Inventory adjustments due to theft, spoilage, and customer charge-offs,• Inventory purchasing and item-receipt activity, and• Pricing overrides.Understanding and Prioritizing Risks8. On an annual basis, the organizati<strong>on</strong> completes a comprehensive, enterprisewiderisk assessment. Those involved in the assessment include seniormanagement, business unit leadership, and where appropriate, direct reports ofbusiness unit leaders. The focus of this risk assessment is identifying the effectand probability (sometimes referred to as “significance and likelihood”) offinancial, operati<strong>on</strong>al, and compliance risks at the store-operati<strong>on</strong>s and corporatelevels. Risks are scored numerically from a low of “1” to a high of “5” andsupport the judgmental prioritizati<strong>on</strong> of the risks. Once prioritized, the risks arebroken down further into levels — or “risk factors” — that indicate how the risksmight manifest. The table below shows how the organizati<strong>on</strong> groups andprioritizes risks.49. Overall, management recognizes that effective store inventory management iscrucial to the organizati<strong>on</strong>’s operati<strong>on</strong>s and financial reporting objectives. As acase in point, we will follow <strong>on</strong>e of those risk factors, “Inaccurate/improperlyadjusted store inventory balances” (risk factor 2.b. below), through the m<strong>on</strong>itoringprocess.10. This organizati<strong>on</strong> sells primarily furniture, appliances, and electr<strong>on</strong>ics.Inventory items are generally large, which means they are easy to count forinventory purposes, and are more difficult to steal than inventory items at otherretailers, such as clothing stores or department stores. However, if pervasive theftor shrinkage exists across multiple locati<strong>on</strong>s, or if store managers are able to4Some organizati<strong>on</strong>s may choose to c<strong>on</strong>duct their risk prioritizati<strong>on</strong> efforts at the level thisorganizati<strong>on</strong> refers to as “risk factors.” For this organizati<strong>on</strong>, however, prioritizing the risks<strong>on</strong>e level higher, and then focusing <strong>on</strong> the c<strong>on</strong>trols that address the related risk factors,provides an adequate level of support for their internal c<strong>on</strong>trol decisi<strong>on</strong>s, including what andhow they will m<strong>on</strong>itor internal c<strong>on</strong>trol.


32 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008fraudulently misstate inventory balances, such deficiencies could lead to errorsthat, in the aggregate, would be material to the organizati<strong>on</strong> both in terms of itsoperati<strong>on</strong>al goals and the accuracy of its published financial statements.11. Knowledge of these factors, al<strong>on</strong>g with management’s understanding of theorganizati<strong>on</strong> and its business, provides support for the organizati<strong>on</strong>’s inventoryrelatedrisk assessment process. The following table exemplifies the organizati<strong>on</strong>’smore detailed risk assessment process for inventory.RisksRisk Factors(i.e., What Can Go Wr<strong>on</strong>g)ImpactRankingProbabilityRankingPriority1. Inappropriate producttype/quantity mix,inventory levels, orstore purchasing2. Inappropriate/inaccurate/untimelyinventory-levelreporting3. Inappropriate storelevelinventoryreceipta. Revenue loss due to inability tomeet customer demandsb. Carrying excess store inventoryc. Write-offs from stale/obsoleteinventorya. Not identifying damaged/obsoleteinventoryb. Inaccurate/improperly adjustedstore inventory balancesa. Inventory not beingrecognized/recorded in the systemin a timely fashi<strong>on</strong>b. Inadvertent acceptance ofdamaged/obsolete inventoryc. Improper inventory costingd. Hard/soft expense associated withcorrecting delivery errorse. Increased theft/damage risk due tore-deliveries5 3 H5 3 H3 3 M4. Inventory theft a. Direct financial lossb. Overstatement of inventorybalancesc. Understatements ofexpenses/overstatements of netincome3 3 M5. Inaccurate/untimelystore-to-storeinventory transfers6. Inaccurate/unavailable storea. Revenue loss due to inability tomeet customer demandsb. Carrying excess store inventoryc. Inaccurate store inventory balanced. Inability to perform accurate storeinventoriesa. Revenue loss due to inability tomeet customer demands5 3 H5 1 M


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 33RisksRisk Factors(i.e., What Can Go Wr<strong>on</strong>g)ImpactRankingProbabilityRankingPriorityinventory datab. Inaccurate inventory booking andcosting adjustmentsc. Poor informati<strong>on</strong> for purchase pricenegotiati<strong>on</strong>sd. Inability of store managers anddistrict managers to performscheduled inventories accuratelyUnderstanding the <strong>Internal</strong> C<strong>on</strong>trol System and Identifying Key C<strong>on</strong>trols12. Once management has prioritized the risks related to inventory management,the organizati<strong>on</strong> links those risks to c<strong>on</strong>trols that address them. This process setsexpectati<strong>on</strong>s for store operati<strong>on</strong>s management, corporate finance, and internalaudit regarding how the internal c<strong>on</strong>trol system should manage or mitigateidentified risks.13. Management further refines m<strong>on</strong>itoring efforts by identifying which of thec<strong>on</strong>trols are most important to m<strong>on</strong>itor in order to c<strong>on</strong>clude that the internalc<strong>on</strong>trol system is properly managing or mitigating the prioritized risks.14. In regards to “Inaccurate/improperly adjusted store inventory balances” risk,management has implemented a number of c<strong>on</strong>trols:• Periodic inventory — To ensure accurate inventory counts at the storelevel, the following inventory-count procedures are performed: 5- The store manager is required to perform a bar-code inventory (i.e.,electr<strong>on</strong>ically scanning the bar codes of items in inventory) three timesper week <strong>on</strong> M<strong>on</strong>day, Wednesday, and Friday. As it is taken, theinventory is automatically recorded in the centralizedinformati<strong>on</strong> system.- The store manager is also required to perform a m<strong>on</strong>thly serial-numberinventory (i.e., counting inventory by serial number and comparingwith inventory records).- The district manager is required to perform a m<strong>on</strong>thly serialnumberinventory.5These extensive store-inventory c<strong>on</strong>trols are possible because inventory c<strong>on</strong>sists of arelatively small number of large items that are easily counted. The scope of these c<strong>on</strong>trolsmay not be feasible in other types of organizati<strong>on</strong>s, including other retail organizati<strong>on</strong>s.


34 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008- Store managers c<strong>on</strong>duct their inventories using barcode scanners thatautomatically document the results within the centralized informati<strong>on</strong>system. Inventories are also timed within the system so thatmanagement can m<strong>on</strong>itor how l<strong>on</strong>g it takes to c<strong>on</strong>duct specificinventories and react accordingly. Inventories that are performed tooquickly may indicate a rushed and ineffective inventory count;inventories that take too l<strong>on</strong>g may signal a need for training or otheroperati<strong>on</strong>al improvements.• Restricted access to record adjustments — To ensure proper oversight andapproval of adjustments to inventory balances, <strong>on</strong>ly the district manager isable to record inventory adjustments for spoilage, theft, or customercharge-offs.• M<strong>on</strong>thly analytical review — To mitigate risk of inappropriate store-levelinventory management and to assess overall store-level profitability, allinventory adjustments are reviewed during m<strong>on</strong>thly district manager andregi<strong>on</strong>al director profit and loss (P&L) reviews. Trends in the same storeover time are analyzed and compared with those of other stores across awide variety of key performance indicators.• Daily inventory report review — To ensure that store-level inventoryactivity is accurate, the district manager reviews a daily report that showsinventory balances <strong>on</strong> hand, inventory item receipt, open purchase orders,and inventory-count excepti<strong>on</strong>s.• Excepti<strong>on</strong> report review — To ensure that inventory counts are performed<strong>on</strong> a timely basis, the SOG, district manager, and regi<strong>on</strong>al director arenotified if inventory counts have not been completed in the system fortwo weeks.• Supervisory store audits - To ensure that store inventory counts areexecuted properly and that store managers are effectively addressing idleinventory, the district manager performs comprehensive quarterly storeaudits. Relative to inventory risk, these store audits include a review ofcompleted store-manager inventory counts, identificati<strong>on</strong> and executi<strong>on</strong> ofinventory adjustments, and an assessment of idle inventory (i.e., inventoryidle for more than 90 days). The c<strong>on</strong>duct of the quarterly store audits isdocumented in the centralized informati<strong>on</strong> system, and the audit results arereviewed by the SOG and reported to the applicable regi<strong>on</strong>al director.15. Note that no individual store’s inventory could be so wr<strong>on</strong>g that it becomesmaterial to the organizati<strong>on</strong> as a whole, even if it were 100 percent wr<strong>on</strong>g. Apervasive failure of the store-manager inventory c<strong>on</strong>trol, covering multiple districtmanagers, would have to occur before such a risk could become material to the


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 35organizati<strong>on</strong> as a whole. Therefore, by focusing m<strong>on</strong>itoring efforts at the storelevel, and by spreading the risk of c<strong>on</strong>trol failure across numerous districtmanagers, the organizati<strong>on</strong> effectively reduces the potential for inventory c<strong>on</strong>trolfailures to become material to the organizati<strong>on</strong>. These organizati<strong>on</strong>al factors areimportant in c<strong>on</strong>sidering the type and amount of persuasive informati<strong>on</strong> necessaryto support a c<strong>on</strong>clusi<strong>on</strong> that the internal c<strong>on</strong>trol system is effective in relati<strong>on</strong> tothe risk.Identify Persuasive Informati<strong>on</strong> About the Executi<strong>on</strong> of Inventory C<strong>on</strong>trols16. Relative to the identified risk (i.e., inaccurate/improperly adjusted storeinventory balances), the store managers’ tri-weekly and m<strong>on</strong>thly inventory countsare the key c<strong>on</strong>trols designed to ensure the accuracy of inventory balances in thesystem. With the excepti<strong>on</strong> of the c<strong>on</strong>trol restricting access to record adjustments,all other c<strong>on</strong>trols identified by management provide various levels of m<strong>on</strong>itoringto ensure that (1) the store managers’ periodic inventories are performedaccurately, or (2) inventory balances and adjustments appear reas<strong>on</strong>able <strong>on</strong> astore-by-store basis. In this particular organizati<strong>on</strong>, management pers<strong>on</strong>nel at eachlevel of the organizati<strong>on</strong> seek to identify sufficient relevant, reliable, and timelyinformati<strong>on</strong> to indicate whether store inventory c<strong>on</strong>trol is working and inventorybalances are accurate.17. Because of the organizati<strong>on</strong>’s size and tiered management structure, executivemanagement’s m<strong>on</strong>itoring efforts (in this case, the CFO’s m<strong>on</strong>itoring efforts)depend <strong>on</strong> (1) the effectiveness of m<strong>on</strong>itoring at the SVP, regi<strong>on</strong>al-director anddistrict-manager levels, (2) the effectiveness of m<strong>on</strong>itoring performed by the SOG,and (3) executive management’s own <strong>on</strong>going m<strong>on</strong>itoring of store statistics acrossthe organizati<strong>on</strong>.Direct Informati<strong>on</strong>18. Available relevant, reliable, and timely direct informati<strong>on</strong> regarding theoperati<strong>on</strong> of the store managers’ tri-weekly and m<strong>on</strong>thly inventory counts includesthe following comp<strong>on</strong>ents:• System records detailing the date, time, and results of the storemanagers’ inventories,• The district managers’ direct observati<strong>on</strong> of store managers takinginventories, and• The results of the district managers’ own m<strong>on</strong>thly inventories, whichwould identify the failure of any given store manager’s inventory countbefore that failure could c<strong>on</strong>tribute to a material error.


36 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Indirect informati<strong>on</strong>19. Available indirect informati<strong>on</strong> that may indicate a potential failure in thestore-manager inventory c<strong>on</strong>trols includes the following comp<strong>on</strong>ents:• Detailed store-level metrics that show store trends andcomparative metrics including product-level analyses, cost of goodssold, profitability, etc.,• System records detailing the durati<strong>on</strong> of each inventory count, and• Store-level inventory records in the system, including <strong>on</strong>-hand balances,inventory items received by the store, open purchase orders and anyneeded adjustments to inventory balances based <strong>on</strong> inventory counts.Implementati<strong>on</strong> of Inventory C<strong>on</strong>trols M<strong>on</strong>itoring20. The following table highlights how various levels of management m<strong>on</strong>itor theeffectiveness of the store-manager inventory c<strong>on</strong>trols, beginning with the districtmanager and ending with the CFO. Note that all of these m<strong>on</strong>itoring procedures,including the separate evaluati<strong>on</strong>s, are part of the organizati<strong>on</strong>’s normal operatingactivities. The procedures were not developed solely to meet an establishedregulatory requirement.M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeCommentsDistrict Managers1. Review daily store-levelinventory report.Indirect Ongoing This report enables the district managerto gauge quickly whether inventorybalances are reas<strong>on</strong>able now and in thenear future. It also gives the districtmanager an idea of what inventoryshould be <strong>on</strong> hand when he or she visitsthe store.2. C<strong>on</strong>duct m<strong>on</strong>thly storeinventory by serialnumber.Direct Ongoing This procedure serves as both a c<strong>on</strong>trolactivity (identifying errors in the inventorybalances) and a m<strong>on</strong>itoring procedure(re-performing, and thus validating, thestore manager’s inventory c<strong>on</strong>trol).


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 37M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeComments3. C<strong>on</strong>duct m<strong>on</strong>thly storelevelanalytical reviewsbetween the districtmanager and theregi<strong>on</strong>al director.Indirect Ongoing Through this m<strong>on</strong>thly analytical review,the district manager and regi<strong>on</strong>aldirector can identify inventory anomaliesthat warrant further investigati<strong>on</strong>.4. C<strong>on</strong>duct quarterly storeaudits, including anexaminati<strong>on</strong> of storemanagerinventoryrecords.DirectSeparateEvaluati<strong>on</strong>This m<strong>on</strong>itoring procedure provides forperiodic examinati<strong>on</strong> of store operati<strong>on</strong>s,including inventory management, at adetailed level that revalidates theeffective operati<strong>on</strong> of internal c<strong>on</strong>trol.5. Follow up <strong>on</strong> anyinventory excepti<strong>on</strong>sidentified by the SOG.DirectSeparateEvaluati<strong>on</strong>If the SOG identifies a store that eitherhas not taken a required inventory in twoweeks (see the SOG below) or presentsother anomalies identified throughanalysis, the district manager andregi<strong>on</strong>al director are notified so that theycan follow up <strong>on</strong> the excepti<strong>on</strong>.Regi<strong>on</strong>al Directors and Senior Vice Presidents1. Review daily, weekly,and m<strong>on</strong>thly storeoperating reports thathighlight numerousstatistics relevant toinventory levels, cost ofgoods sold, andprofitability.Indirect Ongoing This report enables the district managerto gauge quickly whether inventorybalances are reas<strong>on</strong>able now and will bein the near future. It also gives thedistrict manager an idea of whatinventory should be <strong>on</strong>-hand when he orshe visits the store.2. Discuss store operati<strong>on</strong>s,including inventorymanagement, duringregularly scheduledoperati<strong>on</strong>al meetingsbetween the SVPs andtheir regi<strong>on</strong>al directors,and between the regi<strong>on</strong>aldirectors and their districtmanagers.Indirect Ongoing This discussi<strong>on</strong>, while high-level giventhe number of stores, gives regi<strong>on</strong>aldirectors and SVPs an opportunity toinquire about stores and store managersthat may not be as effective as others.


38 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeComments3. Periodically visit storelocati<strong>on</strong>s.IndirectSeparateEvaluati<strong>on</strong>Regi<strong>on</strong>al directors and SVPs are unableto visit a large number of stores or toc<strong>on</strong>duct or observe the inventoryc<strong>on</strong>trols in acti<strong>on</strong>. N<strong>on</strong>etheless, periodicvisits send an important message to thefield about the importance of internalc<strong>on</strong>trol. They also enable the regi<strong>on</strong>aldirectors and SVPs to see firsthand thequantity and c<strong>on</strong>diti<strong>on</strong> of inventory <strong>on</strong>hand.4. Follow up <strong>on</strong> anyinventory excepti<strong>on</strong>sidentified by the SOG.DirectSeparateEvaluati<strong>on</strong>If the SOG identifies a store that eitherhas not taken a required inventory in twoweeks (see the SOG below) or presentsother anomalies identified throughanalysis, the district manager andregi<strong>on</strong>al director are notified so that theycan follow up <strong>on</strong> the excepti<strong>on</strong>.Store Operati<strong>on</strong>s Group1. Perform detailed storeby-storeanalyticalreviews, examineexcepti<strong>on</strong>s, and reportresults to management.Indirect Ongoing This detailed analysis provides anobjective, educated review of store-levelstatistics that has a high likelihood ofidentifying problem stores before theycan c<strong>on</strong>tribute to a material error.The SOG developed its list of keyindicators based up<strong>on</strong> professi<strong>on</strong>alexperience and with assistance fromdedicated technology pers<strong>on</strong>nel who“mine” corporate databases to gatherand evaluate the applicable data. On am<strong>on</strong>thly basis, this list of key indicatorsand the results of the m<strong>on</strong>itoringperformed by the SOG are reviewed byinternal audit, store operati<strong>on</strong>s executiveleadership at the home office, and theorganizati<strong>on</strong>’s executive committee.2. Review evidence in theinformati<strong>on</strong> system of thecompleti<strong>on</strong> and results ofthe store managers’ tri-Direct Ongoing Store-manager inventories are taken byelectr<strong>on</strong>ically scanning the unique barcode <strong>on</strong> each item in stock. The SOGreceives direct informati<strong>on</strong> from the


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 39M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeCommentsweekly bar-codeinventory.system telling it when the inventory wascompleted, its durati<strong>on</strong>, and its results.The SOG then compares these resultswith those from the other 3,000+ storesin order to spot potential anomalies.3. Perform store-levelaudits of inventory andinventory c<strong>on</strong>trols, ifnecessary.DirectSeparateEvaluati<strong>on</strong><strong>Internal</strong> audit and the SOG have theability to c<strong>on</strong>duct separate evaluati<strong>on</strong>s ofinventory c<strong>on</strong>trols, if necessary.Chief Financial Officer1. Review weekly statisticalreports highlightingstores with potentialinventory or profitabilityissues.Indirect Ongoing The weekly statistical report gives theCFO frequent and detailed informati<strong>on</strong>about the results of operati<strong>on</strong>s. It alsohighlights possible anomalies that he orshe can discuss with other members ofmanagement and operati<strong>on</strong>s.2. Discuss store operati<strong>on</strong>s,including inventorymanagement, duringregularly scheduledoperati<strong>on</strong>al meetings.Indirect Ongoing Like the discussi<strong>on</strong>s between the SVPsand their regi<strong>on</strong>al directors, and thosebetween the regi<strong>on</strong>al directors and theirdistrict managers, the CFO’sparticipati<strong>on</strong> in regular operati<strong>on</strong>almeetings provides him or her with muchindirect informati<strong>on</strong> about theeffectiveness of store managementc<strong>on</strong>trols.3. Review reports frominternal audit and theSOG regarding theresults of their m<strong>on</strong>itoringprocedures.DirectandIndirectSeparateEvaluati<strong>on</strong>In most organizati<strong>on</strong>s, reports frominternal audit c<strong>on</strong>sist primarily of directinformati<strong>on</strong>. In this organizati<strong>on</strong>,however, most of the m<strong>on</strong>itoringperformed by the SOG is indirect. Oneexcepti<strong>on</strong> is informati<strong>on</strong> derived from thestore managers’ tri-weekly bar-codeinventory, which c<strong>on</strong>sists of directinformati<strong>on</strong> about stores that have notc<strong>on</strong>ducted proper tri-weekly inventorycounts.Given the nature of the organizati<strong>on</strong> (i.e.,a large number of homogeneous


40 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeCommentslocati<strong>on</strong>s that are statisticallycomparable), and the m<strong>on</strong>itoring usingdirect informati<strong>on</strong> that takes placeelsewhere in the organizati<strong>on</strong>, the CFO’sm<strong>on</strong>itoring procedures provide him withadequate support to determine whetherthe store-manager inventory c<strong>on</strong>trols areeffective across the organizati<strong>on</strong>.Communicating Results21. <strong>Internal</strong> c<strong>on</strong>trol issues identified by the district managers are normallycorrected through communicati<strong>on</strong> between the district manager and thestore manager.22. If a store manager does not perform an inventory count over a two-weekperiod, the SOG team is alerted to the lapse during a review of its statisticalreports. After receiving this alert, the SOG team notifies the store manager directlyand requests an explanati<strong>on</strong> for failing to perform the inventory. The districtmanager and regi<strong>on</strong>al director resp<strong>on</strong>sible for the store are also notified. Inadditi<strong>on</strong>, the issue is documented <strong>on</strong> a Store Operati<strong>on</strong>s Recap Report, whichserves as a clearinghouse for all excepti<strong>on</strong> items identified by the SOG.23. The Store Operati<strong>on</strong>s Recap Report is sent m<strong>on</strong>thly to the Director of <strong>Internal</strong>Audit and the organizati<strong>on</strong>’s Executive Committee. Items included in the reportare maintained there until the item is c<strong>on</strong>sidered “cleared” by the SOG.24. In <strong>on</strong>e instance, during a review of its statistical reports, the SOG identified astore that had an abnormal level of late deposits and cash drawer shortages. TheSOG also noted abnormalities in several key store metrics that could be signs offictitious customers and inventory manipulati<strong>on</strong>. Those metrics included a lapse inthe store manager’s tri-weekly inventory counts for over 100 items, unusualfluctuati<strong>on</strong>s in the number of new sales c<strong>on</strong>tracts and new customers, a high levelof past-due accounts and abnormal fluctuati<strong>on</strong>s in collecti<strong>on</strong>s and profit margins.25. The district manager resp<strong>on</strong>sible for the store and the organizati<strong>on</strong>’s LossPreventi<strong>on</strong> team (a separate group within corporate operati<strong>on</strong>s resp<strong>on</strong>sible forinvestigating inventory-shrinkage issues) were apprised of the issues in questi<strong>on</strong>.Through a store visit and investigati<strong>on</strong>, the district manager and the LossPreventi<strong>on</strong> team discovered that the store manager was stealing cash from the cashdrawer and covering the shortage by recording sales <strong>on</strong> credit to fictitiouscustomers, thereby removing the item from the store’s inventory records. The


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 41store manager would then sell the off-the-book inventory item for cash, which wasused to cover (1) the cash-drawer shortage, and (2) the balances due from thefictitious customer. The store manager would keep any remaining cash.26. The fraud was discovered because the SOG evaluated persuasive informati<strong>on</strong>that a key c<strong>on</strong>trol focused <strong>on</strong> inventory counts was not operating effectively, aswell as other indirect informati<strong>on</strong> that identified unusual activity. Additi<strong>on</strong>ally, theSOG was competent and objective, which enabled it to understand theimplicati<strong>on</strong>s of the failure of this c<strong>on</strong>trol. By communicating/reporting this c<strong>on</strong>trolfailure to the appropriate parties through proper channels, the SOG was able toperform further investigative procedures and identify and correct the source of theproblem.27. This type of fraud, which occurs often in large retail organizati<strong>on</strong>s, wouldlikely have been discovered at some point either through increased receivablewrite-offs or through c<strong>on</strong>trols related to extending credit. However, because of therobust m<strong>on</strong>itoring procedures in place, the organizati<strong>on</strong> was able to identify thefraud quickly, take appropriate corrective acti<strong>on</strong>, and reduce the potential loss in atimely manner.


42 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Supplemental Details Regarding the Above ExampleThe following provides some of the specific details of reports that the organizati<strong>on</strong> used in m<strong>on</strong>itoring.This is intended as a supplement to the discussi<strong>on</strong> above for those who would like to understand theprocess in greater detail.Using the following report, the SOG noted an unusually high level of late deposits and cashdrawer shortages.Store# ItemTran Dollar Debit TranRec<strong>on</strong>Date AccountDaysLate1749 4/6/2007 801.00 D CD 4/23/2007 7751764167 01749 4/6/2007 43.58 C SHRT 4/23/2007 7751764167 01749 4/9/2007 757.42 C 175 4/23/2007 7751764167 01749 4/14/2007 45.25 D OVER 4/23/2007 7751764167 21749 4/14/2007 2,638.58 D CD 4/23/2007 7751764167 21749 4/18/2007 45.00 D 695 5/1/2007 7751764167 01749 4/18/2007 45.00 C SHRT 5/1/2007 7751764167 01749 4/18/2007 2,638.58 C 175 4/23/2007 7751764167 21749 4/29/2007 796.07 C SHRT 7/20/2007 7751764167 11749 4/29/2007 1,740.00 D CD 7/20/2007 7751764167 11749 5/1/2007 943.93 C 175 7/20/2007 7751764167 11749 5/4/2007 582.10 D CD 7/20/2007 7751777167 01749 5/5/2007 363.90 D OVER 7/20/2007 7751764167 01749 5/5/2007 1,122.33 D CD 7/20/2007 7771764167 01749 5/7/2007 512.71 C 175 7/20/2007 7771764167 01749 5/7/2007 364.00 C 175 7/20/2007 7751764167 01749 5/7/2007 1,191.62 C 175 7/20/2007 7751764167 01749 5/16/2007 329.86 C 6280 5/17/2007 0080262008 01749 5/16/2007 329.86 D 455 5/17/2007 0080262008 01749 5/21/2007 485.42 D BC 7/20/2007 0080262008 01749 5/21/2007 786.95 C SHRT 7/20/2007 7751777167 01749 5/21/2007 3,930.93 D CD 7/20/2007 7751764167 01749 5/22/2007 421.43 D BC 7/20/2007 0080262008 01749 5/22/2007 80.00 C SHRT 7/20/2007 0080262008 01749 5/22/2007 740.70 D BC 7/20/2007 0080262008 01749 5/24/2007 1,567.55 C 142 7/20/2007 0080262008 01749 5/25/2007 3,143.98 C 175 7/20/2007 7751764167 01749 6/5/2007 924.05 C CD 7/6/2007 7751764167 41749 6/6/2007 1,133.05 D D 7/6/2007 7751764167 41749 6/6/2007 79.63 D D 7/6/2007 7751764167 41749 6/8/2007 148.03 D SHRT 7/6/2007 7751764167 41749 6/8/2007 643.75 C CD 7/6/2007 7751764167 41749 6/11/2007 341.59 D 175 7/6/2007 7751764167 41749 6/11/2007 487.05 C 175 7/6/2007 7751764167 41749 6/11/2007 1,153.06 C 175 7/6/2007 7751764167 41749 6/11/2007 650.75 C 175 7/6/2007 7751764167 4


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 43Supplemental Details Regarding the Above ExampleThe SOG noted that there was a pattern of both late deposits and cash drawer shortages that couldindicate internal c<strong>on</strong>trol problems related to cash, but not necessarily related to inventory. Theseanomalies in the cash area warranted additi<strong>on</strong>al investigati<strong>on</strong>, and in fact, the SOG professi<strong>on</strong>alresp<strong>on</strong>sible for reviewing the above report initiated inquiries into the cause of the late deposits andcash shortages.So<strong>on</strong> after the above cash related items were identified, the SOG noted, from the Weekly Bar CodeInventory Excepti<strong>on</strong> Report, that more than 100 items had not been inventoried. The SOG also noticedunusual fluctuati<strong>on</strong>s in certain key performance indicators. The table below shows five of thoseindicators out of a report that covers 35 different metrics. The shaded numbers represent anomaliesthat warranted further evaluati<strong>on</strong>.Metric Avg Mar Apr May Jun Jul Aug Sept Oct Nov Dec Jan Feb MarAgreementsgained6.92 -11 46 36 13 49 1 -32 11 -16 27 21 3 -58More than 10 agreements gained is a red flag if not supported by a company promoti<strong>on</strong>. Large fluctuati<strong>on</strong>sbetween m<strong>on</strong>ths are also red flags.Customersgained12.46 6 31 25 6 42 11 -4 22 3 17 21 12 -30Significant increases in a m<strong>on</strong>th can be an indicator of fictitious customers. Repeated decreases can be a sign ofcustomer service problems.Averagepast-dues11.97 13.47 11.62 13.77 12.88 12.99 9.32 9.67 9.49 11.12 12.2 14.67 12.55 11.92Average past-dues greater than 6% can be an indicati<strong>on</strong> of fictitious accounts or poor credit extensi<strong>on</strong> procedures.Percent ofincomecolletedeach m<strong>on</strong>th92.14 96.30 86.50 87.20 92.00 95.00 90.50 95.10 99.10 93.10 85.50 89.80 92.60 95.10Large fluctuati<strong>on</strong>s between m<strong>on</strong>ths are a red flag.M<strong>on</strong>thlyprofitpercent5.92 -0.60 7.50 19.00 -4.00 17.00 -1.50 -0.40 17.20 11.50 -13.10 12.60 10.30 1.50Large fluctuati<strong>on</strong>s between m<strong>on</strong>ths are a red flag.Supplemental Details Regarding the Above ExampleThe cumulative effect of the above analyses lead to a separate evaluati<strong>on</strong> of the c<strong>on</strong>trols over cash andinventory at this particular store, which uncovered the fraud in a timeframe that allowed the organizati<strong>on</strong>to address the problem before it could become material.In analyzing the effectiveness of the m<strong>on</strong>itoring, this example illustrates that the company started with abaseline of effective internal c<strong>on</strong>trol. Over time they developed detailed analysis using both direct andindirect informati<strong>on</strong> that could identify potential problem areas in a timely manner. Moreover, there wasa culture of “follow-up” in the organizati<strong>on</strong> that led to the timely investigati<strong>on</strong> of potential problems.


44 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Observati<strong>on</strong>s28. A brief example such as this cannot c<strong>on</strong>vey fully the organizati<strong>on</strong>al c<strong>on</strong>text inwhich these internal c<strong>on</strong>trols, including m<strong>on</strong>itoring, were developed. Thepers<strong>on</strong>nel involved in assessing risk, designing c<strong>on</strong>trols and related m<strong>on</strong>itoringprocedures, and overseeing the internal c<strong>on</strong>trol system have extensive experiencein this organizati<strong>on</strong> and in this industry. Accordingly, they have developed andimplemented m<strong>on</strong>itoring procedures that provide informati<strong>on</strong> they believe to besuitable and sufficient regarding the effectiveness of the underlying c<strong>on</strong>trols. Theyc<strong>on</strong>tinue to refine those procedures as risks and c<strong>on</strong>trols change.29. Nevertheless, the project team has observed possible modificati<strong>on</strong>s to them<strong>on</strong>itoring procedures described in this example that may be helpful to otherorganizati<strong>on</strong>s as they c<strong>on</strong>sider the possible applicati<strong>on</strong>s to their own, uniquecircumstances. The key for each organizati<strong>on</strong> is to implement internal c<strong>on</strong>trol,including m<strong>on</strong>itoring, that adequately manages or mitigates meaningful risks toorganizati<strong>on</strong>al objectives in a cost-effective manner.30. First, some of the m<strong>on</strong>itoring performed by the district managers (e.g., takinga m<strong>on</strong>thly store inventory at 6–8 stores) may seem excessive to someorganizati<strong>on</strong>s. Because the store managers’ tri-weekly inventory is recordedelectr<strong>on</strong>ically through a bar-code scanner, the district manager may be able toreview a system report documenting the results of the store managers’ inventory,then c<strong>on</strong>duct a separate inventory <strong>on</strong> a less frequent basis.31. Sec<strong>on</strong>d, above the district-manager level, little direct informati<strong>on</strong> is used inm<strong>on</strong>itoring. Because this organizati<strong>on</strong> has a large number of statisticallycomparable stores, it is better able than many other organizati<strong>on</strong>s to use indirectinformati<strong>on</strong> to identify possible c<strong>on</strong>trol problems. Over time, though, that indirectinformati<strong>on</strong> can become clouded by other factors. In some cases, pervasiveinternal c<strong>on</strong>trol problems can gradually influence the indirect informati<strong>on</strong> so thateven material errors appear normal. However, the persuasiveness of theinformati<strong>on</strong> used in m<strong>on</strong>itoring may be improved in a cost effective manner.32. In this organizati<strong>on</strong>, if the district managers c<strong>on</strong>duct their m<strong>on</strong>itoringprocedures correctly, there would be virtually no opportunity for pervasive c<strong>on</strong>trolproblems to develop at the store level that could be material to the organizati<strong>on</strong>’sobjectives. Accordingly, management above the district manager level, includingexecutive management, might benefit from periodic objective m<strong>on</strong>itoring —possibly through internal audit — of the district managers’ m<strong>on</strong>itoring procedures.33. Objective m<strong>on</strong>itoring might examine <strong>on</strong>ly a group of district managers eachyear, or select them randomly, but it would provide management with directinformati<strong>on</strong> supporting a belief that the district managers are performing their


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 45duties effectively. It could also serve as additi<strong>on</strong>al encouragement for the districtmanagers to execute their c<strong>on</strong>trol resp<strong>on</strong>sibilities properly.Summary and C<strong>on</strong>clusi<strong>on</strong>34. This retail organizati<strong>on</strong> improved both the effectiveness and efficiency of itsinternal c<strong>on</strong>trol system by taking steps that are c<strong>on</strong>sistent with the guidanceoutlined in Volume II. In resp<strong>on</strong>ding to certain identified c<strong>on</strong>trol failures andrecognizing that existing m<strong>on</strong>itoring procedures were not achieving theirobjectives, management first performed a comprehensive review of c<strong>on</strong>trol overstore operati<strong>on</strong>s. It then:• Identified and prioritized risks to its operati<strong>on</strong>s and to its financialreporting and compliance objectives,• Improved the internal c<strong>on</strong>trols where necessary and identified key c<strong>on</strong>trolsto m<strong>on</strong>itor at various levels,• Identified persuasive informati<strong>on</strong> (both direct and indirect) that wouldprovide support for a c<strong>on</strong>clusi<strong>on</strong> regarding the effectiveness of the internalc<strong>on</strong>trol system, and• Developed m<strong>on</strong>itoring procedures throughout all levels of management toevaluate the informati<strong>on</strong> through a mix of <strong>on</strong>going m<strong>on</strong>itoring andperiodic separate evaluati<strong>on</strong>s — all with an emphasis <strong>on</strong> <strong>on</strong>goingm<strong>on</strong>itoring procedures.35. Other organizati<strong>on</strong>s — even organizati<strong>on</strong>s similar to the <strong>on</strong>e in thisexample — may follow similar general principles, yet implement differentc<strong>on</strong>trols and different m<strong>on</strong>itoring procedures. The guidance c<strong>on</strong>tained in VolumeII is not intended to lead every organizati<strong>on</strong> to the same c<strong>on</strong>clusi<strong>on</strong>s regardingwhat risks are meaningful, how the risks should be c<strong>on</strong>trolled, or how internalc<strong>on</strong>trol should be m<strong>on</strong>itored. However, it does provide an outline any organizati<strong>on</strong>can use to develop m<strong>on</strong>itoring procedures that will support the organizati<strong>on</strong>’sc<strong>on</strong>clusi<strong>on</strong>s about the effectiveness of internal c<strong>on</strong>trol.


46 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008M<strong>on</strong>itoring of C<strong>on</strong>trols over Certain Operati<strong>on</strong>al Risks in a Mid-SizedManufacturing Organizati<strong>on</strong>Background Informati<strong>on</strong>1. A mid-sized manufacturing organizati<strong>on</strong> produces complex equipment andengine comp<strong>on</strong>ents. These comp<strong>on</strong>ents typically operate for extended periods (upto 40 years) and have very low tolerance thresholds for failure. In fact, the failureof some comp<strong>on</strong>ents can have life-threatening c<strong>on</strong>sequences.2. As part of global sourcing, many of the organizati<strong>on</strong>’s customers requireproduct delivery <strong>on</strong> a just-in-time basis. The organizati<strong>on</strong>’s strategy is toprofitably serve the original-equipment-manufacturer (OEM) and after-marketdemands for these products. As a result, the organizati<strong>on</strong> must carry, or be able toproduce, inventory to address the need for a product that may be 40 years old.3. At <strong>on</strong>e point the organizati<strong>on</strong>’s board of directors expressed c<strong>on</strong>cern aboutinventory growing faster than revenue — a disturbing trend given thattechnological advancements could render existing comp<strong>on</strong>ent inventory partsobsolete. The board and management agreed that a focus <strong>on</strong> producti<strong>on</strong> methodsand inventory management was an important strategic goal. They recognized,however, that such a focus should not be achieved at the expense ofproduct quality.Organizati<strong>on</strong>al Structure and Goal-Setting4. The organizati<strong>on</strong> is structured around three product business groups. Each ofthe three product business groups is managed by a Business Group Vice Presidentwho reports directly to the Chief Executive Officer (CEO).5. Product business groups are supported by centralized corporate finance,human resources, internal audit, and other standard back-office functi<strong>on</strong>s and havea dotted-line relati<strong>on</strong>ship with a product business group c<strong>on</strong>troller who is amember of the corporate finance team.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 476. Each Business Group Vice President is resp<strong>on</strong>sible for all aspects of theproduct business group within the overall corporate strategy, including:• Marketing, development, and growth of the potential customer base for theproduct line,• Oversight of the research and development of requested comp<strong>on</strong>entsfor customers,• Product-line supply chain and supply chain relati<strong>on</strong>ship management,• Product manufacturing process,• Delivery of manufactured comp<strong>on</strong>ents to customers, and• Inventory management that supplies high-quality products to customerswhen needed, yet minimizes <strong>on</strong>-hand quantities in order to reduceoverhead and risk of obsolescence.7. Comp<strong>on</strong>ents are manufactured to the product-design specificati<strong>on</strong>s andquality standards provided by customers, as well as to internal quality standardsdefined through the organizati<strong>on</strong>’s strategic planning process.8. Each product business group comprises a team of design engineers andprocess engineers led by an engineering team leader. Each team oversees thedesign and executi<strong>on</strong> of its manufacturing processes.


48 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 20089. Executive management develops l<strong>on</strong>g-term strategic focus goals which areupdated every year. These strategic focus goals have been defined by theorganizati<strong>on</strong> as:• Focused growth,• Financial excellence,• Commercial and technology excellence,• Process excellence, and• Outstanding employees.10. The executive team further develops annual goals and objectives that arelinked to the strategic plan. Compensati<strong>on</strong> is based, in part, <strong>on</strong> the achievement ofthe specific plans for the business unit. For example, the “commercial andtechnology excellence” and “process excellence” strategic focus goals includeobjectives for comp<strong>on</strong>ent product-manufacturing quality, which will be a focalpoint for this example.11. Business Group Vice Presidents compare m<strong>on</strong>thly, quarterly, and annualresults with the annual strategic goals and report the results to the CEO, CFO, andboard. These reports include analysis related to quality, delivery, rework, cost, andoverall financial performance.12. Each product business group employs a quality assurance team that reportsdirectly to the Business Group Vice President. The quality assurance teams areresp<strong>on</strong>sible for providing quality m<strong>on</strong>itoring and manufacturing compliance.Business group quality assurance teams often comprise former manufacturingprocess team leaders, process engineers, and quality assurance professi<strong>on</strong>als withindependent quality assurance certificati<strong>on</strong>s.Understanding and Prioritizing Risk13. Through the goal-setting process, executive management identifies the risksto achieving the organizati<strong>on</strong>’s goals and objectives, prioritizing them based <strong>on</strong>their likelihood and significance.14. The organizati<strong>on</strong> has identified a high risk related to the potential failure tomanufacture comp<strong>on</strong>ents that meet pre-defined quality standards and thecustomers’ cost requirements. This risk has become more pr<strong>on</strong>ounced as theorganizati<strong>on</strong> seeks to improve producti<strong>on</strong> efficiency, reduce finished-goodsinventory levels, and c<strong>on</strong>tinue to meet customer delivery expectati<strong>on</strong>s. Thus, theorganizati<strong>on</strong> seeks to integrate quality c<strong>on</strong>siderati<strong>on</strong>s into all aspects of theproduct life cycle — from product design, to manufacturing, to delivery.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 4915. <strong>Internal</strong> product-quality expectati<strong>on</strong>s are set forth by the CEO and executivemanagement as part of their commercial and technology excellence and processexcellence strategic focus goals. To enhance product quality and efficiency, theorganizati<strong>on</strong> has implemented a number of lean-manufacturing and qualitystandards, including the recent adopti<strong>on</strong> of Six Sigma, which Business Group VicePresidents are required to follow as part of their l<strong>on</strong>g-term strategic objectives. SixSigma — originally developed by Motorola, Inc. — is a set of practices designedto improve processes by eliminating defects. The methodology typically includesthe following five steps: define, measure, analyze, improve, and c<strong>on</strong>trol.16. During the annual strategic planning process, Business Group Vice Presidentsand the leadership teams reporting to them identify and prioritize manufacturingprocess quality risks. The activity is subjective (i.e., not driven by a quantitativeanalysis of risk significance and likelihood) and draws <strong>on</strong> the extensive experienceof the people involved. The table below dem<strong>on</strong>strates the risk assessment thoughtprocess and related results.Product Life CycleQuality Risks Risk Cause Risk Priority1. Improper design ofcustomer-requestedcomp<strong>on</strong>ents andrelated manufacturingprocesses2. Improper manufactureof comp<strong>on</strong>ents withinquality tolerancesa. Inadequate specificati<strong>on</strong>s received fromcustomerb. Failure (through lack of skills or proper designanalysisprocedures) to address appropriatelythe risk that the comp<strong>on</strong>ent will failc. Failure (through lack of skills or proper designanalysisprocedures) to address appropriatelythe risk that the comp<strong>on</strong>ent will cause a systemfailure or not operate as intended in the systemin which it is installedd. Failure to follow established manufacturingdesign procedures related to:• raw material selecti<strong>on</strong>• producti<strong>on</strong> methods• testing routinesa. Failure to establish proper quality-tolerancemetricsb. Failure to follow up when tolerances areexceededMHHHHMc. Inadequate skills of manufacturing pers<strong>on</strong>nel Md. Inadequate oversight of manufacturing process(other than risk 2.b. above)M


50 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Product Life CycleQuality Risks Risk Cause Risk Priority3. Untimely delivery ofcomp<strong>on</strong>ents tocustomera. Failure to establish reas<strong>on</strong>able deliverydeadlines with customerb. Failure to recognize delays in a timely mannerfor possible correcti<strong>on</strong> or discussi<strong>on</strong> withcustomerMM17. This example will expound further <strong>on</strong> internal c<strong>on</strong>trol and related m<strong>on</strong>itoringregarding Risk #1 above, improper design of comp<strong>on</strong>ents and relatedmanufacturing processes. For simplicity we will refer to this risk as“Design Risk.”Understanding the <strong>Internal</strong> C<strong>on</strong>trol System and Identifying Key C<strong>on</strong>trols18. Management has implemented the c<strong>on</strong>trols in the following table to addressDesign Risk. C<strong>on</strong>trols with the “” symbol are designated as key c<strong>on</strong>trols. Notethat the organizati<strong>on</strong> does not formally designate c<strong>on</strong>trols as “key” or “not key.”These c<strong>on</strong>trols are designated as key in this example because management hasdetermined that, by m<strong>on</strong>itoring them, it can reas<strong>on</strong>ably c<strong>on</strong>clude whether theinternal c<strong>on</strong>trol system is operating as intended with respect to the identified risk.Note also that the designati<strong>on</strong> as “key” is not necessarily an indicati<strong>on</strong> of thec<strong>on</strong>trol’s overall importance to the internal c<strong>on</strong>trol system. Rather, it is anindicati<strong>on</strong> of the relative c<strong>on</strong>tributi<strong>on</strong> that m<strong>on</strong>itoring the c<strong>on</strong>trol will provide to ac<strong>on</strong>clusi<strong>on</strong> about the effectiveness of the internal c<strong>on</strong>trol system in addressing therelated risk. All of the c<strong>on</strong>trols below are important, but the effectiveness of somecan be determined through the m<strong>on</strong>itoring of others.C<strong>on</strong>trol Descripti<strong>on</strong> Comments1. Proper skillsand oversight2. StandarddevelopmenttemplatesAn experienced project manager fromthe business group engineering teamoversees the executi<strong>on</strong> of thecomp<strong>on</strong>ent-manufacturing process andleads a manufacturing project teamcomposed of system, design, andmanufacturing-process engineers and arepresentative from the business groupquality assurance team.The project manager uses standardizedtemplates and develops proposed timeand resource budgets to track projectresults against expected outcomes. Heor she also coordinates project budgetsand costing with the organizati<strong>on</strong>’scorporate finance team.Management’s directinteracti<strong>on</strong> with project teammembers and theirm<strong>on</strong>itoring of the keyc<strong>on</strong>trols identified belowprovide the necessarysupport for a c<strong>on</strong>clusi<strong>on</strong>about the level of skillspresent and the adequacyof manufacturing oversight.Management’s m<strong>on</strong>itoringof the key c<strong>on</strong>trols belowwill identify the failure to usestandard developmenttemplates before suchfailure would be likely tocause a material error.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 51C<strong>on</strong>trol Descripti<strong>on</strong> Comments3. Standardc<strong>on</strong>tractlanguage4. Comp<strong>on</strong>entDesign RiskAnalysis5. System RiskAnalysis6. Review andapproval ofcomp<strong>on</strong>entdesign7. Preparati<strong>on</strong> ofManufacturingProcess FlowThe standard customer c<strong>on</strong>tract c<strong>on</strong>tainsspecific language that highlights therequirement for the customer to submitcomplete and accurate comp<strong>on</strong>entspecificati<strong>on</strong>s. The standard c<strong>on</strong>tractlanguage serves as a communicati<strong>on</strong>mechanism to ensure that the customerunderstands its resp<strong>on</strong>sibilities.To address the risk that a designedcomp<strong>on</strong>ent will not functi<strong>on</strong> properly, themanufacturing project team completes aComp<strong>on</strong>ent Design Risk Analysis,identifying and ranking the cause andeffect of potential comp<strong>on</strong>ent failures.To ensure proper operati<strong>on</strong> of thecomp<strong>on</strong>ent within the system for which itis intended, members of themanufacturing project team perform aSystem Risk Analysis that identifies andranks the cause and effect of potentialsystem failures after the comp<strong>on</strong>ent isinstalled.Before designing the comp<strong>on</strong>entmanufacturingprocess, themanufacturing project team reviews andapproves both the Comp<strong>on</strong>ent DesignRisk Analysis and the System RiskAnalysis.The manufacturing project teamcompletes a Manufacturing ProcessFlow to establish the most effective andefficient manufacturing process and toassist in completing the ManufacturingProcess Risk Analysis.Standard c<strong>on</strong>tract languageis an important c<strong>on</strong>trol, butm<strong>on</strong>itoring key c<strong>on</strong>trol #12below (the customer’sapproval) is a betterindicator of the customer’sunderstanding andacceptance of itsresp<strong>on</strong>sibility.These two c<strong>on</strong>trols areidentified as key because(1) their failure would raisethe organizati<strong>on</strong>’s riskregarding the design of acomp<strong>on</strong>ent to unacceptablelevels, and (2) m<strong>on</strong>itoringtheir effective operati<strong>on</strong>helps support a c<strong>on</strong>clusi<strong>on</strong>about the effectiveness ofearlier c<strong>on</strong>trols.This self-review procedureis an important c<strong>on</strong>trol, but(1) it is not c<strong>on</strong>ducted bysome<strong>on</strong>e objective enoughto provide persuasivesupport to managementlevels above the projectteam, and (2) its failurewould most likely bedetected (before it couldallow a material error) bym<strong>on</strong>itoring key c<strong>on</strong>trols #4and 5 above. As a result, itis not identified as a keyc<strong>on</strong>trol for m<strong>on</strong>itoringpurposes.A failure of this importantc<strong>on</strong>trol would be detected<strong>on</strong> a timely basis throughm<strong>on</strong>itoring of key c<strong>on</strong>trols#8, 9, 10 and 12 below.Thus, it is not identified as akey c<strong>on</strong>trol for m<strong>on</strong>itoringpurposes.


52 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008C<strong>on</strong>trol Descripti<strong>on</strong> Comments8. ManufacturingProcess RiskAnalysis9. ManufacturingProcess C<strong>on</strong>trolPlan10. Manufacturingtesting process11. Review andapproval ofmanufacturingdesign12. CustomerapprovalThe manufacturing project teamcompletes a standard ManufacturingProcess Risk Analysis that identifies andprioritizes potential failures of themanufacturing process.A Manufacturing Process C<strong>on</strong>trol Plan(including key sampling metrics,expected manufacturing results, andapproved resp<strong>on</strong>ses to identified resultsthat are outside process expectati<strong>on</strong>s) iscompleted to ensure that designspecificati<strong>on</strong>s are met during producti<strong>on</strong>.Prototypes are manufactured and testedduring the development of theManufacturing Process Risk Analysisand the Manufacturing Process C<strong>on</strong>trolPlan. The manufacturing project team isadvised of deviati<strong>on</strong>s from expectedresults outlined in the Comp<strong>on</strong>entDesign Risk Analysis and System RiskAnalysis and updates those analysesappropriately.The manufacturing project team reviewsand approves the ManufacturingProcess Flow, Manufacturing ProcessRisk Analysis, and ManufacturingProcess C<strong>on</strong>trol Plan before designcommences of the comp<strong>on</strong>entmanufacturing process.Before the organizati<strong>on</strong> initiatesproducti<strong>on</strong> of the comp<strong>on</strong>ent, formalcustomer approval is required of thefollowing documentati<strong>on</strong>:- Comp<strong>on</strong>ent Design RiskAnalysis,- System Risk Analysis,- Manufacturing Process RiskAnalysis, and- Manufacturing Process C<strong>on</strong>trolPlan.Similar to key c<strong>on</strong>trols #4and 5 above, these threec<strong>on</strong>trols are identified askey because (1) their failurewould raise theorganizati<strong>on</strong>’s risk regardingthe manufacture of acomp<strong>on</strong>ent to unacceptablelevels, and (2) m<strong>on</strong>itoringtheir effective operati<strong>on</strong>helps support a c<strong>on</strong>clusi<strong>on</strong>about the effectiveness ofearlier c<strong>on</strong>trols.C<strong>on</strong>sistent with c<strong>on</strong>trol #6,this self-review procedure isan important c<strong>on</strong>trol at themanufacturing project teamlevel, but it is not objectiveenough to be c<strong>on</strong>sidered akey c<strong>on</strong>trol at higher levelsin the organizati<strong>on</strong>.This c<strong>on</strong>trol is designatedas key because itcompletes thecommunicati<strong>on</strong> cycle withthe customer and providesindependent verificati<strong>on</strong> thatthe customer is satisfiedwith the comp<strong>on</strong>ent designand manufacturing plan.The failure of this c<strong>on</strong>trolcould increase theorganizati<strong>on</strong>’s risk tounacceptable levels, yet notbe detected in a timelymanner by other c<strong>on</strong>trols.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 53Identify Persuasive Informati<strong>on</strong> about the Executi<strong>on</strong> of ManufacturingProcess Quality C<strong>on</strong>trols19. Because product quality is so important to the organizati<strong>on</strong>, management hasdeveloped robust <strong>on</strong>going m<strong>on</strong>itoring of quality indicators including:• The results of the Six Sigma process menti<strong>on</strong>ed above,• M<strong>on</strong>thly comparis<strong>on</strong> of quality metrics (described below) acrossproduct lines,• M<strong>on</strong>thly operating calls, facilitated by the CFO, including Business GroupVice Presidents, and business group c<strong>on</strong>trollers to discuss operating resultsand quality issues, and• Routine reporting to manufacturing plant leadership, business unitleadership, executive management, and the board of directors of defect andwarranty levels.20. The informati<strong>on</strong> used in these <strong>on</strong>going m<strong>on</strong>itoring procedures is indirect.Available indirect informati<strong>on</strong> that may indicate a manufacturing-process qualityfailure includes:• Number of prototype failures;• Qualitative prototype failures compared to expectati<strong>on</strong>s outlined in theComp<strong>on</strong>ent Design Risk Analysis or Manufacturing Process C<strong>on</strong>trol Plan(e.g., failures of a type not anticipated in the design phase may indicateimproper analysis of the risk of failure);• Prototype-development scrap levels;• Extent of revisi<strong>on</strong> informati<strong>on</strong> noted <strong>on</strong> the Comp<strong>on</strong>ent Design RiskAnalysis and System Risk Analysis;• Project time budgets and costs;• Project status updates from the project manager to the engineering teamleader and from the engineering team leader to the Business Group VicePresident; and• Producti<strong>on</strong> statistics regarding scrap, rework, and warranty levels.21. The frequency and level of detail of this indirect informati<strong>on</strong> are such that theorganizati<strong>on</strong> can quickly identify quality problems — however, nearly all of it isproduced either late in the comp<strong>on</strong>ent manufacturing development process or afterproducti<strong>on</strong> has already started. Further, some of the informati<strong>on</strong>, such as levels ofprototype failures, could lead to inaccurate c<strong>on</strong>clusi<strong>on</strong>s about c<strong>on</strong>troleffectiveness. For example, low levels of prototype failures may indicate that boththe comp<strong>on</strong>ent and the related manufacturing processes have been designed well,


54 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008but such low levels could also result from ineffective prototype-testingprocedures. Accordingly, the organizati<strong>on</strong> also performs direct m<strong>on</strong>itoring ofcertain c<strong>on</strong>trols in order to gather more timely and reliable informati<strong>on</strong> about theoperati<strong>on</strong> of underlying c<strong>on</strong>trols. The organizati<strong>on</strong> has access to the followingdirect informati<strong>on</strong> regarding the operati<strong>on</strong> of c<strong>on</strong>trols that address Design Risk:• Customer’s acknowledgement that it provided to the organizati<strong>on</strong>complete and accurate comp<strong>on</strong>ent requirements and informati<strong>on</strong>(specificati<strong>on</strong>s, tolerances, systems in which comp<strong>on</strong>ent will beused, etc.);• Manufacturing project team’s documented acceptance or rejecti<strong>on</strong> of theComp<strong>on</strong>ent Design Risk Analysis and the System Risk Analysis;• Manufacturing project team’s acceptance or rejecti<strong>on</strong> of the proposedManufacturing Process Flow, Risk Analysis, and Manufacturing ProcessC<strong>on</strong>trol Plan;• Informati<strong>on</strong> obtained during development of the manufacturing projectteam’s proposed manufacturing process per the Manufacturing ProcessC<strong>on</strong>trol Plan; and• Customer’s acceptance or rejecti<strong>on</strong> of the Comp<strong>on</strong>ent Design RiskAnalysis, System Risk Analysis, Manufacturing Process Risk Analysis; andManufacturing Process C<strong>on</strong>trol Plan.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 55Implementati<strong>on</strong> of Comp<strong>on</strong>ent-Manufacturing Project Quality M<strong>on</strong>itoring22. The following table highlights how the various levels of management — fromthe Comp<strong>on</strong>ent Manufacturing Project Manager, to the Business Group VicePresident, to the CEO — m<strong>on</strong>itor the effectiveness of an individual comp<strong>on</strong>entmanufacturingprocess:M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeCommentsComp<strong>on</strong>ent-Manufacturing Project Manager1. Day-to-day interacti<strong>on</strong> with andoversight of the comp<strong>on</strong>entdesign and manufacturing designprocesses.2. Completi<strong>on</strong> of the self-reviewprocedures described in c<strong>on</strong>trols#6 and 11 above.DirectDirectOngoingOngoingThe Project Manager’s directinvolvement in overseeingevery aspect of themanufacturing process and thecompleti<strong>on</strong> of the self-reviewprocedures gives him or herrelevant, reliable, and timelyinformati<strong>on</strong> about whetherinternal c<strong>on</strong>trol over DesignRisk is operating effectively.This direct interacti<strong>on</strong> canrelate to all of the c<strong>on</strong>trolsidentified above, but isespecially important withrespect to the identified keyc<strong>on</strong>trols.However, the ProjectManager’s extensiveinvolvement can also impairobjectivity, which affects theability of others above theproject manager level to rely <strong>on</strong>m<strong>on</strong>itoring at this level.


56 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008M<strong>on</strong>itoring ProcedureInformati<strong>on</strong>TypeM<strong>on</strong>itoringTypeCommentsBusiness Group Vice President1. Direct reports from the qualityassurance teams. The qualityassurance teams review directinformati<strong>on</strong> supporting theeffective completi<strong>on</strong> of each ofthe key c<strong>on</strong>trols identified above,including the:• Comp<strong>on</strong>ent Design RiskAnalysis (C<strong>on</strong>trol #4)• System Risk Analysis(C<strong>on</strong>trol #5)• Manufacturing Process RiskAnalysis (C<strong>on</strong>trol #8)• Manufacturing Process C<strong>on</strong>trolPlan (C<strong>on</strong>trol #9)• Manufacturing testing process(C<strong>on</strong>trol #10)• Customer approval(C<strong>on</strong>trol #12)2. Daily, weekly, m<strong>on</strong>thly, andquarterly review of the indirectinformati<strong>on</strong> described earlier.Direct Ongoing These quality assurance teamsformally report to the BusinessGroup Vice Presidents. Whilethey work closely with themanufacturing project teams,they are objective with respectto the comp<strong>on</strong>ent andmanufacturing designprocesses. Their primaryresp<strong>on</strong>sibility is to ensure thatproper quality procedures arefollowed.Their close proximity to theoperati<strong>on</strong> of the c<strong>on</strong>trols,coupled with their objectivity,allows the quality assuranceteams to be a primarym<strong>on</strong>itoring mechanism formanagement.Indirect Ongoing As noted earlier, the level ofdetail provided by this indirectinformati<strong>on</strong> enables theorganizati<strong>on</strong> to identify andreact quickly to manufacturingquality issues if they arise.Such reacti<strong>on</strong>s would typicallyinclude correcting the design ormanufacturing problem andinitiating a separate evaluati<strong>on</strong>of the c<strong>on</strong>trols to identify andcorrect the problem’s rootcause.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 57M<strong>on</strong>itoring ProcedureCEO and Executive Management Team1. Daily interacti<strong>on</strong>s with the threeBusiness Group Vice Presidentsin which the results of otherquality m<strong>on</strong>itoring procedures arediscussed (e.g., quality assuranceteam results, quality metricsresults, financial results, etc.)2. M<strong>on</strong>thly management meetings inwhich the results of other qualitym<strong>on</strong>itoring procedures are moreformally discussed.Informati<strong>on</strong>TypeDirect andIndirectDirect andIndirectM<strong>on</strong>itoringTypeOngoingOngoingCommentsBecause the organizati<strong>on</strong> ishighly focused <strong>on</strong> productquality, daily interacti<strong>on</strong>sbetween executivemanagement and the BusinessGroup Vice Presidents oftenaddress quality-related matters.These interacti<strong>on</strong>s, althoughoften informal, serve asimportant support for executivemanagement’s c<strong>on</strong>clusi<strong>on</strong>sabout c<strong>on</strong>trols over productquality, including Design Risk.These m<strong>on</strong>thly meetings,c<strong>on</strong>ducted in the first week ofevery m<strong>on</strong>th, provide a morerigorous analysis of the resultsof direct m<strong>on</strong>itoring below theexecutive management leveland of the indirect qualitymetrics.Identifying Issues and Communicating Results23. Because the organizati<strong>on</strong>’s structure is relatively flat, the results ofm<strong>on</strong>itoring can be communicated to the proper levels quickly and accurately.Also, because product quality is so important, the communicati<strong>on</strong> protocolsregarding quality issues are designed to escalate rapidly to the Business GroupVice Presidents, executive management, and the board.24. The organizati<strong>on</strong> does not have a formal c<strong>on</strong>trol deficiency prioritizati<strong>on</strong>protocol, but it does track issue identificati<strong>on</strong> and resoluti<strong>on</strong> through a “CorrectiveActi<strong>on</strong> Status” report that is updated c<strong>on</strong>tinuously and reviewed at the m<strong>on</strong>thlymanagement meeting.Summary and Observati<strong>on</strong>s25. This manufacturing organizati<strong>on</strong> has important quality-related risks that mustcoexist with often-competing risks associated with financial goals, such as thoserelated to efficiency, <strong>on</strong>-time delivery, profitability and inventory valuati<strong>on</strong>.Unnecessarily l<strong>on</strong>g lead times for finished goods require higher levels of finishedgoods inventory to meet customer demands, which would negatively affect the


58 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008financial goals. Further, a singular focus <strong>on</strong> producti<strong>on</strong> efficiency would likelylead to an unacceptable reducti<strong>on</strong> in product quality.26. Management and the board have been successful in developing an internalc<strong>on</strong>trol system and related m<strong>on</strong>itoring that enhance product quality and efficiencythrough a focus <strong>on</strong> minimizing defects and planning up-fr<strong>on</strong>t. The c<strong>on</strong>trolsassociated with ensuring that the designed comp<strong>on</strong>ent will work within itsintended system, and the c<strong>on</strong>trols over the design of the manufacturing process,are also critical to meeting the organizati<strong>on</strong>’s quality and financial goals.27. The organizati<strong>on</strong> m<strong>on</strong>itors these c<strong>on</strong>trols <strong>on</strong> an <strong>on</strong>going basis through the useof both direct and indirect informati<strong>on</strong>. Most of the direct-informati<strong>on</strong> m<strong>on</strong>itoringoccurs through the normal functi<strong>on</strong>ing of the quality assurance teams. Theseteams, which include highly competent and objective pers<strong>on</strong>nel, have direct accessto the informati<strong>on</strong> required to determine whether these c<strong>on</strong>trols are operatingeffectively. Day-to-day interacti<strong>on</strong>s — the effectiveness of which is bolstered bythe flat organizati<strong>on</strong>al structure and the high-profile nature of the quality-relatedrisks — are also an important form of direct m<strong>on</strong>itoring.28. The results of the <strong>on</strong>going m<strong>on</strong>itoring are further supported by robustm<strong>on</strong>itoring using indirect informati<strong>on</strong>. This indirect informati<strong>on</strong>, which includesspecific quality metrics as well as financial metrics, enables the organizati<strong>on</strong> toidentify potential issues that may negatively affect the quality goals, financialgoals, or both. This detailed informati<strong>on</strong> is reviewed at every level within theorganizati<strong>on</strong>, including the executive-management level, to ensure that anysignificant deviati<strong>on</strong>s from expectati<strong>on</strong>s are identified and explained.29. The organizati<strong>on</strong> makes extensive use of <strong>on</strong>going m<strong>on</strong>itoring proceduresbecause such m<strong>on</strong>itoring enhances their ability to achieve their objectives.Building m<strong>on</strong>itoring into daily operati<strong>on</strong>s enables the organizati<strong>on</strong> to identify andcorrect c<strong>on</strong>trol problems quickly before they can lead to a material failure. As<strong>on</strong>going m<strong>on</strong>itoring identifies problems or potential problems, the organizati<strong>on</strong>can employ separate evaluati<strong>on</strong>s to further examine and correct them.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 59M<strong>on</strong>itoring Certain Informati<strong>on</strong> Technology (IT) C<strong>on</strong>trols1. The earlier examples in this secti<strong>on</strong> are based <strong>on</strong> the internal c<strong>on</strong>trol systemsand experiences of specific organizati<strong>on</strong>s. They are designed to dem<strong>on</strong>stratem<strong>on</strong>itoring by following an identified risk through the sequence of prioritizing therisk, identifying the key c<strong>on</strong>trols and persuasive informati<strong>on</strong> about those c<strong>on</strong>trols,selecting and executing a m<strong>on</strong>itoring procedure, and assessing and reporting theresults. Their scope is narrow (c<strong>on</strong>centrating <strong>on</strong> a few risks and c<strong>on</strong>trols) in orderto focus <strong>on</strong> each step in the m<strong>on</strong>itoring process.2. The examples in this secti<strong>on</strong> <strong>on</strong> M<strong>on</strong>itoring Certain Informati<strong>on</strong> Technology(IT) C<strong>on</strong>trols differ slightly from the others in that they explore several comm<strong>on</strong>IT-related risks associated with financial reporting and the m<strong>on</strong>itoring of internalc<strong>on</strong>trols related to those risks. It c<strong>on</strong>siders the types of c<strong>on</strong>trols used to mitigatecomm<strong>on</strong> risks, discussing the types of informati<strong>on</strong> used to verify that thosec<strong>on</strong>trols are operating. It also provides examples of comm<strong>on</strong> IT managementprocesses that, in the right circumstances, might be c<strong>on</strong>sidered to be c<strong>on</strong>trolm<strong>on</strong>itoring activities and also examines how technology tools can be used tom<strong>on</strong>itor certain c<strong>on</strong>trols. Note that, while the focus of this example is <strong>on</strong> financialreporting objectives, the c<strong>on</strong>cepts can be applied to operati<strong>on</strong>s-related objectivesor to compliance with laws and regulati<strong>on</strong>s.Understanding and Prioritizing Risk3. Although IT-related risks are applicable to nearly every organizati<strong>on</strong>, theprioritizati<strong>on</strong> of those risks and the relative importance of different types ofc<strong>on</strong>trols that mitigate them will vary from organizati<strong>on</strong> to organizati<strong>on</strong>. The tablebelow summarizes some of the most comm<strong>on</strong> IT-related risks associated withfinancial reporting and c<strong>on</strong>tains summary examples of factors that can bec<strong>on</strong>sidered in determining the relative importance of the given risk.Nature of Risk 61. InappropriateAccessRisk Descripti<strong>on</strong>Applicati<strong>on</strong> programs are accessed and used inappropriately, resulting inerrors, invalid transacti<strong>on</strong>s, or fraud.6 The terms in the Nature of Risk column in this table serve <strong>on</strong>ly to provide a brief name to eachrisk that will facilitate linkage throughout the remainder of the discussi<strong>on</strong>. Readers may notethat the names do not capture completely the essence of the related risk.


60 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Nature of Risk 6Risk Descripti<strong>on</strong>Example Factors Influencing Risk Prioritizati<strong>on</strong>:• Degree to which inappropriate access might benefit some<strong>on</strong>e who obtains it — For example, systemaccess that might allow some<strong>on</strong>e to steal m<strong>on</strong>ey, manipulate transacti<strong>on</strong>s for pers<strong>on</strong>al benefit, orc<strong>on</strong>ceal illegal activity is a greater risk than system access that offers little or no benefit toinappropriate access.• The significance of the data processed by the system and its potential to affect organizati<strong>on</strong>alobjectives in a material manner2. Program Integrity Applicati<strong>on</strong> program processing logic (source code, c<strong>on</strong>figurati<strong>on</strong> informati<strong>on</strong>,etc.) is subjected to unauthorized or improper setup or modificati<strong>on</strong>, renderingthe system incompatible with user needs or expectati<strong>on</strong>s and causingincomplete or inaccurate informati<strong>on</strong> processing or reporting.Example Factors Influencing Risk Prioritizati<strong>on</strong>:• Packaged versus internally developed applicati<strong>on</strong> systems — Relative to programming logic,packaged applicati<strong>on</strong> systems typically carry less risk than internally developed systems becausepackaged applicati<strong>on</strong> systems offer limited or no access to the source code. However, because theyare created to be used by a wide variety of organizati<strong>on</strong>s and typically include more c<strong>on</strong>figurati<strong>on</strong>opti<strong>on</strong>s than internally developed systems, packaged applicati<strong>on</strong> programs can carry a higher level ofrisk regarding the selecti<strong>on</strong> of opti<strong>on</strong>s and the resulting integrity of the c<strong>on</strong>figurati<strong>on</strong> informati<strong>on</strong> thatc<strong>on</strong>trols how programs functi<strong>on</strong>.• Programming complexity — Applicati<strong>on</strong> programs that perform complex calculati<strong>on</strong>s or c<strong>on</strong>trols(sophisticated financial computati<strong>on</strong>s, pricing discounts, etc.) — where end users are less able toc<strong>on</strong>firm complete or accurate processing — typically are higher-risk than applicati<strong>on</strong>s that merelyaccumulate and aggregate business transacti<strong>on</strong>s. For example, a bank’s program integrity risk profilerelated to loan and deposit applicati<strong>on</strong>s might be c<strong>on</strong>sidered “high” due to the nature of processing alarge volume of transacti<strong>on</strong>s having a vast array of calculati<strong>on</strong>s across different product types. Bycomparis<strong>on</strong>, a manufacturer’s customer-invoice computati<strong>on</strong>s may be less complex and easilyverifiable to specific customer orders and physical shipment records.• The significance of the data processed by the system and its potential to affect organizati<strong>on</strong>alobjectives in a material manner3. Data Integrity Data is improperly added or altered, and could include business transacti<strong>on</strong>data (e.g., an invoice), master file data (e.g., a customer credit limit), orparameter settings that c<strong>on</strong>trol processing logic or enable c<strong>on</strong>trols (e.g., asystem setting that triggers an additi<strong>on</strong>al level of approval over a certain dollarlimit).Example Factors Influencing Risk Prioritizati<strong>on</strong>:• Degree of complexity associated with data entry — Data integrity risk is greater in systems requiringcomplex and/or multi-step data entry than in systems with simple data entry procedures.• The significance of the data processed by the system and its potential to affect organizati<strong>on</strong>alobjectives in a material manner


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 61Nature of Risk 64. Informati<strong>on</strong>ProcessingRisk Descripti<strong>on</strong>Processing fails or is err<strong>on</strong>eous, resulting in incomplete, inaccurate, or lostdata.Example Factors Influencing Risk Prioritizati<strong>on</strong>:• Extent of informati<strong>on</strong> interchange — Informati<strong>on</strong> processing risk is commensurate with the number ofinternal and third-party data interfaces.• Potential for system outage or failure that results in disrupted or impaired informati<strong>on</strong> processing• The significance of the data processed by the system and its potential to affect organizati<strong>on</strong>alobjectives in a material mannerIdentifying Key C<strong>on</strong>trols and Informati<strong>on</strong> Used to M<strong>on</strong>itor Those C<strong>on</strong>trols4. The specific types and placement of IT c<strong>on</strong>trols to address prioritized riskscan also vary c<strong>on</strong>siderably. The size and sophisticati<strong>on</strong> of an organizati<strong>on</strong>, thenumber, nature and locati<strong>on</strong> of its underlying technology resources, itsorganizati<strong>on</strong>al structure, and its IT-development philosophy can all affect thenature of the specific c<strong>on</strong>trols in place for managing IT risks. Variati<strong>on</strong>s in thesefactors affect the relative importance of specific IT c<strong>on</strong>trols which, in turn, maydrive different types of m<strong>on</strong>itoring processes. In additi<strong>on</strong>, at times m<strong>on</strong>itoringmanual c<strong>on</strong>trols can provide sufficient support for a c<strong>on</strong>clusi<strong>on</strong> regarding theeffectiveness of IT c<strong>on</strong>trols that operate earlier in the transacti<strong>on</strong> process. Forexample, in a small organizati<strong>on</strong> the Chief Financial Officer (CFO) may signevery check after reviewing supporting invoices. This c<strong>on</strong>trol, if it operateseffectively, enables the CFO to identify unauthorized checks generated bysome<strong>on</strong>e with improper system access. It can also serve as a compensating c<strong>on</strong>trolwhere segregati<strong>on</strong> of duties between check writing and cash accounting isnot practical.5. Although specific c<strong>on</strong>trols and related m<strong>on</strong>itoring processes can vary, thefollowing table summarizes IT c<strong>on</strong>trols that generally are important in mitigating<strong>on</strong>e or more of the broad risks defined earlier. This table also links to the types ofrisk that the c<strong>on</strong>trols address (see Nature of Risks above) and provides a highlevelview of the direct informati<strong>on</strong> typically used to m<strong>on</strong>itor whether thesec<strong>on</strong>trols are operating.


62 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008IT C<strong>on</strong>trolTypeRisk(s)AddressedC<strong>on</strong>trol Descripti<strong>on</strong>Informati<strong>on</strong> Used inM<strong>on</strong>itoringLimitedAccess toApplicati<strong>on</strong>ProgramSource Code• InappropriateAccess• ProgramIntegrityAccess c<strong>on</strong>trols that limit tospecific pers<strong>on</strong>nel the ability tomake applicati<strong>on</strong> programmingand/or c<strong>on</strong>figurati<strong>on</strong> changes:- trained in programmingtools, and- authorized to makeprogramming changes• Listing of access rights tosource code libraries• Evidence of appropriateaccess rights approval• Security logs indicating whohas accessed a givenprogramApplicati<strong>on</strong>Security• InappropriateAccessApplicati<strong>on</strong> access c<strong>on</strong>trolsthat:- provide a restrictive set ofaccess rights to programusers based <strong>on</strong> theirresp<strong>on</strong>sibility, and/or• Listing of access rights toapplicati<strong>on</strong> programs and/orspecific transacti<strong>on</strong>s withinthose programs• Evidence of appropriateaccess rights approval- provide a foundati<strong>on</strong> forsegregati<strong>on</strong> of dutieswithin or betweenapplicati<strong>on</strong> programs• Security logs indicating whohas accessed a givenapplicati<strong>on</strong>Data Security& ChangeC<strong>on</strong>trol• InappropriateAccess• Data Integrity• ProgramIntegrityAccess c<strong>on</strong>trols that restrict to(a) business users ofauthorized applicati<strong>on</strong>programs, or (b) a limitedgroup of data administratorsthe ability to add or alterfinancial reporting dataApproval c<strong>on</strong>trols that providevisibility to and approval ofdata and database changesmade by data administrators• Listing of access rights torelevant data files,databases, or tables within adatabase• Evidence of appropriateaccess rights approval• Evidence of appropriatec<strong>on</strong>figurati<strong>on</strong> of masterdatabase rules, includingapplicati<strong>on</strong> program accessrights• Security logs indicating whohas accessed a givenapplicati<strong>on</strong> or database• Evidence of the identificati<strong>on</strong>and transparency/approval ofdata changes <strong>on</strong> anexcepti<strong>on</strong> basis (i.e.,changes made through anymeans other than normalbusiness processes andapplicati<strong>on</strong> programs thatrequire certain levels ofapproval)


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 63IT C<strong>on</strong>trolTypeRisk(s)AddressedC<strong>on</strong>trol Descripti<strong>on</strong>Informati<strong>on</strong> Used inM<strong>on</strong>itoringLimitedAccess toProducti<strong>on</strong>• ProgramIntegrity• Data IntegrityAccess c<strong>on</strong>trols and operatingsystem security c<strong>on</strong>figurati<strong>on</strong>sthat restrict to a limited anddefined group of pers<strong>on</strong>nel theaccess to operating systemadministrati<strong>on</strong> capabilities (i.e.,restricti<strong>on</strong>s to the ability to“push” program changes intothe producti<strong>on</strong> envir<strong>on</strong>ment).• Listing of access rights torelevant producti<strong>on</strong> programlibraries, files, and relatedc<strong>on</strong>figurati<strong>on</strong> informati<strong>on</strong>• Evidence of appropriateaccess rights approval• Security logs indicating whohas accessed a givenprogramProgramTesting• ProgramIntegrityC<strong>on</strong>trols designed to ensurethat applicati<strong>on</strong> programchanges are sufficiently testedprior to their introducti<strong>on</strong> into aproducti<strong>on</strong> envir<strong>on</strong>ment• Documentati<strong>on</strong> of propertesting of program changes,including those toc<strong>on</strong>figurati<strong>on</strong> data.• Documentati<strong>on</strong> of businessunit or user approval ofrelevant changesProgramChangeC<strong>on</strong>trol• ProgramIntegrityAccess and approval c<strong>on</strong>trolsthat, collectively, ensure thevisibility and approval ofapplicati<strong>on</strong> program and/orc<strong>on</strong>figurati<strong>on</strong> changes• Listing of program changesmade, indicating source andapproval• Documentati<strong>on</strong> ofappropriate testing andapproval of program andc<strong>on</strong>figurati<strong>on</strong> changes beforethey are moved into aproducti<strong>on</strong> envir<strong>on</strong>ment• Evidence of appropriateaccess rights approvalenabling an individual tomove programs to aproducti<strong>on</strong> envir<strong>on</strong>mentJobScheduling &Management• Informati<strong>on</strong>ProcessingAccess and approval c<strong>on</strong>trolsover the scheduling andmanagement of the “jobs”(meaning batch jobs and otheroperati<strong>on</strong>al processesoriginated within IT that arerelevant to informati<strong>on</strong>processing or protecti<strong>on</strong>) thatenable complete and accurateprocessing of data andinformati<strong>on</strong>• Listing of access rights torelevant job scheduling andmanagement tools• Evidence of appropriateaccess rights approval• Evidence that relevant andimportant “jobs” and otheractivities are completed asplanned (including correctingand resubmitting failed“jobs”)


64 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008IT C<strong>on</strong>trolTypeRisk(s)AddressedC<strong>on</strong>trol Descripti<strong>on</strong>Informati<strong>on</strong> Used inM<strong>on</strong>itoringDataRedundancy• Data Integrity• Informati<strong>on</strong>ProcessingTechnology and processingc<strong>on</strong>trols, including datamirroring and disk or tapebackups, designed to ensurethat data is not lost due tooperati<strong>on</strong>al or processingfailures• Reports from backup tools,c<strong>on</strong>firming that all relevantdata files and programs arebacked up• Comparis<strong>on</strong>s of mirroreddata, showing equivalencethereof (usually performedautomatically as part of thesystem’s mirroring process)• Results of periodic datarecovery testsImplementati<strong>on</strong> of IT C<strong>on</strong>trols M<strong>on</strong>itoring6. IT c<strong>on</strong>trols typically are m<strong>on</strong>itored through a combinati<strong>on</strong> of <strong>on</strong>goingm<strong>on</strong>itoring and separate evaluati<strong>on</strong>s. Many IT departments have specificprocesses in place that, as an output from those processes, can providemanagement with informati<strong>on</strong> about the effectiveness of certain c<strong>on</strong>trols. To theextent that those processes work effectively, management may be able to reduce orstreamline the m<strong>on</strong>itoring work performed through separate evaluati<strong>on</strong>s. Some ofthese processes provide “direct” informati<strong>on</strong> about c<strong>on</strong>trol effectiveness; othersprovide <strong>on</strong>ly “indirect” informati<strong>on</strong> at a much higher level or <strong>on</strong> a composite(rather than specific-c<strong>on</strong>trol) basis.M<strong>on</strong>itoring Procedure Informati<strong>on</strong> Type C<strong>on</strong>trols AddressedAccess Recertificati<strong>on</strong> Direct • Limited Access to Applicati<strong>on</strong>Program Source CodeDescripti<strong>on</strong>:• Applicati<strong>on</strong> Security• Data Security & ChangeC<strong>on</strong>trol• Limited Access to Producti<strong>on</strong>• Job Scheduling &ManagementSecurity access recertificati<strong>on</strong> is a process through which, at a given point in time, the existing accessrights to an IT resource (e.g., an applicati<strong>on</strong> program or an infrastructure comp<strong>on</strong>ent) are provided tothe pers<strong>on</strong> resp<strong>on</strong>sible for that resource. The resp<strong>on</strong>sible party compares the existing accessinformati<strong>on</strong> to his or her expectati<strong>on</strong>s and identifies potential excepti<strong>on</strong>s, which are investigated andaddressed, as required.Because this process occurs outside the normal process for adding and changing user access rights, itcan serve as a method of m<strong>on</strong>itoring the effectiveness of the security administrati<strong>on</strong> process (whereby


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 65M<strong>on</strong>itoring Procedure Informati<strong>on</strong> Type C<strong>on</strong>trols Addresseduser access rights are added, changed or removed). To qualify as an effective m<strong>on</strong>itoring procedure,excepti<strong>on</strong>s should be analyzed to determine why the security administrati<strong>on</strong> process allowed them tooccur.Security Log M<strong>on</strong>itoring Indirect • Limited Access to Applicati<strong>on</strong>Program Source CodeDescripti<strong>on</strong>:• Applicati<strong>on</strong> Security• Data Security & ChangeC<strong>on</strong>trol• Limited Access to Producti<strong>on</strong>• Job Scheduling &ManagementA comm<strong>on</strong> c<strong>on</strong>trol in any IT envir<strong>on</strong>ment is the process of “signing <strong>on</strong>” to an IT resource using somecombinati<strong>on</strong> of user ID and password or an equivalent. Many organizati<strong>on</strong>s log this activity to providean audit trail of IT resource users. Because the logging process also records failures where either theuser ID did not exist or the password is incorrect for a valid user ID, an analysis of access failures is afairly comm<strong>on</strong> procedure that provides informati<strong>on</strong> to security management pers<strong>on</strong>nel about whetherany unusual activity is occurring. For example, this type of analysis might identify impers<strong>on</strong>ati<strong>on</strong>attempts wherein some<strong>on</strong>e with access to another pers<strong>on</strong>’s user ID tries to guess that pers<strong>on</strong>’spassword. Such activity would be logged as the same user ID making multiple invalid password-accessattempts. This analysis provides <strong>on</strong>ly indirect informati<strong>on</strong> about the effectiveness of the internal c<strong>on</strong>trolssince the informati<strong>on</strong> that is being m<strong>on</strong>itored represents an analysis of failures to gain access toinformati<strong>on</strong> resources.Independent Quality Assurance or PeerReview Over Program DevelopmentDirect• Program Testing• Program Change C<strong>on</strong>trolDescripti<strong>on</strong>:In many larger IT envir<strong>on</strong>ments, an independent quality assurance functi<strong>on</strong> (or a peer review process)may review all proposed program changes prior to their movement into the producti<strong>on</strong> envir<strong>on</strong>ment. Inthis process, the quality assurance team looks for evidence of testing and required approvals. In somecases, this functi<strong>on</strong> may also independently verify key aspects of the underlying process.Change Review Board Direct and Indirect • Program TestingDescripti<strong>on</strong>:• Program Change C<strong>on</strong>trolSome organizati<strong>on</strong>s with frequent and potentially disruptive changes to the IT envir<strong>on</strong>ment haveimplemented a “change review board” that provides oversight to the change process. Typicallycomprising cross-functi<strong>on</strong>al IT (and, possibly, business unit) managers — and less formal than theIndependent Quality Assurance or Peer Review discussed above — a change review board determineswhether all requirements were met (approvals, testing, communicati<strong>on</strong>, etc.) before the changes wereapproved for movement or producti<strong>on</strong>, then, collectively, reviews and approves all changes. Whetherthis activity provides direct or indirect informati<strong>on</strong> about the effectiveness of c<strong>on</strong>trols depends <strong>on</strong> the


66 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008M<strong>on</strong>itoring Procedure Informati<strong>on</strong> Type C<strong>on</strong>trols Addressednature of the informati<strong>on</strong> gathered and analyzed during the change review process.Post-Implementati<strong>on</strong> Reviews of ProgramChangesIndirect• Program Testing• Program Change C<strong>on</strong>trolDescripti<strong>on</strong>:Similar to the independent quality assurance processes discussed above, to the extent that anorganizati<strong>on</strong> performs a post-implementati<strong>on</strong> review of major program changes, the review process canprovide indirect informati<strong>on</strong> about the effectiveness of its internal c<strong>on</strong>trols over the developmentprocess. The distincti<strong>on</strong> here is that this activity typically is performed after a program has been placedinto producti<strong>on</strong> and is being used in the business. The most effective post-implementati<strong>on</strong> reviewprocesses include an evaluati<strong>on</strong> of both the functi<strong>on</strong>ality and usefulness of the program and theeffectiveness of the internal c<strong>on</strong>trols that are built into the applicati<strong>on</strong> programs and business oraccounting processes.Recovery Testing Direct • Data RedundancyDescripti<strong>on</strong>:IT management may perform different levels of recovery-capability testing for different forms ofdisrupti<strong>on</strong> or disaster. To the extent that this testing involves the re-establishment of IT systems usingeither backup tapes or redundant/mirrored systems, it provides management with direct informati<strong>on</strong>regarding the effectiveness of the redundancy or backup c<strong>on</strong>trols.7. Many organizati<strong>on</strong>s use automated tools to m<strong>on</strong>itor the c<strong>on</strong>tinuedeffectiveness of certain IT-based c<strong>on</strong>trols. The general nature of tools is discussedin the Using Technology for Effective M<strong>on</strong>itoring secti<strong>on</strong> of Volume II. Theexamples below are specific to IT c<strong>on</strong>trols and generally fall into <strong>on</strong>e of four maincategories (see Figure 1).M<strong>on</strong>itoring ToolsFigure 1


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 67Tools that Evaluate System C<strong>on</strong>diti<strong>on</strong>s8. Many “c<strong>on</strong>trols” that are built into applicati<strong>on</strong> programs and infrastructureresources are enabled by c<strong>on</strong>figuring specific parameters or defining a set of rules.This category of automated tools m<strong>on</strong>itors the c<strong>on</strong>sistency of those c<strong>on</strong>trols byexamining the parameters or rules at a given point in time, then comparing theresulting data to baseline data, a prior analysis, or both to determine theirc<strong>on</strong>sistency with the organizati<strong>on</strong>’s internal c<strong>on</strong>trol requirements. Often thesetools are used to m<strong>on</strong>itor c<strong>on</strong>trols in the following ways:• Comparing system parameters to pre-established requirements — Certainsecurity c<strong>on</strong>trols and policies are enabled through parameter settings in thebase operating system, a database envir<strong>on</strong>ment, or the c<strong>on</strong>figurati<strong>on</strong> of anapplicati<strong>on</strong> program. For example, c<strong>on</strong>trols such as the length andcomplexity of passwords and the frequency with which they must bechanged are enabled by security parameters. Tools can be used to scanthese settings and compare them to the resources’ internal security policiesand internal c<strong>on</strong>trol requirements.• Comparing system results to pre-established tolerance levels — Certainc<strong>on</strong>trols within applicati<strong>on</strong> programs depend <strong>on</strong> the base c<strong>on</strong>figurati<strong>on</strong> ofthe applicati<strong>on</strong>. These c<strong>on</strong>figurati<strong>on</strong> opti<strong>on</strong>s can affect transacti<strong>on</strong>processing (billings, payments, etc.) and/or the integrity of the applicati<strong>on</strong>envir<strong>on</strong>ment (security parameters, change c<strong>on</strong>trol, etc.). For example,whether an inventory system uses LIFO or FIFO is dependent <strong>on</strong> theparameters that define the applicati<strong>on</strong> c<strong>on</strong>figurati<strong>on</strong>. Similarly, thetolerance levels for matching processes (e.g., vendor invoice quantities toa receiving report) are dependent <strong>on</strong> applicati<strong>on</strong> c<strong>on</strong>figurati<strong>on</strong>. Tools canprovide for periodic or c<strong>on</strong>tinuous visibility of system c<strong>on</strong>figurati<strong>on</strong>settings for identifying and evaluating out-of-tolerance settings.• Evaluating system access rights for possible segregati<strong>on</strong>-of-dutiesissues — Within ERP systems, the ability to limit access rights andsegregate incompatible duties is enabled by applicati<strong>on</strong> security rules thatare based <strong>on</strong> an organizati<strong>on</strong>’s definiti<strong>on</strong> of roles and the access rightsassociated with those roles. For example, incompatible duties within orbetween applicati<strong>on</strong> programs are identified by comparing existing useraccess rights to a baseline set of incompatible rights either within a singleapplicati<strong>on</strong> or across multiple applicati<strong>on</strong>s. Tools enhancethe effectiveness and efficiency of this potentially complex, timec<strong>on</strong>sumingtask.• Evaluating propriety of administrator rights access — In any technologyenvir<strong>on</strong>ment, “administrator rights” must be assigned to those resp<strong>on</strong>siblefor administering the resource(s). Since some<strong>on</strong>e with administrator rights


68 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008to a resource can perform any functi<strong>on</strong> with respect to that resource, mostorganizati<strong>on</strong>s limit these rights to a small group of pers<strong>on</strong>nel. Tools canprovide management with the informati<strong>on</strong> it needs to m<strong>on</strong>itor theassignment of administrator access rights.9. Tools that m<strong>on</strong>itor informati<strong>on</strong> system c<strong>on</strong>diti<strong>on</strong>s increase the speed andeffectiveness of m<strong>on</strong>itoring, allowing it to be performed <strong>on</strong> a more frequent basis.Such tools may operate periodically (often described as “scanning based”), or theycan operate c<strong>on</strong>tinuously as an integrated comp<strong>on</strong>ent of software or hardware(often described as “agent based”). The decisi<strong>on</strong> as to which approach is correct isdriven by many factors, including the:• Importance of the c<strong>on</strong>trol,• Prioritizati<strong>on</strong> of the risk it is designed to mitigate, and• Effort and/or cost associated with using the tool.Tools that Identify Changes in <strong>Systems</strong>10. Tools that identify changes are an extensi<strong>on</strong> of those that focus <strong>on</strong> c<strong>on</strong>diti<strong>on</strong>s.The basic difference is that change-identificati<strong>on</strong> tools are designed specifically toidentify and report changes to critical programs, infrastructure resources,databases, or data so that some<strong>on</strong>e can verify the appropriateness andauthorizati<strong>on</strong> of those changes. They usually operate c<strong>on</strong>tinuously to identifyrelevant changes or, much like tools that focus <strong>on</strong> business transacti<strong>on</strong>s, theyanalyze log informati<strong>on</strong> created by different IT resources, thus highlightingrelevant change-related activity that may be significant.11. Where c<strong>on</strong>trolling change is important, organizati<strong>on</strong>s typically employ aform of “change c<strong>on</strong>trol” that includes both a preventive c<strong>on</strong>trol (e.g., limits tospecific pers<strong>on</strong>nel the ability to make changes) and a detective c<strong>on</strong>trol (e.g., allchanges are recorded, reviewed, and approved by some<strong>on</strong>e who is independent ofthose making the changes). Thus, the following c<strong>on</strong>siderati<strong>on</strong>s should be takeninto account:• Not all IT resources are capable of recording changes;• In large IT envir<strong>on</strong>ments, individual resource comp<strong>on</strong>ents may be s<strong>on</strong>umerous that analyzing them <strong>on</strong> a detective basis wouldbe overwhelming;• The effects <strong>on</strong> system performance of some resources’ built-in loggingcapabilities may be unacceptable; and• The built-in logging features of some systems are easily disabled, makingthem unsuitable for use in higher-risk areas.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 6912. Tools in this category can be used as part of a c<strong>on</strong>trol activity, part ofm<strong>on</strong>itoring activities, or both. For example, if an evaluator uses the informati<strong>on</strong>from a tool to identify a change for the purpose of independently verifying that thechange was approved, it is likely a m<strong>on</strong>itoring activity. In c<strong>on</strong>trast, if a useremploys that same informati<strong>on</strong> to investigate and seek approval for the change, itis likely being used as a c<strong>on</strong>trol activity. If both users and evaluators use theinformati<strong>on</strong>, the tool serves dual purposes. Specifically, tools in this category can:• Identify changes that have been made to applicati<strong>on</strong> programs, databasestructures or data, and security rights and permissi<strong>on</strong>s. These tools canprovide visibility to change-related activity so that the activity can bevalidated independently, thus establishing whether the underlying changec<strong>on</strong>trolprocess works as designed.• Alert appropriate pers<strong>on</strong>nel when certain types of “missi<strong>on</strong>-critical”changes are being made, ensuring transparency throughout theorganizati<strong>on</strong> and timely acti<strong>on</strong>, as necessary. For example, the tools mayidentify when some<strong>on</strong>e with “administrator” rights makes particularchanges or performs certain acti<strong>on</strong>s, thus facilitating an independentreview of the activity.• Evaluate whether all planned changes were made c<strong>on</strong>sistently andcompletely. For example, in a certain distributed, integrated, and highvolumetransacti<strong>on</strong> system, applicati<strong>on</strong> program c<strong>on</strong>sistency betweenlocati<strong>on</strong>s can be part of the c<strong>on</strong>trols over the system as a whole. Suchc<strong>on</strong>sistency may depend <strong>on</strong> all remote locati<strong>on</strong>s’ running an identicalversi<strong>on</strong> of the applicati<strong>on</strong> program.Tools that Evaluate Processing Integrity13. These automated tools are designed to verify and m<strong>on</strong>itor the completenessand accuracy of the various steps that might occur in high-volume and complexapplicati<strong>on</strong> program process streams. For example, multi-site retailers withdistributed point-of-sale (POS) systems at stores often employ daily — or evenmore frequent — processes for transmitting POS data from each store to a centralprocessing envir<strong>on</strong>ment. Usually, these tools balance and c<strong>on</strong>trol data as itprogresses through processes and systems. Tools in this category can performactivities such as:• Independently verifying the format and c<strong>on</strong>tent of data to be processed,avoiding the processing of bad data;• Rec<strong>on</strong>ciling financial totals and/or transacti<strong>on</strong>/record counts from <strong>on</strong>e fileor database to another file or database within the same (or betweendifferent) applicati<strong>on</strong> and operating systems (for example, these toolsmight be used to ensure the completeness and accuracy of data from


70 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008source systems to the general ledger and from the general ledger to datawarehouses); and• C<strong>on</strong>firming data file, record, and field accuracy as data is aggregated ordisaggregated and as it moves across systems and processes.Tools that Facilitate Error Management14. Most applicati<strong>on</strong> programs that interface with other systems are designedwith logic that detects transacti<strong>on</strong>s that do not meet defined criteria. When suchtransacti<strong>on</strong>s are detected, they often are captured in a suspense area and areinvestigated and corrected before transacti<strong>on</strong> processing can be completed. Forexample:• An automotive parts supplier may receive a technically valid electr<strong>on</strong>icdata interface message describing an authorized shipping schedule;however, the message may have an invalid order identificati<strong>on</strong> thatrequires investigati<strong>on</strong> and correcti<strong>on</strong> before being processed further;• A telecommunicati<strong>on</strong>s provider may receive message informati<strong>on</strong> from itsteleph<strong>on</strong>e switching systems regarding customer ph<strong>on</strong>e usage, but thecustomer may not yet have been added to the billing system so that thosemessages could be rated and billed; or• A bank may receive properly directed deposit or checking activity, but thecustomer account number may be invalid.15. Although these types of systems operate as c<strong>on</strong>trol activities, m<strong>on</strong>itoring thevolume and resolving the activity in these suspense areas substantiate the effectiveoperati<strong>on</strong> of c<strong>on</strong>trols over related error resoluti<strong>on</strong>. In additi<strong>on</strong>, these tools typicallydocument error resoluti<strong>on</strong>, providing an audit trail that provides evidence ofc<strong>on</strong>trol operati<strong>on</strong>.Assessing and Reporting Results16. Reporting the results from m<strong>on</strong>itoring c<strong>on</strong>trols that address IT risks is thesame as for other c<strong>on</strong>trols. However, assessing the impact of identifieddeficiencies can be complicated by the fact that, while many of the IT c<strong>on</strong>trols canbe pervasive, compensating c<strong>on</strong>trols that mitigate deficiencies may also exist inbusiness and accounting processes. Accordingly, effective communicati<strong>on</strong>between IT and accounting and financial reporting is essential to efficient andeffective assessment of the results of the m<strong>on</strong>itoring process.17. Some organizati<strong>on</strong>s also have IT “problem management” processes. Problemmanagement differs from, but is related to, incident management. The purpose ofincident management is to return IT applicati<strong>on</strong>s and services to normal levels asso<strong>on</strong> as possible and with the least possible business impact. The principal


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 71purpose of problem management is to find and resolve the root cause of aproblem, thereby reducing future incidents.Summary and Observati<strong>on</strong>s18. Nearly every organizati<strong>on</strong> has informati<strong>on</strong> technology risks that aremeaningful to organizati<strong>on</strong>al objectives. However, those risks may be prioritizeddifferently across different systems and organizati<strong>on</strong>s. The risk factors discussedabove are intended to help organizati<strong>on</strong>s customize their IT riskprioritizati<strong>on</strong> efforts.19. Once risks are prioritized, organizati<strong>on</strong>s can focus m<strong>on</strong>itoring efforts <strong>on</strong> thec<strong>on</strong>trols that are most important in managing or mitigating those risks — notingthat the c<strong>on</strong>trols may reside outside of the IT envir<strong>on</strong>ment (e.g., the CEO’s manualcheck-signing or other manual c<strong>on</strong>trols that, <strong>on</strong> a timely basis, c<strong>on</strong>firm the validityof informati<strong>on</strong> processing).


72 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008AppendicesThe following appendices include excerpts from actual company documents thatrelate to <strong>on</strong>e or more of the examples presented in this Applicati<strong>on</strong> Techniquesvolume. Organizati<strong>on</strong> names have been removed and other potentially identifyingfeatures, such as department names and report titles, have been altered to preservethe privacy of these organizati<strong>on</strong>s.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-1ABC Company COSO Usage DocumentRelated to Example 1Notes about the materialThis document c<strong>on</strong>tains excerpts from a l<strong>on</strong>ger, 30-page document prepared by alarge professi<strong>on</strong>al services organizati<strong>on</strong> (ABC Company). The organizati<strong>on</strong>updates the document annually and uses it to facilitate and communicateresp<strong>on</strong>sibilities and expectati<strong>on</strong>s about how the organizati<strong>on</strong> achieves theprinciples c<strong>on</strong>tained in the COSO Framework. The excerpts included here arerelated specifically to how the organizati<strong>on</strong> addresses the risk assessment andm<strong>on</strong>itoring comp<strong>on</strong>ents of internal c<strong>on</strong>trol.Table of C<strong>on</strong>tentsOverview 2ABC Company’s Implementati<strong>on</strong> of the COSO Framework 2Risk Assessment 3Risk Assessment & Risk Management Activities 4M<strong>on</strong>itoring 13M<strong>on</strong>itoring Activities 14


Appendix A-2 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008OverviewImplementati<strong>on</strong> of the COSO Framework1. ABC Company has selected the Committee of Sp<strong>on</strong>soring Organizati<strong>on</strong>s(COSO) framework as the guiding framework for internal c<strong>on</strong>trols over financialreporting. In relati<strong>on</strong> to the Financial Reporting secti<strong>on</strong> of the framework, theframework’s general objectives and guidelines have been mapped to ABCCompany’s processes and activities; thus executi<strong>on</strong> of the objectives in theframework should occur naturally as part of ABC Company’s normal activities.2. The COSO framework includes a number of specific activities that supportand reinforce each other. As a set of general principles:• C<strong>on</strong>trol Envir<strong>on</strong>ment activities set the “t<strong>on</strong>e from the top”, are widelyspread and set the appropriate t<strong>on</strong>e for the organizati<strong>on</strong>. Theseactivities are generally m<strong>on</strong>itored and/or tested <strong>on</strong> an annual basis todem<strong>on</strong>strate good enterprise-wideawareness and compliance.• Widely spread c<strong>on</strong>trol activities that arerelated directly to financial integrityand/or fraud preventi<strong>on</strong> are noted as partof the C<strong>on</strong>trol Activities and are tested<strong>on</strong> a regular basis.• Closely held activities which do notrequire the same level of widespreadexecuti<strong>on</strong> are listed in M<strong>on</strong>itoring, RiskAssessment or Informati<strong>on</strong> & Communicati<strong>on</strong>. Some of these activities areincluded in the c<strong>on</strong>trol activities (and, thus, are widely tested), but themajority of them are simply outlined and c<strong>on</strong>firmed as executed <strong>on</strong> anannual basis.3. Each secti<strong>on</strong> of the COSO framework is summarized, and the key ABCCompany activities are outlined after the COSO framework summary. 77 To c<strong>on</strong>serve space, and to remain focused <strong>on</strong> the m<strong>on</strong>itoring comp<strong>on</strong>ent, <strong>on</strong>ly the RiskAssessment and M<strong>on</strong>itoring secti<strong>on</strong>s of ABC Company’s COSO Usage Document are includedin this appendix. Risk Assessment is included due to its direct effect <strong>on</strong> ABC Company’sm<strong>on</strong>itoring.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-3Risk Assessment4. In the COSO definiti<strong>on</strong>, Risk Assessment recognizes that for an entity toexercise effective c<strong>on</strong>trols, it must establish objectives and understand the risks itfaces in achieving those objectives. Management should understand theimplicati<strong>on</strong>s of relevant risks that might hinder progress toward its objectives, andthen management should provide a basis for managing those risks.5. At the summary level, the COSO framework outlines several areas of focusthat should be c<strong>on</strong>sidered in order to establish an effective RiskAssessment process.Area of FocusEntity-Wide ObjectivesActivity (Unit) LevelObjectivesRisksABC Company Expectati<strong>on</strong>s• Broad statements of what an entity desires to achieve, supported bystrategic plans.• Effective Communicati<strong>on</strong> of those objectives (to board and employees).• C<strong>on</strong>sistency of Strategy and Objectives.• C<strong>on</strong>sistency of business plans & budgets with entity wide objectives,strategic plans, and current c<strong>on</strong>diti<strong>on</strong>s.• Activity (unit) level objectives should link to entity-wide objectives andstrategic plans.• Activity level objectives should be c<strong>on</strong>sistent and complementary.• Objectives are established for each significant business process area(where relevant).• Adequate resources exist to achieve objectives.• Prioritizati<strong>on</strong> of objectives to ensure achievement of entity objectives.• Involvement in all levels of management in objective setting, to ensurecommitment to objectives.• C<strong>on</strong>siderati<strong>on</strong> of external and internal factors that could impactachievement of objectives (with risk analysis, to provide management abasis for managing the risks).• Adequate mechanisms to identify risks externally and internally.• Identificati<strong>on</strong> of risks for each activity (unit) objective(s).• Thoroughness and relevance of the risk analysis process (formality of theprocess, involvement of Sr. Management, etc.).


Appendix A-4 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Area of FocusManaging ChangeABC Company Expectati<strong>on</strong>s• Mechanisms must exist to identify and react to routine events or activitiesthat could effect achievement of objectives.• Mechanisms to identify dramatic or pervasive shifts — such as programsto identify customer demographic or paradigm shifts, workforce skill shifts,etc.• Introducti<strong>on</strong> of new pers<strong>on</strong>nel is appropriately managed to introduce themto the organizati<strong>on</strong>’s culture & ensure awareness of their c<strong>on</strong>trols.• New Informati<strong>on</strong> <strong>Systems</strong> are adequately assessed for impact, to ensurec<strong>on</strong>trols are adequate, to ensure system was appropriately developed, andproperly implemented (processes designed, employees trained, etc.).• Rapid growth is managed via supporting systems capability growth;supporting workforce additi<strong>on</strong>s as needed to support the growth (ex:accounting staff), budgets are revised appropriately, and interdepartmentalissues caused by plan revisi<strong>on</strong>s are addressed.• New Technology developments are m<strong>on</strong>itored (informati<strong>on</strong> is gathered;competitors use is c<strong>on</strong>sidered, mechanisms exist to introduce newtechnology into the organizati<strong>on</strong>).• New Products are reas<strong>on</strong>ably forecast; IT and staffing is sufficient; earlyresults are tracked; impact <strong>on</strong> other company products is evaluated;overhead is evaluated to reflect product c<strong>on</strong>tributi<strong>on</strong> accurately.• Restructuring or Downsizing is planned in such a way that reducti<strong>on</strong>s areanalyzed for impact <strong>on</strong> operati<strong>on</strong>s, terminated employees c<strong>on</strong>trolresp<strong>on</strong>sibilities are reassigned, impact <strong>on</strong> morale is c<strong>on</strong>sidered, andsafeguards exist to protect against disgruntled employees.• Foreign Operati<strong>on</strong>s are evaluated regularly; management is aware ofpolitical, regulatory, etc. issues; pers<strong>on</strong>nel are aware of accepted customsand rules; procedures exist in case communicati<strong>on</strong>s are interrupted.Risk Assessment & Risk Management Activities6. While utilizing other frameworks to manage overall risk, ABC Companyincludes a set of activities that align with the first three areas of focus; occurring atthe company-wide (or entity) level, the deployed entity level, and the project level.Change management activities are summarized at the end of the secti<strong>on</strong>.Entity & Unit Level Objective Setting7. Entity and activity objectives are established and communicated through theplanning process:• The planning process is anchored by a 5 year strategic plan, which isupdated annually. The 5 year plan encapsulates our strategic intent in aseries of strategies with respect to type of work mix (revenue growth byservice group), target margin structures by service group, workforceevoluti<strong>on</strong> to support target work mix, SG&A targets, SE pyramids


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-5headcount, and units and financial strategy (sources and uses of cash,equity programs).• The five-year plan is then used as a key input into the next fiscal yearannual plan (al<strong>on</strong>g with current operating data), which drives the entitieskey financial objectives into each organizati<strong>on</strong>al unit (P&L and costcenter). The annual plan is an integrated plan; all major entities areincluded and plan results aligned to overall entity results.• Each entity then completes a detailed plan, with c<strong>on</strong>siderati<strong>on</strong> of a varietyof factors (market c<strong>on</strong>diti<strong>on</strong>s, etc.), and the opportunity to adjust the toplevel plan as detailed plans are completed. Plans are completed at thelowest P&L or significant cost center level, and approved by the leader ofthat unit, and reviewed by management as needed.• During the fiscal year, each organizati<strong>on</strong>al unit completes a quarterlyforecast. Once completed, the plan is updated <strong>on</strong> a quarterly basis throughthe quarterly forecasting process; adjustments in operati<strong>on</strong>s (such asreducti<strong>on</strong>s or increases in hiring, etc.) are identified and communicated asrequired to achieve the plan across entities. Each entity is then resp<strong>on</strong>siblefor operati<strong>on</strong>alizing specific changes (such as cost reducti<strong>on</strong>s, etc.)required to achieve the corporate objectives. The forecasting process alsoprovides opportunities to request additi<strong>on</strong>al funding and modify budgets asappropriate (based <strong>on</strong> reviews).• Achievement of objectives is m<strong>on</strong>itored through a variety of reportingpackages; a comm<strong>on</strong> core set of reports are produced by SAP with acomm<strong>on</strong> core set of metrics. Metrics vary logically between P&L and costcenter units.8. Once completed, a summary of the plan is communicated in a variety ofways, including (but not limited or exclusive to):• The Board of Directors reviews and approves a summary of thefinancial plan.• Senior Executives are given a copy of the ABC Company Business Plan,which includes an overview of the company’s financial and operati<strong>on</strong>alpriorities for the year.• Most pers<strong>on</strong>nel have the opportunity to attend communicati<strong>on</strong> events tolearn about the organizati<strong>on</strong>’s focus. These generally occur via webcast, orpossibly via community meetings. (Excepti<strong>on</strong>s relate to technology accessand some specific business situati<strong>on</strong>s)


Appendix A-6 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 20089. In additi<strong>on</strong> to the planning process outlined above, a number of detailed (butrelevant) activities occur to m<strong>on</strong>itor risks and drive strategic objectives throughthe organizati<strong>on</strong>. Specifically:• The ABC Company Growth & Strategy team completes a number ofstrategic assessments which address various strategic and operati<strong>on</strong>alissues (for example, analysis of margin results) or external issues. Theefforts of the Growth & Strategy team are under the directi<strong>on</strong> of theExecutive Leadership team, reporting directly to the Chief Strategy andCorporate Development Officer (by role, title may vary), to ensureappropriate visibility to the “road signs” of change.• On a periodic basis, as determined primarily by the Chief ExecutiveOfficer, ABC Company may undertake a large-scale, comprehensivereview of our strategy which would include an examinati<strong>on</strong> of internal(e.g., ABC Company recent performance) and external (e.g., competitiveenvir<strong>on</strong>ment, market trends) which inform the refinement of our strategy.This process also includes an analysis of various risks including marketand competitors.• ABC Company maintains an Office of Government Relati<strong>on</strong>s team andGlobal Asset Protecti<strong>on</strong> team that m<strong>on</strong>itor political trends. As with theGrowth & Strategy team, specific issues are identified and acted up<strong>on</strong>based <strong>on</strong> the political risk to the organizati<strong>on</strong>. Briefings are provided toABC Company leadership <strong>on</strong> an as needed basis.• ABC Company completes an annual risk assessment, which is a crossfuncti<strong>on</strong>al, external and internal risk assessment. A number of differentrisk areas are evaluated (for impact and increasing/decreasing risk), andSenior Management uses this data as an input into the planning process.The process reports to the Chief Risk Officer, and is driven by <strong>Internal</strong>Audit; results are shared with senior leadership.• ABC Company’s Office of the CEO maintains an organizati<strong>on</strong> OperatingModel that establishes how the company operates, how the company isorganized and how the various entities and roles in the organizati<strong>on</strong> worktogether to provide effective and efficient customer service. Thisdocument is updated throughout the annual cycle to reflect any changes inthe organizati<strong>on</strong> and serves as <strong>on</strong>e of many management tools to executethe strategic plan and objectives that are developed.• Programs are created to address specific risks, or drive specific objectivesacross units. Program executi<strong>on</strong> is m<strong>on</strong>itored by the Growth & Strategyteam, reporting to the COO.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-7• Regular Management meetings occur at all levels to m<strong>on</strong>itor risks, addressissues and prioritize activities and objectives, and to m<strong>on</strong>itor progress inachieving objectives (P&L level, Cost Center level, Corporate Level).• Specific activities occur in each node to m<strong>on</strong>itor specific risks. As anexample, HR m<strong>on</strong>itors attriti<strong>on</strong>; CIO m<strong>on</strong>itors applicati<strong>on</strong> backupactivities. Specific to IT, strategic technology trends are c<strong>on</strong>sidered <strong>on</strong> aregular basis as a part of the IT Strategy; this is outlined in more detail inthe IT Body of Evidence document.• Benchmarking of major functi<strong>on</strong>al areas (Cost of Finance, Cost of CIO,HR service at a macro level, etc.) occurs to ensure competitive andreas<strong>on</strong>able results across the organizati<strong>on</strong>.C<strong>on</strong>tract Level Risk Assessment and Management Activities10. The heart of ABC Company’s business is c<strong>on</strong>tracts. Accordingly, a set ofRisk Assessment and Management activities exist to ensure that c<strong>on</strong>tract risks areappropriately identified, c<strong>on</strong>sidered, and managed:• Each P&L unit c<strong>on</strong>siders the appropriate customers to pursue as a part oftheir annual planning exercise (including the c<strong>on</strong>siderati<strong>on</strong> of risk to theunit and to ABC Company), resulting in a target set of customers.Although the target set of customers is not exclusive, the majority of Sales& Marketing efforts are directed at these customers.• All c<strong>on</strong>tracts go through an approval process at a variety of levels in theOperating Group, which c<strong>on</strong>siders the risk inherent in the c<strong>on</strong>tract (andbalances the return <strong>on</strong> the c<strong>on</strong>tract with the risk)• All large and complex c<strong>on</strong>tracts meeting a specific set of criteria gothrough a special approval process via the Capital Committee, which ischaired by the Chief Risk Officer. This process ensures that seniorleadership has the opportunity to c<strong>on</strong>sider the risks <strong>on</strong> these largec<strong>on</strong>tracts. The Capital Committee’s process includes reviews by a numberof subject matter experts (Legal, etc.) and an explicit, standardized riskmanagement assessment.• In accordance with the Quality Assurance (QA) process, a QA review isrequired for all opportunities during the selling phase prior to submissi<strong>on</strong>to the customer for all new opportunities. The frequency and timing ofopportunity QA reviews vary based <strong>on</strong> the size and risk of theopportunity — larger/riskier opportunities are subject to more frequent QAreviews. QA reviews are required for all c<strong>on</strong>tracts during the deliveryphase. The frequency and timing of delivery QA reviews are to be aligned


Appendix A-8 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008with key project milest<strong>on</strong>es; however, the highest risk projects must haveQA reviews at least quarterly.• ABC Company methods are employed to reduce risk by providingc<strong>on</strong>tracts with a standard methodology to follow in executing the c<strong>on</strong>tract.Methods are updated <strong>on</strong> a regular basis to recognize changing marketdynamics and new research.• Customer satisfacti<strong>on</strong> is m<strong>on</strong>itored <strong>on</strong> an <strong>on</strong>going basis, via web-basedsurveys. This allows customers an independent method of raising issuesacross the work being performed for a customer. Across customers, ABCCompany management m<strong>on</strong>itors results for market trends and issues.Corporate C<strong>on</strong>tract Risk M<strong>on</strong>itoring11. At the corporate level, a number of activities occur to m<strong>on</strong>itor risk:• High Risk c<strong>on</strong>tracts are m<strong>on</strong>itored for risks that would harm the entity.C<strong>on</strong>tracts with a specific risk profile are identified and escalated throughthe “High Impact” reporting process. As c<strong>on</strong>tracts’ risk profile increases,management attenti<strong>on</strong> escalates, to ensure the appropriate amount ofm<strong>on</strong>itoring & interventi<strong>on</strong> is occurring.Other Risk M<strong>on</strong>itoring Activities12. A variety of other activities occur to m<strong>on</strong>itor risk; the most notable of theseinclude crisis m<strong>on</strong>itoring & resp<strong>on</strong>se:• ABC Company's Global Asset Protecti<strong>on</strong> Team m<strong>on</strong>itors news andsecurity sources for geopolitical issues or natural disasters that impact ouroperati<strong>on</strong>s worldwide. As situati<strong>on</strong>s warrant, the team c<strong>on</strong>tacts or isc<strong>on</strong>tacted by local management. The team has an escalati<strong>on</strong> path to acorporate Situati<strong>on</strong> Management Committee, which includes appropriate(based <strong>on</strong> situati<strong>on</strong>) senior leadership.Risk M<strong>on</strong>itoring Summary13. At the summary level, the following chart illustrates how ABC Company’sactivities support the Risk Assessment area of the COSO framework. This is anillustrative chart <strong>on</strong>ly; the detail above is intended to represent theactual activities.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-9ActivityResp<strong>on</strong>sibleEntityObjectivesActivity(Unit)ObjectivesRisksAnnual Risk Assessment Chief Risk Officer 5 year Strategic Plan, updatedmin 1x per yearChief Strategy and CorporateDevelopment OfficerAnnual Plan, driven toP&L/Cost Center LevelFinance Operati<strong>on</strong>sQuarterly Forecast, tied tocorporate objectivesFinance Operati<strong>on</strong>sCustomers are targeted,including assessment ofaggregate riskOperating Group COOC<strong>on</strong>tracts are reviewed andapproved, including riskassessmentLarge & Complex C<strong>on</strong>tractsmeeting guidelines go througha separate review process viaCapital CommitteeC<strong>on</strong>tracts go through qualityreviewsCustomer Satisfacti<strong>on</strong> ism<strong>on</strong>itored <strong>on</strong> a regular basisKey customer financialsituati<strong>on</strong> is m<strong>on</strong>itoredOperating GroupCapital CommitteeChief Risk Officer/ OG COOChief Risk Officer/ OG COOCFO High Risk C<strong>on</strong>tracts withpotential issues are m<strong>on</strong>itoredby various levels of SeniorManagementChief Risk OfficerGeo Political M<strong>on</strong>itoringGrowth & Strategy, Office ofGov’t Relati<strong>on</strong>s; AssetProtecti<strong>on</strong>Periodic ethics and compliancerisk assessmentCompliance OfficerABC Company Change Management Activities14. The COSO framework notes that effective change management is animportant part of risk assessment, and ABC Company completes a number ofdifferent activities to m<strong>on</strong>itor and address events that could disrupt operati<strong>on</strong>s.


Appendix A-10 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Management of these change events — at the ABC Company or entity level — isdistributed across a number of different groups, as outlined below.COSO ChangeManagement Area Resp<strong>on</strong>sible ABC Company ActivityAnticipati<strong>on</strong> of <strong>Internal</strong> &External events thatcould impact ABCCompanyChanged OperatingEnvir<strong>on</strong>ment — Changesin the operatingenvir<strong>on</strong>ment that couldimpact ABC CompanyOffice of Gov’tRelati<strong>on</strong>s, Growth& Strategy;<strong>Internal</strong> Audit;Global AssetProtecti<strong>on</strong>Growth & StrategyBusinessArchitectureGrowth & Strategy<strong>Internal</strong> AuditLegalGrowth &Strategy; HROperatingGroups/GrowthPlatforms• Externally, as noted above, risk assessmentactivities include m<strong>on</strong>itoring of key external trendsand m<strong>on</strong>itoring of political risks that could disruptthe entity.• <strong>Internal</strong>ly, the Growth & Strategy team provides atracking for major internal programs (combined withselected external trends) to provide Sr.management with ability to influence major changesin the organizati<strong>on</strong>.• In additi<strong>on</strong>, Business Architecture/Operati<strong>on</strong>alPrograms tracks major internal operati<strong>on</strong>alprograms outside of the strategic programs trackedby Growth and Strategy.• As noted earlier, Growth & Strategy & <strong>Internal</strong>Audits both assess external trends that wouldcreate risk for the entity (such as declining margins,etc.).• Legal m<strong>on</strong>itors selected elements of the regulatoryenvir<strong>on</strong>ment for changes that would create risk forthe entity, and provides updates to management <strong>on</strong>key trends.• External labor market trends are m<strong>on</strong>itoredprimarily by HR with some work by G&S; internalemployee trends are m<strong>on</strong>itored via GlobalEmployee Surveys. Employee engagement isexplicitly included and m<strong>on</strong>itored as a part ofcorporate metrics.• OG Resource planning process c<strong>on</strong>siders inputsfrom a variety of sources to balance resourceneeds and regularly (quarterly) revise the staffing &recruiting needs as a part of the quarterlyforecasting process.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-11COSO ChangeManagement Area Resp<strong>on</strong>sible ABC Company ActivityNew Pers<strong>on</strong>nel —Certainty that pers<strong>on</strong>nelare aware of ethicalstandards; c<strong>on</strong>trolsc<strong>on</strong>tinue to executeNew Informati<strong>on</strong><strong>Systems</strong> c<strong>on</strong>siderc<strong>on</strong>trols; are properlydeveloped, and theimpact <strong>on</strong> theorganizati<strong>on</strong> when the golive is assessedRapid Growth ism<strong>on</strong>itored & budgetsrevised accordinglyHR/Ethics andCompliance OfficeHRBusiness LeadsCIOGrowth &Strategy; GlobalBusinessOperati<strong>on</strong>s; HRFinanceOperati<strong>on</strong>sCIO• New pers<strong>on</strong>nel go through an orientati<strong>on</strong> processthat touches <strong>on</strong> key aspects of ABC Company’sculture, including the Code of Business Ethics andrelated policies, and as appropriate, executetraining <strong>on</strong> <strong>Internal</strong> C<strong>on</strong>trols over Finance Reportingas well as operati<strong>on</strong>al c<strong>on</strong>trols related to otherprocesses, if relevant. Also includes specificCorporate Required Training based <strong>on</strong> level andfuncti<strong>on</strong>.• C<strong>on</strong>trol resp<strong>on</strong>sibilities (macro level) have beenadded when relevant to positi<strong>on</strong> resp<strong>on</strong>sibilities toensure the resp<strong>on</strong>sibilities are kept independentfrom the incumbent and remain intact as peoplechange jobs.• Business Leads and Local C<strong>on</strong>trol Leads areresp<strong>on</strong>sible for communicating and m<strong>on</strong>itoringassignment of c<strong>on</strong>trols to ensure executi<strong>on</strong>resp<strong>on</strong>sibilities are clear.• IT c<strong>on</strong>trols include c<strong>on</strong>trols related to the SystemDevelopment Lifecycle, including the appropriatedevelopment, testing, and installati<strong>on</strong> c<strong>on</strong>trols.• System development projects include acommunicati<strong>on</strong> or change management aspect(unless approved to exclude, or impact is nominal<strong>on</strong> organizati<strong>on</strong>). For major changes, this willgenerally include communicati<strong>on</strong>, training, processchange.• System development for large financial systemprojects is m<strong>on</strong>itored via Steering Committees,Quality Assessments, and via CIO developmentc<strong>on</strong>trols, to ensure key activities are executed.• For key financial systems, c<strong>on</strong>siderati<strong>on</strong> of c<strong>on</strong>trolimpacts are explicitly c<strong>on</strong>sidered.• <strong>Internal</strong> budgets & n<strong>on</strong>-financial targets are set inc<strong>on</strong>siderati<strong>on</strong> of ABC Company’s strategy;m<strong>on</strong>itoring c<strong>on</strong>siders low resources as well asexcess resources.• As noted earlier, Budgets are revised quarterly &growth can be accommodated based <strong>on</strong> businessneed.• CIO spend is guided via an IT Steering Committeethat c<strong>on</strong>siders growth, and ABC Company’sstrategy in assigning budgets & resources.


Appendix A-12 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008COSO ChangeManagement Area Resp<strong>on</strong>sible ABC Company ActivityNew Technology ism<strong>on</strong>itored to assessimpact <strong>on</strong> organizati<strong>on</strong>New Products orAcquisiti<strong>on</strong>s arem<strong>on</strong>itored for impactCorporate Restructuringactivities are managed tominimize disrupti<strong>on</strong>Global Operati<strong>on</strong>s arem<strong>on</strong>itored to ensurechanges are identifiedCIOOperating Groups,Growth PlatformsFinanceOperati<strong>on</strong>sP&L Entities, HR,GlobalC<strong>on</strong>trollership,etc.Global BusinessOperati<strong>on</strong>s Legal,HRBusiness LeadsUnit leadershipCIO, Facilities &ServicesManagingDirectorsLegal• CIO strategy (updated periodically) c<strong>on</strong>sidersexternal developments; the strategy c<strong>on</strong>siders newdevelopments in technology.• New service lines (service offerings) are m<strong>on</strong>itoredfor financial & market success.• New skill needs are m<strong>on</strong>itored & communicated toRecruiting (for external acquisiti<strong>on</strong>) & Training (viainternal capability building plans).• Impacts of new services lines & new skills arem<strong>on</strong>itored via standard reporting (for example,expansi<strong>on</strong> into outsourcing included assessment ofimpacts <strong>on</strong> c<strong>on</strong>sulting service fees).• Overhead allocati<strong>on</strong>s (& other related financialreporting mechanisms) are adjusted annually toc<strong>on</strong>sider new product lines, other changes.• Acquisiti<strong>on</strong>s are reviewed and m<strong>on</strong>itored by avariety of teams — Financial performance ism<strong>on</strong>itored by the P&L entity to which the acquisiti<strong>on</strong>reports; HR reviews the compensati<strong>on</strong> & benefitplan of the acquisiti<strong>on</strong>, Global C<strong>on</strong>trollershipm<strong>on</strong>itors financial reporting, etc. Acquisiti<strong>on</strong>s gothru a through a due diligence process, whichincludes legal, compliance, ethics, and businessreviews.• Macro level staff reducti<strong>on</strong> areas are reviewed byHR leadership to ensure planned service reducti<strong>on</strong>sdo not adversely impact operati<strong>on</strong>s and are incompliance with local laws.• Business Leads and local c<strong>on</strong>trol leads remainresp<strong>on</strong>sible for assigning c<strong>on</strong>trols resp<strong>on</strong>sibilities t<strong>on</strong>ew pers<strong>on</strong>nel in the event of restructuring.• Morale is m<strong>on</strong>itored via the Global EmployeeSurveys, with m<strong>on</strong>itoring or improvement goals setby each entities leadership.• Once employees are removed, access (physical,logical) is quickly revoked.• Managing Directors are resp<strong>on</strong>sible for m<strong>on</strong>itoringthe local envir<strong>on</strong>ment & raising issues.• Local Legal pers<strong>on</strong>nel m<strong>on</strong>itor local regulatoryenvir<strong>on</strong>ments, raising issues to Legal leadership asneeded.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-13COSO ChangeManagement Area Resp<strong>on</strong>sible ABC Company ActivityGlobal AssetProtecti<strong>on</strong>Various• At the corporate level, an ABC Company securityteam m<strong>on</strong>itors trouble areas; maintainingevacuati<strong>on</strong> plans and backup communicati<strong>on</strong> plansas needed.• Results in local operati<strong>on</strong>s are m<strong>on</strong>itored by theappropriate P&L entity or cost center entity.M<strong>on</strong>itoring15. M<strong>on</strong>itoring is a c<strong>on</strong>tinuous process that management uses to assess thequality of internal c<strong>on</strong>trol performance over time. At the highest level, M<strong>on</strong>itoringencompasses normal m<strong>on</strong>itoring activities, periodic evaluati<strong>on</strong>s or m<strong>on</strong>itoring, andthe reporting of deficiencies to the appropriate level of management and the boardof directors.16. At the summary level, the COSO framework outlines several areas of focusthat should be c<strong>on</strong>sidered in order to ensure effective m<strong>on</strong>itoring:Area of FocusOngoing M<strong>on</strong>itoringABC Company’s Expectati<strong>on</strong>s• Extent to which pers<strong>on</strong>nel, in performing their normal activities, obtainevidence that the system of internal c<strong>on</strong>trols is functi<strong>on</strong>ing — for example− Operating Management compares sales, producti<strong>on</strong>, etc. data obtaineddaily to system generated data− Data used to manage operati<strong>on</strong>s is rec<strong>on</strong>ciled with data generated byfinancial system− Operating Pers<strong>on</strong>nel sign off <strong>on</strong> the accuracy of their units’ financialstatements & are held resp<strong>on</strong>sible if errors are discovered• Extent to which communicati<strong>on</strong>s from external parties corroborate internallygenerated informati<strong>on</strong>− Customers corroborate billing data by paying <strong>on</strong> time− Communicati<strong>on</strong>s from vendors are used as a m<strong>on</strong>itoring technique− C<strong>on</strong>trols that should have prevented or detected problems are assessed• Periodic comparis<strong>on</strong> of amounts recording by the accounting system withPhysical Assets− Inventory levels are checked when goods are taken for shipment;differences are corrected− Securities held in trust are counted periodically & compared to records• Extent to which training seminars, planning sessi<strong>on</strong>s and other meetingsprovide feedback to management− Relevant issues raised at seminars are captured− Employee suggesti<strong>on</strong>s are communicated upstream


Appendix A-14 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Area of FocusOngoing M<strong>on</strong>itoring(c<strong>on</strong>tinued)Periodic M<strong>on</strong>itoring/Separate Evaluati<strong>on</strong>sReportingDeficienciesABC Company’s Expectati<strong>on</strong>s• Whether pers<strong>on</strong>nel are asked periodically to state whether they understandand comply with the code of c<strong>on</strong>duct, or whether signatures are required toevidence performance of critical c<strong>on</strong>trol functi<strong>on</strong>s• Resp<strong>on</strong>siveness to internal & external auditor recommendati<strong>on</strong>s− Executives with appropriate authority decide which recommendati<strong>on</strong>s willbe implemented− Desired acti<strong>on</strong>s are followed up to verify implementati<strong>on</strong>• Effectiveness of internal audit activities; appropriate IA staffing, competence& experience; positi<strong>on</strong> within organizati<strong>on</strong> is appropriate; access to BOD orAudit Committee is appropriate; their scope is appropriate to theorganizati<strong>on</strong>’s needs• Scope and frequency of separate evaluati<strong>on</strong>s of the internal c<strong>on</strong>trol system,including whether appropriate porti<strong>on</strong>s are evaluated; evaluati<strong>on</strong>s arec<strong>on</strong>ducted by individuals with appropriate skills; scope, depth and frequencyare adequate• Appropriateness of the evaluati<strong>on</strong> process, including whether the evaluatorgains sufficient understanding of the activities; analysis is made vs.established criteria• Appropriateness of the methodology for evaluating whether the system islogical and appropriate, including standard methodology (such as checklists,tools); coordinated planning effort for the evaluati<strong>on</strong> process; evaluati<strong>on</strong>process is managed by an executive with appropriate authority• Appropriateness of level of documentati<strong>on</strong>; are policy manuals, org charts,operating instructi<strong>on</strong>s, etc available; is the evaluati<strong>on</strong> process documented?• Existence of a process for capturing & reporting identified deficiencies — fromexternal sources & from <strong>on</strong>going m<strong>on</strong>itoring or separate evaluati<strong>on</strong>s• Appropriateness of reporting protocols — are deficiencies reported to thepers<strong>on</strong> directly resp<strong>on</strong>sible for the activity, and to a pers<strong>on</strong> at least 1 levelhigher?• Specific types of deficiencies are reported to senior management and to theboard• Appropriateness of follow-up activities. Is the underlying event corrected; arecauses of problems investigated; is follow-up acti<strong>on</strong> taken to ensurecorrective acti<strong>on</strong>?M<strong>on</strong>itoring Activities17. M<strong>on</strong>itoring stands as both an integrated set of activities and a standal<strong>on</strong>e setof assessment activities. This provides both <strong>on</strong>going assurance of c<strong>on</strong>trols and aseparate and distinct set of feedback to management <strong>on</strong> c<strong>on</strong>trol operati<strong>on</strong>s.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-15Ongoing M<strong>on</strong>itoring — Financial• Operating Group Chief Executives sign off <strong>on</strong> the accuracy of theirfinancial results.• Senior Executives are measured <strong>on</strong> GAAP compliance and internalc<strong>on</strong>trols compliance; this is a formal metric included in Senior Executivemeasures & influencing compensati<strong>on</strong> & rewards. GAAP failures andinternal c<strong>on</strong>trols failures negatively influence the Senior Executiveevaluati<strong>on</strong>. GAAP compliance informati<strong>on</strong> is provided by CorporateC<strong>on</strong>trollership; C<strong>on</strong>trol executi<strong>on</strong> informati<strong>on</strong> is provided by <strong>Internal</strong>Audit & the 404 Core team.• C<strong>on</strong>trol activities include a balance of transacti<strong>on</strong>al & m<strong>on</strong>itoring c<strong>on</strong>trolsthroughout the organizati<strong>on</strong>.• Regular (quarterly) feedback <strong>on</strong> operati<strong>on</strong> of critical c<strong>on</strong>trols is provided(independent of testing of those c<strong>on</strong>trols).• <strong>Internal</strong> C<strong>on</strong>trols require appropriate evidence, including a number ofapprovals (usually electr<strong>on</strong>ic) <strong>on</strong> key activities. Management’s training &communicati<strong>on</strong> <strong>on</strong> this point is clear; evidence is required to be retained toprove executi<strong>on</strong> & increase certainty of financial reporting.• Corporate C<strong>on</strong>trollership m<strong>on</strong>itors key GAAP pr<strong>on</strong>ouncements, andadjusts and communicates finance policies as required.Ongoing M<strong>on</strong>itoring — <strong>Internal</strong> & External Audit• External audit recommendati<strong>on</strong>s are assessed by the Chief AccountingOfficer (CAO) and others as needed; implementati<strong>on</strong> is tracked byGlobal C<strong>on</strong>trollership.• <strong>Internal</strong> Audit reports to the Audit Committee, and administratively to theChief Risk Officer, outside of the Finance organizati<strong>on</strong>.• The <strong>Internal</strong> Audit plan is approved by both senior management and theAudit Committee, with corresp<strong>on</strong>ding staffing to execute the plan.• <strong>Internal</strong> audit recommendati<strong>on</strong>s are reported to the CFO, CAO and othersas appropriate; the management of each entity is required to resp<strong>on</strong>d withan acti<strong>on</strong> plan to IA points. The unit resp<strong>on</strong>sible for implementing therecommendati<strong>on</strong>s executes quarterly tracking through implementati<strong>on</strong>.


Appendix A-16 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Ongoing M<strong>on</strong>itoring - Operati<strong>on</strong>al• Forums exist to compare operating informati<strong>on</strong> to financial informati<strong>on</strong> —for example, the Executive Leadership Team meetings, and theOperati<strong>on</strong>s Council.• Performance m<strong>on</strong>itoring (via the forecast, analysis of variances) occurs ateach P&L or cost center node <strong>on</strong> a quarterly (minimum) basis.• Collecti<strong>on</strong> (Days Sales Outstanding) is relatively low, indicative of rapidcustomer payment and a low billing error rate (am<strong>on</strong>g other factors).Ongoing M<strong>on</strong>itoring — Compliance and Regulatory Matters• The Compliance and Regulatory Matters (C&RM) team m<strong>on</strong>itorsmultiple aspects of operati<strong>on</strong>s within the company through methodssuch as: m<strong>on</strong>itoring the Business Ethics Help Line, c<strong>on</strong>ducting multipleethics and compliance surveys c<strong>on</strong>ducted <strong>on</strong> a periodic basis forl<strong>on</strong>gitudinal comparability.• Integrate with other teams, such as the <strong>Internal</strong> Audit team, to leveragetheir assets for additi<strong>on</strong>al specific m<strong>on</strong>itoring requirements.Separate C<strong>on</strong>trol Activity Evaluati<strong>on</strong>s• Evaluati<strong>on</strong> activities are planned for all quarters, though the scope of eachquarter may differ. The design of our c<strong>on</strong>trols is evaluated every year, andevery c<strong>on</strong>trol activity goes through an assessment at least <strong>on</strong>ce in a year.• Evaluati<strong>on</strong> activities are planned and m<strong>on</strong>itored by the core team.• C<strong>on</strong>trol evaluati<strong>on</strong> activities are executed by individuals who are notresp<strong>on</strong>sible for operating a c<strong>on</strong>trol; they receive independent training <strong>on</strong>how to c<strong>on</strong>duct their assessments.• Assessments are c<strong>on</strong>ducted using a standardized set of test plans, whichmay be modified to reflect local c<strong>on</strong>diti<strong>on</strong>s.• Test plans are created to provide a substantive body of evidence thatsupports executi<strong>on</strong>; sample size guidance ensures appropriate testinglevels to provide management comfort of executi<strong>on</strong> (with adjustmentpermissible by management).• Assessment results are reporting to the Business Lead and to the <strong>Internal</strong>C<strong>on</strong>trols team via a portal, with test results documented in the portal.• C<strong>on</strong>firmati<strong>on</strong> activities (or “roll forward” activities) are planned for the4 th quarter.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix A-17• <strong>Internal</strong> Audit also evaluates c<strong>on</strong>trols as part of its standard audit activitiesfor an entity.Reporting Deficiencies• Ongoing c<strong>on</strong>trol failures identified locally are assessed for SignificantDeficiency or Material Weakness potential using a set of guidelinesreviewed by the <strong>Internal</strong> C<strong>on</strong>trols Steering Committee and the AuditCommittee (at the summary level).• C<strong>on</strong>trol failures (with no compensating c<strong>on</strong>trols) that have potential tocreate a significant deficiency or material weakness are elevated to theChief Accounting Officer, CFO, General Counsel and the Disclosurecommittee, and summarized for the Audit Committee.• C<strong>on</strong>trol failures are tracked until c<strong>on</strong>firmati<strong>on</strong> is received that theyhave been resolved. The core team m<strong>on</strong>itors failure resoluti<strong>on</strong> toensure reas<strong>on</strong>ableness.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix B-1Quarterly and Annual Management Representati<strong>on</strong>sRelated to Example 38:Notes about the materialManagement of this internati<strong>on</strong>al manufacturing company uses the following linemanagementcertificati<strong>on</strong> form to:• Communicate a t<strong>on</strong>e from the top regarding management’s expectati<strong>on</strong>sabout the quality of financial reporting• Establish ownership of meaningful financial reporting risks and relatedkey c<strong>on</strong>trols throughout the organizati<strong>on</strong>• Routinely receive acknowledgement, through self-assessment by linemanagers, regarding the effective operati<strong>on</strong> of key c<strong>on</strong>trolsTable of C<strong>on</strong>tentsBackground and Instructi<strong>on</strong>s 2Quarterly and Annual Management Representati<strong>on</strong>s 4Explanati<strong>on</strong>s 10


Appendix B-2 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Background and Instructi<strong>on</strong>s1. The CEO and CFO are required to make an evaluati<strong>on</strong> of disclosure c<strong>on</strong>trolsand procedures in c<strong>on</strong>necti<strong>on</strong> with the filing of Forms 10-Q and 10-K with theU.S. Securities and Exchange Commissi<strong>on</strong>. Resp<strong>on</strong>ses c<strong>on</strong>tained in the attachedquesti<strong>on</strong>naire will be used in their evaluati<strong>on</strong> of disclosure c<strong>on</strong>trols andprocedures in c<strong>on</strong>necti<strong>on</strong> with the following report:Form 10-Q for the quarterly period ended March 31, 20XX2. Please Note: your resp<strong>on</strong>ses to this questi<strong>on</strong>naire are intended to support andprovide reas<strong>on</strong>able assurance that certificati<strong>on</strong>s made by the CEO and CFO to theSecurities and Exchange Commissi<strong>on</strong>, the Audit Committee and our shareholdersare correct and accurate. Certain of these certificati<strong>on</strong>s, if incorrect, could result insevere penalties including criminal penalties. You should resp<strong>on</strong>d to thisquesti<strong>on</strong>naire as if you were making these certificati<strong>on</strong>s yourself and as ifpenalties could apply to you pers<strong>on</strong>ally (in some cases they can).3. This questi<strong>on</strong>naire is an integral part of the evaluati<strong>on</strong> process. You areprimarily resp<strong>on</strong>sible for answering the following questi<strong>on</strong>s for the line ofbusiness and/or functi<strong>on</strong>al area(s) of the Company that you supervise. Answersshould be based up<strong>on</strong> the knowledge that a reas<strong>on</strong>able pers<strong>on</strong> might c<strong>on</strong>clude youshould have as the manager of the area(s) that you supervise. Please note: if youare aware of a reportable item that does not fall within your functi<strong>on</strong>al area ofresp<strong>on</strong>sibility, you should still report it. Do not assume that some<strong>on</strong>e else hasreported it <strong>on</strong> his or her questi<strong>on</strong>naire.4. Please review each questi<strong>on</strong> and resp<strong>on</strong>d by marking either Yes, No or N/A.Unless otherwise indicated, all questi<strong>on</strong>s require a resp<strong>on</strong>se. Explanati<strong>on</strong>s shouldbe provided for all “No” all “N/A” resp<strong>on</strong>ses for which the reas<strong>on</strong> is not obvious,except for questi<strong>on</strong>s B.8, G.16 and H.7, which require explanati<strong>on</strong> if “Yes” or“N/A” answers are provided. The explanati<strong>on</strong>s are to be provided in the areabeginning <strong>on</strong> page 9. Attach any informati<strong>on</strong> or documentati<strong>on</strong> that you feel isappropriate and relevant to support your resp<strong>on</strong>se(s).5. Many of the questi<strong>on</strong>s address materiality. For purposes of this questi<strong>on</strong>naire,unless otherwise indicated, use your judgment for what is c<strong>on</strong>sidered material. Aseries of related transacti<strong>on</strong>s should be combined when determining materiality.Any transacti<strong>on</strong> or event that might cause a violati<strong>on</strong> of a loan covenant or whichinvolves fraud should always be c<strong>on</strong>sidered material regardless of the dollaramount. Any questi<strong>on</strong> that involves the override, suspensi<strong>on</strong> or effective operati<strong>on</strong>of a c<strong>on</strong>trol procedure should be c<strong>on</strong>sidered material if it could be c<strong>on</strong>sideredreas<strong>on</strong>ably likely to result in a material affect now or in the future.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix B-36. You should report any situati<strong>on</strong> that has occurred since the end of the mostrecent year-end or quarter that was not reported <strong>on</strong> a previous questi<strong>on</strong>naire.7. Your resp<strong>on</strong>ses to the questi<strong>on</strong>s c<strong>on</strong>tained in the attached questi<strong>on</strong>naire shouldrelate directly to the plant site for which you are resp<strong>on</strong>sible.8. This quarterly and annual management representati<strong>on</strong>, including theacknowledgment and signatures that follow, should be emailed to ____ by thefollowing deadline:April XX, 20XX9. If you have questi<strong>on</strong>s regarding how to resp<strong>on</strong>d properly to particularquesti<strong>on</strong>s c<strong>on</strong>tained in the questi<strong>on</strong>naire, you should direct them to theCorporate C<strong>on</strong>troller.Acknowledgment and Signatures:10. We recognize that we hold important roles in the disclosure c<strong>on</strong>trols andprocedures of the company, and that informati<strong>on</strong> we provide is used in thecompany’s quarterly and annual filings with the U.S. Securities and ExchangeCommissi<strong>on</strong>. We c<strong>on</strong>firm that the resp<strong>on</strong>ses to the questi<strong>on</strong>s c<strong>on</strong>tained in thismemorandum, as well as any additi<strong>on</strong>al notes or attachments, properly reflectour representati<strong>on</strong>s:Name: ________________________________Title: ________________________________Date: ________________________________Name: ________________________________Title: ________________________________Date: ________________________________


Appendix B-4 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Quarterly and Annual Management Representati<strong>on</strong>sA. Significant Accounting Policies — Revenue Recogniti<strong>on</strong>1. For all sales recognized during the period:a. Was there persuasive evidence that a sales arrangement existedbetween our customer and us prior to the end of the period?b. Had the products been delivered or had the services been renderedprior to the end of the period?c. Was our sales price fixed or determinable prior to the end of theperiod?d. Was collectibility from our customer reas<strong>on</strong>ably assured prior to theend of the period?2. Were all significant sales transacti<strong>on</strong>s of a normal, recurring nature?3. Were the product mix, nature of customers, terms of sale, credit policies,and related items similar to those of prior periods?B. Significant Accounting Policies — Other Than Revenue Recogniti<strong>on</strong>1. Have interplant transacti<strong>on</strong>s been accounted for in designated generalledger accounts?2. Have the results of joint ventures in which the company does not have ac<strong>on</strong>trolling financial interest been included in the general ledger using theequity method of accounting?3. Have the general ledger accounts been translated (or remeasured) fromlocal currency to the U.S. dollar at rates of exchange issued byCorporate Finance <strong>on</strong> a m<strong>on</strong>thly basis?4. Have all expenditures related to new product development been chargedto expense as incurred?5. Has the cost basis of inventories been determined <strong>on</strong> a first-in, first-outbasis?6. Has property, plant, and equipment been capitalized and depreciated inaccordance with companywide guidelines established by CorporateFinance?7. Were items not meeting the criteria for capitalizati<strong>on</strong> expensed?Yes No N/A


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix B-58. Have there been any events or changes in circumstances that indicatethe carrying amount of a l<strong>on</strong>g-lived asset may not be recoverable?Triggering events that you should c<strong>on</strong>sider include:− Significant decrease in the market price− A significant adverse change in legal factors or business climate− Accumulati<strong>on</strong> of significant excess costs bey<strong>on</strong>d originalexpectati<strong>on</strong>s for assets c<strong>on</strong>structed or acquired− C<strong>on</strong>tinuing operating cash flow loss associated with the asset use− Expectati<strong>on</strong> of sale/disposal significantly before the end of theestablished useful lifeC. Judgments and Estimates — Allowances for Doubtful Accounts1. Have accounts receivable balances that are more than 60 days past duebeen reviewed at or near the end of the period for purposes of formingjudgments as to the likelihood of collectibility?2. Has trend informati<strong>on</strong> been reviewed within the last 12 m<strong>on</strong>ths todetermine whether a normal and predictable pattern of accountsreceivable write-offs exists?Yes No N/A3. Has an allowance for doubtful accounts been established in an amount equal to the sum of:a. The amount of specifically identified accounts receivable balanceswhose collectibility is doubtful; andb. The best estimate of the remaining accounts receivable balanceswhose collectibility is doubtful?4. Have you c<strong>on</strong>sidered whether any factors have occurred since trendinformati<strong>on</strong> was last reviewed that would influence the “best estimate”referred to in questi<strong>on</strong> C.3.b?5. Have provisi<strong>on</strong>s and write-offs that are related to credit issues beencharged to bad debt expense?6. Have provisi<strong>on</strong>s and write-offs that are related to pricing (such as forrebates or volume discounts) or other matters of disputes settled in thecustomer’s favor been charged as a reducti<strong>on</strong> to sales?D. Judgments and Estimates — Reserves for Inventories1. Have reserves been established to reduce the carrying value ofinventories to its net realizable value whenever the quantity <strong>on</strong> handexceeds expected demand?2. In establishing the reserves referred to in questi<strong>on</strong> D.1, have inventoryusage reports (such as “two years no usage”) been reviewed in the mostrecent fiscal quarter (or more frequently)?


Appendix B-6 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 20083. Have reserves been established to reduce similar types of inventory toits net realizable value, regardless of demand, whenever the aggregatecarrying value is more than the aggregate market value of thatinventory?4. Have you c<strong>on</strong>sidered whether there have been any decreases in themarket value of inventory that would trigger an evaluati<strong>on</strong> of the need forthe reserve referred to in questi<strong>on</strong> D.3?E. Judgments and Estimates — Warranty Accruals1. Have warranty accruals been established for specifically identifiedwarranty issues that are probable to result in future cost?2. Do the specific warranty accruals referred to in questi<strong>on</strong> E.1 reflect thebest estimate of the future costs?3. Have the specific warranty accruals referred to in questi<strong>on</strong> E.1 beenreviewed at or near the end of the period?4. Has a warranty accrual been established <strong>on</strong> a n<strong>on</strong>-specific basis forestimated remaining future costs that will be incurred <strong>on</strong> product that wassold through the end of the period?5. In establishing the n<strong>on</strong>-specific warranty accrual referred to in questi<strong>on</strong>E.4, was trend informati<strong>on</strong> reviewed in the most recent fiscal quarter (ormore frequently)?6. In establishing the n<strong>on</strong>-specific warranty accrual referred to in questi<strong>on</strong>E.4, have extended warranty obligati<strong>on</strong>s been given specialc<strong>on</strong>siderati<strong>on</strong>?7. Has care been taken not to over-provide for warranty costs byinadvertently doubling up <strong>on</strong> accruals in both the specific and n<strong>on</strong>specificporti<strong>on</strong>s of the warranty accrual?F. Judgments and Estimates — Accruals for Loss C<strong>on</strong>tingencies1. Have all loss c<strong>on</strong>tingencies been accrued for when a future loss isprobable and the amount can be reas<strong>on</strong>ably estimated? (A “lossc<strong>on</strong>tingency” is an existing c<strong>on</strong>diti<strong>on</strong>, situati<strong>on</strong>, or set of circumstancesinvolving uncertainty as to a possible loss to the company that willultimately be resolved when <strong>on</strong>e or more future events occur or fail tooccur.)2. Have all accruals for loss c<strong>on</strong>tingencies been reviewed at or near theend of the period?3. Have all known loss c<strong>on</strong>tingencies been communicated to MarkHartman, the Corporate C<strong>on</strong>troller?Yes No N/A


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix B-7G. <strong>Internal</strong> Accounting C<strong>on</strong>trol <strong>Systems</strong>1. Have basic internal accounting c<strong>on</strong>trols been established andmaintained, giving careful thought to segregati<strong>on</strong> of duties, to ensure thevalidity, accuracy, and completeness of recorded transacti<strong>on</strong>s?2. Have appropriate cut-off procedures been established and maintained toensure proper recogniti<strong>on</strong> of revenues and expenses in appropriate fiscalquarters, and to properly reflect assets, liabilities, and equity at the endof each fiscal quarter?Yes No N/A3. Has detailed informati<strong>on</strong> been rec<strong>on</strong>ciled to the general ledger c<strong>on</strong>trol accounts <strong>on</strong> a m<strong>on</strong>thlybasis for:a. Cash?b. Accounts receivable?c. Inventories?d. Accounts payable?e. All other accounts with significant activity?4. For accounts that do not have significant activity:a. Was there a clear understanding of the details of the accountbalances at the end of each fiscal quarter?b. Was the detailed informati<strong>on</strong> for such accounts rec<strong>on</strong>ciled to thegeneral ledger c<strong>on</strong>trol accounts <strong>on</strong> a periodic basis (at leastannually)?5. Have interplant accounts been rec<strong>on</strong>ciled <strong>on</strong> a m<strong>on</strong>thly basis?6. Have rec<strong>on</strong>ciliati<strong>on</strong>s of cash balances <strong>on</strong> bank statements to our internalaccounting records been performed <strong>on</strong> a timely basis after receivingthose statements?7. For all rec<strong>on</strong>ciliati<strong>on</strong>s, were all rec<strong>on</strong>ciling items investigated in a timelymanner and of the type and amount that would be c<strong>on</strong>sidered normaland recurring?8. Have internal financial records been reviewed analytically by financialmanagement as a means to highlight potential failures of basicaccounting c<strong>on</strong>trols that may need to be investigated and resolved?9. Are managers of the company provided with financial reports that:a. Enable them to m<strong>on</strong>itor performance?b. Provide them the ability to form judgments about the validity,accuracy, and completeness of reported amounts?10. Have c<strong>on</strong>trols been established and maintained to ensure that assetsand the accounting records are adequately safeguarded to prevent lossor theft?


Appendix B-8 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 200811. Have approval and resp<strong>on</strong>sibility levels been established for all businesstransacti<strong>on</strong>s to ensure that transacti<strong>on</strong>s are executed in accordance withmanagement’s authorizati<strong>on</strong>s?12. Are the approval levels referred to in questi<strong>on</strong> G.11 at least as restrictiveas necessary to meet corporate requirements?13. Has corrective acti<strong>on</strong> been taken to address all known instances ofn<strong>on</strong>compliance with internal accounting c<strong>on</strong>trol procedures, whetherintenti<strong>on</strong>al or unintenti<strong>on</strong>al?14. Have all recommendati<strong>on</strong>s for changes in internal accounting c<strong>on</strong>trolprocedures resulting from corporate internal audit or Management’sAssessment of <strong>Internal</strong> C<strong>on</strong>trol Over Financial Reporting activities beenimplemented in accordance with established timelines?15. Have all recommendati<strong>on</strong>s for changes in internal accounting c<strong>on</strong>trolprocedures that resulted from external audit activities beenimplemented or, if not, has an implementati<strong>on</strong> plan been discussed andagreed to with the Company’s Director, <strong>Internal</strong> Audit?16. Have there been any significant changes to the system of internalaccounting c<strong>on</strong>trols?17. If the answer to questi<strong>on</strong> G.16 is “Yes,” have the significant changes tothe system of internal accounting c<strong>on</strong>trols been discussed with andagreed to by the Company’s Corporate C<strong>on</strong>troller?H. Other Representati<strong>on</strong>s1. Have all leases been reviewed to ensure they are operating leasesrather than capital leases?2. Are all procedures associated with accounts payable and accruedexpenses c<strong>on</strong>sistent with the procedures used for previous quarters?3. Are the methods used to allocate expenses between and am<strong>on</strong>gquarterly periods (<strong>on</strong> the basis of revenue, benefits, time or activityassociati<strong>on</strong>) c<strong>on</strong>sistent with the methods used for previous quarters?4. Are expense classificati<strong>on</strong>s c<strong>on</strong>sistent with prior year-endclassificati<strong>on</strong>s?5. Has complete and accurate informati<strong>on</strong> been provided to CorporateFinance when requested?6. Have all financial records and related data been made available to ourindependent registered public accounting firm?7. Based <strong>on</strong> your knowledge, are you aware of any of the following:a. Weakness in internal c<strong>on</strong>trol that could lead to material losses orreporting errors?b. Fraud or defalcati<strong>on</strong>, regardless of materiality, involving a Companymanager or an employee with a significant role in internal c<strong>on</strong>trols?Yes No N/A


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix B-9c. Material transacti<strong>on</strong>s which you have reas<strong>on</strong> to believe may not beaccounted for in accordance with accounting principles generallyaccepted in the United States?d. Unresolved Ethics Policy violati<strong>on</strong>?e. Violati<strong>on</strong>s of security or other laws or regulati<strong>on</strong>s that could havematerially adverse c<strong>on</strong>sequences?f. Material instances where business system generated results havebeen overridden?g. Material completed transacti<strong>on</strong>s that have not yet been recorded <strong>on</strong>the Company’s books?h. Incomplete or pending transacti<strong>on</strong>s that have prematurely beenrecorded <strong>on</strong> the Company’s books?i. Changes in material assumpti<strong>on</strong>s that are used in the applicati<strong>on</strong> ofany accounting method that have not previously been discussed andcleared through Corporate Finance?j. New off-balance sheet relati<strong>on</strong>ships, l<strong>on</strong>g-term c<strong>on</strong>tracts, leasecommitments, employment c<strong>on</strong>tracts or similar arrangements thatobligates or c<strong>on</strong>tingently obligates the Company in a materialamount?k. Material transacti<strong>on</strong>s that are unusual, n<strong>on</strong>-recurring or otherwiseoutside the Company’s normal course of business?l. Material title defects to any Company-owned assets?m. Material violati<strong>on</strong>s or breaches in any c<strong>on</strong>tractual obligati<strong>on</strong>s of theCompany?n. Issues raised by regulators or tax examiners that could result inmaterially adverse c<strong>on</strong>sequences?o. Instances where the Company’s assets have been pledged ascollateral?p. Other item(s) that is not otherwise covered in this questi<strong>on</strong>naire thatcould materially affect the Company’s results of operati<strong>on</strong>s, or cashflows for the period, or the carrying value of its assets or liabilities orits financial c<strong>on</strong>diti<strong>on</strong> at the end of the period?Yes No N/A


Appendix B-10 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008Explanati<strong>on</strong>s11. Provide below explanati<strong>on</strong>s for all “No” and “N/A” resp<strong>on</strong>ses, with theexcepti<strong>on</strong> of questi<strong>on</strong>s B.8, G.16 and H.7, which require explanati<strong>on</strong> if “Yes” or“N/A” resp<strong>on</strong>se is provided.Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #Questi<strong>on</strong> #


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix C-1Quarterly and Annual Disclosure Committee ReviewProcedures ChecklistRelated to Example 38:Notes about the materialThis internati<strong>on</strong>al manufacturer has formed what it refers to as a Quarterly andAnnual Disclosure Committee (QADC). This committee uses the followingchecklist to ensure that they have reviewed and c<strong>on</strong>sidered informati<strong>on</strong> about risksand c<strong>on</strong>trols in areas of identified meaningful risk.


Appendix C-2 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008At the end of each quarter the QADC will:Review and discuss the following:• CEO/CFO evaluati<strong>on</strong> of disclosure c<strong>on</strong>trols and procedures and commentsrelevant to evaluati<strong>on</strong> document;• Summary of resp<strong>on</strong>ses to annual and quarterly managementrepresentati<strong>on</strong>s (see Appendix B);• Summary of quarterly changes to design of internal c<strong>on</strong>trol overfinancial reporting;• Areas of significant process variati<strong>on</strong> (at least <strong>on</strong>ce a year — if this reviewwas not completed in the current quarter, indicate when it waslast completed);• Review of the scope of management’s evaluati<strong>on</strong> (financial analytics andqualitative review to determine the scope of management’s review ofinternal c<strong>on</strong>trol over financial reporting; and• Review of management assessment status reports (plan for the testing ofthe operating effectiveness of internal c<strong>on</strong>trols over financial reporting, aswell as other audits of the organizati<strong>on</strong>) and summary of c<strong>on</strong>troldeficiencies (SOCD) (results of tests of the operating effectiveness ofinternal c<strong>on</strong>trols over financial reporting.)Review a written or oral summary of the following:• Pending or threatened litigati<strong>on</strong>, claims, and assessments;• Summary of relevant ethics hotline communicati<strong>on</strong>s and the businessc<strong>on</strong>duct and oversight committee violati<strong>on</strong> reporting tracking;• <strong>Internal</strong> audit/risk assessment status, including completed projects andstatus of findings/disclosures;• Restructuring/reorganizati<strong>on</strong> activities;• Communicati<strong>on</strong>s/issues with outside auditors;• Global policy review process status; and• Any other matters relevant to forming the c<strong>on</strong>clusi<strong>on</strong>s noted below.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix C-3As a committee, form c<strong>on</strong>clusi<strong>on</strong>s regarding the following:• The effectiveness of disclosure c<strong>on</strong>trols and procedures as of the end ofthe period covered by each Form 10-Q and Form 10-K (include thec<strong>on</strong>clusi<strong>on</strong> in the report to the CEO and CFO);• The effectiveness of internal c<strong>on</strong>trol over financial reporting at the end ofthe fiscal year, separately c<strong>on</strong>sidering design effectiveness and operatingeffectiveness (this procedure is applicable <strong>on</strong>ly in the final quarter of theyear — include the c<strong>on</strong>clusi<strong>on</strong> in the report to the CEO and CFO); and• Whether any material changes were present in internal c<strong>on</strong>trol overfinancial reporting or other disclosure c<strong>on</strong>trols and procedures during thequarter most recently ended (include any such changes in the report to theCEO and CFO).Prepare the following written documentati<strong>on</strong>:• Agenda and c<strong>on</strong>clusi<strong>on</strong>s for committee’s report to CEO and CFO; and• Documentati<strong>on</strong> review notes to be distributed to preparers ofdocumentati<strong>on</strong> reviewed as part of the meeting.


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix D-1Enterprise-Wide Risk MatrixRelated to Example 18:Notes about the materialThe following risk matrix c<strong>on</strong>tains excerpts from multiple places within a retailchain company’s larger enterprise-wide risk analysis. It is presented <strong>on</strong>ly todem<strong>on</strong>strate a possible format for a formal risk analysis that might also be used toassign m<strong>on</strong>itoring resp<strong>on</strong>sibilities. It also dem<strong>on</strong>strates how the organizati<strong>on</strong>identifies and c<strong>on</strong>siders changes to risks between periods.Note that these excerpts are not intended to, and do not present all of the riskc<strong>on</strong>siderati<strong>on</strong>s this company c<strong>on</strong>sidered in each area.


Appendix D-2 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix D-3


Appendix D-4 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix D-5


Appendix D-6 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix D-7


Appendix D-8 | | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008


| | | | | COSO <str<strong>on</strong>g>Guidance</str<strong>on</strong>g> <strong>on</strong> M<strong>on</strong>itoring June 2008 Appendix D-9

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!