TIAPS ALB_Module 2E. Data Analytics for Internal Auditing

07.08.2023 Views

2E. Data Analytics for Internal Auditing 2E Learning Outcomes On completion of this section, students will be better able to: • Describe tools and methods used in data analytics. • Select appropriate data analytics techniques. 2E.1 Data Analytics and Internal Auditing IIA Internal Audit Competency Framework: Information Technology General Awareness: Describe the basic concepts of IT and data analytics. Describe the various risks related to IT, information security, and data privacy. Recognize the purpose and applications of IT control frameworks and basic IT controls. Applied Knowledge: Apply data analytics and IT in auditing. Identify and assess various risks related to IT, information security, and data privacy. Apply IT control frameworks. Expert: Evaluate the use of data analytics and IT in auditing. Recommend actions to address IT risks, information security, and data privacy. Evaluate the use of IT control frameworks. 62 The opportunity to access and analyze large amounts of data has been considerably enhanced through technology. This is true for organizational managers as well as the internal audit function. There are many potential benefits, including: • Improving risk identification, analysis, and control. • Increasing the level of assurance auditors can provide. • Enhancing efficiency. • Providing clearer reporting. • Delivering greater internal audit quality. 63 The ability to be agile and responsive in the face of an ever-changing risk landscape requires the application of sophisticated tools. Often when we refer to data analytics we consider a broad-range of tools and methods that are automated and intelligent. However, many analytical processes and data visualizations can be performed manually (with a calculator or basic spreadsheet functions), albeit with a high degree of human input. Such techniques and tools can be taken together or used in isolation. The role of the human internal auditor is still essential to provide insight, creativity, and judgment. The technology opens previously unimaginable opportunities. This includes: • Accessing, recording, and analyzing large amounts of data very quickly. • Combining internal and external data sets. • Benchmarking performance. • Identifying and reporting unusual transactions, irregularities, and anomalies in real time through continuous monitoring and continuous auditing. • Anticipating issues and addressing them before they occur. 62 Internal Audit Competency Framework, The IIA, 2022. 63 See Wolters Kluwer “Five benefits of data analytics for internal audit.” 70

<strong>2E</strong>. <strong>Data</strong> <strong>Analytics</strong> <strong>for</strong> <strong>Internal</strong> <strong>Auditing</strong><br />

<strong>2E</strong> Learning Outcomes<br />

On completion of this section, students will be better able to:<br />

• Describe tools and methods used in data analytics.<br />

• Select appropriate data analytics techniques.<br />

<strong>2E</strong>.1 <strong>Data</strong> <strong>Analytics</strong> and <strong>Internal</strong> <strong>Auditing</strong><br />

IIA <strong>Internal</strong> Audit Competency Framework: In<strong>for</strong>mation Technology<br />

General Awareness: Describe the basic concepts of IT and data analytics. Describe the<br />

various risks related to IT, in<strong>for</strong>mation security, and data privacy. Recognize the purpose and<br />

applications of IT control frameworks and basic IT controls.<br />

Applied Knowledge: Apply data analytics and IT in auditing. Identify and assess various risks<br />

related to IT, in<strong>for</strong>mation security, and data privacy. Apply IT control frameworks.<br />

Expert: Evaluate the use of data analytics and IT in auditing. Recommend actions to address<br />

IT risks, in<strong>for</strong>mation security, and data privacy. Evaluate the use of IT control frameworks. 62<br />

The opportunity to access and analyze large amounts of data has been considerably<br />

enhanced through technology. This is true <strong>for</strong> organizational managers as well as the<br />

internal audit function. There are many potential benefits, including:<br />

• Improving risk identification, analysis, and control.<br />

• Increasing the level of assurance auditors can provide.<br />

• Enhancing efficiency.<br />

• Providing clearer reporting.<br />

• Delivering greater internal audit quality. 63<br />

The ability to be agile and responsive in the face of an ever-changing risk landscape<br />

requires the application of sophisticated tools. Often when we refer to data analytics we<br />

consider a broad-range of tools and methods that are automated and intelligent. However,<br />

many analytical processes and data visualizations can be per<strong>for</strong>med manually (with a<br />

calculator or basic spreadsheet functions), albeit with a high degree of human input. Such<br />

techniques and tools can be taken together or used in isolation. The role of the human<br />

internal auditor is still essential to provide insight, creativity, and judgment. The technology<br />

opens previously unimaginable opportunities. This includes:<br />

• Accessing, recording, and analyzing large amounts of data very quickly.<br />

• Combining internal and external data sets.<br />

• Benchmarking per<strong>for</strong>mance.<br />

• Identifying and reporting unusual transactions, irregularities, and anomalies in real<br />

time through continuous monitoring and continuous auditing.<br />

• Anticipating issues and addressing them be<strong>for</strong>e they occur.<br />

62<br />

<strong>Internal</strong> Audit Competency Framework, The IIA, 2022.<br />

63<br />

See Wolters Kluwer “Five benefits of data analytics <strong>for</strong> internal audit.”<br />

70


The purpose remains to identify weaknesses in risk management and control and to<br />

implement improvements. Like any tool, their utilization is dependent on the intelligence and<br />

creativity of the user. Application of technology does not guarantee better outcomes. Poorly<br />

used tools that are not well understood by the auditor may produce confusing, misleading, or<br />

inaccurate findings.<br />

<strong>2E</strong>.1: Reflection<br />

To what extent does your internal audit unit use data analytics as part of its work?<br />

What expectations do your clients and stakeholders have regarding the use of data<br />

analytics?<br />

What is the greatest barrier to greater use of data analytics?<br />

71


<strong>2E</strong>.2 <strong>Data</strong> <strong>Analytics</strong> Methods<br />

Analytical methods can be grouped according to their main purpose.<br />

• Descriptive methods are designed to report activity and often includes aggregating<br />

and summarizing large amounts of data using averaging and other techniques <strong>for</strong><br />

making comparisons.<br />

• Diagnostic methods are used to interpret in<strong>for</strong>mation and identify likely causal<br />

relationships and trends.<br />

• Predictive methods are used to make <strong>for</strong>ecasts by extrapolating known data and<br />

creating models based on trends and known interdependencies and correlations.<br />

• Prescriptive methods go one step further than predictive methods and suggest<br />

actions to optimize future per<strong>for</strong>mance.<br />

Prior to applying any analytical technique it will be important to validate the data and apply<br />

data hygiene techniques, removing duplicates and inconsistencies. Unstructured data (like<br />

emails, social media posts, contracts, and recordings of phone calls) must be organized and<br />

structured be<strong>for</strong>e it is possible to process it. The analysis can only be as good as the data<br />

you start with. Common types of data validation checks include:<br />

• <strong>Data</strong> type check, confirming the entry of data in a data field is consistent.<br />

• Code check, confirming data con<strong>for</strong>ms to valid values according to set rules.<br />

• Range check, confirming data falls within any set parameters.<br />

• Format check, confirming data consistently matches defined <strong>for</strong>mats.<br />

• Consistency check, confirming logical consistency that matches the process or<br />

activity recorded.<br />

• Uniqueness check, confirming identifiers such as IDs or emails are unique. 64<br />

The following analytical methods are described below and may be utilized manually or by<br />

applying technological tools:<br />

• Variance Analysis.<br />

• Trend Analysis.<br />

• Reasonableness Testing.<br />

• Ratio Estimation.<br />

• Benchmarking.<br />

Many other methods (e.g., decision trees, time series, fuzzy logic) are also available.<br />

<strong>2E</strong>.2.1 Variance Analysis<br />

Variance analysis involves comparing two similar sets of data and attempting to find reasons<br />

<strong>for</strong> any differences. Typically the comparison is between actual outcomes and one or more<br />

of the following:<br />

• Expected or desired outcomes.<br />

• Predicted or <strong>for</strong>ecast outcomes.<br />

• Budgeted outcomes.<br />

• Historical outcomes.<br />

• Comparable benchmarks.<br />

64<br />

See <strong>Data</strong> Validation, Corporate Finance Institute, 2023.<br />

72


This can help managers identify and react to problems or opportunities. Some causes of<br />

variances are purely random and can be eliminated. The comparison of two sets of data can<br />

help determine the extent to which they are correlated.<br />

Variance analysis is discussed further in <strong>Module</strong> 3.<br />

<strong>2E</strong>.2.2 Trend Analysis<br />

Trends are changes (or variances) in data over time. The changes observed may be:<br />

• Random, to be identified and eliminated or ignored.<br />

• Cyclical, recurring over short cycles, such as higher demands <strong>for</strong> customer services<br />

at certain times of the day or week.<br />

• Seasonal, recurring over longer cycles, such as peaks and troughs in sales of ice<br />

cream over a year.<br />

• Underlying trends, being the true long-term pattern, often over multiple years, having<br />

isolated random, cyclical, and seasonal factors. Often underlying trends are most<br />

apparent when we can compare data from the some point in a cycle, season, or year<br />

over multiple cycles, seasons, or years.<br />

<strong>2E</strong>.2.3 Reasonableness Testing<br />

Reasonableness testing is another <strong>for</strong>m of variance or trend analysis in which reported or<br />

apparent per<strong>for</strong>mance is compared with what might reasonably have been expected, once<br />

the <strong>for</strong>ecast is adjusted to take account of everything that is known. Variances may highlight<br />

errors or deliberate misstatements. When there seems to be no reasonable explanation,<br />

when things look too good or too bad to be true, then it deserves further investigation.<br />

<strong>2E</strong>.2.4 Ratio Estimation<br />

Findings based on a sample of data can be extrapolated to make assumptions about the<br />

remaining data or used as the basis <strong>for</strong> <strong>for</strong>ecasting. Larger samples help reduce the<br />

likelihood of bias but there is no guarantee the sample is representative of the whole<br />

population. Statistical modeling is used to calculate the degree of confidence in the analysis.<br />

<strong>2E</strong>.2.5 Benchmarking<br />

Comparing actual per<strong>for</strong>mance with benchmarking data can help identify errors,<br />

weaknesses, and opportunities <strong>for</strong> improvement to align more closely with best practice.<br />

<strong>2E</strong>.2: Reflection<br />

Consider these commonly used methods <strong>for</strong> analysis of data:<br />

Variance analysis<br />

Trend analysis<br />

Reasonable testing<br />

Ratio estimation<br />

Benchmarking<br />

Which of these do you commonly use?<br />

Which of these do you feel you need more help in developing your competency?<br />

73


<strong>2E</strong>.3 <strong>Data</strong> <strong>Analytics</strong> Tools<br />

To help with the heavy lifting, auditors can take advantage of a wide array of technological<br />

solutions all of which are being used increasingly in service delivery, marketing, sales,<br />

human resources, finance, budgeting, and accounting. There are audit specific applications<br />

– both customized and off-the-shelf – <strong>for</strong>:<br />

• Smart apps.<br />

• Utilization of big data.<br />

• Artificial intelligence.<br />

• Machine learning.<br />

• Natural Language Processing NLP.<br />

• Robotic process automation.<br />

• Drones.<br />

• Artificial reality.<br />

Many proprietary tools are available. Vendors often provide consultation, technical support,<br />

and training to aid the adoption of solutions. Comparison websites are useful to help identify<br />

suitable options depending on organizational need and available resources. 65<br />

For the internal audit function, such enablers may be used to support the following:<br />

• Remote auditing, using drones, artificial reality, robots, teleconferencing, and other<br />

similar tools.<br />

• Automated audit management, using audit software <strong>for</strong> planning, communication,<br />

storage and access, reporting, supervision, monitoring, and open issue tracking.<br />

• Advanced data analytics, using number-crunching, machine learning, artificial<br />

intelligence, and data visualization tools.<br />

• <strong>Internal</strong> cooperation and collaboration with other functions, especially assurance<br />

providers, through alignment with governance, risk management, and internal control<br />

plat<strong>for</strong>ms.<br />

• Significant reduction of manual and repetitive tasks and unnecessary duplication of<br />

data sets through robot process automation and reconciliation.<br />

• Continuous auditing through artificial intelligence.<br />

Artificial intelligence (AI) is a “hot topic” which much discussion about apps such as Chat<br />

GPT which may revolutionize many activities. It is not possible to predict exactly how AI will<br />

impact internal auditing but it is clear it creates new opportunities. Manual tasks such as data<br />

extraction can be automated much more quickly and without errors. Rather than relying on a<br />

sample, AI can per<strong>for</strong>m analytics on complete population sets and in real time to identify<br />

trends, anomalies, errors, and potential fraud. AI can also anticipate new and emerging risks<br />

through rigorous interrogation of historical and recent data.<br />

<strong>Internal</strong> audit functions are often criticized <strong>for</strong> being slow to adopt technology in comparison<br />

with other functions. A recent article recounted the excuses commonly given by auditors:<br />

• Don’t have the budget.<br />

• Don’t have the time.<br />

• Don’t have the right people.<br />

65<br />

See <strong>for</strong> example, The Best <strong>Data</strong> <strong>Analytics</strong> Tools & Software of 2023, Forbes, 2023.<br />

74


• Don’t have the right leadership.<br />

• Don’t have proper support.<br />

• Don’t have the right knowledge on the team.<br />

• Inertia and complacency. 66<br />

What can internal audit do about these obstacles? A lack of the right people and sufficient<br />

budget can be significant inhibitors which is why it is necessary to persuade senior<br />

management and the governing body. <strong>Internal</strong> audit managers should develop a robust<br />

strategic plan aligned with organizational priorities and based on a clear vision of an<br />

advanced, agile, and responsive function in which utilization of technology plays a central<br />

role. The mission of helping management and the board make timely interventions to<br />

support organizational success is the justification needed <strong>for</strong> investing in internal audit digital<br />

trans<strong>for</strong>mation. To attract the best talent and to deliver the maximum value requires audit<br />

functions to be leaders of innovation. It can be easy to be complacent about the current state<br />

and essential to break that mindset in favor of continuous positive momentum, even if taken<br />

incrementally. Audit leaders can start small and build on success. Senior management and<br />

the governing body may not be pressing the audit function to change but it should be part of<br />

every auditor’s DNA to strive <strong>for</strong> continual improvement. Sometimes an external quality<br />

review can help provide added weight to the case <strong>for</strong> investment in technology. As the<br />

advocate <strong>for</strong> continuous improvement, audit managers need to implement processes <strong>for</strong><br />

identifying and evaluating opportunities <strong>for</strong> improving the delivery of service excellence.<br />

In addition to the use the internal audit function may make of artificial intelligence and other<br />

technological innovations, they also represent potential opportunities and threats <strong>for</strong> other<br />

parts of an organization. <strong>Internal</strong> auditors need to be well in<strong>for</strong>med to be able to offer<br />

meaningful assurance, insight, and advice. The IIA has produced a three part series to help<br />

internal auditors. 67 The guidance references four different kinds of AI:<br />

Type I. Reactive machines: This is AI at its simplest. Reactive machines respond to<br />

the same situation in exactly the same way, every time. An example of this is a<br />

machine that can beat world-class chess players because it has been programmed<br />

to recognize the chess pieces, know how each moves, and can predict the next<br />

move of both players.<br />

Type II. Limited memory: Limited memory AI machines can look to the past, but the<br />

memories are not saved. Limited memory machines cannot build memories or “learn”<br />

from past experiences. An example is a self-driving vehicle that can decide to change<br />

lanes because a moment ago it noted an obstacle in its path.<br />

Type III. Theory of mind: Theory of mind refers to the idea that a machine could<br />

recognize that others it interacts with have thoughts, feelings, and expectations. A<br />

machine embedded with Type III AI would be able to understand others’ thoughts,<br />

feelings, and expectations, and be able to adjust its own behavior accordingly.<br />

Type IV. Self-awareness: A machine embedded with Type IV AI would be selfaware.<br />

An extension of “theory of mind,” a conscious or self-aware machine would be<br />

66<br />

Garyn, Hal, “Why Is <strong>Internal</strong> Audit Often A Tech Laggard?” <strong>Internal</strong> Audit 360, 2022.<br />

67<br />

Global Perspectives & Insights, The IIA, various.<br />

75


aware of itself, know about its internal states, and be able to predict the feelings of<br />

others. 68<br />

The guidance also highlights potential opportunities and threats.<br />

Opportunities<br />

• The ability to compress the data processing cycle.<br />

• The ability to reduce errors by replacing human actions with perfectly repeatable<br />

machine actions.<br />

• The ability to replace time-intensive activities with time-efficient activities (process<br />

automation), reducing labor time and costs.<br />

• The ability to have robots or drones replace humans in potentially dangerous<br />

situations.<br />

• The ability to make better predictions, <strong>for</strong> everything from predicting sales of certain<br />

goods in particular markets to predicting epidemics and natural catastrophes.<br />

• The ability to drive revenue and grow market share through AI initiatives.<br />

Threats<br />

• Unidentified human biases are imbedded in the AI technology.<br />

• Human logic errors are imbedded in the AI technology.<br />

• Inadequate testing and oversight of AI results in ethically questionable results.<br />

• AI products and services cause harm, resulting in financial and/or reputational<br />

damage.<br />

• Customers or other stakeholders do not accept or adopt the organization’s AI<br />

initiatives.<br />

• The organization is left behind by competitors if it does not invest in AI.<br />

• Investment in AI (infrastructure, research and development, and talent acquisition)<br />

does not yield an acceptable ROI. 69<br />

Which of these apply to your situation?<br />

<strong>2E</strong>.3: Reflection<br />

Don’t have the budget.<br />

Don’t have the time.<br />

Don’t have the right people.<br />

Don’t have the right leadership.<br />

Don’t have proper support.<br />

Don’t have the right knowledge on the team.<br />

Inertia and complacency (we don’t need to do more – clients and stakeholders are happy).<br />

68<br />

Artificial Intelligence, <strong>Internal</strong> Audit’s Role, and Introducing a New Framework Part 1, The IIA, 2017.<br />

69<br />

Artificial Intelligence, <strong>Internal</strong> Audit’s Role, and Introducing a New Framework Part 1, The IIA, 2017.<br />

76


<strong>2E</strong>.4 <strong>Data</strong> Visualization<br />

Auditors gather data from many sources and in different ways. Examples include:<br />

• Interviewing people or conducting focus groups within or outside of the areas being<br />

audited.<br />

• Using questionnaires or checklists to collect in<strong>for</strong>mation, including observations and<br />

opinions from people who work in or deal with the business area being audited.<br />

• Observing the workings within a business area over a period of time to spot issues or<br />

inconsistencies.<br />

• Vertical auditing, in which the auditor monitors one process from beginning to end to<br />

identify any issues.<br />

• Documenting <strong>for</strong>mal practices and procedures within a business area.<br />

• Accessing in<strong>for</strong>mal documentation that may provide insights into ad hoc processes<br />

and procedures. 70<br />

<strong>Data</strong> must be validated by:<br />

• Evaluating whether the data has come from a reliable source and makes sense in<br />

context with the auditors’ overall understanding of the business area.<br />

• Considering how many sources the data are derived from, as well as how long they<br />

took to obtain, to determine if these factors raise risks to data integrity. 71<br />

<strong>Data</strong> visualization can be defined as<br />

the practice of translating in<strong>for</strong>mation into a visual context, such as a map or graph, to<br />

make data easier <strong>for</strong> the human brain to understand and pull insights from. The main<br />

goal of data visualization is to make it easier to identify patterns, trends and outliers in<br />

large data sets. The term is often used interchangeably with others, including in<strong>for</strong>mation<br />

graphics, in<strong>for</strong>mation visualization and statistical graphics. 72<br />

Software makes it easy to create appealing graphics to communicate key in<strong>for</strong>mation<br />

succinctly and powerfully. It can also be a temptation <strong>for</strong> overelaborate and complex pictures<br />

that obscure more than they reveal. Choice of colors, 3-D effects, font size, animation, and<br />

other graphical elements combined with decisions regarding what data to include and to<br />

what level of detail create challenges <strong>for</strong> an auditor completing a report or preparing a<br />

presentation. 73 Auditors should be familiar with the best way to use pie charts, bar charts,<br />

and so on. Some common techniques are described below, based on a Harvard Business<br />

School list. 74<br />

70<br />

<strong>Data</strong> <strong>Analytics</strong> Part 2: Gathering, Understanding, and Visualizing <strong>Data</strong>, The IIA, 2022.<br />

71<br />

<strong>Data</strong> <strong>Analytics</strong> Part 2: Gathering, Understanding, and Visualizing <strong>Data</strong>, The IIA, 2022.<br />

72<br />

<strong>Data</strong> Visualization, TechTarget, Business <strong>Analytics</strong>, 2022.<br />

73<br />

Examples of data visualization tools can be found at The Best <strong>Data</strong> Visualization Tools of 2023, Forbes, 2023.<br />

74<br />

See Harvard Business School online, https://online.hbs.edu/blog/post/data-visualization-techniques<br />

77


Technique and Description<br />

A pie chart is a segmented circle depicting relative<br />

proportions of categories. Used <strong>for</strong>. An exploded pie<br />

chart highlights a segment or segments of particular<br />

relevance.<br />

A bar graph compare multiple categories of data.<br />

Variants include vertical, horizontal, segmented,<br />

and others.<br />

A histogram looks similar to a bar chart, but it<br />

illustrates how a variable changes.<br />

A Gantt chart organizes events in relation to each<br />

other to show their relative timing, how they are<br />

linked, and their current status.<br />

A heat map organizes data with different colors<br />

(often using a spectrum from cold to hot) to indicate<br />

relative size and significance.<br />

A box and whisker diagram illustrates frequency<br />

and marks the upper and lower quartiles in the <strong>for</strong>m<br />

of a box and the median as a line inside the box.<br />

The “whiskers” show the range from the highest and<br />

lowest values.<br />

A waterfall chart shows a stepwise progress of a<br />

variable in relation to another factor.<br />

An area chart is a line graph under which the areas<br />

are shaded.<br />

A scatter plot illustrates the relationship between<br />

two variables.<br />

A pictogram uses a relevant icon or picture to show<br />

relative size or changes in a variable. The picture<br />

may be repeated or scaled in proportion.<br />

A timeline depicts related in<strong>for</strong>mation arranged in<br />

chronological order.<br />

A highlight table deploys colors within a data grid<br />

to show areas of significance.<br />

A bullet graph variation of a simple bar graph to<br />

show live data variances with benchmarks, targets,<br />

or expected values.<br />

A choropleth map is a shaded geographical map.<br />

A word cloud is an array of words using font size to<br />

show relative frequency.<br />

A network diagram comprises nodes and links that<br />

illustrate connections between different points.<br />

A correlation matrix uses colors to emphasize<br />

emphasis and appeal.<br />

Usefulness<br />

Useful <strong>for</strong> conveying simple messages<br />

about comparative weightings<br />

Useful <strong>for</strong> quick comparison of size.<br />

Useful <strong>for</strong> illustrating changes over<br />

time or in relation to another variable.<br />

Useful <strong>for</strong> project management.<br />

Among other applications, heat maps<br />

are often used to show risk data.<br />

Useful <strong>for</strong> communicating frequency<br />

data and its relative spread.<br />

Useful <strong>for</strong> communicating significant<br />

moments of change in values.<br />

Provides a visual cue of relative<br />

proportions.<br />

Useful <strong>for</strong> a quick visual determination<br />

if there is a direct, indirect, or negligible<br />

relationship between two variables.<br />

Useful <strong>for</strong> a quick and impactful<br />

illustration of relative proportions.<br />

Useful <strong>for</strong> illustrating developments<br />

over time.<br />

Useful <strong>for</strong> communicating such<br />

features about the data as<br />

highest/lowest, trends, anomalies, etc.<br />

Useful <strong>for</strong> showing current activity in<br />

comparison with desired outcomes and<br />

<strong>for</strong> creating dashboards.<br />

Useful <strong>for</strong> depicting regional variations.<br />

Useful <strong>for</strong> showing the most frequently<br />

occurring topics or words from<br />

unstructured in<strong>for</strong>mation.<br />

Useful <strong>for</strong> identifying relationships<br />

among individuals, teams,<br />

organizations, geographical locations,<br />

centers of activity, and more<br />

Useful <strong>for</strong> communicating correlation<br />

coefficients easily.<br />

78


The secrets to successful visualized reporting are:<br />

• Using the appropriate technique to communicate what you are trying to show.<br />

• Keeping it simple.<br />

• Avoiding excessive use of colors, animation, special effects, etc.<br />

• Including only what is relevant.<br />

• Avoiding inclusion of every data point but be careful not to create misleading<br />

graphics.<br />

• Helping the intended audience focus on what is most important.<br />

<strong>2E</strong>.4: Reflection<br />

From recent internal and external reports you have seen, identify examples of good and bad<br />

practice with respect to presenting data, and share these examples with your fellow<br />

students.<br />

What is it about the examples you have that make the data presentation effective or<br />

ineffective?<br />

Do you feel confident using graphics to represent data in your audit reports and<br />

presentations?<br />

Have you asked your clients whether they find your reports (especially tables and<br />

graphics) clear and helpful?<br />

What more can you do to improve the user-friendliness of data as presented in your<br />

reports?<br />

79


References and Additional Reading<br />

7 Ways to Win the <strong>Internal</strong> Audit Budget Argument with your CFO, AuditBoard, 2019.<br />

https://www.auditboard.com/blog/7-ways-to-win-the-budget-argument-with-your-cfo/<br />

Artificial Intelligence, <strong>Internal</strong> Audit’s Role, and Introducing a New Framework Part 1<br />

Becoming agile: A guide to elevating internal audit’s per<strong>for</strong>mance and value, Deloitte, 2017.<br />

https://www2.deloitte.com/content/dam/Deloitte/global/Documents/Finance/gx-fa-agileinternal-audit-introduction-elevating-per<strong>for</strong>mance.pdf<br />

The Best <strong>Data</strong> <strong>Analytics</strong> Tools & Software 2023, Forbes, 2023.<br />

https://www.<strong>for</strong>bes.com/advisor/business/software/best-data-analytics-tools/<br />

The Best <strong>Data</strong> Visualization Tools of 2023, Forbes, 2023.<br />

https://www.<strong>for</strong>bes.com/advisor/business/software/best-data-visualization-tools/Brown,<br />

Brené, Dare To Lead: Brave Work, Tough Conversations, Whole Hearts, 2018.<br />

Collins, Jim, Good To Great: Why Some Companies Make the Leap…And Others Don’t,<br />

Harper Collins, 2001.<br />

Computer Assisted Audit Techniques (CAATS): Definition, types, advantages and<br />

disadvantages, Accounting Hub. https://www.accountinghub-online.com/computerassisted-audit-techniques/<br />

COSO <strong>Internal</strong> Control – Integrated Framework, COSO, 2017.<br />

COSO Enterprise Risk Management – Integrating with Strategy and Per<strong>for</strong>mance, COSO,<br />

2017.<br />

<strong>Data</strong> Validation, Corporate Finance Institute, 2023.<br />

https://corporatefinanceinstitute.com/resources/data-science/data-validation/<br />

<strong>Data</strong> Visualization, TechTarget, Business <strong>Analytics</strong>, 2022,<br />

https://www.techtarget.com/searchbusinessanalytics/definition/data-visualization<br />

<strong>Data</strong> <strong>Analytics</strong> Part 2: Gathering, Understanding, and Visualizing <strong>Data</strong>, The IIA, 2022.<br />

https://www.theiia.org/globalassets/site/content/articles/global-knowledgebrief/2022/data-analytics-part-2-gathering-understanding-and-visualizing-data/dataanalytics-part-2--final.pd<br />

Garyn, Hal, “Why Is <strong>Internal</strong> Audit Often A Tech Laggard?” <strong>Internal</strong> Audit 360, 2022.<br />

https://internalaudit360.com/why-internal-audit-is-a-tech-laggard-and-how-to-fix-it/<br />

Global Knowledge Brief: Audit Team Trans<strong>for</strong>mation, The IIA, 2019.<br />

https://www.theiia.org/globalassets/site/content/articles/global-knowledgebrief/2019/april/audit-team-trans<strong>for</strong>mation/audit-team-trans<strong>for</strong>mation_iia_global_kb.pdf<br />

Global Perspectives & Insights, From Con<strong>for</strong>mance to Ambition: Applying the <strong>Internal</strong> Audit<br />

Ambition Model, The IIA, 2020.<br />

https://www.theiia.org/globalassets/documents/content/articles/gpi/2020/august/globalperspectives-and-insights---ambition-model_final-1.pdf<br />

80


Global Risks Report 2023, World Economic Forum, 2023.<br />

https://www3.we<strong>for</strong>um.org/docs/WEF_Global_Risks_Report_2023.pdf<br />

Guidelines <strong>for</strong> Conducting a Quality Assessment (QA), Deutsches Institut für Interne<br />

Revision e.V. (IIA–Germany), September 2007.<br />

https://www.diir.de/fileadmin/fachwissen/standards/downloads/DIIR_Revisionsstandard_<br />

Nr_3_englisch_V1.1.pdf<br />

IIA Global Perspectives and Insights Artificial Intelligence three parts, The IIA, 2017-18.<br />

IIA Competency Framework, The IIA, 2022.<br />

https://www.theiia.org/globalassets/documents/standards/ia-competencyframework/2022-4103-sem-competency-framework-graphics-table_fnl.pdf<br />

https://www.theiia.org/en/content/articles/global-perspectives-and-insights/2018/artificialintelligence-internal-audits-role-and-introducing-a-new-framework-part-1/<br />

https://www.theiia.org/globalassets/documents/content/articles/gpi/2017/december/gpiartificial-intelligence-part-ii.pdf<br />

https://www.theiia.org/en/content/articles/global-perspectives-and-insights/2018/artificialintelligence-part-iii/<br />

IIA Position Paper: Staffing/Resourcing Considerations <strong>for</strong> <strong>Internal</strong> Audit Activity, The IIA,<br />

2018. https://www.theiia.org/globalassets/documents/resources/staffing-considerations<strong>for</strong>-internal-audit-activity-may-2018/staffing-considerations-<strong>for</strong>-internal-audit-activity.pdf<br />

The Institute of <strong>Internal</strong> Auditors’ Quality Assessment Manual <strong>for</strong> the <strong>Internal</strong> Audit Activity,<br />

6th Edition. https://www.theiia.org/en/products/bookstore/quality-assessment-manual-<strong>for</strong>the-internal-audit-activity-qa-manual/<br />

<strong>Internal</strong> Audit Capability Model (IA-CM) <strong>for</strong> the Public Sector, The IIA, 2023.<br />

https://www.theiia.org/en/promotions/bookstore/IA-CM/<br />

<strong>Internal</strong> Audit’s Role in ESG Reporting, The IIA, 2021.<br />

https://www.theiia.org/globalassets/documents/standards/implement-thestandards/2021/internal-audits-role-in-esg-reporting-independent-assurance-is-critical-toeffective-sustainability-reporting/white-paper-internal-audits-role-in-esg-reporting.pdf<br />

International Professional Practices Framework, The IIA, 2016.<br />

https://www.theiia.org/en/standards/international-professional-practicesframework/?gclid=CjwKCAiA0JKfBhBIEiwAPhZXDwsJCKbFTF34RJmKqKME7VhbLi9b0<br />

s_GYUUIcz-ae9H7y8VAyBYe-RoCuH8QAvD_BwE<br />

ISO 31000: Risk Management, ISO, 2018.<br />

Landry, Lauren, “How to Delegate Effectively: 9 Tips For Managers,” Harvard Business<br />

School, 2020. https://online.hbs.edu/blog/post/how-to-delegate-effectively<br />

Lean <strong>Auditing</strong> (Part 1): Rethinking <strong>Internal</strong> Audit Using Lean Techniques to Enhance Value<br />

and Improve Productivity, efficientlearning.com,<br />

https://www.efficientlearning.com/blog/lean-auditing-part-one/<br />

81


Lean <strong>Auditing</strong> (Part 2): Rethinking <strong>Internal</strong> Audit Using Lean Techniques to Enhance Value<br />

and Improve Productivity, efficientlearning.com<br />

https://www.efficientlearning.com/blog/lean-auditing-part-two/<br />

Lean <strong>Auditing</strong> (Part 3): Rethinking <strong>Internal</strong> Audit Using Lean Techniques to Enhance Value<br />

and Improve Productivity, efficientlearning.com<br />

https://www.efficientlearning.com/blog/lean-auditing-part-three/<br />

Local Management Guide: The Practice of <strong>Internal</strong> Controls, Office o the New York State<br />

Comptroller, 2010. https://www.osc.state.ny.us/files/localgovernment/publications/pdf/the-practice-of-internal-controls.pdf<br />

Mintzberg, Henry, Mintzberg on Management, Free Press, Simon & Schuster, Inc., 1989.<br />

“One page audit report: maximizing efficiency, elevating impact,” AuditBoard, 2022.<br />

https://www.auditboard.com/blog/one-page-audit-report-maximizing-efficiency-elevatingimpact/<br />

Paterson, James, Lean <strong>Auditing</strong>: Driving Added Value and Efficiency in <strong>Internal</strong> Audit, Wiley,<br />

2015.<br />

“Planning <strong>for</strong> uncertainty: the rise of the flexible audit plan,” AuditBoard, 2022.<br />

https://www.auditboard.com/blog/planning-<strong>for</strong>-uncertainty-the-rise-of-the-flexible-auditplan/<br />

Practice Guide: <strong>Auditing</strong> Culture, The IIA, 2019.<br />

https://www.theiia.org/globalassets/documents/content/articles/guidance/practiceguides/auditing-culture/pg-auditing-culture.pdf<br />

Practice Guide: <strong>Auditing</strong> Third Party Risk Management, The IIA, 2018.<br />

https://www.theiia.org/globalassets/documents/content/articles/guidance/practiceguides/auditing-third-party-risk-management/pg-auditing-third-party-riskmanagement.pdf<br />

Practice Guide: Developing the <strong>Internal</strong> Audit Strategic Plan, The IIA, 2012.<br />

https://www.theiia.org/globalassets/documents/content/articles/guidance/practiceguides/developing-the-internal-audit-strategic-plan/pg-developing-the-internal-auditstrategic-plan.pdf<br />

The Agile <strong>Internal</strong> Audit Journey Series Part 1: Trans<strong>for</strong>ming <strong>Internal</strong> Audit To Add Greater<br />

Value, BakerTilly, 2019. https://www.bakertilly.com/insights/the-agile-internal-auditjourney-series-part-i--trans<strong>for</strong>ming-internal-audit-to-add-greater-value<br />

Practice Guide: Quality Assurance and Improvement Program, The IIA, 2012.<br />

https://www.theiia.org/globalassets/documents/content/articles/guidance/practiceguides/quality-assurance-and-improvement-program/ippf-pg---quality-assurance-andimprovement-program.pdf<br />

Risk Appetite: Critical to Success, COSO, 2020.<br />

https://www.coso.org/Shared%20Documents/COSO-Guidance-Risk-Appetite-Critical-to-<br />

Success.pdf<br />

82


Risk Assessment in Practice, COSO, 2012.<br />

https://www.coso.org/Shared%20Documents/COSO-ERM-Risk-Assessment-in-Practice-<br />

Thought-Paper-October-2012.pdf<br />

Risk in focus 2023: more risky, uncertain, and volatile times ahead, ECIIA, 2023.<br />

https://www.eciia.eu/2022/09/risk-in-focus-2023-more-risky-uncertain-and-volatile-timesahead/<br />

Wolters Kluwer “Five benefits of data analytics <strong>for</strong> internal audit.”<br />

https://www.wolterskluwer.com/en/expert-insights/5-benefits-of-da ta-analytics-<strong>for</strong>internal-audit<br />

83


CIPFA: 77 Mansell Street, London E1 8AN<br />

+44 20 7543 5600<br />

cipfa.org<br />

CEF: Cankarjeva cesta 18, 1000 Ljubljana, Slovenia<br />

+386 1 369 61 90<br />

cef-see.org<br />

The Chartered Institute of Public Finance and Accountancy. Registered with the Charity<br />

Commissioners of England and Wales No 231060. Registered with the Office of the<br />

Scottish Charity Regulator No SCO37963.<br />

84

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!