Audit support systems and decision aids: Current practice and opportunities for future research

Technological changes and audit firm mergers over the last decade raise the question as to whether the decision aids reported in prior research are representative of the types of decision support currently employed in audit firms. To address this issue, a study was conducted of the audit support systems used at five international audit firms and the types of decision support embedded within their audit support systems. The concepts of system restrictiveness and audit structure were combined to develop a definition of audit support system restrictiveness, and the firms' systems were classified using this definition. Substantial differences in audit support system restrictiveness were found to be associated with the type of decision support embedded within these systems. In order to guide future research, existing audit decision aid studies were mapped to the types of embedded decision support and several future research opportunities were identified.     

The effects of system design alternatives on the acquisition of tax knowledge from a computerized tax decision aid

Accounting firms are intensifying their reliance on experiential learning, and experience increasingly involves the use of computerized decision aids [Messier, W. (1995) Research in and development of audit decision aids. In R. H. Ashton & A. H. Ashton, Judgment and decision making in accounting and auditing (pp. 207–230). New York: Cambridge University Press]. Accountants are expected to learn from automated decision aid use, because the aids are not always available when dealing with the aid's topical matter, and the knowledge inherent in the aid is needed for competency on broader issues. To facilitate knowledge acquisition and explain the logic of the underlying processes, computerized decision aids provide the rationale for their calculations in the form of online explanations. We study how the location of explanations in a computerized decision aid affects learning from its use. Specifically, this research extends the existing literature by using a framework for the study of learning from decision aid use and by using cognitive load theory to explain the failure of certain decision aid design alternatives to promote learning. We define learning as the acquisition of problem-type schemata, and an experiment is performed in which cognitive load is manipulated by the placement of explanations in a computerized tax decision aid to determine its effect on schema acquisition. Schemata are general knowledge structures used for basic comprehension, and cognitive load refers to the burden placed on working memory when acquiring schemata. We find that increased cognitive load produced by the location of explanations in a decision aid leads to reduced schema acquisition. Our results indicate that when explanations in a computerized decision aid are integrated into its problem solving steps, cognitive load is reduced and users acquire more knowledge from aid use. This appears to be an important design consideration for accounting firms buying or building computerized decision aids.     

Can computerized decision aids do “damage”? A case for tailoring feedback and task complexity based on task experience

The theory of technology dominance [Arnold, V., and Sutton, S.G., 1998. The Theory of Technology Dominance. Advances in Accounting Behavioral Research. 1: 175–194.] predicts that mismatches between the skills of decision-aid users and the complexity of the tasks the decision aid is designed to assess will result in a lack of reliance on the decision aid and, ultimately, a potential for deskilling. The cognitive science literature on cognitive load suggests that varying the level of feedback provided to decision-aid users might moderate the risks that result from under-reliance. The current study presented participants, who were divided between two levels of skills, with decision aids in which the level of feedback was varied. These aids were used to solve cases of differing complexity. The results show that individuals with a high level of skill in understanding internal controls deskilled when they were assigned to non-complex cases. Further, this study found that with complex cases, a lower level of feedback was helpful and with non-complex cases, a higher level of feedback was helpful.     

Impact of intelligent decision aids on expert and novice decision-makers' judgments

Businesses have invested tremendous resources into intelligent decision aid development. A good match between user and aid may improve the expert decision‐maker's decision quality. However, novices may be prone to poorer decision‐making if intelligent decision aids are more expert than the user. The present paper provides an empirical test of the impact of decision aids on subjects with differential expertise levels. The results support the contention that intelligent decision aids aggravate bias in novices’ decision‐making but mitigate bias in experts’ decision‐making processes. Intelligent decision aids may be best viewed as complements to expert decision‐makers during complex problem analysis and resolution.     

THE EFFECTS OF PRESENTATION FORMAT ON THE EFFECTIVENESS AND EFFICIENCY OF AUDITORS‘ ANALYTICAL REVIEW JUDGMENTS

Modern audit practice has focused increasing attention on the use of analytical review procedures to improve the effectiveness and efficiency of audits. To assist in this endeavour, one branch of analytical review research has investigated the judgment processes that auditors' use in analytical review and the development of decision aids to improve these processes. Several recent papers have considered how alternative presentations of financial and operating data, specifically graphs versus tables, may affect the effectiveness of auditors' analytical review judgments. However, the results have been mixed. This study investigated the expectation that there would be effectiveness and efficiency performance advantages for auditors receiving graphically presented data over those receiving tabular presented data in an analytical review setting. This paper reports on the results of an experiment that examined the impact of graphs versus tables on the effectiveness of sales account balance prediction, confidence in this prediction and the setting of a noninvestigation region, and the relative time efficiency with which these tasks were completed, for an analytical review of sales for a retailing client. The study found mixed results for the accuracy of the sales account balance predictions of the graphical and tabular treatment groups, with no difference found when a regression model estimate of the ‘correct’ prediction was used and greater accuracy for the graphical group when the actual audited sales account balance was used as the accuracy benchmark. No significant differences between treatment groups was found for their confidence in their sales account balance predictions and the width of the noninvestigation regions set. However, a significant time advantage was found for the graphical group. These findings suggest that there may a useful role for the use of graphs as decision aids in income statement related analytical review procedures in improving audit efficiency without sacrificing audit effectiveness.     

Using client performance measures to identify pre-engagement factors associated with qualified audit reports in Greece

The purpose of this paper is to test the extent to which client (corporate) performance measures can be used to enhance the ability to discriminate between the choice of a qualified or unqualified (clean) audit report. Audit firms face the risk of losing the client if they issue a qualification. On the other hand, failing to qualify exposes the auditor to potential lawsuits and loss of reputation. We examined the financial statements, auditors' opinions, and financial statements notes for companies in Greece that received a qualified audit report and for those that received an unqualified audit report. We modeled the auditor's qualification using a multicriteria decision aid classification method (UTADIS—UTilités Additives Discriminates) and compared it with other multivariate statistical techniques such as discriminant and logit analysis. The qualification decision is explained by financial ratios and by nonfinancial information such as the client litigation. The developed models are accurate in classifying the total sample correctly with rates of almost 80%.     

Risk assessment in internal auditing: a neural network approach

Risk assessment is a systematic process for integrating professional judgments about relevant risk factors, their relative significance and probable adverse conditions and/or events leading to identification of auditable activities (IIA, 1995, SIAS No. 9). Internal auditors utilize risk measures to allocate critical audit resources to compliance, operational, or financial activities within the organization (Colbert, 1995). In information rich environments, risk assessment involves recognizing patterns in the data, such as complex data anomalies and discrepancies, that perhaps conceal one or more error or hazard conditions (e.g. Coakley and Brown, 1996; Bedard and Biggs, 1991; Libby, 1985). This research investigates whether neural networks can help enhance auditors’ risk assessments. Neural networks, an emerging artificial intelligence technology, are a powerful non‐linear optimization and pattern recognition tool (Haykin, 1994; Bishop, 1995). Several successful, real‐world business neural network application decision aids have already been built (Burger and Traver, 1996). Neural network modeling may prove invaluable in directing internal auditor attention to those aspects of financial, operating, and compliance data most informative of high‐risk audit areas, thus enhancing audit efficiency and effectiveness. This paper defines risk in an internal auditing context, describes contemporary approaches to performing risk assessments, provides an overview of the backpropagation neural network architecture, outlines the methodology adopted for conducting this research project including a Delphi study and comparison with statistical approaches, and presents preliminary results, which indicate that internal auditors could benefit from using neural network technology for assessing risk. Copyright © 1999 John Wiley & Sons, Ltd.     

Examining the effect of deception detection decision aids on investors' perceptions of disclosure credibility and willingness to invest

Recent evidence suggests that the trend of issuing video disclosures is growing and investors are exposed to the risk of including deceptive information in their decisions. This study suggests that investors can use deception detection decision aids to identify deceptive behavior in video disclosures, and that the use of such decision aids affects their perceptions of disclosure credibility and willingness to invest. The theoretical framework of this study suggests that providing investors with a deception detection decision aid affects their willingness to invest through their perceptions of disclosure credibility, and that this effect is conditional on management's reputation. Using data from 387 nonprofessional investors, the findings provide support for the predicted effect of deception detection decision aid on investors' judgment and decision making. The effect of providing investors with a deception detection decision aid is fully mediated by investors' perceptions of disclosure credibility, and that effect is significantly stronger when management's reputation is good than when management's reputation is bad.     

The development of an expert system for managerial evaluation of internal controls

Both practitioners and researchers have devoted signi?cant effort to the study of decision aids, especially expert systems, to assist auditors in internal control evaluations. In addition to being used as a decision aid, researchers have long contended that expert systems could be used to train non‐expert users. Even though the professional accounting literature makes it clear that responsibility for maintaining an effective internal control system rests with management rather than auditors, the focus to date has been on expert systems aimed at assisting/training auditors, not an organization's management. In contrast, this study focuses on management as users of an expert system for internal control evaluation. We describe the development process, explain how the resulting system was evaluated, and discuss results of that evaluation. These results suggest that such a system gives a new way to help managers increase effectiveness and ef?ciency of a critical organizational process: the evaluation of internal controls. Copyright © 2004 John Wiley & Sons, Ltd.     

Responsiveness of Auditors to the Audit Risk Standards: Unique Evidence from Big 4 Audit Firms

We examine the effect of changes in audit risk standards on the conduct of financial statement audits in a European setting. We investigate this by analysing the audit hours and audit fees for clients of Big 4 audit firms in Finland in 1996 and 2010. Our results show that audit firms became more sensitive to clients’ business risk due to the introduction of the new audit risk standards, with more audit hours allocated to owner-managed companies in 2010 than in 1996, and fewer audit hours allocated to low-risk clients in 2010 than in 1996. Also, the labour mix in the audit team changed for owner-managed companies, with a greater work load carried by junior auditors in 2010 than in 1996. Regarding the price of audit, we find an increase in audit fees for clients with high business risk, while audit fees remained at roughly the same level for low-risk clients. These findings should be of interest to the auditing profession and those involved in the development of auditing regulations.     

Decision aid reliance: Modeling the effects of decision aid reliability and pressures to perform on reliance behavior

We investigate the effects of decision aid reliability and pressure to perform on decision aid reliance. A total of 403 students took part in a four (pressures to perform: one through four) by five (decision aid reliability: 50%, 60%, 70%, 80% and 90%) between-participants experiment. We test two competing models of decision aid reliance behavior: pressure-induced rationality and pressure arousal theory. Additionally, we introduce a general model of reliance on a decision aid. We find that pressure arousal theory predominantly explains decision aid reliance behavior at all but the highest level of decision aid reliability tested in this study (90%). Our results indicate that there are reliance peaks across the reliability levels as more pressure to perform is applied, and that continually increasing pressures can eventually lead to decreased, rather than increased, reliance.     

Cue usage in financial statement fraud risk assessments: effects of technical knowledge and decision aid use

This paper investigates the effects of technical knowledge and decision aid use on financial statement fraud risk assessments made by directors and students. More extreme fraud risk assessments are made when participants identify and process larger (smaller) numbers of diagnostic (non‐diagnostic) factors, with technical knowledge driving diagnostic factor identification. Significant decision aid‐technical knowledge effects are also found; decision aid use has a detrimental effect on high‐knowledge directors while improving performance in inexperienced, low‐knowledge students. These results suggest that although decision aids can afford gains in performance in inexperienced users, they can have unintended and/or paradoxical behavioural effects on experienced users.     

PREDICTING UNCERTAINTY AUDIT QUALIFICATIONS IN AUSTRALIA USING PUBLICLY AVAILABLE INFORMATION

This research project constructed a logit model to predict “subject to” qualified audit opinions using financial statement and market variables for 1,848 audit reports for Australian companies issued from 1984 to 1988. The model provided a better goodness of fit and was more efficient than two naive strategies for predicting “subject to” audit qualifications. The model explicitly incorporated the relative costs of Type II to Type I errors to account for the auditor's asymmetrical loss function. The model was reasonably accurate when a sensitivity analysis for the relative costs of Type II and Type I errors was considered. The accuracy rates for the estimation sample ranged from 70% to 95%. An inter-temporal holdout sample of 293 audit opinions for Australian firms issued during 1989 indicated that the model was useful for predicting “subject to” audit opinions. The accuracy rates for the holdout sample ranged from 72% to 90% over a range of relative Type II and Type I costs.     

Auditor economic incentives and going-concern opinions in a limited litigious Continental European business environment: empirical evidence from Belgium

Theory predicts that auditor reporting behaviour may be influenced by the perceived consequences of disclosing going-concern uncertainty in the audit report (DeAngelo 1981, Watts and Zimmerman 1986). Krishnan and Krishnan (1996) and Louwers (1998) have addressed this issue empirically in a US context. The results of Krishnan and Krishnan (1996) suggested that one of the important factors in the auditor's opinion decision is the risk of litigation. The purpose of this study is to examine the relationship between auditor economic incentives and the propensity to issue going-concern opinions in a limited litigious business environment, Belgium. In spite of the low risk of litigation and the fact that most Belgian companies are privately held, various regulations have been put into effect to safeguard audit quality in Belgium. However, the results suggest that the auditor's going-concern opinion decision in Belgium is associated with factors relating to the perceived consequences of disclosing a going-concern opinion. Specifically, the results suggest that auditors in Belgium are significantly less likely to issue going-concern opinions to clients that pay higher audit fees, and when the audit firm has lost a relatively high proportion of its clients in the preceding year. The auditor's going-concern opinion does not appear to be significantly influenced by the length of the auditor-client relationship, year of the auditor engagement period, and auditor type. The results of this study are to some extent different from the study by Louwers (1998), in which none of the incentive variables related to the auditor's loss function was significant.     

Auditors’ self-perceived abilities in conducting domain audits

This study investigates the extent to which auditors’ ratings of self-perceived abilities correspond with their actual performance, and whether these perceptions are influenced by audit experience and effectiveness when conducting audits within their domain of specialization. One hundred forty-four (144) industry-specialized audit seniors and managers reviewed two sets of audit working paper cases, one in banking and one in healthcare. At the end of the review, the auditors rated their ability to perform an audit in their domain. The analysis of these ratings shows that auditors significantly inflated their perceived abilities relative to actual performance. The results indicate that differences in auditor rank are insignificant in terms of this propensity to overestimate self-perceived abilities relative to actual performance; however, above median effective auditors are far less overconfident than below median effective auditors. These results have implications for the audit profession in terms of training, assignments, performance evaluation, and the use of decision aids to mitigate the propensity toward overconfidence.     

The effects of decision aid structural restrictiveness on cognitive load,perceived usefulness,and reuse intentions

As accounting environments become increasingly automated through information technology support systems, the underlying systems are increasingly restrictive in an effort to direct user behavior and decision making. However, consistent with the theory of technology dominance, restrictive systems have been found to dominate users' decision processes and to have a detrimental effect when decisions require knowledge from outside the system's capability. This study expands upon this research through an examination of users' preferences for more (less) restrictive systems based on their own level of domain knowledge. Incorporating theory on task technology fit, we theorize that users with less knowledge will prefer to be dominated by the system, while users with greater levels of knowledge will prefer a system that provides the user with a level of control over the decision process rather than submitting entirely to the decision aid's control. These theorizations are empirically tested through an experimental design that varies the level of systems restrictiveness across groups of novice and experienced participants. The results confirm that novice (experienced) participants find a highly restrictive system substantially (minimally) reduces cognitive load, increases (decreases) usefulness of the decision aid, and strengthens (weakens) the intention to reuse the system in the future. The results add an important piece to understanding the effect of restrictive systems in that the users that are most susceptible to dominance by decision aids are the users most willing to adopt a restrictive system that reduces the effort they must put forth and in turn reduces the knowledge they accrue from using the system.     

Accountability and auditors’ materiality judgments: The effects of differential pressure strength on conservatism,variability, and effort

This study investigates the effects of differential accountability pressure strength on auditors’ materiality judgments. We evaluate whether incremental levels of accountability (i.e., review, justification, feedback) increase judgment conservatism, decreases judgment variability, and increases effort. One hundred sixty auditors participated in a between-subjects experiment that included a planning materiality task and a proposed audit adjustment materiality task. As predicted, auditors under higher levels of accountability pressure (i.e., justification, feedback) provided more conservative materiality judgments and had less judgment variability than auditors under lower levels of pressure (i.e., review, anonymity). The results also indicate that accountability strength was positively related to the amount of time spent on the task, explanation length, and consideration of qualitative materiality factors. Finally, the results show that use of a planning materiality decision aid influenced the accountability effects for the planning materiality judgment. These judgments were more conservative and less variable when the planning materiality decision aid was available. We consider implications for research, practice, and policy in the context of the study’s limitations.     

Measurement of knowledge structures acquired through instruction,experience, and decision aid use

This study investigates a method for measuring knowledge structure development in novice accountants by extending Bonner and Walker [Bonner, S. and P. Walker. 1994. The effects of instruction and experience on the acquisition of auditing knowledge. The Accounting Review 69: 157–178.], which examined the effects of instruction and experience on the acquisition of declarative and procedural knowledge. We employ Pathfinder network scaling, a recently developed and validated measure of knowledge structure acquisition, to determine whether the combinations of instruction and experience previously found to be effective in promoting declarative and procedural knowledge acquisition result in the development of expert-like knowledge structures. Further, we examine the effectiveness of a simple decision aid in promoting the acquisition of expert-like knowledge structures through experience with the decision aid. Results from two laboratory experiments indicate that Pathfinder-based measures of knowledge structure can effectively capture the effects of training and decision aid use on the development of expertise. The findings suggest that assessments of knowledge structures are valuable tools for measuring the effectiveness of training programs, and such assessments can be applied in decision domains where traditional measures of knowledge acquisition are insufficient or infeasible. Finally, the results indicate that properly designed decision aids can impart expert-like knowledge structures to novice decision makers, and these knowledge structures are the key to expertise.     

An empirical test of spatial competition in the audit market

This study empirically examines the effects of competition through differentiation on audit pricing. Based on prior economic theory on differentiated-product markets (e.g., Hotelling, 1929, Tirole, 1988), we hypothesize that audit fees are affected by an auditor's relative location in a market segment. We define audit markets per industry segment and U.S. Metropolitan Statistical Area and specify an auditor's industry location relative to the client (auditor–client industry alignment) and relative to the closest competitor (industry market share distance to closest competitor). We find that audit fees increase in both auditor–client industry alignment and industry market share distance to the closest competitor.