A Model to Examine Audit Effectiveness: Nationally, Globally

[cmsmasters_row data_padding_bottom_mobile_v=”0″ data_padding_top_mobile_v=”0″ data_padding_bottom_mobile_h=”0″ data_padding_top_mobile_h=”0″ data_padding_bottom_tablet=”0″ data_padding_top_tablet=”0″ data_padding_bottom_laptop=”0″ data_padding_top_laptop=”0″ data_padding_bottom=”50″ data_padding_top=”0″ data_bg_parallax_ratio=”0.5″ data_bg_size=”cover” data_bg_attachment=”scroll” data_bg_repeat=”no-repeat” data_bg_position=”top center” data_color=”default” data_bot_style=”default” data_top_style=”default” data_padding_right=”3″ data_padding_left=”3″ data_width=”boxed” data_shortcode_id=”wetksdu9up”][cmsmasters_column data_width=”1/2″ data_animation_delay=”0″ data_border_style=”default” data_bg_size=”cover” data_bg_attachment=”scroll” data_bg_repeat=”no-repeat” data_bg_position=”top center” data_shortcode_id=”rpz43y8mxb”][cmsmasters_image shortcode_id=”gwj91940fk” align=”center” link=”http://intosaijournal.org/wp-content/uploads/2019/07/IJGA-Summer-201919.jpg” animation_delay=”0″]19529|http://intosaijournal.org/wp-content/uploads/2019/07/IJGA-Summer-201919.jpg|full[/cmsmasters_image][/cmsmasters_column][cmsmasters_column data_width=”1/2″ data_shortcode_id=”b8y8ob9ylh”][cmsmasters_image shortcode_id=”7d25c2l0zk” align=”center” link=”http://intosaijournal.org/wp-content/uploads/2019/07/IJGA-Summer-201920.jpg” animation_delay=”0″]19540|http://intosaijournal.org/wp-content/uploads/2019/07/IJGA-Summer-201920.jpg|full[/cmsmasters_image][/cmsmasters_column][/cmsmasters_row][cmsmasters_row data_padding_bottom_mobile_v=”0″ data_padding_top_mobile_v=”0″ data_padding_bottom_mobile_h=”0″ data_padding_top_mobile_h=”0″ data_padding_bottom_tablet=”0″ data_padding_top_tablet=”0″ data_padding_bottom_laptop=”0″ data_padding_top_laptop=”0″ data_padding_bottom=”50″ data_padding_top=”0″ data_bg_parallax_ratio=”0.5″ data_bg_size=”cover” data_bg_attachment=”scroll” data_bg_repeat=”no-repeat” data_bg_position=”top center” data_color=”default” data_bot_style=”default” data_top_style=”default” data_padding_right=”3″ data_padding_left=”3″ data_width=”boxed” data_shortcode_id=”da4duoja0h”][cmsmasters_column data_width=”1/1″ data_animation_delay=”0″ data_border_style=”default” data_bg_size=”cover” data_bg_attachment=”scroll” data_bg_repeat=”no-repeat” data_bg_position=”top center” data_shortcode_id=”dxiby434fh”][cmsmasters_quotes shortcode_id=”9ii176v2k” mode=”slider” speed=”5″ animation_delay=”0″][cmsmasters_quote shortcode_id=”hdpfh2ndaj”]

This unique model provides a foundation to examine audit effectiveness and enables measuring specific factors that can affect an audit’s impact. While this study focused on SAI Israel’s audit effectiveness, the model may be applicable to other SAIs.

[/cmsmasters_quote][/cmsmasters_quotes][/cmsmasters_column][/cmsmasters_row][cmsmasters_row][cmsmasters_column data_width=”1/1″][cmsmasters_text]

by Dr. Amir Seri, Commissioner of State Audit, Regulation and Marketing Group, Israel Electric Cooperation, and Lecturer at Bar Ilan University-Israel

Supreme Audit Institutions (SAIs) represent important mechanisms in safeguarding public resources, and the broad authorities of the Comptroller of Israel are intended to, among other things, strengthen good governance. However, evaluating public audit effectiveness and its ability to enhance good governance is complex and often difficult, if not impossible.

This article explores modeling to examine audit effectiveness, including an examination of influential factors and a comparison that uncovers the most impactful report type.

The Proposed Model
Creating a benchmark definition for effectiveness was the first step. For this model, effectiveness (E) is the rate of deficiency correction—how many corrective measures were implemented based on audit findings and recommended actions.

Next, defining variables that potentially impact audit effectiveness were identified and categorized (categories were based on research, which often cited grouping factors into four broad categories):

• Category A: Reciprocal relationship between audit and public and media opinion;
• Category B: Reciprocal relationship between audit and legislative authority;
• Category C: Reciprocal relationship between audit and executive authority; and
• Category D: Audit office work patterns.

Given these variables, measuring audit effectiveness can be calculated using the formula:

E=f (A, B, C, D) or ∑i= Ai+ Bi +Ci +Di, where i represents the report type—regular (r) or special (s).

Regular reports are those published at times defined by law, while special reports are initiated by the comptroller and not included in the annual work plan.

The resulting “E” value falls within a range between 0 and 1 (0-100%), where a value of “1” indicates all deficiencies have been corrected, and a value of “0″ means no corrections have been implemented.

Putting the Model Into Practice
This model was used to specifically evaluate SAI Israel’s audit effectiveness, and an equal amount of completed regular and special audit reports (13 each) were examined and compared to provide the basis for the “E” value.

Additionally, 15 interviews were conducted, which included sessions with three recent Comptrollers; the former Chairman of the State Audit Affairs Committee; previous managers of the State Control Inspector General Division in the Prime Minister’s office; and relevant internal staff (both managerial and technical).

To create quantitative measures from qualitative information for each category, the following data were used:

• Category A was analyzed using the number of articles published in the press on a specific report;
• Category B was calculated by examining the extent of discussions in designated parliamentary committees;
• Category C was checked by analyzing activities associated with correcting the audit’s identified deficiencies; and
• Category D scoring included analyzing and comparing various parameters within the audit office that may affect audit effectiveness, such as audit work timing, audit frequency and monitoring deficiency corrections. Performing interviews (in-depth, semi-structured) with relevant personnel, both internal and external, helped validate and strengthen findings.

Results

• Values calculated for Category A concluded that, on average, interactions between SAI Israel and the media increase special report effectiveness when compared to regular reports;
• Analyzing Category B results indicate interactions between SAI Israel and the legislative branch also increase the effectiveness associated with special reports more so than that of regular reports;
• On the other hand, Category C results suggest the interactions between the SAI and executive authorities increase regular report effectiveness in comparison to special reports; and
• Category D analysis showed that, as a rule, there is no difference (in the context of effectiveness) in how SAI Israel operational patterns impact regular and special reports.

Conclusions
Findings suggest that effectiveness (faults correction rate) coinciding with special reports will generally be higher than that of regular reports.

Special reports tend to generate a greater amount of real-time value and relevancy given the nature in which they are initiated and the topics they tend to cover. This is also in-keeping with available literature suggesting such factors (value and relevancy) increase the probability of an event becoming sensationalized in the media.

Research also indicates the media’s ability to raise awareness on more publicly stimulating topics leads to increased coverage of special reports and boosts topic recognition, which, in turn, can result in heightened pressure on auditees to correct identified faults, thus enhancing audit effectiveness.

The uniqueness of this model provides a foundation to examine audit effectiveness and enables measuring specific factors that can affect an audit’s impact.

While this study focused on SAI Israel’s audit effectiveness, the model may be applicable to other SAIs.

Contact the author at amir.seri@iec.co.il for a full list of references and to learn more about the model.

[/cmsmasters_text][/cmsmasters_column][/cmsmasters_row]