A review of the article on “performance management: a framework for management control systems research”

A review of the article on “performance management: a framework for management control systems research”

 

 

How to present this article in Harvard reference format?

To reference this article in Harvard format, you would structure it as follows:

Otley, D. (1999) ‘Performance management: a framework for management control systems research’, Management Accounting Research, 10(4), pp. 363–382. doi: 10.1006/mare.1999.0115.

If you need to include the URL (for example, if you accessed it online), you can add:

Available at: https://www.researchgate.net/publication/222473924_Performance_Management_A_Framework_For_Management_Control_Systems_Research (Accessed: [date]).

  

What are the key research issues the article wants to address?

 

·        The article by David Otley (1999) identifies key research issues in the field of performance management and management control systems centered around five core questions which form a framework to analyze organizational control systems:

1.    Identification of Key Objectives: What are the critical objectives central to the organization's long-term success, and how is achievement of these objectives evaluated? This raises research questions around how organizations define and prioritize goals from the perspectives of different stakeholders.

2.    Strategies and Plans: What strategies and plans has the organization adopted, what processes and activities are required to implement these strategies, and how is performance of these activities assessed? Research interest lies in linking strategy formulation to control systems and understanding means-end relationships.

3.    Target-Setting: What level of performance is needed in each area, and how are appropriate performance targets established? Traditional issues about effectiveness, efficiency, and benchmarking stem from this.

4.    Incentives and Rewards: What rewards and penalties are attached to achieving or failing to achieve targets? Despite being often neglected in performance measurement research, exploring the design and impact of incentive schemes, including cultural differences, is important.

5.    Information Feedback Loops: What information flows (feedback and feed-forward) exist to help the organization learn from experience and adapt behavior? This includes understanding multiple timescales of learning and organizational culture formation.

Beyond these specific questions, the article highlights broader research issues such as:

o   How different control systems operate as part of an overall organizational control package rather than in isolation.

o   The contingencies affecting the choice and effectiveness of control systems, particularly the role of strategy and organizational context.

o   The practical use, integration, and behavioral impacts of specific performance management techniques like budgeting, Economic Value Added (EVA), and the Balanced Scorecard.

o   The need for longitudinal, in-depth case studies and mixed methods (e.g., combining survey and case study approaches) to better understand these control systems in practice.

o   Exploring the motivation and behavior aspects in the design and operation of management control systems, recognizing cultural and organizational differences.

o   Assessing the behavioral and organizational effects of financial versus non-financial performance measures and reward systems.

In sum, the article sets out to move beyond narrowly economic or technical views of performance measurement to a broader, integrated research agenda addressing how performance management works in practice in the complex organizational and strategic context.

 

 

Describe two main theories employed in this article.

The article by David Otley (1999) employs two main theoretical perspectives to underpin the proposed framework for performance management and management control systems research:

1.    Contingency Theory of Management Accounting This theory posits that there is no universally optimal management control system; rather, the choice and design of appropriate control techniques depend on specific contingencies or circumstances of an organization, especially its objectives and strategy . Key elements include:

·        The organization's goals and strategies heavily influence the selection of performance measures and controls. Different strategies require different configurations of control systems.

·        The need for a “goodness of fit” between control systems and organizational context to enhance effectiveness.

·        Contingency theory rejects a “one-size-fits-all” approach and instead encourages tailoring controls to organizational conditions such as size, technology, and competitive environment.

·        The paper draws on works by Anthony (1965) as well as Simons (1995) and Langfield-Smith (1997) who emphasized strategy as a key contingent variable shaping controls.

2.    Management Control Systems (MCS) Framework Originating mainly from Anthony’s (1965) classic framework of management planning and control systems, this approach distinguishes between strategic planning, management control, and operational control and explores how management control systems provide information to assist managers in influencing organizational behavior . Key features include:

·        MCS are viewed as systems providing information feedback loops to enable evaluation and regulation of performance relative to plans and objectives.

·        It acknowledges behavioral aspects such as motivation and the role of incentives in influencing manager and employee actions.

·        However, traditional MCS frameworks have been critiqued for focusing narrowly on financial measures and for insufficiently integrating strategic planning and operational control.

·        The article seeks to extend the MCS framework to a broader ‘performance management’ perspective that integrates strategy, objectives, target-setting, incentives, and information flows, thus enriching the classic model.

Together, these theories justify the article’s inductive framework which addresses five key questions about objectives, strategies, targets, rewards, and information feedback, emphasizing the fit between organizational context and control system design . The contingency theory explains why different organizations require different systems, while the MCS framework provides the foundation for understanding control system operation and information flows in management .

 

 

Highlight 2 main primary findings reported in this article.

The article by David Otley (1999) reports two main primary findings based on the development and application of the proposed performance management framework:

1.    Integration of Five Key Issues Provides a Comprehensive Framework for Analyzing Performance Management Systems The article identifies five central questions related to organizational objectives, strategies and plans, target setting, incentive and reward structures, and information feedback loops as essential components of management control systems . By integrating these five interconnected elements, the framework offers a more complete, holistic view of organizational control systems beyond traditional financial performance measurement. This comprehensive approach helps to expose neglected areas in practice and research and provides a valuable tool for analyzing and improving performance management techniques such as budgeting, Economic Value Added (EVA), and the Balanced Scorecard.

2.    Control Systems Are More Like ‘Packages’ Than Fully Coherent, Rational Systems and Need to Be Studied Longitudinally and Contextually The article finds that organizational control systems are typically complex, evolving packages with components added at different times by different managers, rather than fully integrated, rationally designed systems . This has important implications for research methodology, emphasizing the need for longitudinal, in-depth case studies that consider context, inter-relationships, and cultural factors. Such studies can reveal the antecedents, operation, and consequences of control system choices and provide a richer understanding than isolated, technique-focused analyses. The framework thus encourages more empirical research that examines the dynamic and socially embedded nature of performance management systems.

These findings underscore the importance of a broad, integrated perspective on performance management and the need for research approaches that capture the complexity and context-dependent nature of control systems.

  

Describe 3 main claims of the article in terms of Toulmin's model of argument.

Using Toulmin's model of argument—which includes claims, grounds (evidence), warrants (justification), backing, qualifiers, and rebuttals—three main claims from David Otley’s (1999) article can be described as follows:

---

Claim 1: The performance management framework integrating five key questions provides a useful and comprehensive tool for analyzing management control systems beyond traditional financial measurement.

·        Grounds (Evidence): The paper inductively develops five central questions relating to objectives, strategies and plans, target-setting, incentives and rewards, and information feedback loops, and applies this framework to three systems (budgeting, EVA, Balanced Scorecard) to expose neglected areas and guide improvements .

·        Warrant (Justification): A framework that explicitly integrates multiple interrelated aspects of control systems captures organizational complexity better than narrow financial approaches.

·        Backing: Prior research on management control systems, contingency theory, and examples of budgeting and newer techniques like EVA and Balanced Scorecard support the need for such broader frameworks .

·        Qualifier: This framework is a first step and may require adaptation to different organizations and contexts.

·        Rebuttal: While not prescriptive, some may argue other frameworks or narrower financial models suffice; however, such approaches risk overlooking crucial elements that affect performance management.

---

Claim 2: Management control systems should be understood as complex, evolving "packages" rather than fully rational, coherent systems.

·        Grounds (Evidence): The article references prior literature on contingency theory and organizational control packages, and notes that control elements are added by different people at different times, making the overall system less cohesive .

·        Warrant (Justification): Organizational realities and historical processes hinder fully rational system design; understanding these systems requires acknowledging their fragmented and evolving nature.

·        Backing: Theoretical backing from Hopwood (1987) and others who compared control systems to archaeology; empirical observations supporting complexity and incoherence .

·        Qualifier: This complexity is typical but individual elements may exhibit rationality.

·        Rebuttal: One might assume that organizations could design fully coherent systems, but the evidence suggests otherwise.

---

Claim 3: Empirical research on performance management systems should prioritize longitudinal, context-sensitive case studies to generate meaningful understanding.

·        Grounds (Evidence): The paper discusses the limitations of purely economic or normative views and argues that in-depth, longitudinal studies allow exploration of control packages in context, capturing interactions, motivators, and the dynamic evolution of systems .

·        Warrant (Justification): Because control systems are complex, socially embedded, and context-dependent, static or cross-sectional studies cannot adequately reveal causes and effects.

·        Backing: Examples cited include Scandinavian and U.K. research traditions that have successfully employed these methods .

·        Qualifier: Such methodologies may be more resource intensive and focused on single organizations but yield richer insights.

·        Rebuttal: Large-scale surveys or experimental methods might be faster but risk ignoring critical contextual nuances.

---

These three claims collectively support the article’s thesis that performance management research and practice benefit from a richer, multi-faceted, and contextually aware approach.

 

Describe 2 main research limitations of the study.

Two main research limitations of David Otley’s (1999) study are:

1.    Primarily Conceptual and Inductive Framework Without Extensive Empirical Testing The performance management framework is developed inductively from prior research and existing theory and applied illustratively to three control techniques (budgeting, EVA, Balanced Scorecard) but is not extensively empirically validated across a broad range of organizations or contexts. Otley acknowledges that the framework “can usefully be developed further by its use in analysing other instances” and specifically calls for case-based, longitudinal studies to test and refine it. Thus, the study’s propositions remain largely theoretical and hypothesis-generating rather than empirically confirmed.

2.    Focus on Organizational-Level Analysis May Overlook Variations at Sub-Unit or Cross-Cultural Levels While the framework is applied at the level of relatively autonomous strategic business units, Otley notes that performance management configurations may differ in sub-units due to corporate policies or context, and that control systems are influenced by national and organizational culture . The study does not deeply explore such intra-organizational or cross-national variations, potentially limiting the generalizability and comprehensiveness of the framework when dealing with multi-layered or culturally diverse settings.

In summary, the limitations center on (1) the need for more extensive empirical validation, especially longitudinal and case studies, and (2) the somewhat narrow analytical focus on organizational units without fully addressing internal heterogeneity or cultural factors that influence management control systems.