A review of an article using argument and questioning methods: systems dynamic approach to the balanced scorecard – for advanced management accounting students

A review of an article using argument and questioning methods: systems dynamic approach to the balanced scorecard – for advanced management accounting students

 

How to describe the article in Harvard reference format?

The article can be cited in Harvard reference format as follows:

Hristov, I., Cristofaro, M., Camilli, R. and Leoni, L. (2024) ‘A system dynamics approach to the balanced scorecard: a review and dynamic strategy map for operations management’, Journal of Manufacturing Technology Management, 35(4), pp. 705-743. doi: 10.1108/JMTM-02-2022-0069.

 

Highlight the main research issues and research objectives, 2 main academic theories used and the main research methods used in this article.

Based on the provided content from the article, here is the summary of the requested elements:

Main Research Issues:

• Identifying the various performance drivers (lead indicators) and outcome measures (lag indicators) studied in literature related to the Balanced Scorecard (BSC) within Operations Management (OM) contexts.
• Understanding how these performance drivers and outcome measures relate both within and across the four BSC perspectives (financial, customer, internal processes, learning/growth).
• Addressing the ongoing debate on how to select relevant lead and lag indicators for designing and developing the BSC effectively in OM.
• Highlighting the system dynamics connections and cause-effect feedback loops among the BSC perspectives, which is often underexplored in OM research.

Main Research Objectives:

1.    To identify the different performance drivers and outcome measures investigated in the BSC literature specific to OM.

2.    To analyze and understand the systemic causal relationships among these measures within and between the four BSC perspectives.

3.    To synthesize these relationships into dynamic causal loops enabling the construction of a dynamic strategy map tailored for OM.

4.    To provide a comprehensive and holistic framework that enhances the understanding of BSC implementation in OM, benefiting scholars and practitioners.

Two Main Academic Theories Used:

1.    Balanced Scorecard (BSC) Theory – The strategic performance measurement framework developed by Kaplan and Norton, focusing on four perspectives (financial, customer, internal processes, learning/growth), emphasizing cause-and-effect relationships between lead and lag indicators.

2.    System Dynamics Theory – A theory and methodology for understanding complex, dynamic systems via causal loops and feedback, applied here to model and analyze interrelations among BSC indicators and perspectives, bridging performance measurement with dynamic strategy execution.

Main Research Methods Used:

• Systematic Literature Review (SLR): A rigorous, reproducible, and transparent method to locate, screen, evaluate, and synthesize relevant scholarly articles on BSC in the OM field, following PRISMA guidelines for selection and assessment of 40 peer-reviewed articles from multiple academic databases.
• Data Extraction and Analysis: Extraction of performance drivers and outcome measures indicators and their relationships (polarity, direction, strength) from selected articles, assigning them to BSC perspectives, and building causal loop diagrams representing dynamic interrelationships.
• System Dynamics Modelling: Construction of causal loop diagrams and dynamic feedback models to develop a strategy map that captures the systemic relationships in OM BSC implementation, facilitating better performance management and strategic alignment.

These elements structure the research framework and methodology to address comprehensive performance management in operations through a dynamic, systemic lens

 

Describe 3 main claims of the article in terms of Toulmin's model of argument and then provide a critical review of the article using the Socratic Method.

Below is an analysis of three main claims from the article using Toulmin's model of argument, followed by a critical review applying the Socratic Method.

---

Toulmin’s Model of Argument Applied to Three Main Claims

Claim 1: The BSC in operations management (OM) is best understood through a system dynamics approach that captures complex, dynamic cause-and-effect relationships rather than a static and linear one.

• Data: Literature review of 40 peer-reviewed articles on BSC in OM, revealing evidence of dynamic and reciprocal relationships among performance drivers and outcome measures across all four BSC perspectives.
• Warrant: Because BSC critiques highlight oversimplified, static cause-effect assumptions and because system dynamics can model feedback loops and complexity effectively, adopting system dynamics provides a more realistic understanding of BSC in OM.
• Backing: Prior works by Kaplan and Norton (1996a; 2004) and later research advocating second- and third-generation BSCs employ system dynamics to support more nuanced causal analysis.
• Qualifier: The system dynamics approach may not capture all contextual variations and requires further empirical validation for all OM contexts.
• Rebuttal: Some BSC implementations may find simpler models sufficient depending on organizational context or resource constraints.

---

Claim 2: Performance drivers and outcome measures within and between the four BSC perspectives in OM relate systemically, forming interlinked feedback loops rather than following a strictly hierarchical or trade-off model.

• Data: Causal loop diagrams synthesized from reviewed studies show multiple positive and balancing feedback loops connecting indicators within and across BSC perspectives; only one loop is balancing, the rest are reinforcing loops, opposing trade-off views.
• Warrant: System dynamics and empirical findings reveal that indicators influence each other reciprocally rather than linearly, undermining models based on hierarchical or simple dyadic trade-offs (e.g., sand-cone or trade-off models).
• Backing: Consistency with systems theory and research criticism of BSC’s static assumptions strengthen this claim.
• Qualifier: The precise nature of these loops may depend on firm-specific and context-specific factors, requiring customized mapping.
• Rebuttal: Certain OM contexts or industries might still exhibit some trade-offs or hierarchical relationships that are dynamic but visible in localized ways.

---

Claim 3: The creation of a dynamic strategy map based on system dynamics enhances both scholarly understanding and managerial implementation of BSC in OM contexts.

• Data: The study proposes a dynamic strategy map integrating four identified causal loops that reflect performance interactions. It clarifies relationships between drivers and outcomes and addresses BSC critiques on simplicity and unidirectionality.
• Warrant: A comprehensively mapped dynamic strategy enables managers to perceive complex interdependencies, align strategies better, and tailor performance measurement systems more effectively.
• Backing: Prior theoretical frameworks and practical studies demonstrate that improved causal clarity leads to better strategic control and operational viability (linking to viable system model theory).
• Qualifier: Practical application remains conceptual in this study and requires adaptation, verification, and refinement in real-world settings.
• Rebuttal: Without empirical testing, the proposed map might overlook unexpected interactions or practical barriers in various OM organizations.

---

Critical Review Using the Socratic Method

Q1: What is the core value of integrating system dynamics with the BSC for OM? A1: It moves beyond static, one-way causal assumptions, allowing a fuller appreciation of complex feedbacks and interdependencies in performance measures, which better reflects real-world operations.

Q2: But does this complexity risk making the BSC too complicated for practical use by managers? A2: It could. While theoretically insightful, complexity can impede accessibility and adoption. The authors recognize this and suggest tailored implementation steps, but how manageable this is remains to be proven in practice.

Q3: How strong is the empirical support for these dynamic causal loops in OM settings? A3: The article’s support is literature-based synthesis rather than new empirical data. Although robust in review methodology, the causal loops are inferred more from logic and existing studies than from fresh field validation. Empirical proof remains an important next step.

Q4: Could the dynamic strategy map and causal loops be oversimplifying or overgeneralizing across different OM sectors and scales? A4: Given that OM contexts vary widely, the universal applicability is uncertain. The authors note the need for adaptation to context, but without granular differentiation, some relationships might not hold or could be inverted.

Q5: Does the paper address how managers can practically operationalize this system dynamics-based BSC? A5: The article provides a conceptual foundation and outlines a systematic procedure for implementation but stops short of offering concrete case studies or guidelines for overcoming real-world barriers.

Q6: Could simpler, more traditional BSC models still be adequate or preferable for some organizations? A6: Yes. While this work reveals the benefits of a dynamic approach, the complexity and data needs may not fit all organizations. Trade-offs between depth and usability should be considered.

Q7: What is the paper’s contribution to theory and practice? A7: It advances the theoretical understanding of BSC in OM by empirically-informed systemic causality and provides a novel dynamic strategy map. Practically, it equips managers with a conceptual tool, but real-world testing is needed.

---

Summary

Overall, the article makes a compelling case for a system dynamics approach in understanding and implementing the BSC in OM, supported by rigorous literature synthesis. However, the conceptual nature of the contribution and the lack of empirical testing limit immediate practical applicability. Future research should empirically validate and adapt these dynamic models, balancing complexity with managerial usability.

 

Describe 2 main research limitations of the article.

Two main research limitations of the article are:

1.    Lack of Practical Implementation and Empirical Validation: The proposed dynamic strategy map for operations management (OM) is conceptual and has not been practically implemented or empirically tested. While the article provides a framework and possible steps for applying the system dynamics approach to the balanced scorecard (BSC) in OM contexts, it does not offer real-world case studies or data that validate the effectiveness or generalizability of the model. The authors explicitly acknowledge this gap and call for future empirical studies to confirm the causal relationships and practical applicability of their framework.

2.    Context-Specificity and Generalizability Concerns: The dynamic relationships and causal loops identified through the systematic literature review may vary across different organizational contexts, including industry sectors, firm size, strategy, and culture. The article notes that the strategy map needs to be adapted to specific operational contexts to ensure the relevance and accuracy of the performance measurement system. This indicates a limitation in the universal applicability of the model without customization, potentially limiting the direct transferability of the findings across diverse OM environments.