Glitches in the matrix: threats to the validity of data-driven business process simulation
Blümel, Robert, Kirchdorfer, Lukas, Rehse, Jana-Rebecca, Kampik, Timotheus, van der Aa, Han Process Science
· Springer Nature
· 2026-07-31
· DOI: 10.1007/s44311-026-00056-6
Abstract
Business Process Simulation (BPS) is commonly used to conduct what-if analyses and assess the impact of changes to processes and their underlying information systems. In a typical data-driven BPS approach, a simulation model is derived from an event log and evaluated through a six-step method. However, following these steps can introduce systematic errors that potentially bias evaluation results and, thereby, lead to incorrect assessments of simulation model quality. To address this, we identify five systematic errors as threats to the internal validity of evaluation results, highlighting the problem and forming the central contribution of this paper. Through empirical examples, we demonstrate that these threats can distort evaluation outcomes, both individually and in combination, even when the same process and simulation model are applied. Building upon this analysis, we outline a conceptual framework that integrates these insights with established methods from related fields to guide mitigation of the identified threats. By recognizing the threats, we highlight how simulation accuracy may be misjudged, and by proposing this framework, we enable more valid evaluations that better support decisions about redesigning business processes and information systems.
Blümel, Robert, Kirchdorfer, Lukas, Rehse, Jana-Rebecca et al. Glitches in the matrix: threats to the validity of data-driven business process simulation. // Process Science. – 2026. – DOI: 10.1007/s44311-026-00056-6. – URL: http://link.springer.com/openurl/fulltext?id=doi:10.1007/s44311-026-00056-6
Blümel, Robert, Kirchdorfer, Lukas, Rehse, Jana-Rebecca, Kampik, Timotheus, van der Aa, & Han (2026). Glitches in the matrix: threats to the validity of data-driven business process simulation. Process Science. https://doi.org/10.1007/s44311-026-00056-6
Blümel, et al. “Glitches in the matrix: threats to the validity of data-driven business process simulation.” Process Science, 2026. doi:10.1007/s44311-026-00056-6.
@article{Blmel2026,
title = {Glitches in the matrix: threats to the validity of data-driven business process simulation},
author = {Blümel and Robert and Kirchdorfer and Lukas and Rehse and Jana-Rebecca and Kampik and Timotheus and Aa, van der and Han},
journal = {Process Science},
year = {2026},
doi = {10.1007/s44311-026-00056-6},
url = {http://link.springer.com/openurl/fulltext?id=doi:10.1007/s44311-026-00056-6}
}
The diffusion of Artificial Intelligence (AI) is reshaping the competitive architecture of small and medium enterprises (SMEs), yet the extent to which AI adoption is associated with measurable competitive advantage among...
This study draws on Uses and Gratifications Theory (UGT), the MAIN model, and prior OTT service research to examine key factors associated with consumer satisfaction with OTT SVOD platforms, focusing on entertainment, escape, modality,...
Research has shown that entrepreneurial ecosystems (EEs) shape universities’ entrepreneurial activities. However, limited attention has been paid to how university entrepreneurial ecosystems (UEEs) support graduate start-up creation...
This study investigates the safe-haven resilience of Gold, the US dollar (USD), and Bitcoin against four systemic tail risks—stock market volatility (VIX), oil market volatility (OVX), geopolitical risk (GPR), and climate risk—over the...
NA. Tanzania’s sisal exports are an important source of foreign exchange and rural income, but their value is volatile, reflecting global demand cycles, competition from synthetic fibres, climatic variability and domestic supply...