Search papers, labs, and topics across Lattice.
This study introduces a staged robustness analysis framework that integrates Structural Equation Modelling (SEM), Ordinary Least Squares (OLS) regression, and Double Machine Learning (DML) to assess the stability of findings in survey-based research. By applying this framework to a FinTech Digital Customer Intimacy survey model, the authors reveal which relationships remain robust across different estimation methods and which require cautious interpretation. The results emphasize the importance of methodological transparency and robustness in survey-based research, offering a reproducible template for future studies.
Stability of survey-based findings varies significantly across SEM, OLS, and DML methods, revealing critical insights that could reshape interpretative practices in research.
Structural equation modelling (SEM) is widely used in survey-based business and information systems research to assess latent constructs and theory-driven structural relationships. However, SEM path significance is obtained within a particular model specification and may not show whether findings remain stable under alternative estimation frameworks. This study develops and demonstrates a staged robustness analysis framework that connects SEM, ordinary least squares (OLS) regression, and Double Machine Learning (DML). SEM is first used to refine the measurement structure and estimate the robustness-baseline SEM model, in which the full theory-specified structural path system is retained for downstream robustness analysis before final structural path evaluation. OLS regression is then applied to SEM-derived construct scores as a transparent regression benchmark. Finally, DML-style residualisation is used to examine whether each tested focal relationship remains stable after flexible machine-learning-based adjustment for observed controls. Learner-sensitivity checks compare Random Forest, Gradient Boosting, and Support Vector Machine learners, and selected reverse-direction diagnostics are used to examine directional sensitivity. The framework is demonstrated using a FinTech Digital Customer Intimacy survey model. The findings identify which relationships are stable across SEM, OLS, and DML-style checks, and which require more cautious interpretation. A reproducible Google Colab workbook and generated result files are publicly available, providing a reusable template that researchers and students can adapt to other survey-based latent-construct studies. The paper contributes a practical robustness workflow and interpretation guide for survey-based researchers seeking to complement SEM with conventional and machine-learning-based robustness checks.