The Effect of Trust in Generative AI on Critical Thinking: The Mediating Role of AI Over-Reliance

Authors

  • Rina Matsumoto The University of Osaka, Suita, Osaka, Japan
  • Kenta Ishii The University of Osaka, Suita, Osaka, Japan
  • Shota Miyazaki The University of Osaka, Suita, Osaka, Japan

DOI:

https://doi.org/10.66238/smsrj.v4i2.77

Keywords:

generative AI, cognitive dependence, critical thinking, higher education, mediation analysis, human–AI collaboration, trust, over-reliance

Abstract

Trust is necessary for productive use of generative artificial intelligence (GenAI), yet excessive trust can shift cognitive work from the learner to the system. This study tests whether AI over-reliance mediates the relationship between trust in GenAI and critical-thinking disposition. We conduct a reproducible secondary mediation analysis using a public dataset of 2,614 Bangladeshi university students and construct-level statistics reported in its companion conference study. Trust in AI was strongly associated with cognitive dependence (r = .707). Using standardized ordinary least-squares mediation reconstructed from the published correlation matrix, the trust→dependence path was a = .707; the dependence→critical-thinking path controlling for trust was b = .150; the direct trust→critical-thinking path was c′ = .242; and the indirect effect was ab = .106 (delta-method SE = .018, z = 5.78, 95% CI [.070, .142]). The total trust–critical-thinking association was c = .348, so 30.5% of the observed association was carried through cognitive dependence. Importantly, the indirect path is positive in this self-report dataset, which does not support a simple “more dependence means less critical thinking” account. We interpret this pattern as a calibration paradox: high-trust students may simultaneously report stronger critical-thinking tendencies and stronger reliance, while behavioral studies can still show performance costs from uncritical acceptance. The paper contributes a dual-pathway framework that distinguishes trust, dependence, and verification quality, and derives design implications for GenAI-supported learning.

 

References

[1] R. Arifen, M. K. M. Rahman, and S. Khandakar, “Dataset on Cognitive Dependence on Generative AI Tools among Bangladeshi University Students,” Mendeley Data, Version 2, 2026, doi: 10.17632/7m94b7yr8w.2.

[2] R. Arifen, S. Khandakar, M. K. M. Rahman, and A. Azad, “Exploring Cognitive Dependence on Generative AI among Bangladeshi University Students: The Roles of Trust, Critical Thinking, and Academic Decision-Making,” in Proc. Symposium on Photonics, Emerging Computational Technologies, Research & AI-Data Science (SPECTRA), 2026, doi: 10.5281/zenodo.21459044.

[3] J. D. Lee and K. A. See, “Trust in automation: Designing for appropriate reliance,” Human Factors, vol. 46, no. 1, pp. 50–80, 2004, doi: 10.1518/hfes.46.1.50_30392.

[4] R. Parasuraman and V. Riley, “Humans and automation: Use, misuse, disuse, abuse,” Human Factors, vol. 39, no. 2, pp. 230–253, 1997, doi: 10.1518/001872097778543886.

[5] M. T. Dzindolet, S. A. Peterson, R. A. Pomranky, L. G. Pierce, and H. P. Beck, “The role of trust in automation reliance,” International Journal of Human-Computer Studies, vol. 58, no. 6, pp. 697–718, 2003, doi: 10.1016/S1071-5819(03)00038-7.

[6] K. A. Hoff and M. Bashir, “Trust in automation: Integrating empirical evidence on factors that influence trust,” Human Factors, vol. 57, no. 3, pp. 407–434, 2015, doi: 10.1177/0018720814547570.

[7] E. Glikson and A. W. Woolley, “Human trust in artificial intelligence: Review of empirical research,” Academy of Management Annals, vol. 14, no. 2, pp. 627–660, 2020, doi: 10.5465/annals.2018.0057.

[8] L. J. Skitka, K. L. Mosier, and M. Burdick, “Does automation bias decision-making?” International Journal of Human-Computer Studies, vol. 51, no. 5, pp. 991–1006, 1999, doi: 10.1006/ijhc.1999.0252.

[9] K. Goddard, A. Roudsari, and J. C. Wyatt, “Automation bias: A systematic review of frequency, effect mediators, and mitigators,” Journal of the American Medical Informatics Association, vol. 19, no. 1, pp. 121–127, 2012, doi: 10.1136/amiajnl-2011-000089.

[10] E. F. Risko and S. J. Gilbert, “Cognitive offloading,” Trends in Cognitive Sciences, vol. 20, no. 9, pp. 676–688, 2016, doi: 10.1016/j.tics.2016.07.002.

[11] B. Sparrow, J. Liu, and D. M. Wegner, “Google effects on memory: Cognitive consequences of having information at our fingertips,” Science, vol. 333, no. 6043, pp. 776–778, 2011, doi: 10.1126/science.1207745.

[12] Z. Buçinca, M. B. Malaya, and K. Z. Gajos, “To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-Assisted Decision-Making,” Proceedings of the ACM on Human-Computer Interaction, vol. 5, no. CSCW1, 2021, doi: 10.1145/3449287.

[13] M. Schemmer, N. Kühl, C. Benz, A. Bartos, and G. Satzger, “Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations,” in Proc. 28th Int. Conf. Intelligent User Interfaces (IUI), pp. 410–422, 2023, doi: 10.1145/3581641.3584066.

[14] Y. Zhang, Q. V. Liao, and R. K. E. Bellamy, “Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making,” in Proc. FAT* 2020, pp. 295–305, 2020, doi: 10.1145/3351095.3372852.

[15] Q. V. Liao, D. Gruen, and S. Miller, “Questioning the AI: Informing design practices for explainable AI user experiences,” in Proc. CHI 2020, pp. 1–15, 2020, doi: 10.1145/3313831.3376590.

[16] N. T. Mai, Q. Fang, and W. Cao, “Measuring Student Trust and Over-Reliance on AI Tutors: Implications for STEM Learning Outcomes,” International Journal of Social Sciences and English Literature, vol. 9, no. 12, pp. 11–17, 2025, doi: 10.55220/2576-683x.v9.799.

[17] C. Hou, G. Zhu, and V. Sudarshan, “The role of critical thinking on undergraduates’ reliance behaviours on generative AI in problem-solving,” British Journal of Educational Technology, vol. 56, pp. 1919–1941, 2025, doi: 10.1111/bjet.13613.

[18] A. Y. H. Goh, A. Hartanto, and N. M. Majeed, “Generative artificial intelligence dependency: Scale development, validation, and its motivational, behavioral, and psychological correlates,” Computers in Human Behavior Reports, vol. 20, Art. no. 100845, 2025, doi: 10.1016/j.chbr.2025.100845.

[19] C. Zhai, S. Wibowo, and L. D. Li, “The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review,” Smart Learning Environments, vol. 11, Art. no. 28, 2024, doi: 10.1186/s40561-024-00316-7.

[20] J. Tian and R. Zhang, “Outsourcing thinking to AI? Focused immersion, AI dependency, and the double-edged impact on critical thinking,” Humanities and Social Sciences Communications, vol. 13, Art. no. 1015, 2026, doi: 10.1057/s41599-026-07153-8.

[21] S. Si, Y. Qi, J. Xu, and X. Qi, “When Thinking Is Outsourced: Cognitive Offloading and the Heterogeneity of Critical Thinking Among Chinese University Students Using Generative Artificial Intelligence,” Journal of Intelligence, vol. 14, no. 7, Art. no. 116, 2026, doi: 10.3390/jintelligence14070116.

[22] Yue, X., & Zhu, R. (2024). An explainable hybrid machine learning framework for cash-flow-conditioned multi-horizon liquidity risk early warning: An SME-oriented benchmark study. World Journal of Management Science, 2(1), 63-72.

[23] Jiao, Y., & Liang, Y. (2024). An integrated process mining and explainable machine learning framework for bottleneck and internal control risk detection in the multi entity financial close. Social Science and Management, 1(3), 96-107.

[24] Bian, M., Wang, Y., & Lin, Y. (2024). Explainable supplier risk prediction for critical telecommunications infrastructure procurement: An empirical XGBoost–SHAP framework. Social Science and Management, 1(1), 64-77.

[25] Shang, W., & Chen, T. (2024). PrefixKD-Edge: Real-time locomotion-intent prediction with prefix self-distillation on lightweight temporal networks. Innovation and Technology Studies, 1(1), 30–38.

[26] Rhee, M., Zou, J., & Qin, Y. (2024). CLARITY: A closed loop framework for duplicate aware failure prediction and budgeted automated remediation in cloud infrastructure. AI and Data Science Journal, 1(1), 76-85.

[27] Lin, Y., Wang, Y., & Bian, M. (2024). XOR EW: An explainable and cost aware artificial intelligence framework for operational risk early warning in financial institutions. AI and Data Science Journal, 1(1), 94-102.

[28] Zhao, W., & Wang, B. (2022). CAPA: A prediction‑driven autoscaling framework for SLO‑aware cloud‑native machine learning inference. Journal of Computer Science and Electrical Engineering, 4(1), 8-16.

[29] Fang, Q., & Liu, W. (2025). HARLA-ED: Resolving Information Asymmetry and Enhancing Algorithmic Symmetry in Intelligent Educational Assessment via Hybrid Reinforcement Learning. Symmetry, 18(1), 58.

[30] Wang, Y., & Zhang, C. (2023). AERIS: Adaptive executor scoped resource management for privacy preserving data processing in Apache Spark. Eurasia Journal of Science and Technology, 5(2), 25-33

Downloads

Published

2026-09-29

Issue

Section

Articles