Evaluating the Performance of AI-Based Software Tools in Intelligent Decision-Making Systems
DOI:
https://doi.org/10.47941/ijce.3315Keywords:
Artificial Intelligence, Decision Support Systems, Intelligent Decision-Making, AI Software Tools, IoT IntegrationAbstract
This paper evaluates the performance of AI-based software tools within intelligent decision-making systems, emphasizing their application in Industry 4.0 environments. Various AI techniques, including machine learning, deep learning, and natural language processing—are assessed across domains such as predictive maintenance, quality control, supply chain optimization, and energy management. To advance this field, we introduce a novel framework, RAISE-DM (Real-time Adaptive Intelligence Software Evaluation for Decision-Making), which combines real-time data acquisition from IoT devices with adaptive AI models for continuous decision optimization. Performance evaluation considers key parameters such as scalability, response time, accuracy, and interpretability. The study also highlights critical technical barriers like data heterogeneity and integration complexity, offering targeted strategies to address them. By providing a structured performance analysis and proposing a scalable evaluation model, this research contributes to the design of more efficient, transparent, and resilient AI-driven decision support systems applicable across industrial and cross-sector settings.
Downloads
References
[1] Rezaei, Mojtaba, Marco Pironti, and Roberto Quaglia. "AI in knowledge sharing, which ethical challenges are raised in decision-making processes for organisations?." Management Decision (2024).
[2] Bashaddadh, Omar, Nazlia Omar, Masnizah Mohd, and Mohd Nor Akmal Khalid. "Machine Learning and Deep Learning Approaches for Fake News Detection: A Systematic Review of Techniques, Challenges, and Advancements." IEEE Access (2025).
[3] Shandilya, Shishir Kumar, Agni Datta, Yash Kartik, and Atulya Nagar. "Role of artificial intelligence and machine learning." In Digital Resilience: Navigating Disruption and Safeguarding Data Privacy, pp. 313-399. Cham: Springer Nature Switzerland, 2024.
[4] Koushik, Priyanka, Sumit Mittal, Seema Nath Jain, and Pawan Whig. "Enhancing Predictive Maintenance in Supply Chain Systems With Deep Learning Strategies." In Quantum Computing and Supply Chain Management: A New Era of Optimization, pp. 141-159. IGI Global, 2024.
[5] Logeswaran, K., S. Savitha, P. Suresh, K. R. Prasanna Kumar, M. Gunasekar, R. Rajadevi, M. K. Dharani, and A. S. Jayasurya. "Unifying technologies in industry 4.0: Harnessing the synergy of internet of things, big data, augmented reality/virtual reality, and blockchain technologies." Topics in Artificial Intelligence Applied to Industry 4.0 (2024): 127-147.
[6] Han, Xiao, Shumei Xiao, Jun Sheng, and Guangtao Zhang. "Enhancing efficiency and decision-making in higher education through intelligent commercial integration: Leveraging artificial intelligence." Journal of the Knowledge Economy 16, no. 1 (2025): 1546-1582.
[7] Assis, André, Jamilson Dantas, and Ermeson Andrade. "The performance-interpretability trade-off: A comparative study of machine learning models." Journal of Reliable Intelligent Environments 11, no. 1 (2025): 1.
[8] Manfren, Massimiliano, and Karla M. Gonzalez-Carreon. "Tracking decarbonisation: Scalable and interpretable data-driven methods for district energy systems." Applied Energy 391 (2025): 125883.
[9] Hassija, Vikas, Vinay Chamola, Atmesh Mahapatra, Abhinandan Singal, Divyansh Goel, Kaizhu Huang, Simone Scardapane, Indro Spinelli, Mufti Mahmud, and Amir Hussain. "Interpreting black-box models: a review on explainable artificial intelligence." Cognitive Computation 16, no. 1 (2024): 45-74.
[10] Sabeena, Jasmine. "Demystifying the Black Box: Explainable AI for Transparency and Trust in Sustainable Business Decisions." In AI Integration for Business Sustainability: For a Resilient Future, pp. 131-142. Singapore: Springer Nature Singapore, 2025.
[11] Hassija, Vikas, Vinay Chamola, Atmesh Mahapatra, Abhinandan Singal, Divyansh Goel, Kaizhu Huang, Simone Scardapane, Indro Spinelli, Mufti Mahmud, and Amir Hussain. "Interpreting black-box models: a review on explainable artificial intelligence." Cognitive Computation 16, no. 1 (2024): 45-74.
[12] Mathew, Daniel Enemona, Deborah Uzoamaka Ebem, Anayo Chukwu Ikegwu, Pamela Eberechukwu Ukeoma, and Ngozi Fidelia Dibiaezue. "Recent emerging techniques in explainable artificial intelligence to enhance the interpretable and understanding of AI models for human." Neural Processing Letters 57, no. 1 (2025): 16.
[13] Panagoulias, Dimitrios P., Maria Virvou, and George A. Tsihrintzis. "A novel framework for artificial intelligence explainability via the technology acceptance model and rapid estimate of adult literacy in medicine using machine learning." Expert Systems with Applications 248 (2024): 123375.
[14] Kostopoulos, Georgios, Gregory Davrazos, and Sotiris Kotsiantis. "Explainable artificial intelligence-based decision support systems: A recent review." Electronics 13, no. 14 (2024): 2842.
[15] Kostopoulos, Georgios, Gregory Davrazos, and Sotiris Kotsiantis. "Explainable artificial intelligence-based decision support systems: A recent review." Electronics 13, no. 14 (2024): 2842.
[16] Zahid, Idrees A., Salem Garfan, M. A. Chyad, A. S. Albahri, O. S. Albahri, A. H. Alamoodi, Muhammet Deveci, Raad Z. Homod, and Laith Alzubaidi. "Explainability, Robustness, and Fairness in User-Centric Intelligent Systems: A Systematic Review." IEEE Transactions on Emerging Topics in Computational Intelligence (2025).
[17] Almadani, Basem, Hunain Kaisar, Irfan Rashid Thoker, and Farouq Aliyu. "A systematic survey of distributed decision support systems in healthcare." Systems 13, no. 3 (2025): 157.
[18] Kostopoulos, Georgios, Gregory Davrazos, and Sotiris Kotsiantis. "Explainable artificial intelligence-based decision support systems: A recent review." Electronics 13, no. 14 (2024): 2842.
[19] Kostopoulos, Georgios, Gregory Davrazos, and Sotiris Kotsiantis. "Explainable artificial intelligence-based decision support systems: A recent review." Electronics 13, no. 14 (2024): 2842.
[20] Alijoyo, Franciskus Antonius, S. Janani, Kathari Santosh, Safa N. Shweihat, Nizal Alshammry, Janjhyam Venkata Naga Ramesh, and Yousef A. Baker El-Ebiary. "Enhancing AI interpretation and decision-making: Integrating cognitive computational models with deep learning for advanced uncertain reasoning systems." Alexandria Engineering Journal 99 (2024): 17-30.
[21] Khosravi, Mohsen, Zahra Zare, Seyyed Morteza Mojtabaeian, and Reyhane Izadi. "Artificial intelligence and decision-making in healthcare: a thematic analysis of a systematic review of reviews." Health services research and managerial epidemiology 11 (2024): 23333928241234863.
[22] Kumar, Prabhat, Danish Javeed, Randhir Kumar, and AKM Najmul Islam. "Blockchain and explainable AI for enhanced decision making in cyber threat detection." Software: Practice and Experience 54, no. 8 (2024): 1337-1360.
[23] Herath Pathirannehelage, Savindu, Yash Raj Shrestha, and Georg von Krogh. "Design principles for artificial intelligence-augmented decision making: An action design research study." European Journal of Information Systems 34, no. 2 (2025): 207-229.
[24] Aljohani, Abeer. "AI-Driven decision-making for personalized elderly care: a fuzzy MCDM-based framework for enhancing treatment recommendations." BMC Medical Informatics and Decision Making 25, no. 1 (2025): 1-16.
[25] Yang, Cherng Chia, Ching Fu Wang, Wei Ming Lin, Shu Wen Chen, and Hsiang Wei Hu. "Evaluating the performance of an AI-powered VBAC prediction system within a decision-aid birth choice platform for shared decision-making." Digital Health 10 (2024): 20552076241257014.
[26] Shulajkovska, Miljana, Maj Smerkol, Gjorgji Noveski, and Matjaž Gams. "Enhancing urban sustainability: developing an open-source AI framework for smart cities." Smart Cities 7, no. 5 (2024): 2670-2701.
[27] Pangavhane, Shreyas, Gokul Raktate, Prasad Pariane, Krishna Shelar, Rohit Wakchaure, and J. N. Kale. "AI-augmented software development: Boosting efficiency and quality." In 2024 International Conference on Decision Aid Sciences and Applications (DASA), pp. 1-5. IEEE, 2024.
[28] Wu, Meng, and Xue Qin. "AI based smart business management and control analysis based decision making by machine learning model." Entertainment Computing 51 (2024): 100724.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Abdinasir Ismael Hashi, Mr.Osman Abdullahi Jama
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution (CC-BY) 4.0 License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
