Teo Susnjak

dblp:57/7231 · DBLP profile ↗
← Back
16ranked-venue papers
7as first author
7since 2021 · last 2026
0000-0001-9416-1435ORCID · verified

Domains — the database's venue-derived domains; a paper can count in several

Artificial intelligence and machine learning · 8 · 5 first-author · 3 since 2021Security and privacy · 2 · 2 since 2021Software engineering, systems software and programming languages · 2Databases, data management, data science and information retrieval · 2 · 1 first-author · 2 since 2021Graphics, computer vision, multimedia, augmented reality and games · 1 · 1 first-authorHuman-computer interaction and ubiquitous computing · 1

Expertise — from the expertise taxonomy: the topics of the expert's papers under the CCF categories. A weight counts papers with recency: 1 for a paper about the topic, 0.3 when the topic is its context, halved every five years.

Interdisciplinary, comprehensive, and emerging computing
1 paper
Computational social science and digital humanities · 100%
Human-computer interaction and pervasive computing
1 paper
Health and well-being technologies · 100%

Topics — the 2 heaviest of 2, each with the papers that count most for it

TopicWeightPapersLastEvidence papers
Computational social science and digital humanities
social media
0.412020
A systematic literature review: What is the current stance towards weight stigmatization in social media platforms? · Int. J. Hum. Comput. Stud. 2020
Health and well-being technologies › digital well-being
body image
0.112020
A systematic literature review: What is the current stance towards weight stigmatization in social media platforms? · Int. J. Hum. Comput. Stud. 2020

Methods — techniques the papers use, named apart from their topics

systematic literature review · 0.9
YearPublicationVenuePosition
2026 Over the Edge of Chaos? Excess Complexity as a Roadblock to Artificial General Intelligence
abstract
This study explores the progression of artificial intelligence (AI) systems through the lens of complexity theory, challenging conventional linear projections of advancement toward artificial general intelligence (AGI). We posit the existence of critical points, akin to phase transitions, where increasing system complexity may not lead to greater capability, but rather to performance plateaus or instability. To investigate this hypothesis, we used agent-based modelling (ABM) to simulate the evolution of AI systems, using evaluation benchmark performances as a proxy for complexity. Our simulations modeled the possible characteristics that systems could exhibit when crossing a critical threshold, transitioning from predictable improvement to a regime of erratic, volatile behavior. Practically, we introduced and validated a methodology for detecting these simulated critical transitions algorithmically. We proposed a heuristic Stochastic Gradient Descent-based approach and compared it with established CUmulative SUM (CUSUM) and Lyapunov exponent techniques, to show that different signatures of instability-from abrupt shifts to gradual volatility ramps-can be identified. We contextualized these findings with real-world phenomena, arguing that the empirically observed -"Jagged Capability Frontier" in large language models (LLMs) illustrates the kind of nonlinear performance boundaries that could be sharply accentuated by the onset of criticality. This research contributes not only a novel theoretical framework for understanding potential limits to AI scaling but also a practical, validated methodology for monitoring the systemic stability of AI systems, offering a new dimension to AGI evaluation and safety.
Teo Susnjak, Timothy R. McIntosh, Andre L. C. Barczak, Napoleon H. Reyes, Tong Liu 0016, Paul A. Watters, Malka N. Halgamuge
IEEE Trans. Cybern.1
2025 Modeling the Chaotic Semantic States of Generative Artificial Intelligence (AI): A Quantum Mechanics Analogy Approach
abstract
Generative AI models have revolutionized intelligent systems by enabling machines to produce human-like content across diverse domains. However, their outputs often exhibit unpredictability due to complex and opaque internal semantic states, posing challenges for reliability in real-world applications. In this article, we introduce the AI Uncertainty Principle , a novel theoretical framework inspired by quantum mechanics, to model and quantify the inherent unpredictability in generative AI outputs. By drawing parallels with the uncertainty principle and superposition, we formalize the tradeoff between the precision of internal semantic states and output variability. Through comprehensive experiments involving state-of-the-art models and a variety of prompt designs, we analyze how factors such as specificity, complexity, tone, and style influence model behavior. Our results demonstrate that carefully engineered prompts can significantly enhance output predictability and consistency, while excessive complexity or irrelevant information can increase uncertainty. We also show that ensemble techniques, such as Sigma-weighted aggregation across models and prompt variations, effectively improve reliability. Our findings have profound implications for the development of intelligent systems, emphasizing the critical role of prompt engineering and theoretical modeling in creating AI technologies that perceive, reason, and act predictably in the real world.
Tong Liu 0016, Timothy R. McIntosh, Teo Susnjak, Paul A. Watters, Malka N. Halgamuge
ACM Trans. Intell. Syst. Technol.3
2025 Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning
abstract
This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our study employed advanced fine-tuning methodologies on open sourced LLMs, applying textual data mining techniques to automate the knowledge discovery and synthesis phases of an SLR process, thus demonstrating a practical and efficient approach for extracting and analyzing high-quality information from large academic datasets. The results maintained high fidelity in factual accuracy in LLM responses, and were validated through the replication of an existing PRISMA-conforming SLR. Our research proposed solutions for mitigating LLM hallucination and proposed mechanisms for tracking LLM responses to their sources of information, thus demonstrating how this approach can meet the rigorous demands of scholarly research. The findings ultimately confirmed the potential of fine-tuned LLMs in streamlining various labor-intensive processes of conducting literature reviews. As a scalable proof-of-concept, this study highlights the broad applicability of our approach across multiple research domains. The potential demonstrated here advocates for updates to PRISMA reporting guidelines, incorporating AI-driven processes to ensure methodological transparency and reliability in future SLRs. This study broadens the appeal of AI-enhanced tools across various academic and research fields, demonstrating how to conduct comprehensive and accurate literature reviews with more efficiency in the face of ever-increasing volumes of academic studies while maintaining high standards.
Teo Susnjak, Peter Hwang, Napoleon H. Reyes, Andre L. C. Barczak, Timothy R. McIntosh, Surangika Ranathunga
ACM Trans. Knowl. Discov. Data1
2024 From COBIT to ISO 42001: Evaluating cybersecurity frameworks for opportunities, risks, and regulatory compliance in commercializing large language models
abstract
This study investigated the integration readiness of four predominant cybersecurity Governance, Risk and Compliance (GRC) frameworks - NIST CSF 2.0, COBIT 2019, ISO 27001:2022, and the latest ISO 42001:2023 - for the opportunities, risks, and regulatory compliance when adopting Large Language Models (LLMs), using qualitative content analysis and expert validation. Our analysis, with both LLMs and human experts in the loop, uncovered potential for LLM integration together with inadequacies in LLM risk oversight of those frameworks. Comparative gap analysis has highlighted that the new ISO 42001:2023, specifically designed for Artificial Intelligence (AI) management systems, provided most comprehensive facilitation for LLM opportunities, whereas COBIT 2019 aligned most closely with the European Union AI Act. Nonetheless, our findings suggested that all evaluated frameworks would benefit from enhancements to more effectively and more comprehensively address the multifaceted risks associated with LLMs, indicating a critical and time-sensitive need for their continuous evolution. We propose integrating human-expert-in-the-loop validation processes as crucial for enhancing cybersecurity frameworks to support secure and compliant LLM integration, and discuss implications for the continuous evolution of cybersecurity GRC frameworks to support the secure integration of LLMs.
Timothy R. McIntosh, Teo Susnjak, Tong Liu 0016, Paul A. Watters, Dan Xu 0021, Raza Nowrozy, Malka N. Halgamuge
Comput. Secur.2
2024 A Reasoning and Value Alignment Test to Assess Advanced GPT Reasoning
abstract
In response to diverse perspectives on artificial general intelligence (AGI), ranging from potential safety and ethical concerns to more extreme views about the threats it poses to humanity, this research presents a generic method to gauge the reasoning capabilities of artificial intelligence (AI) models as a foundational step in evaluating safety measures. Recognizing that AI reasoning measures cannot be wholly automated, due to factors such as cultural complexity, we conducted an extensive examination of five commercial generative pre-trained transformers (GPTs), focusing on their comprehension and interpretation of culturally intricate contexts. Utilizing our novel “Reasoning and Value Alignment Test,” we assessed the GPT models’ ability to reason in complex situations and grasp local cultural subtleties. Our findings have indicated that, although the models have exhibited high levels of human-like reasoning, significant limitations remained, especially concerning the interpretation of cultural contexts. This article also explored potential applications and use-cases of our Test, underlining its significance in AI training, ethics compliance, sensitivity auditing, and AI-driven cultural consultation. We concluded by emphasizing its broader implications in the AGI domain, highlighting the necessity for interdisciplinary approaches, wider accessibility to various GPT models, and a profound understanding of the interplay between GPT reasoning and cultural sensitivity.
Timothy R. McIntosh, Tong Liu 0016, Teo Susnjak, Paul A. Watters, Malka N. Halgamuge
ACM Trans. Interact. Intell. Syst.3
2023 Harnessing GPT-4 for generation of cybersecurity GRC policies: A focus on ransomware attack mitigation
abstract
This study investigated the potential of Generative Pre-trained Transformers (GPTs), a state-of-the-art large language model, in generating cybersecurity policies to deter and mitigate ransomware attacks that perform data exfiltration. We compared the effectiveness, efficiency, completeness, and ethical compliance of GPT-generated Governance, Risk and Compliance (GRC) policies, with those from established security vendors and government cybersecurity agencies, using game theory, cost-benefit analysis, coverage ratio, and multi-objective optimization. Our findings demonstrated that GPT-generated policies could outperform human-generated policies in certain contexts, particularly when provided with tailored input prompts. To address the limitations of our study, we conducted our analysis with thorough human moderation, tailored input prompts, and the inclusion of legal and ethical experts. Based on these results, we made recommendations for corporates considering the incorporation of GPT in their GRC policy making.
Timothy R. McIntosh, Tong Liu 0016, Teo Susnjak, Hooman Alavizadeh, Alex Ng, Raza Nowrozy, Paul A. Watters
Comput. Secur.3
2022 The Application of Machine Learning Techniques for Predicting Match Results in Team Sport: A Review
abstract
Predicting the results of matches in sport is a challenging and interesting task. In this paper, we review a selection of studies from 1996 to 2019 that used machine learning for predicting match results in team sport. Considering both invasion sports and striking/fielding sports, we discuss commonly applied machine learning algorithms, as well as common approaches related to data and evaluation. Our study considers accuracies that have been achieved across different sports, and explores whether evidence exists to support the notion that outcomes of some sports may be inherently more difficult to predict. We also uncover common themes of future research directions and propose recommendations for future researchers. Although there remains a lack of benchmark datasets (apart from in soccer), and the differences between sports, datasets and features makes between-study comparisons difficult, as we discuss, it is possible to evaluate accuracy performance in other ways. Artificial Neural Networks were commonly applied in early studies, however, our findings suggest that a range of models should instead be compared. Selecting and engineering an appropriate feature set appears to be more important than having a large number of instances. For feature selection, we see potential for greater inter-disciplinary collaboration between sport performance analysis, a sub-discipline of sport science, and machine learning.
Rory P. Bunker, Teo Susnjak
J. Artif. Intell. Res.2
2020 A systematic literature review: What is the current stance towards weight stigmatization in social media platforms?
Vajisha Wanniarachchi, Anuradha Mathrani, Teo Susnjak, Chris Scogings
Int. J. Hum. Comput. Stud.3
2019 The Inadequacy of Entropy-Based Ransomware Detection
Timothy R. McIntosh, Julian Jang, Paul A. Watters, Teo Susnjak
ICONIP (5)4
2016 Design from detail: Analyzing data from a global day of coderetreat
David Parsons 0001, Teo Susnjak, Anuradha Mathrani
Inf. Softw. Technol.2
2014 Influences on regression testing strategies in agile software development environments
David Parsons 0001, Teo Susnjak, Manfred Lange
Softw. Qual. J.2
2013 Coarse-to-fine multiclass learning and classification for time-critical domains
Teo Susnjak, Andre L. C. Barczak, Napoleon H. Reyes, Kenneth A. Hawick
Pattern Recognit. Lett.1
2012 Adaptive cascade of boosted ensembles for face detection in concept drift
Teo Susnjak, Andre L. C. Barczak, Kenneth A. Hawick
Neural Comput. Appl.1
2011 A New Ensemble-Based Cascaded Framework for Multiclass Training with Simple Weak Learners
Teo Susnjak, Andre L. C. Barczak, Napoleon H. Reyes, Kenneth A. Hawick
CAIP (1)1
2010 Adaptive Ensemble Based Learning in Non-stationary Environments with Variable Concept Drift
Teo Susnjak, Andre L. C. Barczak, Kenneth A. Hawick
ICONIP (1)1
2008 Accelerated Classifier Training Using the PSL Cascading Structure
Teo Susnjak, Andre L. C. Barczak
ICONIP (1)1