JAIT 2026 Vol.17(7): 1310-1320
doi: 10.12720/jait.17.7.1310-1320

Cross-Dataset Generalization Framework for Cybercrime Detection Using CIC-IDS2017, CIC-Phishing2019, and Malicious Uniform Resource Locator (URL) Data

R. Adinarayana1,* , G. Vamsi Krishna2

  • 1Department of Computer Science and Systems Engineering, Andhra University, Visakhapatnam, India
  • 2Department of Computer Science and Engineering, Dr. Lankapalli Bullayya College of Engineering (A), Visakhapatnam, India

* Corresponding author

  • Manuscript receivedFebruary 8, 2026
  • revisedApril 8, 2026
  • acceptedMay 6, 2026
  • publishedJuly 23, 2026

Abstract

Proposed cybercrime detection models demonstrate satisfactory performance on specific benchmark datasets; however, they are not always robust across diverse, practical scenarios. This paper examines the generalization performance of a cross-dataset measure for cybercrime detection across network traffic, phishing email, and malicious Uniform Resource Locator (URL) domains. The work combines three popular security benchmarks Canadian Institute for Cybersecurity Intrusion Detection System Dataset2017 (CIC-IDS2017), Canadian Institute for Cybersecurity Phishing Dataset2019 (CIC-Phishing2019), and Malicious URL 2020 in a single preprocessing and learning pipeline to avoid dataset-specific bias. One or more datasets are used to train models, which are then directly evaluated on previously unseen datasets to verify transferability across distribution shifts. We will discuss performance while considering accuracy, F1−Score, Receiver Operating Characteristic (ROC), and fold-to-fold stability. Experiments demonstrate that direct training with a single random source results in significant performance deterioration, with a 23% decrease in F1−Score when applied to unseen datasets. In contrast, the degradation caused by the proposed framework is kept below 10% and maintains Receiver Operating Characteristic–Area Under the Curve (ROC–AUC) values consistently above 0.90. Paired significance testing demonstrates that the gains in robustness are highly significant (<em>p</em> < 0.01). The results indicate that cross-dataset evaluation is essential for the development of deployable cybercrime detection systems, providing empirical insights for developing generalization-oriented security analytics.

Keywords

  • cross-dataset generalization
  • cybercrime detection
  • network traffic analysis
  • phishing email detection
  • malicious Uniform Resource Locator (URL) classification
  • security benchmark datasets
JAIT-V17N7-1310

How to Cite

Copied

R. Adinarayana and G. Vamsi Krishna, "Cross-Dataset Generalization Framework for Cybercrime Detection Using CIC-IDS2017, CIC-Phishing2019, and Malicious Uniform Resource Locator (URL) Data," Journal of Advances in Information Technology, vol. 17, no. 7, pp. 1310-1320, 2026. https://doi.org/10.12720/jait.17.7.1310-1320

Copyright & License

Copyright © 2026 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Article Metrics in Dimensions