Home > Published Issues > 2025 > Volume 16, No. 9, 2025 >
JAIT 2025 Vol.16(9): 1329-1337
doi: 10.12720/jait.16.9.1329-1337

Energy Distance Based Similarity Analysis of Hyperparameter Optimization Results for Random Forests

Thuy Thi Tran 1,2, Nghia Quoc Phan 1, and Hiep Xuan Huynh 3,4,*
1. Assessment Office, Tra Vinh University, Tra Vinh, Vietnam
2. Network Management Center, University of Cuu Long, Vinh Long, Vietnam
3. College of Information and Communication Technology, Can Tho University, Can Tho, Vietnam
4. CTU Leading Research Team on Automation, Artificial Intelligence, inforMation tEchnology and Digital Transformation, Can Tho University, Can Tho, Vietnam
Email: tranthithuy.dhcl@gmail.com (T.T.T.); nghiavnt@tvu.edu.vn (N.Q.P.); hxhiep@ctu.edu.vn (H.X.H.)
*Corresponding author

Manuscript received January 24, 2025; revised February 27, 2025; accepted May 9, 2025; published September 19, 2025.

Abstract—In this study, we propose a novel approach for analyzing the results of Hyperparameter Optimization (HPO) for Random Forest (RF) models by applying Energy Distance (ED), a metric based on pairwise Euclidean distances. This method provides a quantitative measure of the similarities and differences between the configurations of hyperparameters and their corresponding performance metrics. We use a dataset from a hyperparameter optimization experiment for RF, where we explore the relationship between hyperparameter settings and model accuracy. The results indicate that Energy Distance can offer useful insights into the proximity of different hyperparameter configurations and help identify clusters of similar configurations, which can be useful for model selection and optimization.
 
Keywords—energy distance, hyperparameter optimization, random forest, Euclidean distance, machine learning

Cite: Thuy Thi Tran, Nghia Quoc Phan, and Hiep Xuan Huynh, "Energy Distance Based Similarity Analysis of Hyperparameter Optimization Results for Random Forests," Journal of Advances in Information Technology, Vol. 16, No. 9, pp. 1329-1337, 2025. doi: 10.12720/jait.16.9.1329-1337

Copyright © 2025 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Article Metrics in Dimensions