2024
doi: 10.12720/jait.15.12.1315-1328
A Novel Trans-Dataset Ensemble Architecture for Sign Language Recognition
- College of Computing, Prince of Songkla University, Phuket, Thailand
- Manuscript receivedJune 3, 2024
- revisedJuly 19, 2024
- acceptedAugust 26, 2024
- publishedDecember 6, 2024
Abstract
Sign Language Recognition (SLR) is used to communicate between deaf and normal people or among hearing-impaired communities. The rapid development of Artificial Intelligence technologies can be exploited as a medium to strengthen these connections. Many studies have been conducted to indicate their interest and usefulness. The differences between this study and previous research are as follows: first, increasing the noise robustness and noise robustness analysis because noise can always appear in real applications; Secondly, an architecture is proposed to extend the dataset without merging and retraining all datasets. Our study proposes using a Convolutional Neural Network (CNN) as a feature extractor; different potential models are compared for the effectiveness and complement of feature extractors. Feature normalization was analyzed before being fed to the ensemble classifier. Moreover, our study compared Support Vector Machine (SVM), random forest, and bagging SVM as optimized candidates for the ensemble classifier. Our study shows that the proposed micro-block provides better accuracy than the reference SLRNet-8 model in dataset D1 with some noisy environments, and the proposed trans-dataset ensemble architecture is also better than applying the traditional transfer learning technique with reference SLRNet-8 model when validating with either dataset D1 or D2 in our setting environment.
Keywords
- sign language
- convolutional neural network
- ensemble classifier
- model fusion
- random forest
- feature extractor
How to Cite
Noppon Lertchuwongsa and Komsan Kanjanasit, "A Novel Trans-Dataset Ensemble Architecture for Sign Language Recognition," Journal of Advances in Information Technology, vol. 15, no. 12, pp. 1315-1328, 2024. https://doi.org/10.12720/jait.15.12.1315-1328
Copyright & License
Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).






