JAIT 2024 Vol.15(12): 1315-1328
doi: 10.12720/jait.15.12.1315-1328

A Novel Trans-Dataset Ensemble Architecture for Sign Language Recognition

Noppon Lertchuwongsa* , Komsan Kanjanasit*

  • College of Computing, Prince of Songkla University, Phuket, Thailand

* Corresponding author

  • Manuscript receivedJune 3, 2024
  • revisedJuly 19, 2024
  • acceptedAugust 26, 2024
  • publishedDecember 6, 2024

Abstract

Sign Language Recognition (SLR) is used to communicate between deaf and normal people or among hearing-impaired communities. The rapid development of Artificial Intelligence technologies can be exploited as a medium to strengthen these connections. Many studies have been conducted to indicate their interest and usefulness. The differences between this study and previous research are as follows: first, increasing the noise robustness and noise robustness analysis because noise can always appear in real applications; Secondly, an architecture is proposed to extend the dataset without merging and retraining all datasets. Our study proposes using a Convolutional Neural Network (CNN) as a feature extractor; different potential models are compared for the effectiveness and complement of feature extractors. Feature normalization was analyzed before being fed to the ensemble classifier. Moreover, our study compared Support Vector Machine (SVM), random forest, and bagging SVM as optimized candidates for the ensemble classifier. Our study shows that the proposed micro-block provides better accuracy than the reference SLRNet-8 model in dataset D1 with some noisy environments, and the proposed trans-dataset ensemble architecture is also better than applying the traditional transfer learning technique with reference SLRNet-8 model when validating with either dataset D1 or D2 in our setting environment.

Keywords

  • sign language
  • convolutional neural network
  • ensemble classifier
  • model fusion
  • random forest
  • feature extractor
JAIT-V15N12-1315

How to Cite

Copied

Noppon Lertchuwongsa and Komsan Kanjanasit, "A Novel Trans-Dataset Ensemble Architecture for Sign Language Recognition," Journal of Advances in Information Technology, vol. 15, no. 12, pp. 1315-1328, 2024. https://doi.org/10.12720/jait.15.12.1315-1328

Copyright & License

Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Article Metrics in Dimensions