Abstract—Depression is a chronic mental health disorder characterized by psychological, physical, and social impairments, often resulting in diminished interest in daily activities and, in severe cases, suicidal ideation. Recent physiological studies have revealed measurable differences in vocal attributes between depressed and non-depressed individuals, motivating the use of speech signal analysis for automatic depression detection. However, conventional approaches relying on Mel-frequency or Fourier-based spectrograms often fail to capture discriminative features for effective emotional classification. To address this limitation, this study proposes an optimized deep learning framework, Adaptive Multi-scale Fused Feature-based Deep Network (AMF2-DNet) for both depression detection and severity assessment. Speech signals from the Distress Analysis Interview Corpus with Wizard-of-Oz (DAIC-WOZ) benchmark dataset undergo noise reduction and normalization, followed by feature extraction, including Mel-Frequency Cepstral Coefficients (MFCCs), spectral features, and deep features learned through a Sparse Autoencoder (SAE). These multimodal features are integrated within a residual Bidirectional Recurrent Neural Network (Bi-RNN) architecture enhanced with a novel loss function for improved convergence. Further, the Refined Attacking Strategy of Giant Armadillo Optimization (RASGAO) dynamically optimizes network parameters and scale weights. Experimental results demonstrate that AMF2-DNet achieves 94.88% accuracy, an F1-Score of 84.50%, and a Mathews Correlation Coefficient (MCC) of 0.82, surpassing state-of-the-art baselines by up to 7.44% in accuracy. The proposed framework also exhibits strong robustness across noise levels and speaker variability. Future work will focus on real-time deployment using lightweight architectures, cross-lingual validation, and multimodal fusion with facial and physiological cues for enhanced clinical applicability.
 
Keywords—feature extraction, speech recognition, speech analysis, recurrent neural network, affective computing


Copyright © 2025 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).